Find Jobs
Hire Freelancers

Need a scraping expert to fix 429 too many request error. -- 2

$30-250 USD

Closed
Posted over 3 years ago

$30-250 USD

Paid on delivery
Hi, I want to scrape a site. But it shows "429 too many request error". Can you help me to avoid that error? Thank you.
Project ID: 27874134

About the project

29 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
29 freelancers are bidding on average $118 USD for this job
User Avatar
Hi there! I read your project of Need a scraping expert to fix 429 too many request error. -- 2 I am in top freelancers and can do this in professional way! I will use PHP Web Scraping Software Architecture MySQL Data Mining WAITING FOR YOU IN CHAT BOX Best: AQEEL
$140 USD in 7 days
4.9 (165 reviews)
7.5
7.5
User Avatar
Hi, I am professional Python script developer, I can avoid 429 error by python within very short time. Thanks
$240 USD in 3 days
4.9 (140 reviews)
7.2
7.2
User Avatar
This is because you visit the website too fast, so you can use: 1, proxy to avoid this 2, slow down the speed. 3, detect 429 error, then sleep a long time (such as 5 minutes), try again. Do you have proxy? What operating system do you use? what programming language do you use? Let's talk. Thank you very much.
$50 USD in 1 day
5.0 (65 reviews)
6.9
6.9
User Avatar
Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered results as per your requirement, In the format you want. You can also ask for data into a particular format - Excel, Json, Mysql, Databases, XMLs, you name them. Further Can help you with integrating it with ur databases, Can create json outputs. We are not only good with scraping but also with the tools that u may need after that. We can help you build you softwares round the data we have 99% Data Accuracy. We have Duplicate finder. etc., We can help with Statistics on the data We can help with creating Api's front the data We can create Softwares to manage that data We can build Sites round the data
$244 USD in 1 day
5.0 (15 reviews)
6.5
6.5
User Avatar
Hi there, I see you need to find a Python programmer who has Data Crawling skill. You're facing problem that requesting too many data from a single IP. The solution for now is to use Proxy or VPN or something like that. I can help you to config that. Hope to see your response. Best regards, Nam
$250 USD in 1 day
5.0 (37 reviews)
6.2
6.2
User Avatar
“Share the website” I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. I will show you a sample first. I can work right away. Please message me. Thanks
$100 USD in 1 day
4.9 (106 reviews)
6.1
6.1
User Avatar
Hi. Some of my skills are: PHP, MySQl, jQuery / Prototype, Javascript, HTML, CSS. I want to do this project.
$30 USD in 1 day
4.9 (115 reviews)
5.7
5.7
User Avatar
Hello. I have experince in various web-scraping techniques. I think i may be help to you in this one. We may lower request frequency, or scrape in some other way, maybe direct API queries. Maybe we can use rotating headers technique etc. Cannot say much without first looking at project. Message if interested. Thanks.
$40 USD in 5 days
5.0 (78 reviews)
5.6
5.6
User Avatar
Hello You are making IG scraper? You should use proxy for avoiding it. Thanks
$250 USD in 1 day
5.0 (23 reviews)
5.0
5.0
User Avatar
Dear Employer, You have specified that you need a scraping expert to fix 429 too many request error. I'm a professional Web Scraper & Internet Researcher with 7+ years of experience. I can assure you that I will provide you high-quality data. I have worked on several similar projects and can deliver quality projects to tight deadlines. I can do this project very carefully within the provided time. I can manage 40+ hours a week for this job. Here is a sampling of the data entry projects I’ve completed: https://www.freelancer.com/projects/data-entry/Project-for-Abdul-26795214 https://www.freelancer.com/projects/data-entry/Build-list-blogs-26649667 https://www.freelancer.com/projects/web-scraping/need-professional-web-scraper-27100683 If you award me the project I'd be very happy to discuss this further and get started for you as soon as possible. Best regards @Servicehour24
$100 USD in 2 days
5.0 (9 reviews)
4.3
4.3
User Avatar
Hello! My name is George and I am an Engineer in Computer Science and a Full Stack Web Developer. That error appears when you try to access a URL resource too many from the same IP. The only solution for it is a rotating proxy system, which you can pay for it monthly. With respect, George.
$100 USD in 3 days
4.8 (8 reviews)
3.5
3.5
User Avatar
hi friend,iam a software developer by profession ,iam working as a python developer in a company, i can help u if u r interested we can discuss
$56 USD in 1 day
4.6 (7 reviews)
3.8
3.8
User Avatar
Hello, I can certainly scrap data from the website. I have 3+ years of experience in website scraping. I have done this work so many times for so many clients. I can scrap data from JD from the keywords you are given, send me a pm to discuss more details Please ping me a message for discussion. Regards Bharti
$140 USD in 7 days
5.0 (8 reviews)
3.1
3.1
User Avatar
Greetings, I think here you are looking for someone to scrape a site and help you to avoid the highlighted error. I understood your project description. I am an expert in PHP, Web Scraping, Software Architecture, MySQL, Data Mining and I am really interested in your project. I am really confident that, I can do this with 100% accuracy and ready to start now! But I want to know more about your project. So, can we discuss more? So, please take your time to discuss more on your project with me. Thank you.
$75 USD in 4 days
5.0 (3 reviews)
3.2
3.2
User Avatar
HI I am experienced in 0 newmessages PHP Web Scraping etc I can start right now but i have few doubts and questions lets have a quick chat and get it started waiting for your reply
$140 USD in 7 days
5.0 (3 reviews)
2.9
2.9
User Avatar
Hi, i'm Danilo! I have about 5 years of experience with Python, and in particular Data Science, Open Data, Big Data, Jupyter Notebook, Web/Data Scraping and Machine Learning. I'm also specialized in some Python's libraries, such as Pandas, NumPy, SciPy, Seaborn, Matplotlib, Selenium and others. I based my Bachelor thesis on AWS and Machine Learning, and i also created some maps based on Open Data on uMap. So, if you're interested, contact me!
$30 USD in 1 day
5.0 (3 reviews)
2.9
2.9
User Avatar
Hello, I can modify your script in a number of ways to avoid triggering that response from the target server. Send me the file over chat and I can give you a more accurate time/cost estimate for fixing this. Kind regards, Cinar Doruk
$50 USD in 4 days
5.0 (1 review)
2.1
2.1
User Avatar
Hi, manager! Nice to meet you. I hope you are safe without the effect of covid-19. As checking your job description, I have noticed I'm a good fit for your project from my skills and experience. 1. My scraping works and experience I have 7 years of experience in web scraping and scraped so many many websites(around 1500). Also, I have extracted the product data from shopping websites like Amazon, eBay, Aliexpress, Taobao, and I have extracted the data from social sites like Facebook, Linkedin, Twitter, etc. 2. My preferred scraping methods I make my own scraping tools with python. In order to make a python scraping tool, I use several Python scraping frameworks like Scrapy, selenium, and so on. And I use parse libraries like BeautifulSoup, lxml, regular expression, and so on.
$50 USD in 1 day
5.0 (2 reviews)
2.2
2.2
User Avatar
Hi, I have scrapped so many website in past Amazon (400 Pages) Google Images using Keywords (5000 images) US yellow pages (100 pages) Saudi Arabia ecommerce website etc (More than 20000 products)Centerpoint (Extract  More than 30000 products)Jarir(Extract  More than 30000 products)Kidzee((Extract  More than 30000 products)Khulud (Extract  More than 2000 products) Giordano (Extract  More than 2000 products)  I have Python experience with more than 4 years and written so many scripts using that 1) Web Scraping (Amazon, Facebook, Naukri, etc) using tool (SELENIUM and BEAUTIFUL SOUP)Already scrapped(Amazon, Facebook, Google Images,US Yellow Pages and many more) 2) Created running graphs using python 3) Data Transformation and Data Processing 4) Stack creation using python 5) JSON Transformation using python 6) Video editing using python 7) REST API Using Python 8) ML models using python 9)  Using Pyspark Library running Dataproc Jobs in GCP 10) Automate scripting using python 11) Graphical Dashboard creation Tableau and Google Data Studio and many more 12) Management code in  GITHUB 13) Applied FUZZY WUZZY Logic to compare the similarity of two texts Hope you will give me a chance to express my talent on your project using python.
$140 USD in 7 days
5.0 (3 reviews)
1.9
1.9
User Avatar
.. Hi, I have read your project description and I’m confident I can do this project for you perfectly. I only bid on jobs. I am 100% confident I can complete on time& on budget. Please leave a message on my chat so we can discuss the budget and deadline of the project. I am very prompt in communication and always prefer to discuss the project on call/chat and finalized the cost of the project. I believe giving suggestions and asking question to deliver stable & quality final product. I am very interested to work with you. Please let us know when we can start the project Thanks
$30 USD in 2 days
0.0 (1 review)
0.0
0.0

About the client

Flag of COLOMBIA
Cartagena, Colombia
5.0
6
Payment method verified
Member since Mar 20, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.