Find Jobs
Hire Freelancers

Fix and Scale Python/Django Instagram email scraper

$250-750 USD

Cancelled
Posted almost 5 years ago

$250-750 USD

Paid on delivery
PLEASE READ EVERYTHING BEFORE BID We have an Instagram bio email scraper ( Scrape Public Email address from Instagram user's bio ) This scraper worked fine for the past few months, but since we changed the server, currently the scraper function is not running. We need you to fix this issue. AND When we were running the scraper, we noticed if we try to run over 50-100 scraping tasks at one time, The Server CPU goes full and the website become slow, We need you to find a solution to run 1000s of scraping tasks without breaking the server, and find a way to scale the app even more ( You can use google firebase to save scraped emails, Or some other cloud solution like that too )
Project ID: 19645015

About the project

27 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
27 freelancers are bidding on average $459 USD for this job
User Avatar
Hi, it's not a problem for me to change your scraper so it will do millions of requests to instagram per day. as long as you have enough proxies.
$250 USD in 3 days
5.0 (337 reviews)
9.0
9.0
User Avatar
Hi. Let's get in touch and discuss more about it. Thx, waiting for these details and hope to collaborate.
$500 USD in 5 days
5.0 (135 reviews)
7.5
7.5
User Avatar
Hello sir I have rich experience of django and instgram bot. Also I am familiar with multi processing and suitable for this project. I am ready to start the work. Best Regards, Yongtao
$555 USD in 10 days
4.9 (129 reviews)
7.6
7.6
User Avatar
Hello. I am very interested to your project. I have a wealthy experience of Django and scraping. I can satisfy all your requirements. Please contact me and let discuss in detail. Thanks.
$500 USD in 7 days
5.0 (19 reviews)
7.0
7.0
User Avatar
Hi There, I can do it very quickly & effectively. I'm having more than 9 years of web development experience. Looking forward to work with you! Thanks!
$800 USD in 7 days
4.8 (133 reviews)
7.2
7.2
User Avatar
Hi, sir. I have looked carefully at your commentary. In my view, I think I am the right person for your project. Previously I had a similar project. I would like to have a more specific discussion on the project.
$555 USD in 10 days
4.9 (163 reviews)
7.1
7.1
User Avatar
Hi, I read your project requirement carefully and I understand your project but I want to ask a few questions before mover further so that I can deliver you exact work with one shoot. I always deliver quality with one shoot and you can check my profile and I had 6-year experience. Please come over chat for further detailed discussion to start working on it. Thanks
$500 USD in 7 days
4.7 (70 reviews)
7.1
7.1
User Avatar
Hi, there. I've read your project description carefully and I’m interested in your project. I have many good experiences in web and server technologies .Please send me your private message. Thanks
$555 USD in 3 days
4.9 (114 reviews)
6.3
6.3
User Avatar
Hello. I 'm expert in "Django, PHP, Python, Software Architecture, Web Scraping" and I have working for 7+ years in this field. I 'm very interest to your project. I have checked your project description carefully and i can do it. I 'll do my best till you satisfy if you want me. Contact me please. Thank you. Yang L.
$500 USD in 3 days
4.8 (172 reviews)
6.5
6.5
User Avatar
Hi, sir. am Gavrichkov. I have read carefully your requirements. I have the best skills and much experiences in building robotic process automation tools for scraping in Python. I have already completed so many projects so far. Now I have some tools which I have done so far and I am always in scraping as python. I am sure I can complete this project perfectly within 4 days. I have always good communication with you and can catch your project detail very quickly. If you award this project to me, then you will get a great result! Looking to be your Good Venture along with your project! Best Regards.
$400 USD in 4 days
4.9 (49 reviews)
6.0
6.0
User Avatar
can solve the Instagram scraper. want to see the code base. can scale up with use of task based solution using Python celery These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping
$666 USD in 5 days
4.9 (56 reviews)
6.1
6.1
User Avatar
Hi, I looked at your description carefully and I am very interested in providing my skills in hopes of working with you. I have ample experience in web scraping. -scrap any website using selenium, beautifulSoup, request and etc in python. -save data scraped into xlsx, csv, mysql and etc using xlsxwriter and csv. -create bots and website replica. I have just completed the same project. Please feel free to contact me if you have any further questions. I look forward to hearing back from you. Thank you!
$250 USD in 5 days
4.7 (47 reviews)
6.0
6.0
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. ,
$333 USD in 3 days
4.9 (100 reviews)
5.8
5.8
User Avatar
hi, how are you. surely can do this job. super easy! i am working as a senior web developer for 8 years. top knowledge of php, python is my key point. let's get in touch for more details. thanks a lot
$500 USD in 7 days
5.0 (36 reviews)
5.8
5.8
User Avatar
Hope you doing great. I have done the ACL and Role bases authorization in django. I am Full Stack Developer (Django + Python ) developer with 4.5+ years of experience. In past, I have done the same level of customization (Building selenium application using python ) for many of my clients. These are my tech stack: Python Angular HTML/Bootstrap/CSS/LESS/JS/Javascript Django Mezzanine Wagtail Django-CMS Backbone Odoo Flask Twisted Postgres Mysql PHP AWS/Ec2/ECS/Dynamo DB K8 Docker Drone Please connect with us and discuss the requirement in more details. Delivering product in time is our best character because we regard credit is the most important one for a man. Best regards
$361 USD in 10 days
4.7 (35 reviews)
5.7
5.7
User Avatar
Hi there! I have read what you exactly need, however I would like to ask you a few questions. I would call myself a master of what I do, I do work smart and do not rest until I get the job done. Please feel free to ping me anytime so we can have a detailed discussion
$377 USD in 10 days
5.0 (7 reviews)
5.1
5.1
User Avatar
Hi, How are you? I am interested in taking up your project. I can complete your project on time and within your budget. I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. I never give up, constantly learn, easy communication. I deliver fast, clean and quality work that meets your expectation and is well within your budget. Willing to work within specified deadlines and time. Thanks. Regards from A.G
$500 USD in 10 days
4.4 (39 reviews)
5.7
5.7
User Avatar
Hi i am expert python developer i have build different scrapping scripts with python i can make this task and deliver 1000 thread on the same time , waiting your response Regards
$666 USD in 10 days
4.9 (14 reviews)
5.3
5.3
User Avatar
hi there, i've read your requirements. Let me work on your Instagram bio email scraper and fix it to run properly on the new server. I analyze and enable it to run 1000s of scraping tasks without breaking the server. Ok, i will use google firebase to save scraped emails. I'm in web-development business for 10+yrs and have done many scraping work in the past. Looking forward to hear from you Thank you Max
$250 USD in 3 days
4.7 (18 reviews)
5.3
5.3
User Avatar
Hello, I read your job description and this issue might be related to the some data garbage collection from application. I need to analyze the project to find the exact root cause of the problem only then I can provide you the right solution to run 1000s of scraping tasks. It will be appreciable if you start the conversation and share the complete details so that I can check the code. Please feel free to ask if you have any queries or concerns. I am available to answer you. Looking forward for your positive response. Best Regards, Harshvir Singh
$600 USD in 10 days
4.6 (12 reviews)
4.8
4.8

About the client

Flag of SRI LANKA
Kandy, Sri Lanka
5.0
8
Payment method verified
Member since Aug 12, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.