Find Jobs
Hire Freelancers

Scrapping project

$250-750 USD

Closed
Posted about 5 years ago

$250-750 USD

Paid on delivery
Hello, I need to scrape data from 70-80 websites which provides the same type of data about the same products. Targeted data types are – links, text and numeric. After scraping I need to rearrange, sorting and recalculate all data before a show to my website. Targeted websites add/change/update their data around 1-2 times per hour. So, I need those scrapers run/scrape automatically 1-2 times per hour. Similar data found on multiple sites should be overwritten/skip/updated while scraping. Similar numeric data should be overwritten/skip/updated or replaced by higher/lower value while scraping. Some data should be overwritten/skip/updated by early/latest date and time. There are some custom calculators are present on targeted websites. If those calculators can’t be scraped then those calculators have to be built with collected numeric data. An admin panel needs to add/modify/delete data manually. Need to start/stop scrapers manually. Need to show the scraping reports. Need to control/modify banners on the website. If you are only expert in scraping/programming, but not in website design/building you’re also welcome to bid in this project. I need a website designed to show all these scraped data. The design of my website has to be very different than the targeted websites. Need clean and SEO friendly codes/links with full on-page SEO. Need to add payment API integrated to my website. Need some banners spaces on website and banners should be added to the website automatically after payment is done. Payment system: Payments will be made by 2 parts. I’ll create a milestone for scraping jobs. I have a simple website where you can show or test the outputs. Or you can build a simple website to test/show the scraped data. Once the scraping/arranging/sorting/calculations are done successfully, I’ll create another milestone for the website design/functions. Both milestones will be released after scraping and the website has done. No milestones will be released until the work is 100% complete. I’ll take 24-72 hours to check everything carefully and the milestone will be released then. ** MOST IMPORTANT: You must have to complete the project on the timeframe which will be discussed before awarding the project to you. Once the timeframe is over, the contract may get canceled and milestone payments will be canceled without any notice. Thank you for reading the full details.
Project ID: 18899999

About the project

20 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
20 freelancers are bidding on average $418 USD for this job
User Avatar
I'm a professional engineer with vast experience in IoT, sensors, and software architectures. My background is aerospace engineering with a focus on Systems engineering and I'm a very skilled PCB designer and Firmware/Front-end/Back-end programmer. I've already worked on many different scrapping projects. Send me a message to further discuss the details of this project. Best regards, Juan
$277 USD in 10 days
5.0 (18 reviews)
6.4
6.4
User Avatar
Greetings, I am an experienced scrapper and have done similar projects in the past. Same can be verified by my profile. Let me allow to assist you. Thanks
$500 USD in 15 days
4.8 (67 reviews)
6.2
6.2
User Avatar
I HAVE TOP SKILLS AS YOU CAN SEE MY PROFILE, I'M READY TO START RIGHT NOW. I have read your job description pretty carefully and I am sure that I can do your job. I promise the high-quality code and deliver it in time. Your job seems to be posted only for me not for the others, because you are looking for only an expert just like me. I’m a developer who is specialized in scrapping and python for +6 years so I know it as I do know myself. At least in this field, I have a confident that nobody is superior to me. I can help you complete this job as you want. I have done this kind of work so many times so I know how to complete this job and make you fully happy with my quality works. I can start working right now. I hope to work with you. Thanks.
$555 USD in 10 days
5.0 (24 reviews)
5.5
5.5
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,
$277 USD in 10 days
4.9 (102 reviews)
5.8
5.8
User Avatar
Hi There, I'm a 5-star web automation developer and a java expert. I have years of experience and have my own ways to compile database in least consumed time with highest accuracy. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Thanks, Nirmal Vidura
$400 USD in 5 days
5.0 (130 reviews)
5.5
5.5
User Avatar
I believe in providing good quality code and services with security. I am a Web Security Researcher & Bug Bounty Hunter at HackerOne, BugCrowd, BountyFactory and many other Independent Bug Bounty Programs Reported Security Vulnerabilities to Google, Facebook, Twitter, TCS, DigitalOcean, Magento, Nexmo and many other Companies Listed in more than 30 Company's Hall of Fame for reporting Security Vulnerabilities and reported more than 200 Security Vulnerabilities Web Security : OWASP, BurpSuite, Kali Linux, BugCrowd VRT, MetaSploit + HTML5, CSS3 + jQuery, Javascript, Ajax + Angular JS, React JS + Website design + Bootstrap, Responsive design + PHP + ColdFusion + MYSQL + Magento + Joomla + Laravel + Wordpress + Dot Net + CodeIgniter Development + User Interface / IA, Graphic Design, Logo design + PSD to HTML + Web Security + Penetration Testing + Ethical Hacking + Linux : CentOS, RedHat, Ubuntu + Windows Server + Vulnerability Assessment
$250 USD in 1 day
5.0 (94 reviews)
5.3
5.3
User Avatar
Hi there, I have a Team. I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. Thank you. Please Check my mastery work at:- https://www.freelancer.in/u/Stephenrajs *Why you are choose me 1. 24/7 hours support 2. Quick response 3. Deliver on time 4. Smooth communication. I assure that I can satisfy you completely and want to have a long term relationship with you.. Best Regards Stephenrajs
$450 USD in 10 days
4.8 (111 reviews)
5.5
5.5
User Avatar
hi there, able to data scrape from website with expectation . ready start right now. waiting for your replay. thank you, shafayat
$333 USD in 10 days
5.0 (3 reviews)
3.3
3.3
User Avatar
Well i have 4 years of experience as a programmer Having experience on python Modules like scrapy pandas etc
$250 USD in 1 day
5.0 (3 reviews)
2.7
2.7
User Avatar
Scraping data from websites is more an effort in content management than in the actual scraping. A developer will begin creating their scraping tool by looking for patterns in the website's code, then they will create a back-end database for managing the scraped content, looking for duplicates and updates to resources that were previously scraped. Part of what I will create is not only the scraping tool, but automatic management of the content that is scraped with debugging available when an event occurs that the scraping tool can't handle without user intervention or that would best be handled with user intervention via a simple yes or no scenario. Any service I provide is backed by ongoing support after the project has ended free of charge for up to 3 months. Websites can break or undergo massive changes after tools are created to scrape, have peace in mind knowing if they occur in the first 90 days you can have my scraper updated free of charge.
$500 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Although we are new freelancer but we have worked on many projects and completed successfully. Relevant Skills and Experience We are experienced software developer and worked on many architecture's like caching,data warehouse,data lake, Authentication and Authorization, microservices etc.
$388 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of BANGLADESH
Dhaka, Bangladesh
5.0
146
Payment method verified
Member since Feb 20, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.