Find Jobs
Hire Freelancers

Collect data / crawl webpages / scrape web data

$250-750 USD

Completed
Posted about 5 years ago

$250-750 USD

Paid on delivery
Collect daily car ad data from the following web pages: [login to view URL] [login to view URL] and store the initial data and any change (for instance price change, km change) on a Postgre database. The script should be developed with Python and should not be blocked by the website due to too frequent queries. The information for each car should be stored in a tabular form on Postgre. When the ad is not available anymore, it should be stored with a closing entry as well. The main goal of this project is to track how long a car ad is posted and how frequently the price and mileage changes until the car is sold.
Project ID: 18539148

About the project

33 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, I am interested in your project related to build a scraper to pull ads data from [login to view URL] and autoscout24.ch. I checked both websites, autoscout24 has at the moment 147 240 ads and [login to view URL] has 9960 ads. I will build the scraper in Python using multi-threading and with proxies rotation so it will be very fast and never get blocked. The scraper will be schduled to be run on a daily basis and the data will be put to PostgreSQL. Please send me a message so that we can discuss all the details. Thanks, Ramzi
$500 USD in 7 days
5.0 (496 reviews)
8.4
8.4
33 freelancers are bidding on average $478 USD for this job
User Avatar
Hi I know you need in python. But let me know if you can accept the tool to be done in C# and run in windows and save data in mysql Can work on a demo Thanks
$500 USD in 5 days
5.0 (115 reviews)
7.6
7.6
User Avatar
I checked both sites and I can provide you fast and effective Python (Scrapy) spiders that will check all ads and save information into PostgreSQL database just like you want. My script will check any mileage or price change and update database record. Also if will change Ad status to closed if original ad is no longer active. I have worked on similar projects many times before (see my reviews) that's why I'm sure you'll be impressed with my work.
$500 USD in 3 days
4.9 (431 reviews)
7.6
7.6
User Avatar
Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about this project? Thanks, Lin
$400 USD in 6 days
5.0 (330 reviews)
7.7
7.7
User Avatar
Hello, I'd be glad to develop a python tools that scraps and analyses data related to car selling ads . Looking forward to chat with you soon for more details. Best regards,
$277 USD in 3 days
5.0 (167 reviews)
7.3
7.3
User Avatar
Hi there, I can collect daily car ad data from the following web pages. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir
$250 USD in 10 days
4.9 (207 reviews)
7.6
7.6
User Avatar
Hello, Dear How are you? I am very interested in your project and am ready for discussing with you about project for now. I have experienced in developing Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping. I will work very hard and best for you. Best Regards
$400 USD in 10 days
5.0 (54 reviews)
7.1
7.1
User Avatar
Dear Hiring Manager, You may see my profile here: https://www.freelancer.com/u/motiur03.html I am writing in response to your advertisement for scraping vehicle website, I have prior experience in similar job. I have extensive knowledge of using MS programs such as Spreadsheets, PowerPoint, Excel, data scraping and Word along with a number of other software and programs. I also possess extensive knowledge of database programs. Sincerely, Motiur03
$250 USD in 5 days
4.8 (138 reviews)
6.9
6.9
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$500 USD in 10 days
5.0 (60 reviews)
6.6
6.6
User Avatar
Hi there, I have checked the details I have rich experienced with Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping. Please initiate chat so we can discuss this job.
$555 USD in 10 days
5.0 (8 reviews)
6.1
6.1
User Avatar
can develop script in Python. can think it on daily basis and update the postgres database. want to know more about ad These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.
$555 USD in 10 days
4.9 (55 reviews)
6.1
6.1
User Avatar
Greetings, I have read your requirements and interested to complete this project. As i have done several projects before and same can be verified by my profile. It's my routine job to scrape. Looking forward to hear from you.
$333 USD in 5 days
4.8 (65 reviews)
6.2
6.2
User Avatar
I'm a web scraping and bot developer with 5 years experiences. I developed many bots using selenium technology. Selenium is automation test tool and it uses chrome web driver to automate the chrome browser action. I have also experienced bot detection script to stop automatic action. But I have passed them successfully and It will be challenging part in automatic web scarping. - Web Scraping & Automation Software ˃ Node.js, Django, Flask, CodeIgniter ˃ .Net, Qt ˃ BeautifulSoup, lxml, selenium, greasemonkey, chromium driver Let's have a interview to discuss in detail. Regards, ChunYan.Y.
$555 USD in 10 days
5.0 (5 reviews)
5.6
5.6
User Avatar
Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon. Best Regards,
$499 USD in 5 days
5.0 (49 reviews)
5.7
5.7
User Avatar
Hi there, I can help you complete this project. I will be looking forward to hear from you. Please contact me on PM for details.
$250 USD in 10 days
4.8 (43 reviews)
5.6
5.6
User Avatar
Hello? How are you? I have good experiences in "Collect data / crawl webpages / scrape web data" as you can see my profile for these (Data Mining, PostgreSQL, Python, Web Crawling, Web Scraping). I have been working for 7 yrs in this scope. While we contract and work in our jobs, I will get paid once you have confirmed satisfied result. If I do not deliver satisfied result, I will never get paid from you. We can discuss more details to understand more easily if you have other infos. Hope to work with you. Thank you.
$555 USD in 3 days
4.9 (34 reviews)
5.3
5.3
User Avatar
Sir, I am well versed in these kind of jobs and can do your project as per requirement. ***I am ready to start Waiting to hear from you. with thanks and regards Relevant Skills and Experience Web scrapping, excel
$555 USD in 7 days
4.9 (29 reviews)
5.3
5.3
User Avatar
Hello, Full Stack Scraping Expert development team is ready to serve you. We can build an online scraper and admin panel to manage the data. We are working on hourly rate 35usd/h Please check my profile and message me for more details
$555 USD in 10 days
5.0 (12 reviews)
4.5
4.5
User Avatar
Hi, I'm a System Engineer with coding skills. I had developed tons of scrapers and crawlers. I can help. Regards.
$555 USD in 10 days
5.0 (12 reviews)
4.5
4.5
User Avatar
hi, I am a professional web scraper, with experience of 4 years. I can scrape any site with antibot detection using proxies., I check this site also. looks easy I can do it
$455 USD in 6 days
4.9 (15 reviews)
4.3
4.3
User Avatar
Hi I have read your description in more details and have interested in your project. I am a star in this field and can do it ahead of schedule perfectly. I would like to have a discussion with chat to get more about your project.
$600 USD in 20 days
5.0 (4 reviews)
2.7
2.7

About the client

Flag of SWITZERLAND
Zürich, Switzerland
0.0
0
Payment method verified
Member since Jan 5, 2018

Client Verification

Other jobs from this client

Build me a d3 dashboard
€30-250 EUR
Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.