Find Jobs
Hire Freelancers

Python Developer Needed to Scrape Data from a Website

$30-250 USD

Closed
Posted almost 4 years ago

$30-250 USD

Paid on delivery
We are looking for an experienced Python developer for web scraping. The development environment is CentOS / Linux and the database is PostgreSQL. The job entails the following: Scraping data from website; inserting data into PostgreSQL database; writing an updating script that grabs periodic updates from the source; writing an export tool to export data from the database to a CSV file; testing, documenting, and deploying the solution to production. You'll use Sphinx to generate documentation and use our internal Git server for version control. The code should perform three main functions: 1) fetch entire data history and populate PostgreSQL database with entire history data and any relevant metadata; 2) perform ongoing updates to the database as new data are released by the source; 3) exporting data from PostgreSQL database to an CSV file in the desired format. We will QA the CSV file using our in-house tools to verify data have been gathered correctly. The ideal candidate will have: Expert-level experience with Python Expert level experience with SQL databases Experience with git If you find this opportunity intriguing and interesting, please send us your answers to the following questions: Which types of data have you scraped in the past? How many years of experience do you have with webscraping? How many years of experience do you have with SQL databases? Which text editor or IDE do you use for coding? If this job goes well, we will have several other jobs for you. We are ideally looking for someone we can work with long-term.
Project ID: 25792582

About the project

16 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
16 freelancers are bidding on average $195 USD for this job
User Avatar
Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. How many results/urls are there? 5. What is the website? Let's get in touch and we can provide a sample. Thx, waiting for these details and hope to collaborate.
$140 USD in 4 days
5.0 (147 reviews)
7.7
7.7
User Avatar
Hi! I'm Python script developer that can retrieve data & do tasks with AUTOMATION.100% ACCURATE! *Can you tell me the website URL? i would like to do some test on it first. Let's discuss more details :) # answering your questions: 1.6 Years 2.6 Years 3. i use sublime text, notepad++ , IDLE. Thank you and i'm looking forward to working with you! Best Regards, VincentOng07 ** 5 Stars rating & 100% Project Completion **
$90 USD in 2 days
5.0 (114 reviews)
6.4
6.4
User Avatar
Hello, my name is Puru. I am from India. I have 6+ years experience in providing integrated development solutions including web-dev, web automation and web-based applications with industry-grade expertise in web scraping and data mining using latest technologies. I have done 50+ scraping projects, including eCommerce sites, automobiles, Facebook, Twitter etc, with more than 6+ years of experience with scraping and SQL database. Text Editor used is VSCode. Prior to bidding, I have carefully read the details of your "Python Developer Needed to Scrape Data from a Website" project, and its requirements. I understand your needs and am ready to discuss and provide suggestions before we initiate the project. I am goal-oriented and focused on customer satisfaction. To understand the quality of my business, have a look at my profile and 5-star reviews. If you want to continue working with trusted partner, send me a message. My priority is to meet the needs of my clients, and provide support and long-term relationships for future endeavours. Best, Puru
$350 USD in 7 days
5.0 (27 reviews)
5.6
5.6
User Avatar
dear sir I am python expert work on many packages like numpy, scipy, pandas and web frameworks like flask I have 6+ years of experience in python , Postsql etc a) Data Scientist b) Development of machine Learning Algorithms c) Sentimental Analytics of social media d) web api using Django e) Exposure on more than 3000 packages of python I myself is Developer with expert team of data scientist please initiate further for better understanding and technical discussion
$556 USD in 10 days
5.0 (36 reviews)
4.9
4.9
User Avatar
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! -- Which types of data have you scraped in the past? R: I have created scraping programs to extract data from websites like: Amazon, eBay, Instagram, Facebook, Yelp, Groupon and many more. -- How many years of experience do you have with webscraping? R: I have 2 year of experience doing web scraping and web automation. -- How many years of experience do you have with SQL databases? R: The same amount of time. -- Which text editor or IDE do you use for coding? R: I mainly use Visual Studio Code and PyCharm I hope to work with you!
$220 USD in 7 days
5.0 (6 reviews)
4.2
4.2
User Avatar
I would be a perfect fit for your task as it requires my experience and qualifications to differentiate between exceptional and ordinary work Waiting for your positive response. Thanks
$140 USD in 7 days
1.8 (4 reviews)
1.3
1.3
User Avatar
Dear Client, I am interested in working for this task. I have an experience of working for more than 6 yearas in Python and I am an expert in webscraping and MySQL. I have worked on more than 100+ successful scraping projects in Upwork. Looking forward to hear from you. With Regards Anand
$200 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I will do it within hours, I already scrape large amounts of datasets those are running on daily bases. also I have completed API's in terms of different language like : Russian, Chinese and many more. I am new at this platform. so please don't mind and i will give my best. thanks cheers
$222 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have done project in data extraction using python to fetch stock data and save to cloud for analytics to create predictive charts and forecasting Relevant Skills and Experience Data extraction using python and store to cosmo db or pandas data structure
$156 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello! I am a creative, proficient and experienced programmer is at your disposal. I have been worked as a web developer for 6 years. I'm extremely reliable and will always deliver quality work on-time and at a reasonable rate. You can expect good communication from me, because I work as full-time freelancer at home and my phone is always on my hand. Language: C++, C#, Java, Swift... Cross Platform: React Native, Ionic | Backend: PHP, Laravel, Node.js, RoR, Django Frontend: React, Redux Angular, Vue, Bootstrap, Material Database: MySQL, PostgreSQL, MongoDB What you’ll get: On-Time Delivery 100% full custom design 100% satisfaction. Please feel free to shoot me a message Best Regards.
$30 USD in 1 day
0.0 (0 reviews)
1.8
1.8
User Avatar
I am a beginner in freelancing. I can complete your project on time and within your budget. I would love to work on your project. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well.
$60 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi! I'm IT specialist with 10+ year expierence in web, mostly for projects use python, php, node.js for frontends I use react.js or vue.js, depends on requirements. I havee 4 projecta where I use scraping, but mostly information I got from google and youtube and from e commerce sites. The Idle I use depends from language, for python I use Pycharm or VS Code, and for others I use VSCode or Webstorm. Have expierency with automation, graphical apps and comand line tools.
$278 USD in 7 days
0.0 (0 reviews)
2.8
2.8
User Avatar
I have more thanks 10years working with Technology Consulting and experience with React, Python selenium. Please let me know if you need more information.
$222 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Client, I am a python developer who has experience in web scraping. I am currently using git, postgreSQL, docker technologies and django, pandas, numpy , scrapy, selenium, beautifulsoup frameworks and packages in python. I have made scraping on online shopping websites like amazon, aliexpress, sahibinden, hepsiburada etc. I have two years experience on web scraping with python packages. I have 5 years experience on SQL databases. I am currently using vim editor for my coding. I am available to work for long-term. Kind regards.
$100 USD in 7 days
0.0 (1 review)
0.0
0.0

About the client

Flag of UNITED STATES
Santa Clara, United States
0.0
0
Member since May 30, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.