Find Jobs
Hire Freelancers

a web crawler for data collection

$30-250 USD

Closed
Posted over 6 years ago

$30-250 USD

Paid on delivery
1. Get full list of companies from data sources like Glassdoor, or Linkedin 2. Crawl the products page from each of the companies, if the page exists 3. Process the crawled data 4. Save the crawled data into a NoSql database, like MongoDB 5. Must be multi-processing, efficient and effective 6. Easy to stop and start to run 7. Can be written in Java or Python. Only these two languages allowed. 8. Able to use proxy IPs to prevent blocking
Project ID: 14939218

About the project

20 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
20 freelancers are bidding on average $192 USD for this job
User Avatar
Already designed and developed webcrawler . Contact me I am interested. Relevant Skills and Experience EXPERT Proposed Milestones $500 USD - Default
$500 USD in 3 days
5.0 (126 reviews)
7.3
7.3
User Avatar
A proposal has not yet been provided
$155 USD in 3 days
5.0 (32 reviews)
6.9
6.9
User Avatar
I'm a professional Python developer. Also I have a lot of experience in web scraping. I read the description and it looks pretty straight forward. please contact me to discuss more. Relevant Skills and Experience Python selenium Scraping Proposed Milestones $140 USD - final
$140 USD in 5 days
5.0 (47 reviews)
5.9
5.9
User Avatar
Hi, I am FURKAN a CERTIFIED Java, NoSQL Couch & Mongo, Parallel Processing, Python, Web Crawling, WEB SCRAPPING EXPERT . I would love to provide you Quality data by getting a list of companies from LinkedIn and then crawl the products page from each of the companies and then Save the crawled data into a NoSql database as per your requirements. I can complete your project with perfection, in time, and will charge you a reasonable PRICE. I have 5+ experience in Java, NoSQL Couch & Mongo, Parallel Processing, Python, Web Crawling, Website Scraping, Screen Scraping, Internet Research. I can do scarping using any language like Python,PHP,JAVA etc. You can go through my Portfolio and can check my reviews and my ratings that i have ALREADY successfully completed such projects in the past with 100% customer Satisfaction, so it my pleasure to work on your project. I think i am the Right person who can take responsibility for you project and can complete it according to your REQUIREMENTS , As i got all the skills that you need for this project. You can Test the Quality of my work if needed, and provided that i can also show you my SAMPLE works. I do bidding on your project with the hope that you will hire me so that we can work together for a long time. Waiting for your positive response. Regards... Furkan wani
$30 USD in 1 day
4.6 (33 reviews)
5.7
5.7
User Avatar
Hi, I read your requirement and understand it very well. I am able to do it. I am scraping data by using tools which are developed by using "Java Technology". Relevant Skills and Experience Experience: I have completed below "Web Scraping" project, extracted 70000 data. 1. Web crawling around 25000 data. 2. Scrape retail locations from 4 websites around 25000 data And more.... Proposed Milestones $250 USD - Fix Price Full requirement of the project.
$250 USD in 3 days
5.0 (3 reviews)
4.9
4.9
User Avatar
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction. Relevant Skills and Experience I usually finish projects with ease on which other freelancers have already given up. I learn and understand new stuff very fast and finish the job with top quality and reliability. Proposed Milestones $155 USD - test
$155 USD in 3 days
4.0 (24 reviews)
5.6
5.6
User Avatar
To work as soon as proposal accepted. Relevant Skills and Experience I have done a web crawler for Amazon products and stored in a database.
$111 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$99 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
i have been developing java projects since 2008. i already implemented a java project that retrieves live twitter data(similar to getting data from linkedin api) Relevant Skills and Experience Java Proposed Milestones $144 USD - getting data from linkedin $300 USD - crawling company pages
$444 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey there , off topic , are you I tested I a full USA business database (updated ) includes emails phone numbers location names and more ..
$111 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
I’m a Data Analyst at Dafiti.com.br. I currently build statistical model to improve the sales performance and predict sales using Python, Machine Learning and other Data Science Tools. Relevant Skills and Experience 3+ years experience with Python, Data Science, R, Sql, Excel Proposed Milestones $83 USD - Develop the required script
$83 USD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello , this project is quite interesting me , i have a lot of experience in the web development, i would like to make a python app for your need. Can we chat a bit before? Relevant Skills and Experience Web engineer for more than 10 years, working with mongo db for some times now and developing in python. Proposed Milestones $166 USD - the whole project Can you be more specific when you mean the products page?
$166 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$93 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Herndon, United States
5.0
27
Payment method verified
Member since Jul 7, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.