Find Jobs
Hire Freelancers

Website Crawler– PJ-160621

$30-250 USD

Completed
Posted almost 8 years ago

$30-250 USD

Paid on delivery
Description: We need someone to program a crawler for us. The crawler is required to fetch data from one website as our demand. The crawler should be written by JAVA or Python. Besides, the fetched data ought to be accurate. He/She should give us the data due to the deadline which both of us agree. The data should be able to be imported into MongoDB, so he/she could offer us the .bson format. Requirement: ·The crawler should fetch the data in same structural places of the webpages according to our requirements. We will mark these positions and send him/her pictures about it. ·We will give him/her “Key” names, and he/she should put the fetched data as “Value” into the relevant Keys. He/she should set the “Key:Value” structure strictly to meet our demands. ·He/she should give us the initial data fetched by the crawler for us to inspect. The data should be saved as .bson format and can be imported into MongoDB. ·The repeated data of the same webpage in the result he/she give us are not allowed to appear twice. So duplication removal is necessary. ·The integrity of the fetched data should be more than 99%. It means that within 100 fetched contents 99 contents should be correct and complete. We will reveal more details when we have established the cooperation officially.
Project ID: 10822514

About the project

24 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello, i can offer application written in Java using Spring Framework and corresponding frameworks for HTML processing (like JSOUP). Application will feature multi-threading execution and asynchronous local database processing. Application may feature GUI or use Console interface. Application may be run on server (vps) as web application or localy on any platform/os. Application will feature everything thats in requirements. Source code with comments will be provided via GIT, aswell as documentation on major methods and getting started guide how to setup and run application. Contact me for more details.
$80 USD in 5 days
5.0 (16 reviews)
5.1
5.1
24 freelancers are bidding on average $133 USD for this job
User Avatar
Hi there. I would be glad to help you out with this project. I am a professional web scraper, with experience creating easy to use scripts to scrape data periodically. I can write a python scripts able to do the extractions as per your requirements. I would like to take a look at the website form where the data will be extracted in order to let you know my approach. Thanks, Daniel
$250 USD in 3 days
5.0 (113 reviews)
8.7
8.7
User Avatar
Hi there, I have read the project & would like to discuss.. I have good web scraping reviews & can make web scraping scripts in Python.. Hope to hear from you..
$100 USD in 1 day
5.0 (348 reviews)
7.5
7.5
User Avatar
TOP RANKED Programmer here. Worked on crawlers before in Java. I can do this project.
$222 USD in 10 days
4.8 (443 reviews)
7.5
7.5
User Avatar
Hello, I have 100% completion rate and I am expert in web scraping as I have written over 2000 site scrapers in my career. Contact me if you are interested so we can start working on your project. Check my profile to see that people who worked with me are extremely satisfied with my results and speed. Best regards, Dusan
$200 USD in 5 days
5.0 (188 reviews)
7.4
7.4
User Avatar
I am new to freelancer.com and hence bidding very less to build reputation. This wont take a lot of time or efforts and you should not pay a lot for this simple task. Search for me online to see my open source experience.
$30 USD in 3 days
5.0 (33 reviews)
5.4
5.4
User Avatar
Hello Employer, I am interested in this project. I have the relevant experience and can finish your work with 100% accuracy and on time. Please message me to discuss further. Thanks, Ankur
$155 USD in 3 days
5.0 (19 reviews)
3.7
3.7
User Avatar
Hello, My name is Irshad, I am expert in python language, I have 5 years+ experience in python language and I am certified python expert. i have completed 100+ projects using python , i am good in scraping ,data mining ,data crawling ,so i ensure best crawler in python Expertise : Python, Django, Django-Rest-Framework and many python packages. My key Skills are: Python, AngularJS, Scala, JavaScript, Go, PHP, SQL, HTML, Jython, Perl, CSS. Platforms:Linux, Amazon Web Services (AWS), Google App Engine, Windows, Mac OS X I have completed more than 100+ projects in Python programming. You can test the quality of my work if needed. Thanks.
$120 USD in 5 days
2.8 (4 reviews)
2.6
2.6
User Avatar
The task is well described, and there is nothing to add in that regard. In order to be able to provide you with correct deadline and price I need to know the address of the site and data which is to be scraped from that site. This is needed because the feasibility of this process depends on site's architecture and (possible) anti-bot measures. Kind Regards
$222 USD in 2 days
5.0 (1 review)
0.4
0.4
User Avatar
 ..........if we fail to deliver quality results......we will refund the full amount without asking a single sentence . We always work for client satisfaction with 24x7 support. Try our services we will make you feel happy :)
$166 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have been very committed for all the tasks that I have done. I also have done similar kindof project so I feel I can do this project in better way.
$45 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, We reviewed your job description and we are interested to assist you in developing this scrapper and we will be using Python for this crawler. We will be looking forward to get some more details from you so that we can have a plan to implement this scrapper according to your requirements. We have completed projects of .NET on freelancer and you can see out profile and the feedback clients have given us, this shows our dedication towards the work. Looking forward to work with you. Thanks
$160 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am an expert in Java. I am really interested in this project because I have worked on a web crawler. Do you need any GUI for this? Send me the positions from which I need to parse data. Waiting for your response. Thank you.
$100 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have 2 years in crawler data from Facebook and other website using java. I just need 1 day to finish this requirement
$55 USD in 1 day
0.0 (0 reviews)
0.6
0.6
User Avatar
I can do this very well. I do my work with 100% accuracy. Please read Reviews of my previous clients. ... I am a full time freelancer and have no other job of any kind. I really want to build a serious career on this platform and its my start here so I can work for you upto 16 hours a day & 7 days a week, plus I have 24 hours electricity backup and a reliable fast internet connection. I have done Masters in Information Technology and a specialization in Web Design and Development. There is no issue of money as well you can pay little amount or can pay later if you have financial issue currently. Just Rate my work and give a Honest Review and it will be enough. +I have pretty good mastery in Excel and MS Word +Data Entry and Data Processing +Specialized in Web Scraping and Internet Research +Expert in Copy Typing, PDF/Image to Text +Contact Searching(Company Info, CEO/Management, Email, Phone Number etc) +Lead Generation ***Pay ONLY IF you are 100% Completely Satisfied with work done. If you are not satisfied do not pay at all. Thanks for reading my proposal. Regards, Mubbarik Ali ________________ Recent Reviews of My Clients: “Very quick and accurate work, I was very happy with it :)” -Aidamediagroup (UK) Rating: 5/5 “Very professional Good Communication, timely delivery, quality work” -srayancejain from (US) Rating: 5/5 “mubbarikali was fantastic. He came through again on a quick timeline and continued to work making my document better.” -lou0187 (US) Rating: 5/5
$30 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I'm familiar with the Apache Nutch, which is a java based web crawler. if you would like to work with me, please let me know more detail about the project.
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Self-directed and motivated technical project leader with twenty years' experience in Java/J2EE, smartphone and PHP technologies. Excellent at developing and maintaining client/server applications. I am hardworking and a fast learner with good communication skills and a strong design background.
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CHINA
上海, China
5.0
45
Payment method verified
Member since Dec 9, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.