Basic Webcrawler and API to make crawled information accesible
€30-250 EUR
In Progress
Posted over 6 years ago
€30-250 EUR
Paid on delivery
I'm looking for a basic webcrawler that aggragtes the information from h**p://[login to view URL] once every 5 minutes and make them accesible via api.
Kutum (World Boss)
Last Spawn: Mon, 07:05 EDT
Next Spawn: Mon, 15:05 EDT - Mon, 23:35 EDT
Est. Spawn: Mon, 17:35 EDT
Dastard Bheg
Last Spawn: Mon, 06:25 EDT
Next Spawn: Mon, 18:25 EDT - Tue, 02:55 EDT
Est. Spawn: Mon, 20:55 EDT
Dim Tree Spirit (Field Boss)
Last Spawn: Sun, 21:45 EDT
Next Spawn: Mon, 09:45 EDT - Mon, 18:15 EDT
Est. Spawn: Mon, 12:15 EDT
Giant Mudster (Field Boss)
Last Spawn: Mon, 02:10 EDT
Next Spawn: Mon, 14:10 EDT - Mon, 22:40 EDT
Est. Spawn: Mon, 16:40 EDT
Karanda (World Boss)
Last Spawn: Mon, 00:55 EDT
Next Spawn: Mon, 14:55 EDT - Mon, 19:25 EDT
Est. Spawn: Mon, 17:25 EDT
Kzarka (World Boss)
Last Spawn: Mon, 05:40 EDT
Next Spawn: Mon, 13:40 EDT - Mon, 18:10 EDT
Est. Spawn: Mon, 16:10 EDT
Red Nose (Field Boss)
Last Spawn: Mon, 03:35 EDT
Next Spawn: Mon, 15:35 EDT - Tue, 00:05 EDT
Est. Spawn: Mon, 18:05 EDT
Nouver (World Boss)
Last Spawn: Mon, 06:10 EDT
Next Spawn: Mon, 14:10 EDT - Mon, 19:40 EDT
Est. Spawn: Mon, 16:40 EDT
example for what the api request could look like :
request : /action=getKutumLast -> response : Mon, 07:05 EDT
request : /action=getKutumNext -> response : Mon, 15:05 EDT - Mon, 23:35 EDT
request : /action=getKutumEst -> Mon, 17:35 EDT
Doesn't matter if post or get requests.
Please contact me if you would like to schedule an interview or have any questions about my skills or experience.
I have very reasonable and successful experience in the following:
- 6 PHP+MySQL, node.js, JavaScript + Ajax sites: small auction site for car dealer, site for selling coupons for local shops and corporate site for insurance company.
- all site were done by me from 0. I got just PSD files and did all responsive HTML coding for MAC/Win: FF/Chrome/IE/Safari.
- I used WooCommerce to apply payment gateways, UPS API for shipping, OAUTH API (SSO 2);
- I have great knowledge how develop well optimized DB and less about NoSQL DB;
My previous employers always complimented me that I have good creative taste
I will be create a web crawler to get the data as per needed by from API in every 5 minutes .
Relevant Skills and Experience
I have vast expertise in creating web crawler and API integration ,rendering the XML data and JSON data.
Proposed Milestones
€222 EUR - Create crawler to get data .
From which API you want to integrate ?
Where you want to put the data ? Is it csv file or on server?
Hello Sir,
I have carefully read your job description, it seems that you need an expert webcrawler developer. So, i just want to tell you that i am a perfect candidate for this job.
Relevant Skills and Experience
I have an experience of webcrowling.
I have 5+ years experience in PHP, MySql,Wordpress, Woocommerce, CSS, HTML, Ajax,etc.
Proposed Milestones
€50 EUR - full milestone
Hello,
I can develop a NodeJS that runs every 5 min to crawl data from the page and store it (MongoDB) and an API for you to connect and retrieve the data.
Relevant Skills and Experience
I am a web architect and a fullstack NodeJS developer.
I just finished an online platform based on Meteor (A NodeJS framework) that has a dashboard, a database and an API.
Proposed Milestones
€150 EUR - The crawler feature
€100 EUR - The API