Creating a web crawler

Status: Closed
Prize: $731
Entries Received: 19
Winner: hwanghendra

Winner

Contest Brief

I will give three different websites and I want you to create a crawler that goes to two websites and retrieve three different items: Product's name, price and picture from each product in these three websites. The program has to store these items in a database.

Also, the program will be run automatically in a daily basis.
http://www.jarir.com/
http://www.extrastores.com/en-sa/

Recommended Skills

Winner

Post a Contest Like This

Employer Feedback

“we will work together soon.”

edeeeeede, Saudi Arabia.

Public Clarification Board

njose
- 7 years ago
Please see entry #26 - I made it possible to interact with the crawler so that your sure it's retrieving products from the actual source websites you gave us. The entire process will be automated, I want you to be certain of it's functionality #26
- 7 years ago
ankurs13
- 7 years ago
Hello Sir, I have been able to retrieve all products from the two websites from all categories and the output list is present in my submission as a google sheet link. Please go through it and contact me. My submission is #21
- 7 years ago
Contest Holder
- 7 years ago
Guys, anyone who is able to retrieve all the products from the two website. He/she has to contact me.
- 7 years ago
1. yourSalesPitch
  - 7 years ago
  hello Sir
  - 7 years ago
2. yourSalesPitch
  - 7 years ago
  Please Award !!!
  - 7 years ago
yourSalesPitch
- 7 years ago
Please check #11 . I am ready to code it for you. Thanks
- 7 years ago
1. Contest Holder
  - 7 years ago
  sure, will be checked
  - 7 years ago
busygayan
- 7 years ago
Hi,
Do you require all the products to be extracted or selected categories and pages ?
- 7 years ago
1. busygayan
  - 7 years ago
  Please extend the time, i can write an efficient bot in python, which will go through all the products in the site and collect data.
  - 7 years ago
2. Contest Holder
  - 7 years ago
  Yes, all the products should be extracted from all categories
  - 7 years ago
Contest Holder
- 7 years ago
sure, I will check all your proposal and get back to you guys
- 7 years ago
njose
- 7 years ago
Please see entry #26 for working demo. It features a well structured, and organised code base. It's highly scalable and easy to maintain. In addition, all actions can be executed from the command line without the interface which simplifies scheduling tasks and is way faster.
- 7 years ago
1. njose
  - 7 years ago
  If you have any question, please let me know. I will be happy to answer any of them. Best, Njose
  - 7 years ago
Lauris79
- 7 years ago
Just added entry #22 . Will send You live demo URL in chat message.
- 7 years ago
ankurs13
- 7 years ago
Please check my entry #21 and provide feedback please :)
- 7 years ago
njose
- 7 years ago
Hi.. I have started working on a fully functional script with an intuitive interface. I will submit my entry before the due date for you to demo. Best, Njose
- 7 years ago
yourSalesPitch
- 7 years ago
#16 Please
- 7 years ago
yourSalesPitch
- 7 years ago
#11 Please message me through chat window. I have a demo for you
- 7 years ago
yourSalesPitch
- 7 years ago
Please message me through chat window. I have a demo for you
- 7 years ago
Contest Holder
- 7 years ago
I have extended the contest and also increased the amount to 731. NOTE: I am not going to extend the project any more.
- 7 years ago
1. Lauris79
  - 7 years ago
  Thanks! Next entries and the demo coming soon!
  - 7 years ago
Contest Holder
- 7 years ago
I will try to extend the due date
- 7 years ago
1. yourSalesPitch
  - 7 years ago
  Hi, please pm me. I'll do it for you
  - 7 years ago
ankurs13
- 7 years ago
#extended please, working on it
- 7 years ago
Lauris79
- 7 years ago
#extended
- 7 years ago
1. Lauris79
  - 7 years ago
  If You're interested in live demo code and complete dataset, extend the contest at least 2-3 days
  - 7 years ago