Find Jobs
Hire Freelancers

Scraper for multiple e-commerce websites

$250-750 USD

Closed
Posted over 5 years ago

$250-750 USD

Paid on delivery
We're looking for someone who can build a scraper that will scrape the products/clothing items from several e-commerce websites to create a single database. We'd like these products displayed on a website where visitors can browse and filters the items based on sizes, colors, types of clothing, and more. The visitor does not need the ability to purchase from our website; instead, we will offer an affiliate link to the 3rd party website where the visitor can buy it. Our website will only focus on 1 style of clothing (petite) so we will provide the direct URLs to this category for each ecommerce website. The initial sites will be: -[login to view URL] -[login to view URL] -[login to view URL] -[login to view URL] -[login to view URL] *Alternatively, if any of the sites provide an API, you can use it instead. We will start by scraping these 5 e-commerce sites. The chosen developer will be paid to add additional websites at a later time. *Phase 1:* Build the scraper. Perhaps something like [login to view URL] 1. Scrape all data provided by the e-commerce website; some examples of required data (if provided): *Product name *Photos *URL to product *Price *Sale price *In-stock/out of stock *Size *Brand *Category (shirt, pants, shorts etc.) *Color 2. Configure the scraper to be executed daily. 3. When the details of a product changes (such as the price or "in stock" status), update our database accordingly. 3. "Flag" any items in our database that are no longer available (i.e., item does not exist on the website anymore but still exists in our database) *Phase 2:* Create an admin panel that displays all products scraped. 1. Allow admins to add any missing data for the product. 2. Allow admins to assign custom keywords/tags to each item (pattern, solid, striped). 3. Create a button that allows us to "Add Product to Website", which allows the product to be visible on the website (alternatively, they should be able to toggle to "Remove from Website"). 4. Allow #2 to be completed in mass (check boxes that we can add/remove multiple products at once). 5. Add an option for each product to "delete". Deleting will remove the product from the admin list/prevent it from showing again in the future. 6. Basic filtering in the admin to sort the products. 7. A filter/page that lists all items that no longer exist (see Phase 1, #3). 8. A section to manage "affiliate links" for each e-commerce website. For example, when we display a product link to "[login to view URL]", we need to automatically append parameters to the [login to view URL] URL, ex: [login to view URL] will become: [login to view URL] *We need this page in the admin to allow us to define the parameters that must be added to each 3rd party ecommerce domain we're going to link to *Phase 3:* Create a public facing website with a basic fashion e-commerce theme 1. We'll need your help choosing a CMS that will be the best fitting for this type of website (Wordpress with WooCommerce?) 2. The website will need to contain filtering options for filtering the products. For example: [login to view URL] Filtering options include: *Price range *Size *Brand *Category (shirt, pants, shorts etc.) *Color 3. An option to "Sort results by". *Most popular *Price high to low *Price low to high *Newest Example: [login to view URL] 4. Display 12 products by default, load more products as the user scrolls down 5. Each product will need its own "view product" page that provides all the information we have stored as well as a link to the 3rd party e-commerce website to purchase the item 6. A global search box/search results page 7. Track number of clicks on the "purchase item" button for each product. We will need this to track the "most popular" items (needed for #3)
Project ID: 17576692

About the project

48 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
48 freelancers are bidding on average $597 USD for this job
User Avatar
Hello, This is Vaishali from "Hire WordPress Experts" and I am here to help you with Scraper for multiple e-commerce websites . We have gone through the information provided by you. and I can assure you that we are expert with MySQL, PHP, Python, Web Scraping, WordPress and I will make your project a reality. This is how we plan to do your task: Surely, We are ready to help you with all 3 Phase. -Yes, we will build the scraper. *Yes, It will Scrape all data provided by the e-commerce website *Configure the scraper to be executed daily *Yes, "Flag" any items in our database that are no longer available -Yes, We will create an admin panel that displays all products scraped. -Yes, We will create a public facing website with a basic fashion e-commerce theme We will need these things from you: We have understood your requirements. Let discuss little more? We are ready to start the work now! Rest be assured you. We will offer you the best. I can promise following 1. You will have exceptional time working 2. We do not hesitate if specifications change for good. 3. The project will be completed in far less than 25 days and you receive free support for up to 25 days. 4. We will be available on sky-pe 5. We do not take any upfront payments Please review our profile and past work here: https://www.freelancer.com/u/OutsourceMan Please select us right away, so that we can get started without wasting a day! Thanks P.S. Be assured you will have a nice time. Vaishali
$250 USD in 5 days
4.9 (630 reviews)
9.0
9.0
User Avatar
I have read your project details. I have to ask a few questions. Can you please message me via chat so we can discuss all the details to elicit all the requirements and hence start the development? I will showcase all the skills and my experience for this project over the chat. Please message me so we can resume this discussion. Can you provide me all the functional/Non-functional requirements via a document? It seems like an interesting project. I would like to discuss all the requirements with you, so I can mark the scope of this project. Please also note that final estimation will be provided once all the requirements will be revealed from your end. Hence, my cost of development & deadline solely depends on what you reveal (in detail). Looking forward to conduct an extensive chat with you.
$555 USD in 10 days
5.0 (83 reviews)
8.5
8.5
User Avatar
Hi,Alessandra! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can scrap websites you need and organize the product database. Please contact me to discuss project details, Best regards, Vlad
$500 USD in 5 days
4.9 (74 reviews)
8.1
8.1
User Avatar
Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$555 USD in 5 days
5.0 (206 reviews)
8.3
8.3
User Avatar
Hello Sir, As a self-motivated, solutions-oriented and passionate individual, I have been actively involved in implementing WordPress security and have considerable knowledge of PHP and MySQL Injection. With over 8 years’ experience with jQuery, HTML and CSS3, I have been able to develop interactive plugins and themes which have been commended for their functionality many times. Also, since I possess great familiarity with APIs and JSON, I believe that I will not need any training and will be productive immediately. Extensive programming knowledge in PHP, Word press, joomla, magneto, open cart, prestashop , Shopify, big commerce volusion Excellent verbal and written communication Familiarity with Cascading Style Sheets (CSS) Good design sense Ability to use debugging tools Ability to work on a team
$666 USD in 10 days
4.9 (342 reviews)
8.2
8.2
User Avatar
Hi I can work only on the 1st phase (scraping) I bid with 90 USD per site. I will provide scrapers that can run in "windows VPS" and export to the database. later your site can connect to this database. Can provide demo if you like. Thanks
$450 USD in 2 days
5.0 (180 reviews)
7.9
7.9
User Avatar
Hi, my name is Oleksii. I can help you to create a scraper. I have 19 years' experience in Web Development and Programming. I would like propose partnership with our company Tangram for your project. My team is with strong knowledge of MySQL, PHP, Python, Web Scraping, and WordPress. I'll be happy to chat with you to review your needs and assets. I'm looking forward to your reply and wish you a great day ahead.
$750 USD in 10 days
4.5 (226 reviews)
8.7
8.7
User Avatar
Hello, Hope you are doing well. I can help with you in your project Scraper for multiple e-commerce websites. I can assure you the quality job. I have good experience in MySQL, PHP, Python, Web Scraping, WordPress. We have worked on several similar projects before! We have worked on 385+ Projects. Please check the profile reviews. I can deliver your job with in your deadline. Please ping me for more discussion. I can assure the 100% job satisfaction. Thanks,
$750 USD in 12 days
4.9 (203 reviews)
7.6
7.6
User Avatar
Dear Sir/Ma'am, I can scrape for multiple e-commerce websites. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir
$750 USD in 10 days
4.9 (230 reviews)
7.6
7.6
User Avatar
Dear AlessandraJones1 I have gone through your project Scraper for multiple e-commerce websites Can we do quick chat right now so that we can discuss the project briefly? I do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. Relevant Skills and Experience I have 10+ years of experience in MySQL, PHP, Python, Web Scraping, WordPress I can do this within your budget too $250 - $750 USD I assure you quality work complete attention and proper communication. Iam waiting for your responce, Regards Mmadi
$525 USD in 12 days
5.0 (51 reviews)
7.1
7.1
User Avatar
Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.
$555 USD in 10 days
4.9 (120 reviews)
7.1
7.1
User Avatar
Hi I am expert in web scraping and data mining and i have done several scraping jobs similar to this one. Please check my profile as thats the best thing i can present you as a proof of my skills. After checking please contact me so we can discuss further about the projects specification in detail Umar
$500 USD in 4 days
4.9 (252 reviews)
7.2
7.2
User Avatar
Hi there, I can scrape these websites as I have more than 7 years of experience in this field. I have checked the website and i assure you that i can scrape them for the details you want. Looking forward to hearing back from you. Thanks
$555 USD in 3 days
4.9 (160 reviews)
7.0
7.0
User Avatar
Hi there, I would like to let you know that I have successfully built more than 150 multiple website based on WordPress for our clients. I have ample experience in not only WordPress but in Magento,Shopify,Wix,Squarespaceetc.I have also developed lots of websites from scratch by using multiple frameworks like Html,Php,Css,JavaScript etc.I will be greatful to serve you with this project if you give me an opportunity and will be obliged if drop me a message in chat box. Regards, Saurav
$411 USD in 8 days
4.9 (153 reviews)
6.9
6.9
User Avatar
Hello Sir/Mam, First of all thanks for sharing a detail requirement of this project. Hope you are doing well.. I have read your project requirement and understood that you are looking an Scraper for multiple e-commerce websites. I will happy to develop products and clothing several e-commerce websites to create a single database to work as per your need. I have got you all point and understood that what you need i am pleased to inform you that we will happy to help you, we have more than 6 years of experience developer team and develop more than 218+ successful projects.I will share my past work projects in personal chat. Can you please share your best time for the chat then we can discuss further and move ahead. Waiting for your response.... Warm Regards, Mirali
$2,777 USD in 30 days
5.0 (12 reviews)
6.8
6.8
User Avatar
Hi I have done many difficult web scraping and ecommerce product scraping projects. I will provide you all accurate data from the sites. I can start the work today. Please contact with me for discussion. Thank you.
$680 USD in 12 days
4.9 (87 reviews)
6.6
6.6
User Avatar
Hello sir, I have completed web/data scraping jobs for many times. I am interested in your project as well. I would like to discuss details via pm. I am looking forward to hear from you soon. Best Regards,
$250 USD in 10 days
5.0 (58 reviews)
6.1
6.1
User Avatar
Can build scraper with scrapy framwork. Can build admin panel with python or nodejs. Can setup cron server for daily running the job. Can use mysql or mongodb for database can create urls for uploading to website. these are my skill related to web scraping and web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.
$666 USD in 20 days
4.9 (62 reviews)
6.3
6.3
User Avatar
Recently I have developed a scraper for linkedin using SCRAPY. The scrapper had all the features like it has a REST API, which is mainly useful to fetch data from the database. In addition, REST API can also provide interface to any user with rate limit. It also has a Control panel which indicates the current progress of the scrapper. Moreover, you can view crawled pages, errors and other stats on the dashboard. You can start and stop scrapper from the control panel and my scrapper use to run 24/7. I also developed a CRM for the customers to interact with the data. I have added some policies which made sure that the scrapper doesn't get blocked. I used PYTHON for scrapping and PHP for REST API. Although I have a new account in this site, but I have more than 5 years of experience. I have developed many apps similar to UBER taxi. The apps are both in IOS and android platform. I have also worked on billing apps, games, and cryptocurrency. I need to discuss few things about the deployment of the scrapper. Will you deploy on your machine or some server? Do you have any specific database in mind or I can use any centralize database?
$755 USD in 30 days
5.0 (3 reviews)
5.8
5.8
User Avatar
Hello sir we can execute the idea using python. I will use scrapy and selenium for scraping, for database, admin panel we will use django. The end product will be scalable, efficient and well documented. lets get in touch and discuss more. waiting!
$250 USD in 10 days
4.9 (21 reviews)
6.1
6.1

About the client

Flag of UNITED STATES
United States
0.0
0
Member since Aug 15, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.