Find Jobs
Hire Freelancers

Web Scraper (Scrappy) / Magento (Magmi) importer / Data miner

$30-250 AUD

Closed
Posted almost 9 years ago

$30-250 AUD

Paid on delivery
I need someone to develop a solution for us to regularly scrape a website and it's categories of products. Then produce a CSV file with some changes that I will outline below, lastly they need to be uploaded to a magento store. The main focus of this solution will be how this can be updated on a regular basis to flag out of stock products to "out of stock" on magento and any new arrivals be added each time the scraper/software is run? Required features: - Scrape a website category of products (Name, price, special price, short description, brand, URL, configurable product options, product options stock availability) e.g. size S/M/L but size S is sold out so output needs to show this. - Map Categories of source website to my website. (Mappings will be provided by me).. E.g Electronics category == Gadgets - Manipulate data in the Scrapped data to edit certain values by adding or removing certain text strings (e.g. change the scrapped URL data to have an additional referral ID) - Ability to run data Scrape on demand, as well as scheduled - Run scrape using proxy servers to increase reliability - Ability to synchronize data between the source and the target to ensure pricing and stock availability is accurate. - Add any new products that may have been listed since the last scrape. - Remove any products that have been deleted since the last scrape - Update stock for any configurable products that have sold out/come back in stock This job if done correctly has potential for ongoing work as it will then be replicated for numerous data sources and websites.
Project ID: 8044326

About the project

19 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
19 freelancers are bidding on average $259 AUD for this job
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$229 AUD in 5 days
5.0 (216 reviews)
7.1
7.1
User Avatar
Hi there! I am an expert programmer specializing in webscraping as well as database administration and have completed projects that involve scraping well over 100 websites for clients here on Freelancer. I am confident I can complete your project and hope to speak with you further about the details. Please message me when you can; I am available on Freelancer anytime. Thanks, Mike
$250 AUD in 5 days
5.0 (78 reviews)
6.8
6.8
User Avatar
ready to get this done as according to your satisfaction and requirements. Magento expert here. Lets chat and get this started as soon as possible.
$254 AUD in 3 days
4.9 (179 reviews)
6.4
6.4
User Avatar
I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably you will get a quick response from my end.
$309 AUD in 10 days
4.8 (38 reviews)
6.4
6.4
User Avatar
A proposal has not yet been provided
$200 AUD in 3 days
5.0 (50 reviews)
5.7
5.7
User Avatar
Hello sir, i read your requirements very-well and ready to start work from now. Hope you will give me a chance to do work with you, waiting for your reply, Thank you
$150 AUD in 3 days
4.9 (21 reviews)
5.5
5.5
User Avatar
Hello there. I am a professional web scraper with experience writing scripts easily updatable. I would be glad to help you out keeping your online store updated. I can guarantee you an excellent job and deliver as soon as possible. My approach would be to create a script on php that will be updated on certain schedule or by demand, which will extract the data, edit it as per your needs and then upload it to your site. Hope to hear back from you soon. Daniel
$350 AUD in 3 days
4.8 (16 reviews)
5.0
5.0
User Avatar
Hello! I'm web scraping expert. I use python scrapy framework. My scripts can run on windows or linux, but linux is preferably. I can schedule scripts on server if it is required. I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc. If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode. I can export data into json, csv (excel), mysql, mongodb. I have a lot of finish projects (google scraping, facebook scraping, yellow pages, webshops and other sites with lists of any items). Time to scrape one site: 2-4 days (depend on the different site). I am ready do for you free test file that contain 1000 rows for verify of quality my scripts.
$200 AUD in 3 days
4.8 (22 reviews)
5.0
5.0
User Avatar
I can develop a solution as I have been creating web scraping solutions for people all around the globe and for a long time. But this will not come in your budget. Please read my profile for more details about me.
$555 AUD in 15 days
5.0 (11 reviews)
4.1
4.1
User Avatar
A proposal has not yet been provided
$155 AUD in 3 days
5.0 (18 reviews)
4.0
4.0
User Avatar
I am expert in website scraping, I have completed many projects similar to this, You can view all in my profile. Please contact me, Ready to start now
$100 AUD in 5 days
4.9 (6 reviews)
3.4
3.4
User Avatar
A proposal has not yet been provided
$200 AUD in 1 day
5.0 (4 reviews)
3.6
3.6
User Avatar
Hi, I am ready to start it.i am highly interested in your project But i have some questions for you. So kindly leave message for me, then i'll discuss it in depth.
$83 AUD in 2 days
4.8 (12 reviews)
3.3
3.3
User Avatar
A proposal has not yet been provided
$50 AUD in 3 days
4.1 (6 reviews)
3.6
3.6
User Avatar
Hi Can get this done using python and imacros coupled with regex to format the results sent to the CSV file . Would be glad to discuss further.
$155 AUD in 3 days
5.0 (1 review)
2.4
2.4
User Avatar
I am a Python & PHP certified Web scrapper and have an experience of 3 years in developing scrapping tools for such tasks. I can easily develop the tool as per your requirements and provide you 100% accurate and desired results.
$222 AUD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Epping, Australia
5.0
25
Payment method verified
Member since Aug 5, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.