Scraper for finding new products on Shopify websites

In Progress Posted 7 years ago Paid on delivery
In Progress Paid on delivery

All online stores using the Shopify platform have their products listed in a xml file that follows the format: [login to view URL]

Here are some examples...

[login to view URL]

[login to view URL]

[login to view URL]

I am looking to build a scraper that will automate the task of finding new product links as soon as they are uploaded to the site, and put them in a table showing the website, product name, product ID, url, date added, etc.

I also need the scraper to identify keywords in the product URL and output these "hits" to a separate table, which containing all product links with positive keyword matches.

Other features:

- Scrape multiple sites at once

- Customizable delays for how often it checks the page, so I can leave the program running

- Proxy support

- Simple, but user-friendly GUI

- Copy / paste links from the output window

- Make a sound when a keyword match is found

.NET C# Programming UI / User Interface Web Scraping XML

Project ID: #11236614

About the project

8 proposals Remote project Active 7 years ago