Data Scraping

YELLOW PAGES AUSTRALIA SCRAPING PROJECT – DATA COLLECTION I would like you to build an excel file that is populated with basic information (company name, address, phone number, email address, website, etc) for all businesses involved in the custom joinery in Queensland. These would be renovation, commercial joinery, shop fitters, office fitout etc. The Excel file needs to be in a .csv format. Upon being awarded the project, I will supply the headings, examples of content and layout of the Excel spreadsheet. You can build this directory by building your own web crawler/scraper or by using one of the existing web crawlers. We would like you to crawl most common Australian directories like True Local, Hotfrog, Start Local and most importantly Yellow Pages Australia. There are other niche websites that I will provide to the successful freelancer. The niche websites will include links to sites and businesses/suppliers that may not be in the yellow pages. I will provide a list of search terms to use in the yellow pages. This will simplify and refine your search. Each business listing needs to be categorized. I will provide a list of categories that each business must fit into. The most important piece of data is the "email" and “website”. As such we would like you to find all those business that have a website (and hopefully an email contact on the website). Accuracy of data; All websites must be verified that they exist. All details (phone, address, services) of businesses need to be cross checked against their respective websites (if a website exists). No duplicate listings allowed, all the data must be checked to see that there are no duplicate listings. Many listings will not have a website or email address. We will still require these details to be added to the Excel spreadsheet. The spreadsheet will be checked by me for accuracy and for duplicate listings prior to you being paid. I will cross check listings on yellow pages to see if email addresses are listed. I will also cross check websites to see if an email address is listed. If I find duplicate listings or data that has not been verified or added, you will not be paid for the project until it is all fixed. If you are not prepared to accept these conditions, do not bid on the project. The time is of essence in this project as well as accuracy of data. Please respond with the methods you would use and the details of a similar project that you have completed in the past. We are building databases with several clients and we will require the same services again. So this project has the potential provide regular work for a good freelancer. WEBSITES TO CRAWL: [login to view URL] [login to view URL] [login to view URL] [login to view URL]