PHP Web Scraper - 21/01/2018 18:24 EST

Closed Posted 6 years ago Paid on delivery
Closed Paid on delivery

I need a PHP script that will scrape HTML tables from various web pages on 16 different websites, and output the results to a single PHP page, so that I can manipulate them.

I've made a basic PHP web scraper myself, but while it works correctly for most websites, it returns blank/incomplete/incorrect HTML results from these particular websites I need to scrape. So maybe some client side scraping is needed to get a proper result, but I'll leave that to you.

It's important that my IP doesn't get blacklisted by the websites I'm scraping, so the script must have time-restrictions on requests, and the script also needs to use a variety of (free, 3rd party) proxy IPs.

The URLs I need to scrape on each website are irregular, and change over time, so the script will need to start on the homepage and follow 2 or 3 links to get the correct URL. There must also be an option for me to copy/paste these URLs directly instead (to minimize requests).

I'll be running this script to scrape each webpage several times every hour every day, and it's important that it doesn't get blocked, so an important part of this project is ensuring the script doesn't get blocked by the target servers over time.

JavaScript MySQL PHP Software Architecture Web Scraping

Project ID: #16126540

About the project

11 proposals Remote project Active 6 years ago

11 freelancers are bidding on average $161 for this job

Angel521

Hi, I have many experience like this job. I have 6 years of experience in web scrap and web crawler. I have scrapped Gumtree,GMSarea,eaby,Amazon,etc... If u hire me, i'll do best for u. Trust me. Thank u.

$155 AUD in 3 days
(136 Reviews)
7.6
uumarkhalid31

​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete More

$100 AUD in 3 days
(237 Reviews)
7.2
Nada100200

Hello client. Hope you are doing well Over 9 +years experience writing almost exclusively web scraping code. I've done it all. I can scrape all LinkedIn profile My languages in order of experience and use is Python, Ja More

$30 AUD in 3 days
(14 Reviews)
5.4
lvdt

Hi there, I am a professional PHP developer with a lot of experience doing web crawlers. If you don't mind, I'd prefer to start my scripts from scratch rather than modifying your scripts. I will write reusable More

$250 AUD in 3 days
(101 Reviews)
5.1
katilinas

Hi, I'm ready to work on "php web scraper" project. Relevant Skills web scraping Milestones 105 usd - code writing 26 usd - userfriendly interface I can achieve the results that you are asking for.

$178 AUD in 3 days
(17 Reviews)
4.7
mayankinnovative

A proposal has not yet been provided

$100 AUD in 3 days
(96 Reviews)
4.5
MikeMusni

Please pass me the URLs and I will make a page where you can view the table. If you like the result of the page, then we are ok to resume the project.

$222 AUD in 3 days
(2 Reviews)
1.4