Develop a scraper to analyze information about a website

$30-250 USD

Completed

Posted

over 7 years ago

$30-250 USD

Paid on delivery

The code will run via API (No UI needed). Input: a list of website URLS Out put: The list of URL's with this extra data about the site: - Company type: Manufacturer / Online Store / SMB (Suggestion to how to find this data is below). - Is the website mobile friendly: yes / no - Load speed (Homepage load speed in msec) - Is Google analytics installed: yes / no - Is there a link to facebook: yes/no - What CMS is used: Wordpress / Joomla / Wix / Drupal/ ExpressionEngine / TextPattern / Radiant CMS / other. - Contact form link (The URL where a contact form is, if there is one). Finding the "company type": In order to find this information, first analyze the text on the homepage. 1- Look for links with the text "products" "our products" "product catalog" also look for "distributors" "find a distributors" and so on. Usually companies that have a link with this language are "manufacturer". 2- Look for "cart" "checkout" or "add to cart" links. If these are present, this is an "online store" 3- Look for "opening hours" or "directions" in the website. Usually if this text is present, this is an "SMB" (small/medium business).

Data Processing

PHP

Python

Software Architecture

Web Scraping

Project ID: 11741982

About the project

15 proposals

Remote project

Active 8 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the website analysis program you require. To do so, I will use the libraries Requests (for web automation tools), BeautifulSoup (for parsing html), and Selenium (for working with AJAX and Javascript). I have written very similar programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

$133 USD in 3 days

4.9

(69 reviews)

6.5

15 freelancers are bidding on average $118 USD for this job

@mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Kimi

$68 USD in 2 days

5.0

(447 reviews)

7.9

@amitarai

Hello My name is Pranav I have checked the details shared by you will do done exactly what you want Please consider my bid and we can discuss more so that i can assist you in better way our services always with you even we complete the project My Portfolio https://www.freelancer.com/u/amitarai.html

$155 USD in 7 days

4.9

(84 reviews)

6.2

@sanidhayy

Hello, I am a Highly Experienced Freelancer from India. I have read your project description and I have some questions regarding your project. I would like to talk to you directly to discuss more about the project. You can message me directly from this screen. Looking forward to your response. Thanks.

$165 USD in 1 day

4.8

(13 reviews)

4.1

@arthurbarros

Pretty straight forward we could even use Google Pagespeed API to extract even more meaningful data. I intend to use Python 2.7, python-mechanize, requests lib, RabbitMQ as a Queue broker and MongoDB as the database while parsing data.

$140 USD in 2 days

5.0

(1 review)

0.2

@shumiakter

Dear sir Your project is based on..............................I have done many job like as your project. Provide me your budget, time frame and more detail's please ! Thanks.

$35 USD in 3 days

0.0

(0 reviews)

0.0

@saymajahan

Hi, I'm Sayma Jahan. I have enough experience in this field. I can easily complete this project as per your instructions. How much is your budget and how long will be the time frame? Thank you.

$30 USD in 3 days

0.0

(0 reviews)

0.0

@muhamedze

A proposal has not yet been provided

$55 USD in 1 day

0.0

(0 reviews)

0.0

@halilceliksu

I and my friend are python proggramer. We wrote some codes that get and analyse urls and informations from different news web sites. So we can do what you want.

$88 USD in 3 days