Web scraping software

It will search for keywords in the Google search engine. It will navigate all sites between the page numbers I want(example 10 to 20). And will browse all the pages in the visited sites, collecting all the mail addresses in the site.

- The PYTHON programming language will be used.

- A username password verification with a server that will work on linux.

- If the user is online and wants to log in from a different computer, the user will be prevented from using the program.

- The program's data output will be in csv format. That's how each line will fit:

KEYWORD - GOOGLE SEARCH PAGE - SITE DOMAIN - EMAIL ADDRESS.

If there is more than one mail address on a site, it will create a new line for each different mail.

The output file name will be keyword - date.

- The program must have a graphical interface. For user name password entry and other received data.

- It may give an audible warning when the process is completed.

- Forgot your password and registration part have to be. The registration will be according to the KEY. If an invalid KEY is called or a key previously used, it will not be able to register.

- Username, password, name, e-mail address, phone number and key will be requested when registering.

Data to be retrieved from the user:

Keyword

Which page range to search

---

I have a linux server. On this server I want to see the information of people who are online with the information of the people who are entering the program. Also, the online person should not be able to log in from a different computer.

The bot that the user will be able to use must be able to search between the user's input keyword and the page number they want. And it should be able to give the csv file the mail addresses found in every site that the bot visited in that interval.

My Linux server is a standard droplet with 2GB of RAM over DigitalOcean. [login to view URL] for linux server

Data Mining Linux Python Software Architecture Web Scraping

Project ID: #17520251

About the project