Web Scraping Oddspedia.com

Here a brief description of the project Project: Web Scraping [login to view URL] Table of Contents: 1. Introduction 2. Objectives 3. Code Structure 4. Project Delivery Introduction This project aims to construct a simple and automated web scraping system for the [login to view URL] site, focusing on soccer match data. The system will gather detailed data from each match, including date, time, teams, score, and odds from various markets. Objectives 1. Building the Database The system will gather data from all leagues, from all countries, and for all seasons. The obtained information will include: • Date, Time, Home Team, Away Team, HT and FT Score (divided into home and away goals). • Odds from all matches of all markets: Money Line 1x2, Over/Under (0.5, 1.5, 2.5, 3.5), Asian Handicap (AH), Both Teams to Score (BTTS), all at HT and FT. • The Odds should be obtained from the following bookmakers: Pinnacle, Bet365, 1XBet. The information must be included in the DataFrame and should be the opening odd and the closing odd. • The database should be updated daily. • The data should be provided in both JSon and CSV formats. 2. Today's Matches The system will provide a DataFrame with information about the day's matches. The information will be the same as that from the database, but if the game has not started yet, the closing odd will be replaced by the current odd. 3. Upcoming Events The system will provide a DataFrame with information about upcoming events (tomorrow, 2 days later, 3 days later, etc.). The information will be the same as that from the database, but the closing odd will be replaced by the current odd. Code Structure The code will feature an interface with checkboxes for the selection of different options. Each checkbox will allow for multiple selections as well as an option to select all: • Choice of desired DataFrame (Database, Today's Matches, Upcoming Events). • Selection of countries. • Selection of leagues. • Selection of seasons. • Selection of the odds range and also odds comparison. For example: Home Team Odd - Away Team Odd < (<=, >, >= etc) value, and Away Team Odd - Home Team Odd < (<=, >, >= etc) value. The same choice options will be provided for other odds (Over/Under (0.5, 1.5, 2.5, 3.5), Asian Handicap (AH), Both Teams to Score (BTTS), all at HT and FT). Project Delivery The project code will be delivered in a GitHub repository, including comprehensive documentation and usage instructions. To ensure the system's quality and reliability, unit tests and activity logs will also be provided. Accompanying the code, a detailed report will be delivered outlining the development process, challenges encountered, and the solutions adopted to overcome them. Regular updates will be provided throughout the project's development to ensure transparency and open communication.