Data scraping data mining project jobs
Hello I have a company CRM, I need to scrape specific information each day from my CRM to produce a report based on the data. I need someone experienced in a Cloud Hosted Web CRM to help me scrape the data and put it into a MySQL database.
I'm looking for an expert capable of scraping textual data from various e-commerce websites. Your role will involve: - Scanning and extracting specific data points from multiple sites. - Implementing a mechanism for updating this data on a monthly basis. Ideal candidates will possess demonstrable experience with web scraping, data extraction and programming. Familiarity with e-commerce platforms and structures is much appreciated. This job requires high-level accuracy and efficiency, as it contributes to key business decisions based on the extracted data.
I'm looking for a skilled Python expert who can perform a variety of tasks, potentially including data analysis, web scraping, and automation. The specifics will be determined based on the project requirements at the time. Skills and Experience: - Proficient in Python Programming - Ability to carry out data analysis - Knowledge of web scraping tools and techniques - Familiar with automating tasks using Python Although not required, freelancers may find it beneficial to include details of past work, their experience, and detailed project proposals in their application. I haven't specified a particular operating system for this project, so being capable on Windows, Mac, or Linux will work just fine.
I REQUIRE A MASTER IN WEBSCRAPING TO GET DATA FROM SITE WEBSITES (MOSTLY YELLOW PAGES AND SOCIAL MEDIA SUCH AS FACEBOOK, INSTAGRAM, LINDEKIN) DATA WILL BE PRESENTED IN AN EXCEL SPREADSHEET WITH COLUMNS AND ROWS I HAVE LOTS OF THESE TASKS GOING ON EACH WEBSCRAPE LIST PAYS AROUND 30$ AUD AND INVOLVES SCRAPING 250 TO 1000 RECORDS
I'm in need of a skilled data collection specialist who can extract valuable market research information from specific company websites and LinkedIn profiles. Ideal Skills and Experience: - Ability to identify and collect relevant data efficiently - Proficient in web scraping tools and techniques - Experience with LinkedIn data extraction - Knowledge of HTML/CSS - Strong analytical skills to interpret data Requirements: - Identify the Chief Strategy Officer or Head of Mergers and Acquisitions or equivalent from 300 companies - Find and provide emails and mobile phone information for each of the individuals found - Extract professional profiles and company information from LinkedIn - Ensure data is collected in a structured format for easy a...
I am in need of a detailed, well-researched lead list for cyber insurance in Australia. This task suits a freelancer proficient in market research, data mining, and lead generation, and who preferably has an understanding and experience in the fields of insurance and cyber security. Requirements: - Identify prospective leads primarily in small to medium-sized businesses. - Collect the company name, contact person's name, and phone number for each lead. - Ensure the leads are particularly those who would be interested in cyber insurance. Use of Leads: - The generated leads will be employed for cold calling, email marketing, and direct mail marketing. So the relevance and accuracy of each lead is crucial. Candidates must demonstrate a track record of excellent lead ge...
I'm in need of a skilled data collection specialist who can extract valuable market research information from specific company websites and LinkedIn profiles. Ideal Skills and Experience: - Ability to identify and collect relevant data efficiently - Proficient in web scraping tools and techniques - Experience with LinkedIn data extraction - Knowledge of HTML/CSS - Strong analytical skills to interpret data Requirements: - Identify the Chief Strategy Officer or Head of Mergers and Acquisitions or equivalent from 300 companies - Find and provide emails and mobile phone information for each of the individuals found - Extract professional profiles and company information from LinkedIn - Ensure data is collected in a structured format for easy a...
I'm looking to build a specialized website dedicated to tennis enthusiasts. The core functionality will revolve around scraping up-to-date information on tennis gear from multiple prominent online retailers and affiliate marketing. Here's what I need: - **Data Scraping**: - **Products**: We'll focus exclusively on tennis products, collecting data like product names, prices, and descriptions. - **Sources**: Primary sources will include a broad range of retailers such as Amazon, eBay, Tennis Point, Tennis Nuts, and more niche brands like Babolat, Wilson, and Adidas, spanning both equipment and tennis apparel. - **Website Development**: - A user-friendly layout that prominently displays the latest tennis products. - An affiliate ...
...extracting data from Website B. The immediate goal is to replicate this data extraction process to retrieve the same data in a plain text format. The final deliverable should be a working example or script capable of performing this extraction efficiently and reliably. **Essential Skills and Experience:** - Proficiency in JavaScript and web scraping techniques. - Experience with data extraction from iframes. - Ability to understand and reverse-engineer JS scripts. - Knowledge of data formats and conversion, specifically to text format. - Familiarity with Website B's structure and potential anti-scraping measures. **Project Requirements:** - Analyze the existing iframe and JS script to understand the data extraction ...
Scraping car details from 10 websites into one web page having images of cars with links.
I need data scraping and Excel entry experience. My project involves routine extraction of names and addresses from numerous pages of government website PDFs every week and consolidating this data into Excel spreadsheets. Here are the project specifications: - Scraping Data: Your task is to extract names and addresses from hundreds of PDFs each week. Leaving no page unattended, you will get the PDFs from one public website. No additional information beyond the names and addresses is needed. - Excel Entry: Once the data is collected, it must be input into Excel. I need names and addresses registered in separate columns. Key skills and experiences: - Proven experience in data scraping in English. - Proficient in Exce...
I am in need of a professional to help with the extraction of both text content and images from a designated website. Here ar...professional to help with the extraction of both text content and images from a designated website. Here are the details of the task: * The extracted content should be delivered in a JSON format. * Only text content and images need to be retrieved, links can be disregarded. * I don't require any cleansing or manipulation of the data post-extraction. The raw data is completely suitable. Freelancers need to have experience in web data extraction, web scraping, and data mining. Additionally, knowledge in JSON formatting is crucial. Understanding of copyright rules regarding text and image extraction will be a plus. You...
I need a scraping tool to extract re views from google maps, you must have an excellent tool for that **Requirements:** - Expertise in web scraping, particularly with Google. - Ability to quickly and accurately extract data. - Knowledge of data extraction tools and software. **Ideal Skills:** - Proficiency in coding languages suitable for scraping (e.g., Python). - Experience with web scraping tools (e.g., Beautiful Soup, Scrapy).
...focus on creating a program that can adapt to various forms and site structures. ### Core Components of the System 1. **Flexible User Interface (UI):** A user-friendly interface that allows users to specify the URL of the web form they wish to interact with. The UI should provide "Scan" and "Run" buttons to initiate scanning for form fields and filling the form with data from an Excel file, respectively. 2. **Dynamic Web Scraping and Automation:** Selenium WebDriver is a powerful tool for web automation that can interact dynamically with web pages. The application should use Selenium to identify form fields across different websites, regardless of the specific HTML structure. 3. **Excel Integration:** Apache POI or a similar library will be used for...
I'm looking for an experienced data scraping expert to create a software or script that will effectively scrape specific information from LinkedIn profiles. The information to be extracted includes: - Name and job title - Education and qualifications - Skills and endorsements - Mobile number - Email address This tool will be primarily used for recruitment purposes. Hence, the perfect freelancer for this project should ideally have a background in Human Resources or a clear understanding of recruitment processes. Moreover, the data scraped needs to be automatically updated on a daily basis to keep up with any changes on the profiles. It's essential that the chosen applicant knows how to implement this feature. Previous experience with LinkedIn sc...
I'm in need of an adept individual capable of both data entry and web research. To succeed in this role, you will need the following: - Proven experience in Data Entry: Entry accuracy is crucial, and previous work that demonstrates this skill will be looked upon favorably. - Proficiency in Web Research: The ability to find, digest, and sensibly organize information from an array of online sources. - Manual Typing and Data Scraping Skills: Both methods for data entry will be used in this project. You should be comfortable with each one. Applications without concrete examples of past work and clear project proposals will not be considered. You must demonstrate the necessary attributes and lay out a detailed plan for the project's ...
...database. This task requires precise data scraping to assist in creating a comprehensive database for my site, which is the foundational step for my project. I'm seeking a freelancer with a strong background in data scraping and extraction, and familiarity with various data extraction tools and software. **Ideal Skills and Experience:** - Proficiency in data scraping tools and techniques. - Experience with web scraping software such as Scrapy, Beautiful Soup, or Octoparse. - Strong understanding of HTML, CSS, and JavaScript to navigate through the structure of the website for efficient data extraction. - Ability to cleanse and format extracted data for use in a new website environment. - Knowledge of d...
I need a proficient Python WebUI developer with a keen knowledge (AI - Chatgpt/Perplexity), specially in blog/content writing g...functionality we desire. Key Requirements: - knowledge in prompt engineering - Strong experience in Python, Web UI development - Deep understanding of Python and AI (open-source projects) - Ability to build user personalization options in the interface. crew ai (knowledge a plus) web scraping (multiple website) custom output format A working Python program will be given (open source) and i just need web ui to have, customize it if crew ai (as an option) in generating content (article, product review), and a web scraping tool to generate an input file and have the option to type of the output format (Html) ready for posting in a blog website....
...skilled freelancer proficient in data entry and web scraping to assist me in extracting specific information from numerous web pages. The core of this project revolves around efficiently gathering text and links from 10 to 50 web pages. This will involve not only collecting raw data but also organizing it effectively in an Excel sheet for ease of analysis and reference. **Data Collection:** - Specifically, I'm interested in two types of data on these pages: Titles and URLs. - The freelancer must navigate through each page, identify these elements, and accurately record them. **Ideal Skills and Experience:** - Proficiency in web scraping tools and techniques. - Strong understanding of HTML and how web pages are structured to efficie...
...purpose is to extract critical data elements in real time and display them in another app meticulously. **Objective:** To ensure the scraper runs efficiently, capturing: - Game results - Player statistics - Betting odds - Live TV - Betting data **Required Frequency:** - The data updates in real-time, necessitating the scraper to perform consistently without delay. **Primary Use:** - The extracted data will be showcased on a different application, demanding real-time precision for an accurate data display. **Ideal Skills and Experience:** - Proficient in API scraping, particularly from Android applications. - Strong background in handling real-time data collection and integration. - Knowledge in developing and managing databases to s...
I'm in need of a skilled data specialist to clean a dataset containing both text and numeric data. The exact source of this data is varied, as it encompasses multiple types of inputs which might include surveys, web scrapes, databases, and more. The goal is to refine and cleanse this data for further analysis and usage in a data-driven project I'm working on. **Requirements:** - Experience in data cleaning, particularly with mixed datasets (text and numeric). - Proficiency in data processing tools and programming languages suitable for data cleaning tasks (e.g., Python, R, SQL). - Ability to identify and correct errors, inconsistencies, and redundancies in the data. - Strong understanding of techniques for de...
Project Title: Data mining I am looking for a data mining expert who can assist me in finding customer data and present it in a spreadsheet format. Skills and Experience Needed: - Strong expertise in data mining and data extraction techniques - Knowledge of various data sources and the ability to identify potential data sources - Proficiency in working with customer data and extracting relevant information - Experience in presenting data in a spreadsheet format - Attention to detail and the ability to ensure accuracy in data mining processes Deliverables: - Assistance in finding customer data from various sources - Presentation of the data in a well-organized and struc...
...an expert in data scraping to help gather specific company information, which will be pivotal for an ongoing market research project. The goal is to accurately compile a comprehensive database of company names and addresses. This undertaking will require both precision and a keen eye for detail to ensure the integrity of the collected data. **Requirements:** - Extract company names and addresses - Organize data in an Excel spreadsheet - Ensure high accuracy and reliability of information - main activities of the company and Email address **Ideal Skills and Experience:** - Proficiency in website scraping techniques - Strong experience with data extraction tools and software - Excellent attention to detail - Familiarity with Excel and ...
I'm in urgent need of a talented freelancer to develop a sophisticated web scraping tool that can extract text content from specified websites in real-time and store this data in CSV format. This tool will be vital for my data analysis project, where timely and accurate information extraction is crucial. **Requirements:** - Experience in developing web scrapers that can handle dynamic and static websites. - Proficiency in programming languages suitable for scraping tasks, such as Python, specifically with libraries like Beautiful Soup, Scrapy, or similar. - Capability to implement real-time data extraction without causing undue strain on the target websites’ resources. - Expertise in handling and manipulating data to fit into CS...
...highly skilled and communicative freelancer to join my project focused on data management and design. The right candidate should be proficient in using Canva for various design tasks and have a solid background in data handling. Your role will involve a balance of creativity and precision, ensuring data is handled efficiently while also creating visually appealing designs when necessary. **Skills and Experience Required:** - Expertise in Canva for creating and editing designs. - Strong data entry skills, including but not limited to transcription, cleansing, and mining. - Excellent command of English for effective communication. - Ability to work independently with minimal supervision. **Responsibilities:** - Manage and organize data ef...
I'm looking for a skilled Python developer to perform two main tasks. The first task involves web scraping to extract trading data from Zerodha. The second task is automation, where I need the implementation of specific trading rules. These rules include the concept of moving average crossover, RSI divergence, and breakout strategy. Ideally, you have extensive experience with both web scraping and automation and a good understanding of trading dynamics. Familiarity with Zerodha and the trading strategies listed is a bonus. Clearly showing how these strategies are implemented successfully in your bid will be highly appreciated.
I'm looking for a skilled freelancer to create a dynamic web scraping tool tailored for Trendlyne to capture specific stock information across multiple pages. The data fetched is actually a CSV file which is then saved to mongoDB for easy review and analysis. **Key Requirements:** - Utilize Trendlyne to fetch a list of stock names available - Develop a scraper that can efficiently navigate through one page but for multiple stocks, differentiated only by the stock names, to collect comprehensive data on each. - Implement a function to compile and download the aggregated data in a CSV format for each stock name, which is then saved to mongoDB. - Everyday run, which updates DB with latest score of the stocks for dates for which it is not updated. - Ensure t...
My project aims to develop a tool that will scrape specific data from two targeted websites and then synchronize this data with our Google Sheets and WordPress site, dynamically adjusting based on the fetched data. The operation should occur at a high frequency to ensure data remains current. ### **Core Requirements:** - Extract *product prices* and their *availability status* (in-stock or out-of-stock) from both websites. - Update Google Sheets with scraped data every 2 minutes. - Implement a feature to utilize this data dynamically upon command in Discord. - Adjust product prices on our WordPress site in alignment with scraped data in real-time or near real-time. ### **Ideal Skills and Experience:** - Proficiency in web scrapin...
In need of professional research and data collection skills to curate a comprehensive list of 6000 restaurants, clubs, and bars (excluding pubs) in Central London in CSV file Provide 'Jasper' at the beginning to confirm you read the description. Recommend scraping in TripAdvisor because it provides email for each restaurant. Email must! Upon successful delivery of a clean and fully comprehensive list, payment will be made promptly with a release of the project's entire milestone. Thank you.
In need of professional research and data collection skills to curate a comprehensive list of 6000 restaurants, clubs, and bars (excluding pubs) in Central London in CSV file Provide 'Jasper' at the beginning to confirm you read the description. Recommend scraping in TripAdvisor because it provides email for each restaurant. Email must! Upon successful delivery of a clean and fully comprehensive list, payment will be made promptly with a release of the project's entire milestone. Thank you.
As I venture into a new project, I am looking for a skilled professional to aid in data downloading from a website. Various types of data would be involved - text files, images, as well as videos. Key Aspects: - You'll need to be proficient in extracting complex data from websites. - Experience in downloading various types of files is crucial. - The final downloaded files must be in the specific formats, namely PDF for text files, JPEG for images, and MP4 for videos. Skills & Experience Needed: - Advanced web scraping and data extraction - Experience handling and converting multimedia file types - Proven record of similar projects. Looking forward to working with a professional who can deliver these requirements accurately and effici...
I'm seeking a skilled freelancer to enhance the visibility and member count of my Telegram channel, which primarily shares valuable information and news targeting business professionals. This project requires a nuanced approach, considering the specific audience and the goal of distributing valuable content without a stringent timeline. ### Ideal Skills and Experience: - Proven experience in Telegram member scraping and invitation processes - Understanding of the business professional demographic and how to engage them effectively - Capability to use or develop tools that can target and invite members efficiently and respectfully - Knowledge of the latest Telegram policies to ensure all activities are compliant and avoid any risk of channel penalties - Strong communicat...
I'm looking for an experienced RedM scripter to bring an innovative mining script to life within our RedM server. This script must incorporate a mining system, an experience system, and the functionality to hire AI workers. **Key Requirements:** - **Mining System**: Allow players to mine resources within the game world. This should be engaging and interactive, offering a realistic and immersive experience. must be able to customize what items are minable and be able to add and change locations - **Experience System**: Players should be rewarded for their time and effort with an experience system that tracks their progress. As they gain experience, they should receive resource bonuses and level up, enhancing their gameplay this should be customizable to add lev...
I am currently in need of a seasoned specialist who can procure me a list of 1,000 real, verified American OWNERS of e-commerce businesses. I need the owne...Skilled Lead Generator: Your key responsibility will be sourcing the leads. As I haven't specified how this should be done, I am open to strategies you might suggest; be it web scraping, through online directories, or utilizing social media platforms, etc. - Niche Expertise: Having a deep understanding and experience with the e-commerce industry, particularly within the United States, is vital. You should know where to look and how to filter these businesses efficiently. - Quick Turnaround: I need these leads "ASAP". Please confirm your availability, proposed strategy, and timeframe to deliver this pr...
...slots are released for booking. - **Error Handling**: Capable of managing errors or site changes with notifications sent to my email about the booking status or issues encountered. - **Security Concerns**: Must handle login credentials securely and efficiently. **Ideal Skills and Experience**: - Proficiency in Python, JavaScript, or any suitable language for web automation. - Experience with web scraping and automation tools like Selenium or Puppeteer. - Understanding of basic security practices for handling login credentials. - Familiarity with cron jobs or similar scheduling methods for daily tasks. - Previous experience with automation scripts that interact with websites for booking or purchasing is highly desirable. By accomplishing this, you'll help ensure that I can ...
...generation campaign for my project. The ideal professional will use a combination of web scraping, ZoomInfo, and LinkedIn to gather high-quality leads that can drive our business objectives forward. Below are the details of the project and what I'm looking for in a freelancer: I need multiple professional to generate leads for all the industries in the United States, australia & canada. Fields required : contact first name, contact last name, title, company name, email address, industry, person LinkedIn profile.. Source from- Zoom info, lead411, LinkedIn I will order 60k list each week. This will be a long time and on going project I will need 6 categories list. Human Resources, Marketing, Purchase and Procurement, Construction & Contract...
I'm looking for a professional who can use Chrome browser for web scraping and macro text insertion to find and purchase telephone numbers using a specifiic website. This project is aimed at optimizing our approach to locating and securing the right services for our needs. Summary To provide a new screen scraping program to look and feel like the existing one, to access a web site using the Chrome browser, login with a username and password (stored in a text file) and add some parameters such as a house number and postcode (stored in a text file) and then use numbers stored in a separate input txt file to search for these numbers and then work thorugh this list to buy numbers if available and allow the user to manually enter a call forward number and click [Su...
...a unique mining script that will provide engaging content for players. Here's a brief on what I envision: - **Core Requirement:** Implement a comprehensive mining system with experience to be received when successful mining and a customizable level system to give the player bonus resources gathered. being able to hire AI workers to mine at mining businesses. to have the ability to mine with dynamite for higher reward. needs to be configurable to different locations - **Challenges & Rewards:** Including varying levels of difficulty in missions with corresponding rewards. - **Integration:** The script must integrate seamlessly with existing server features and databases while maintaining performance. - **Player Interactions:** Facilitate interaction...
I need an expert in data extraction to compile a database from LinkedIn. The database should contain specific information from user profiles. - Collect Data: The extracted data should focus on user profiles, specifically contact information. The most valuable contact information for this project is the user's email address. No other data needs to be gathered at this stage. - Ideal Skills: The freelancer should be proficient in Web Scraping or Data Mining and should have relevant past experience particularly in handling LinkedIn-based tasks or similar projects. They should also have data privacy knowledge since we're dealing with user contact information. Please ensure when bidding that you acknowledge the data...
I'm looking for an experienced data scraping expert to create a software or script that will effectively scrape specific information from LinkedIn profiles. The information to be extracted includes: - Name and job title - Education and qualifications - Skills and endorsements - Mobile number - Email address This tool will be primarily used for recruitment purposes. Hence, the perfect freelancer for this project should ideally have a background in Human Resources or a clear understanding of recruitment processes. Moreover, the data scraped needs to be automatically updated on a daily basis to keep up with any changes on the profiles. It's essential that the chosen applicant knows how to implement this feature. Previous experience with LinkedIn sc...
Project Requirements: 1. Objective: Create a fitness magazine , using that theme (). The content will be derived from our fitness store, YGL, hosted on Magento 2 (). We have urls for all products and blog posts on store , as well sitemap 2. Content Creation: - Utilize ChatGPT for writing articles. Articles will be based on product descriptions and existing posts from www.ygl.co.il. The inspiration for these articles can be found here: - We will provide specific prompts for ChatGPT to ensure content relevancy and quality. 3. Technology and Tools: - Use ActivePieces () to establish API connections and facilitate the integration process. ActivePieces will also be instrumental
I'm in need of a proficient Python Django developer to play a pivotal role in enhancing the functionalities of my website. Need on a monthly basis, daily 2-3 hours per day, I am only searching for freelancers not an agency. Key Requirements: - Solid understanding of Python language - Proficiency in web development using Python & Django - Experience in integrating APIs, Creating functions and scraping data from the website. - Using Github and experience in building the application on Digital Ocean. The ideal candidate should not only have a solid command of Python, but also be proficient in web development, particularly with regards to implementing user-centric features. As we settled monthly amount that we set for 2-3 hours per day.
I am looking for a skilled data scraper who can efficiently gather information from Transfermarkt, focusing on football transfers. This project requires a detailed and accurate data extraction. Analysis is helpful but not necessary **Requirements:** - Extract the following data fields: - Player name - Transfer fee - Transfer date - Transfer spend by position - Player market value at the time of transfer - Any other important transfer related information **Ideal Skills and Experience:** - Proficiency in data scraping tools and techniques - Experience with sports data analysis, specifically football transfers - Ability to accurately extract and compile data into user-friendly tables - Knowledge of Transfermarkt's stru...
I am looking for an experienced data scraper, capable of accessing and efficiently retrieving specific data from Businesses' website. The data to be scraped includes names, addresses, email addresses and phone numbers. Key Details: - The target businesses are businesses with a (company name). or web addresses. - The regions to be targeted in this scrape are businesses located in the United States. Qualifications: Ideal candidates should have excellent programming skills with experience in data mining, data scraping, and data analysis. Knowledge of Python, SQL, or R would also be highly beneficial to the execution of this project. Please make sure you have similar experience and your proposal also show the evide...
I require comprehensive and verified data on UK small to medium enterprises (SMEs) in the Healthcare sector. Information required includes: - Company Name - Contact Person - Phone Number I have no set number of companies I wish to include, so I'm open to varying list sizes. Please note, the priority is the quality of the data. Ideal candidates will have demonstrable experience with data mining and compilation, particularly within the business and healthcare sectors. A strong understanding of the UK healthcare market would also be beneficial. Accuracy, timeliness, and attention to detail are of paramount importance for this project.
...handles by name and address. Responsibilities: - Collaborate with the project team to understand the specific requirements for each website. - Design and develop the websites, ensuring they are visually appealing, intuitive to navigate, and responsive across various devices and browsers. - Integrate secure payment gateways and communication APIs for the international calling website to facilitate smooth transactions and seamless connectivity. - Implement robust search functionalities and data processing algorithms for the people search platform to accurately retrieve contact information based on user input. - Ensure the websites comply with data privacy regulations and implement appropriate security measures to protect user data. Requirements: - Proven expe...
...Python and web development to create a tool that will enhance my website, , by offering a price comparison feature. This project involves several key components: 1. **Web Scraping:** Develop a Python script to effectively scrape current prices from two specific websites: - - 2. **Data Management:** Once the prices are scraped, they should be neatly organized and stored in a Google Sheet for easy access and analysis. This process requires a developer familiar with Google Sheets API or similar technology. 3. **Website Integration:** Utilize the collected data to generate a new page on that will showcase the price comparison. This new page should blend seamlessly with the existing
...on an ambitious project focused on classifying numerical data to inform critical decision-making processes within my organization. This requires deep analysis and pattern recognition within vast datasets, seeking out correlations and classifications that are not immediately apparent. **Key Goals:** - Accurately classify large sets of numerical data. - Uncover and leverage underlying patterns within the data. - Provide actionable insights based on the data classification results. **Ideal Skills and Experience:** - Proficiency in data mining techniques and tools. - Strong background in statistical analysis and mathematics. - Experience with machine learning algorithms, especially those relevant to classification tasks. - Expertise in prog...
