Web Scraping Jobs

I need text data scraped from a specific website. I will provide the website URL and login details through chat, along with examples of the data I need. The scraping needs to be executed via either VBA or .NET, and I will require the source code. Key requirements: - Data needs to be compiled into an Excel spreadsheet. - Ability to navigate potential anti-scraping measures (if present). - Proficiency in either VBA or .NET. Ideal candidate would be someone who is well-versed in web scraping, has a deep understanding of both VBA and .NET, and can deliver the project in a timely manner. Experience with similar projects, particularly scraping text data from websites, will be highly regarded.

I'm looking for a detail-oriented freelancer to help me extract specific characteristics from products listed on an e-commerce website. Key Responsibilities: - Navigate through various product groups on the specified e-commerce site - Go through each product's dedicated page - Identify and select specified product characteristics such as dimensions, weight, material composition, color, functions, and other features - Accurately transfer this data into an Excel document Ideal Skills and Experience: - Proficiency in data extraction and Excel - Attention to detail - Familiarity with e-commerce sites - Ability to work independently and efficiently

I need someone to help me organize and analyze customer feedback and reviews in a Google Sheet. The raw data has been provided to me and needs to be filled into the spreadsheet. Key Responsibilities: - Organizing customer contact details alphabetically by name - Implementing an email format check for data validation purposes - Ensuring all data is accurately and neatly presented Ideal Skills: - Proficient in Google Sheets - Attention to detail - Experience with data organization and analysis

I'm in need of a specialized tool that can assist all customer Facebook marketing efforts. The core functionalities of the tool should include: - Exporting competitor post comments: I need the user id, first name, last name, and phone number (This must follow the Facebook customer list template). - Exporting 'Like' interactions from my competitors. - Exporting member information from relevant groups. The tool should export in CSV format. To legally collect the data you're interested in, you would need to use Facebook's Graph API, which requires creating an app in the Facebook Developer portal. This app would need to request specific permissions to access the types of data you’re interested in, such as public comments on competitor pages. Facebook reviews a...

I am looking for a professional who can create a comprehensive email database targeting property buyers in Asia, specifically vacation home buyers. Key Responsibilities: - Collect email addresses of potential vacation home buyers in the largest tourist countries visiting Bali - Gather information on their investment preferences and budget range. Ideal Skills and Experience: - Proficiency in data collection and market research. - Prior experience in targeting property buyers preferred. - Strong understanding of the real estate market of people buying property in Bali - Excellent data management skills.

I'm looking for a seasoned developer to improve the backend services of my website, , which is built on React and powered by AWS Python scripts. Key Tasks: - Implement new features, particularly enhancing the scraping capabilities and integrating a functionality that mimics the AI chat from ChatGPT. - Improve the efficiency and accuracy of the data scraping process from thedrudgereport.com. The ideal freelancer for this project should have extensive experience with React, AWS, Python, and web scraping. A background in AI and chatbots would be a significant plus. I'm looking for someone who can deliver high-quality work and help take my website to the next level.

I need a python script that leverages the request library to login into the website using cookies and click the vote button on my behalf Key Features: -proxy support: The script includes proxy support as only allow 11 votes from the same IP every 12 hours - Voting validation: After clicking the vote button the script should check the success of each voting attempt Ideal skill : -Proficient in python with a focus on the request library -Experience with web scraping and automation -Familiarity with proxy serves and their configuration _Ability to work with JSON files and understand their structure Please Note = I skipped the type of proxy support I need but I am open to your advice and which would be most effective

I'm looking for a skilled developer who can build a data scrubbing program for me. The primary purpose of this program is to scrape pricing data from Temu and subsequently, place the grabbed items onto my BigCommerce website. Key Requirements: - Create a program that scrapes product prices, descriptions, titles, and pictures from Temu. - Automate the process of uploading the scraped data onto a BigCommerce site. Ideal Skills: - Proficiency in web scraping, specifically with e-commerce platforms. - Experience with BigCommerce. - Strong programming skills, preferably in Python or similar languages. - Understanding of e-commerce trends and data analysis.

I'm looking for a web scraper that can extract product names and prices from an e-commerce site for a one-time data collection job. Ideal skills for this project include: - Proficiency in web scraping tools and programming languages (like Python, BeautifulSoup, Scrapy, etc.) - Experience with e-commerce site data extraction - Ability to deliver clean, organized data Please note, this project requires a keen attention to detail to ensure all data is accurately captured.

I'm seeking a detailed contact list of roofing, restoration, and mitigation companies located in Minnesota. The list should be compiled into an Excel sheet and include: - Company name and address - Phone number and email - Key contact person's name and role - Specific roles such as Owner, Sales Managers, and HR Ideal skill set for the job includes proficiency in data collection and Excel, and ideally, some experience or understanding of the roofing and restoration industry.

I need a Python script to read an Excel file containing user details and send birthday wishes via WhatsApp and Microsoft Teams. Details: - The Excel file contains five columns: NAME, MOBILE NUMBER, EMAIL, BIRTHDATE, and MESSAGES. - On each user's birthday, the script should send birthday wishes twice: once at 12 AM and again at 6 AM. - Messages are to be sent using the WhatsApp Business API and Microsoft Teams Webhook. - I will upload the Excel file manually. Ideal skills for the job include: - Proficiency in Python - Experience with Excel file handling in Python - Familiarity with WhatsApp Business API and Microsoft Teams Webhook - Ability to code a time-based script

I need a skilled professional who can scrape and save all information, videos and comments on a widely covered news story from the web. This includes: - Text articles: Collecting all relevant articles from various news websites. - Videos: Finding all pertinent video content from news sources and social media. - Comments: Capturing public sentiment from social media platforms, blogs, and forums. Ideal candidates should have experience in data scraping and a deep understanding of various media platforms. The ability to filter and prioritize content based on relevance and credibility is crucial. Please note that the format for the collected data has not yet been decided, so flexibility and ability to work with different formats (CSV, JSON, Database) will be appreciated.

I need someone to extract printed text from more than 50 PDF files which include images and present it in an Excel spreadsheet. Some of the data to be collected appears as text on the PDF files. The latitude and longitude are in white font on each image. Each PDF has three images, the text on each image is the same so there is only a need to obtain the latitude (the negative number) and longitude (the positive number) from one image on each PDF. I imagine this as an OCR data processing exercise rather than transcription so that once a template has been developed it can be applied easily to many images. Ideal skills for this task include: - Proficiency in data entry - Experience with OCR (Optical Character Recognition) software - Experience with Google Cloud Vision OCR - Attention to de...

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experience with similar projects wil...

I'm seeking a seasoned Python developer to enhance my existing script, which interacts with both Instagram and YouTube. The focus is on improving the script's scalability to handle larger tasks efficiently. Key Requirements: - Proficient in Python with a strong portfolio of script development and optimisation. - Hands-on experience with both Instagram and YouTube APIs. - Ability to improve script performance for scalability. - Previous experience with performance tuning is a plus.

I need a simple website with a backend addon to store user data. Django python bootstrap

I'm looking for an experienced professional well-versed in YouTube video management. I have a script that needs improvement and want you to upgrade it and start working with it. The focus will primarily be on tutorials and educational content. scraping knowledge on instagram. Key tasks will include: - Improving the current script for better engagement and clarity. - Managing the enhanced video uploading process The ideal candidate should have: - Proven experience working with YouTube, specifically with educational and tutorial content. - Strong scriptwriting and editing skills. - Knowledge of video uploading and management best practices on YouTube.

I'm seeking a proficient data miner to extract information from LinkedIn profiles of Lawyers. The ideal candidate should have experience with web scraping and data extraction. Key Tasks: - Extracting names and qualifications of Lawyers/Chartered Accountants/Company Secretary/. - Collecting their contact details. - Gathering information about their work experience. Skills and Experience Required: - Proficiency in data extraction tools and techniques. - Prior experience in web scraping, particularly from LinkedIn. - Understanding of professional qualifications and career trajectories of Lawyers. - Strong attention to detail to ensure data accuracy.

I need a Python-based software that can fetch and analyze financial data from various sources. Key Requirements: - The software should be able to pull data from stock market APIs. - It should be able to fetch different types of stock market data, including historical data, real-time data, and company financials. - The software should have the capability to perform comprehensive data analysis. Also software able to data in and out by means of excel entries. Ideal Skills and Experience: - Proficiency in Python is a must. - Prior experience with financial data analysis is highly desirable. - Familiarity with stock market APIs will be an added advantage.

I'm in need of a data expert who can help me gather 50,000 valid email addresses from companies that offer loans in the United States. These emails should be recent (not older than one month) and exclusively from companies, not personal emails. Tasks and Requirements: - Generate a list of 50,000 emails from various industry sectors, not limited to but including: Banking, Financial services, and Credit unions. - Ensure all email leads are valid and up-to-date. - Utilize any method of email verification, whether it's a third-party service, an in-house developed script, or manual verification. Ideal Skills and Experience: - Proficiency in data mining and email list generation. - Familiarity with the loan industry in the United States. - Experience with email verification tools and...

I'm looking for a data extraction expert who can help me scrape text data from a specific website. This is a one-time task. Ideal candidates should have: i need script i can pay max 10 AUD. https://www.gallerydirect.co.uk/hurston-rectangle-mirror.html#1102=6443&1105=6595 - Prior experience in web scraping - Proficiency in data extraction tools - Attention to detail to ensure the accuracy of the data extracted.

I am seeking an experienced developer to create a solution that can extract and read information from a real estate website while delivering two key functions: 1- a search capability 2- alert system for new listings that match specified criteria. The primary objective is to automate the collection of real estate data to enhance efficiency of searches and finding what clients need Main functions & Milestones: 1. Initial Planning & Requirements Definition - Finalize project scope, including key functionalities such as data extraction, search, and alerts. - Define search criteria for villas (e.g., price, size, city) as the first specific search function. 2. Web Scraping Prototype for Villas - Develop and test a script/code that can scrape and extract data from the rea...

I need a professional to assist me in downloading live financial data from a public financial website. The data will need to be converted into a dashboard in Excel. This dashboard will need to be updated in real-time to reflect the most current data. Ideal Skills: - Proficient in Excel and data visualization - Experienced in web scraping - Familiar with financial data Please note that I will provide the necessary inputs to facilitate this task.

I'm looking for someone to develop a tool that takes queries from Google Sheets, performs a Google search, scrapes the URL of the first search result, and then returns that URL to Google Sheets. The tool should work on demand, and only return the first result.

I'm looking to develop a Flask web application that scrapes comments from a specific YouTube video and performs sentiment analysis on them. The application should include features for filtering and searching comments based on their sentiment score. Key Requirements: - Scraping: The application should be able to efficiently scrape comments from a YouTube video. - Sentiment Analysis: The core functionality of the app is performing sentiment analysis on the scraped comments. - Filtering: Comments should be filterable based on their sentiment score. - Searching: The app should include a search functionality for finding specific comments. Ideal Skills: - Proficiency in Python and Flask framework. - Experience with web scraping and sentiment analysis. - Familiarity with YouTube's ...

Title: Collecting contact information from LinkedIn - Specialist needed. Content: The task involves automatically collecting in Sales Navigator: Searching for profiles of people working in indicated positions (company size, job title and keyword for the position) Actual data now should be collected Data sample - necessary to assess the quality of the data Collecting the following information: name, position, company name, email address (if available), link to LinkedIn profile Prepare a database in an Excel spreadsheet containing the collected information Purpose: to collect data Requirements: Experience in collecting data from LinkedIn Familiarity with data scraping tools Attention to accuracy and completeness of data Adherence to LinkedIn rules and data protection Deadline...

I'm looking for a meticulous freelancer to assist with data entry involving text data sourced from various online databases. Key Responsibilities: - Extracting text data from specified online databases - Ensuring accuracy and attention to detail during the data entry process Ideal Candidates Should Have: - Experience in data entry, particularly from online databases - Strong attention to detail - Excellent ability to follow instructions and data entry guidelines

I need text data scraped from a specific website. I will provide the website URL and login details through chat, along with examples of the data I need. The scraping needs to be executed via either VBA or .NET, and I will require the source code. Key requirements: - Data needs to be compiled into an Excel spreadsheet. - Ability to navigate potential anti-scraping measures (if present). - Proficiency in either VBA or .NET. Ideal candidate would be someone who is well-versed in web scraping, has a deep understanding of both VBA and .NET, and can deliver the project in a timely manner. Experience with similar projects, particularly scraping text data from websites, will be highly regarded.

looking for a pyton web script to extract data to an excel spreadsheet

I'm in need of a JavaScript that can help me bypass Cloudflare's Human Verify Captcha. This script needs to be affixed to my web browser to facilitate web scraping tasks, which range from simple data extraction to more complex content monitoring and price comparison. Key Requirements: - A robust JavaScript script capable of bypassing Cloudflare's captcha - Easy integration with my web browser - Ability to support a variety of web scraping tasks Ideal Skills: - Proficient in JavaScript, specifically in creating browser-compatible scripts - Experienced in web scraping - Knowledgeable about Cloudflare's captcha system and potential bypass techniques Please note, this script will primarily be used for web scraping. As such, it should be efficient and capable of handling ...

I'm seeking assistance with data entry. The task involves working with numeric data that is currently stored in digital files. The files are in CSV format. Ideal skills and experience: - Proficiency in Excel - Experience with data entry from CSV files - Strong attention to detail to ensure data is accurately entered - Ability to handle numeric data.

I'm in need of a seasoned freelance developer to create a bespoke web scraping script. This script should identify websites lacking specific widgets (namely, chatbots) and integrate seamlessly with PhantomBuster to automate a variety of tasks. Key Tasks: - Create a web scraping script in Python, JavaScript, or Ruby that identifies websites without chatbots. - Ensure this script can be run on any of the aforementioned programming languages. - Integrate the web scraping script with PhantomBuster. PhantomBuster Integration Tasks: - Automate data export to a spreadsheet - Set up automated email notifications - Ensure posting of data to a CRM system Ideal Skills and Experience: -PhantomBuster API developer - Proficiency in Python, JavaScript, and Ruby - Extensive experience in web scra...

I need a crawler that can access a specific page on the MakeMyTrip website and fetch daily prices for different room categories (Deluxe Room, Standard Room, Suite) on a particular date. The fetched prices should be delivered in an Excel format. Ideal Skills and Experience - Proficiency in web scraping technologies. - Previous experience with data extraction from MakeMyTrip or similar travel websites is a plus. - Strong skills in Excel and data formatting.

We will scrape some past and live statistics for live football games from a bet site. And when the conditions are matched we will send a telegram notification.

I need a proficient data scraper to extract information from specific Facebook and Instagram pages. The data to be collected includes: - Profile information: Name, Email, Phone The primary use for this data will be for marketing purposes. The final output should be delivered in an Excel spreadsheet. Ideal candidates for this project should have: - Proven experience in data scraping, specifically from social media platforms - Familiarity with marketing data requirements - Proficiency in Excel Please ensure you can adhere to privacy and data protection regulations while bidding for this project. Facebook Pages: Instagram:

I'm seeking a freelancer who can generate a list of names and email addresses of individuals who speak English and have a net worth exceeding $5 million (excluding their primary residence): Ideal Skills: - Proficiency in data mining - Understanding of finance and real estate industries - Familiarity with global high net-worth individuals This list will primarily be used for a marketing campaign. Please ensure the data is accurate and up to date. Let me know how many you can provide and at what price.

I am in need of a professional data entry specialist able to handle a variety of data types and formats. This includes text, numbers, and images, with the bulk of the work being in Excel format, but also involving Word and PDF files. The task involves inputting a small amount of data, less than 100 entries. Ideal Skills and Experience: - Proven experience in data entry, ideally with a variety of data types - Expertise in Excel, with the ability to organize and manage data effectively - Attention to detail to ensure accurate data entry - Time management skills to complete the task efficiently - Familiarity with Word and PDF formats Your precision and understanding of various data formats will be key in executing this task successfully.

I have a list of 28,000 contacts in Apollo. Not all will have emails, but I need the following details exported for each contact into Excel: Full name, Email address, LinkedIn profile address, and Company. I need this done quickly and efficiently. Please do not clean or validate the data, just export it as is.

I need a GoLang developer with substantial large scale web scraping experience. The task will involve scraping general public web data from an extensive array of 50 million websites on a monthly basis. Ideal Skills and Experience: - Proficient in Go Lang with a strong understanding of its web scraping libraries and tools. - Previous experience with large scale web scraping. - Ability to efficiently handle and process large volumes of data. - Strong problem-solving skills to overcome potential obstacles in the scraping process. - Familiarity with ethical considerations in web scraping.

I'm looking for an expert to help me deploy my R code as a service. This service primarily revolves around making prediction using dara analysis. Key requirements: - The service needs to interact with various external systems. - It will specifically need to connect with APIs and third-party website. Ideal skills and experience for the job: - Strong experience in deploying R code and python code as a service. - Familiarity with APIs and third-party web services. - Knowledge in automating tasks and data analysis would be a plus.

I am looking for a developer who can create a custom job application automation tool for me. This software should be able to scrape job listings from LinkedIn, Indeed, Glassdoor, and Targetjobs, tailor my resume for each job description using job-specific keywords, format adjustments, and personalized cover letters, and apply with one click. Key Features: - Job Scraping: The tool should be able to scrape job listings from multiple platforms. - Resume Customization: The software should tailor my resume for each job using job-specific keywords, adjusting the format as needed, and inserting personalized cover letters. - One-click Applications: After tailoring, the software should allow me to apply with a single click. - Job Filtering: The tool should filter job listings by job title. Ideal ...

Required Job. WEB scraping / Web Scraper. Project Details. A. WEB scraping / Web Scraper. B. Language: PHP C. End user or Open / Public page data scraping. D. Prefer: Function Like, PHP file_get_contents or PHP Curl (GET/POST) D. After data scraping we want store in mySql DB (Its my owrk). For Example I want to Scraper this website data: and

I'm seeking a diligent Virtual Assistant to help me collect contact information from various business websites. Key Responsibilities: - Collecting contact information from business websites - Ensuring the data is accurate and up-to-date Ideal Skills: - Previous experience in data collection - Proficiency in using the internet for research - Excellent attention to detail

I'm in need of a skilled Python developer who can scrape text content from a specified website. The project does not currently require data formatting or scheduling for scraping tasks, but the ability to provide the scraped data in different formats (like CSV, JSON, or Excel) would be a plus for future tasks. Ideal Skills: - Proficiency in Python and web scraping libraries (like BeautifulSoup, Scrapy, or Selenium) - Experience working with text data - Knowledge of data storage formats (CSV, JSON, Excel) Experience: - Previous web scraping projects in google sheets - Data analysis and processing - Python programming

I'm looking for a freelancer who can build an email database of Australia-based investors primarily interested in consumer / FMCG products. The data gathering should focus on LinkedIn and Facebook, with the goal of creating a comprehensive and targeted database. Key Requirements: - Expertise in data mining and web scraping - Proficiency in LinkedIn and Facebook - Prior experience in building investor databases - Understanding of the consumer products industry - Strong attention to detail Please note that while I am currently only interested in email addresses, the ability to collect additional investor information (full name, company name, phone number) would be a plus.

I'm in need of a specialized tool that can assist all customer Facebook marketing efforts. The core functionalities of the tool should include: - Exporting competitor post comments: I need the user id, first name, last name, and phone number (This must follow the Facebook customer list template). - Exporting 'Like' interactions from my competitors. - Exporting member information from relevant groups. The tool should export all this data in CSV format, which is the only output format I require. Ideal skills and experience for this job include: - Expertise in data extraction and web scraping. - Previous experience with creating or working with social media marketing tools. - Proficiency in developing software that can interface with Facebook.

I'm looking for a developer to create a website that can monitor sales figures and price changes in real-time from two specific platforms: and www.douyin.com. This tool will assist in tracking market trends and product performance across these platforms. Ideal skills for this project include: - Proficiency in web scraping and data extraction - Experience in developing real-time monitoring tools - Familiarity with the Chinese e-commerce landscape As a part of the project, I do not require alerts or notifications for specific events. The focus is solely on the collection of data from these two websites. Xiao hongxu Enable viewing real-time sales by category on Xiaohongshu, showing weekly, monthly, and yearly sales. Enable viewing sales by store on Xiaohongshu Douyin Enable view...

I need a web script that can handle HTTP POST requests to download MP3 files from a password-protected website, upload them to Amazon AWS S3, and return the public URL of the uploaded file. Requirements: - The script should use Puppeteer to handle the downloading and to bypass the reCAPTCHA challenges on the website. - The app should be able to handle the login process using a username and password. - It should properly manage the downloading, uploading, and URL returning processes. Ideal Skills: - Proficiency in JavaScript and experience with Puppeteer. - Familiarity with Amazon AWS S3 and how to upload files to it. - Experience with handling HTTP POST requests in a web app context. - Understanding of how to integrate with to bypass reCAPTCHA. - Knowledge of working with MP3 files. ...

I'm seeking a skilled developer to create a program that collects business data from the Korea Map. Ideal Skills: - Proficiency in data scraping and software development. - Experience with map data crawling. - Knowledge of Python, Java or similar programming languages. A very, very simple program. Just collect data and save it in Excel. How it works When you press the start button after entering a keyword, the program enters the keyword on the map and crawls from the left to the right end, and then goes down again to crawl all the information on the map and save it in Excel. In a nutshell, it crawls all the areas on the map and removes duplicate collections.

I'm seeking a corporate trainer for an advanced Python training program in Bangalore, India, lasting two weeks. The trainer should have expertise in Python's application in data analysis and visualization, machine learning, and web development using Django and Flask. Key Requirements: - Proven experience as a Python trainer - In-depth knowledge of advanced Python topics - Familiarity with data analysis and visualization tools - Experience in machine learning - Proficient in web development with Django and Flask - Based in or able to travel to Bangalore, India