Web scraping class jobs

I'm looking for a Python developer to assist me in creating a web scraper that can extract specific text content from a website on a weekly basis. The scraped data should be efficiently saved to a CSV or Excel file for easy review. Capable of being plugged to a distribution app. Key Requirements: - Develop a Python-based web scraper that targets a website to extract text data - The scraper should be designed to run on a weekly schedule - Ensure that the code is concise and easy to understand for potential future modifications - Store the scraped data in a CSV or Excel file format Skills and Experience: - Proficiency in Python programming - Experience with web scraping libraries such as BeautifulSoup or Scrapy - Understanding of scheduling tasks in Python...

I am looking for a professional to scrape LinkedIn profiles for the purpose of lead generation. - The data I need extracted includes Name, Mobile Number, Email ID, and Company. - The intention is to use this information for email marketing. I need the freelancer to scrape more than 5000 profiles for this project. Ideal Skills: - Proficient in LinkedIn data scraping - Experience in lead generation - Strong attention to detail - Excellent communication skills Please let me know if you have handled similar projects in the past. Thank you.

I'm looking for a professional who can scrape specific tables on a government website for insurance claim statistics. Key Requirements: - Web Scraping: You should have prior experience in web scraping and can navigate through the website's structure to extract relevant data. - Data Extraction: The main focus will be on compiling data related to insurance claim statistics. The final deliverable should be a well-organized dataset with accurate claim statistics. Please share your experience in similar projects.

I'm seeking a freelancer to develop a custom web scraping script. The goal is to curate a comprehensive database of restoration and IICRC technicians in Australia. Specifically, I need the following information from their websites: - Business name - Phone number - Email address - Location (state, suburb, postcode) Websites without data available to scapers will require manual collection The ideal candidate should be well-versed in web scraping, particularly with experience in extracting data from websites into an organised and structured format. You should also possess strong problem-solving skills to handle any complications that may arise during the scraping process. This is a specialised type of cleaning so the database should be broken down i...

I'm in need of a web crawler that can extract specific data from a large online ads website. The extracted data should then be neatly exported to a Google Sheet. Key requirements: - The crawler should not be intrusive to the host website. - I want the crawler to crawl current and expired ads based on links present in the site map, as historic data is also of importance to me - You should be able to provide a way for me to run this crawler myself at any time - ideally on a monthly basis. I haven't yet decided on the precise fields to be extracted. I'm looking for someone with the skills to recommend suitable fields that could be beneficial for my project. It's important that the extracted data is organized and easily readable once exported to Google Sheets. ...

I'm in need of a skilled web scraping expert who can help me compile a database of local businesses. The data I need should include company name, physical address, email, phone numbers and their social media profiles. Key requirements: - Data extraction from multiple websites: I'm looking to collect this information from a variety of sources, not just a single site. This will require the ability to navigate various structures and formats, so experience with diverse web scraping is a must. - Targeting local businesses: The focus of this project is to gather data specifically from local businesses. This implies you should have the know-how to identify and extract data from these specific types of entities. - Data fields: The most crucial data I need in...

I urgently need a Python script created to scrape data from Website 1 and write it to a CSV file. The data I need to extract is specific to TVL daily total. Site: Key Requirements: - Develop a Python script for web scraping - Extract TVL daily total data from - Save the data into a CSV file Ideal Skills: - Proficient in Python programming - Experience with web scraping tools and techniques - Strong understanding of data handling, especially writing to CSV files - Good communication for timely updates on the project's progress.

I'm seeking a skilled web developer to create a financial information website with features similar to forexfactory.com. The website will be designed with a modern and minimalist aesthetic. Key features include: - Live forums page: This will allow users to engage in financial discussions, share insights, and connect with other members of the community. - Economic calendar: We need a comprehensive economic calendar that notifies users of upcoming reports, events, and indicators that may impact the financial markets. We will need to find all the sources the main information comes from and scrape them using provided API's from the government sites that they provide usually. - SEC Insider Traders Page: This is a vital component of the website. It should include: - A list of...

I'm looking for a skilled Python developer to help me with a scraping project. I need to extract specific product data from a website's table. Skillset: - Proficiency in Python and Scrapy - Experience in web scraping - Familiarity with handling web popups The website () contains a table with important product information. For each product, I need the following details scrapped: Certificate Type Certificate Number Product Type Organization Name Country Issue Date Expiry Date in addition to Product Details Brand Model Description Barcode The data should be saved in a CSV file. There are no specific rules or requirements to be followed during the scraping process.

...perform searches and click on search results multiple times. Key Project Requirements: - The tool should be built using Python, Java or Visual Basic - The primary goal of the tool is to perform automated web browser searches and click on various results - The tool should utilize Google Chrome as the web browser To give you a better idea, the tool should: - Conduct multiple web searches on Google - Click on a configurable number of search results from the returned search page Ideal Skills and Experience: - Proficient in Python, Java or Visual Basic - Experience in browser automation and web scraping - Familiarity with Google Chrome's automation capabilities If you have experience with similar projects or expertise in the mentioned languages, I&...

I'm in need of a skilled Python developer to work on a web scraping project. Key Requirements: - I'm primarily focusing on Web scraping as the main functionality for the project. - You should be well-versed in Python and have a proven track record in data analysis. - Knowledge of web scraping is essential to ensure efficient and reliable data extraction.

I am looking for a flyer with an Arabesque design for kids. Arabic Language Institute (add logo) presents Arabic for Kids (add picture of kids learning Arabic) Ages 5 to 10 - Reading - Vocabulary - Speaking Starting Saturday, June 1st at Masjid Darul Islam 602 Salem Ave, Elizabeth, NJ Class Options 1 Day $10 per day 2 Days $15 per weekend Saturday 12:00 noon to 1:30pm Sunday 12:00 noon to 1:30pm Scan QR Code for Registration

I need a Python program that can tap into Yahoo's fantasy football datasets using their API and extract various essential pieces of his...associated League ID (each league created by Yahoo is given it's own unique ID that a league member can provide) - the associated Game Key (there is a unique Game Key provided by Yahoo by fantasy sport and by year) - I have an online resource that outlines the baseline setup for what is required to leverage the Yahoo API, so can provide that I'm looking for a programmer who has experience in web scraping and working with APIs, especially the Yahoo API. Knowledge of fantasy football would be a very helpful plus, but not an absolute necessity. The ideal candidate should be able to deliver within 2-3 weeks, although there'...

I have a web scraper script that needs fixing. It's designed to scrape various URLs from the Apollo website. Key Requirements: - Scraper debugging: The script is currently not working properly, and needs to be fixed. - URL scraping: The script should be able to successfully pull the data from the selected URLs on Apollo website. Experience with: - Web Scraping: Previous experience in web scraping is essential, as the data needs to be pulled accurately from this specific website. - Script Debugging: Ability to identify and fix issues within an existing script. - Proficiency in Python or relevant language for web scraping. - Knowledge of Apollo website structure. Please make sure your bid includes information on how you pla...

I'm seeking an experienced data extraction specialist to scrape both HTML and text files for specific data. Particulars to look for will involve the text content within these files that follows a mixed format structure so would require vast knowledge and understanding of both table format data and paragraph-style data. Key Skills and Experience Required: - Strong abilities in web scraping - Adept with HTML, text parsing - Knowledge of data formats and how to transform data - Proficient in CSV file generation. We need a comprehensive extraction that maintains the integrity and accuracy of the data. As these files do come in multiple formats, versatility and attention to detail are paramount on this project.

...skilled and experienced Data Scraping Specialist to optimize and significantly increase the speed of our current data scraping processes. The ideal candidate will have extensive experience in web scraping, advanced knowledge of bypassing anti-scraping measures, and proficiency in utilizing cloud-based solutions for enhanced performance. Strong problem-solving and hacking skills to navigate complex web security systems are essential for this role. Responsibilities: Analyze and improve existing data scraping scripts to maximize efficiency and speed. Implement and manage cloud-based solutions (AWS, GCP, Azure, etc.) for scalable scraping tasks. Develop advanced strategies to bypass anti-scraping measures like CAPTCHAs, rate l...

I'm looking for a skilled freelancer with prior experience in data scraping to help me extract specific text content and URLs from a public site. Key Details: - Your main task will be to collect the text content and URLs from the site. - Previous experience in a similar project is a must. - Please provide me with details regarding your experience in your application. The purpose of this data scraping project is for market analysis.

I'm looking for a data scraping specialist proficient in leveraging social media platforms, business directories and website scraping. The goal is to create an Excel sheet with approximately 500 entries for market research purposes. Skills & Requirements: - Proficient in data scraping from multiple sources - Capable of filtering and sorting data - Able to extract and compile the following data fields: zip codes, locations, contact information, business name and industry. The successful candidate should demonstrate experience in similar projects, showcasing their ability to find and compile information efficiently and accurately for market research purposes.

I'm looking fo...White House website or through a manually updated database. Key Features: - Development for both iOS and Android platforms - Implementation of user notification features including push notifications, email alerts, and SMS alerts. Ideal Skills and Experience: - Proven track record in developing and launching user-friendly mobile applications for both iOS and Android - Familiarity with APIs and web scraping to acquire real-time data from government websites or the ability to create a reliable, manually updated database - Experience in integrating push notifications, email alerts, and SMS alerts into a mobile application Please note that this project may involve a degree of flexibility, as the method for acquiring flag status information has not been def...

I need a comprehensive web scraping task done on Yellowpages for business broker. The goal is to extract the following data about businesses: - Business name - Address - Phone number - Email - Website - Contact Person I'm looking for a professional who is well-versed in web scraping and can deliver accurate and complete data. Skills required: - Proficiency in web scraping techniques - Experience with scraping - Attention to detail to ensure all relevant data is captured - Ability to deliver in a timely manner Please note that the number of pages to be scraped is not defined, meaning the task might involve a large number of results. The scraper should be able to handle this efficiently.

I'm looking for a freelancer to help me extract financial data and regulatory filings from a tax website. This involves scrapping website using the provided credentials...approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) - Proficient in creating PDF documents from extracted data - Adept at handling large amounts of data - Familiarity with tax websites would be a plus but is not neccesary because it ...

Please Sign Up or Login to see details.

I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.

I need a Java or python3 programmer to create a sensor-data... Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and automation - Knowledge of cookies and their generation - Experience in simulating sensor data such as mouse movements and keyboard interactions Please note, the success of this project is heavily dependent on the ability to accurately simulate sensor data and trigger the generation of the _abck cookie on the specified website.

Education Website with Live Class Feature The project requires comprehensive full-stack development skills, with the aim to create a robust and functional website targeting students. The layout should be intuitive, offering a seamless learning experience. Key Features: - A fully functional and interactive landing page that includes contact forms and social media integration for enhanced communication. - A secure payment gateway offering an effortless checkout process for users. - Implementation of video and study material storage facilities. - Live classes integration providing real-time learning experiences. Study Material Details: - Incorporation of text files, video lectures, and interactive quizzes for a well-rounded learning experience. The project offers a strict time...

I am seeking a highly creative and skilled freelancer to design a video invitation card for a special event I am planning. The video should radiate elegance and class, appealing directly to my friends and family. The successful candidate should be excellently adept at: - Graphic Design - Video Editing - Animation The inclusion of the following elements is essential: - A well-crafted personal photo collage that will touch hearts - Animated text that adds a touch of class and uniqueness - Choosing or creating a befitting music or voiceover that complements the overall feel of the video It would be highly advantageous if you have prior experience creating similar video invitation cards, particularly ones that incorporate classic style elements effectively. Proven skills in bl...

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentatio...

I'm in need of a multi-user web portal that will facilitate the connection between trainers and students. The portal will have the following features: - **Multi-Login System**: There needs to be a seamless and secure multi-login system to accommodate both trainers and students. - **Search Functionality**: Users should be able to search for trainers or classes based on the city or trainer's name. This will make it easy for students to find trainers that are close to them or whom they may have heard of. - **User Profiles**: Each trainer or class should have a detailed profile which includes: - Biography: A brief description of the trainer and their training methods. - Reviews and Ratings: Users should be able to rate and write reviews about the trainers/class...

...corporate identity and logo. The aim is to create brand recognition, present a professional image, and differentiate ourselves from competitors in our niche. I am seeking a proficient artistic designer who can create a unique and captivating logo for brand recognition, website use, and product labeling. Expectations: * Develop a logo and corporate identity that's innovative, yet represents a sense of class. Something simple but distinct like luxury brands. * Adherence to a color palette of black, white and touches of burgundy. I'm open to different gradations and intensities of these colors to make the logo pop. * We want the logo to use the image of a lynx or a fox. * Develop a manual with the brand corporate identity to explain how and when the logo must be used (co...

i have Pojo class where it is picking property value from api response as integer in the Pojo Class: @JsonProperty("intensity") private Integer intensity; public Integer getColor() { return color; } public void setColor(Integer color) { = color; } and in parser class (INTENSITY, ((), 0)); The problem is sometimes the Api giving the color value as string not as interger but only on on checkbox config we add and this already defined in java if(checkVariant is true) then consider it string and parse it what i have to do to fix my code based on that condition so i can parse the string value this way: updateProperties("color", ((), ));

I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...

I'm searching for an experienced graphic designer to create a unique, sophisticated logo for my pastry shop named "Voilà". Key Requirements Include: - Incorporating the name "Voilà" into the logo design - Conveying a sense of class and sophistication - Utilizing a color scheme of burgundy/champagne, or gold/ rose gold Skills and Experience: - Proficiency in color theory - Strong background in logo and brand design, especially for food-related businesses - Ability to capture the essence of a brand's identity in a visual format I look forward to seeing your portfolio and discussing potential designs for "Voilà". I want to use my logo for Instagram profile, to add on my personal pastry photos, and also on stickers an...

...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...

I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.

Quiero pasar estas dos funciones de C++ a C template<class T> int EEPROM_put(int ee, const T& value) { const byte* p = (const byte*)(const void*)&value; unsigned int i; for (i = 0; i < sizeof(value); i++) foo(ee++, *p++); return i; } template<class T> int EEPROM_get(int ee, T& value) { byte* p = (byte*)(void*)&value; unsigned int i; for (i = 0; i < sizeof(value); i++) *p++ = foo(ee++); return i; }

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experien...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals....

...information and disease descriptions. Requirements: Programming Language: Preferably Python. Libraries: Experience with web scraping libraries like BeautifulSoup, Selenium, and data processing libraries like Pandas. Output Format: Ability to export data into an Excel file using Pandas or similar libraries. Error Handling: Robust error handling to manage failed requests and parsing errors. Compliance: Adherence to the websites' terms of service and rate limits to avoid being blocked. Project Scope: Input: A list of CRM numbers and a list of CID numbers. Process: Automate the lookup and data extraction process. Output: An Excel file with the compiled data. Skills Required: Web Scraping Python Programming Data Processing Automation Excel File Generation ...

...person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strategy in finding those companies and collecting names and emails of relevant employees, 2- Total number of expected V...

Please Sign Up or Login to see details.

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I need a robust class management system that caters to the needs of a large-scale educational institution. Our primary users will be students, teachers, administrators, and parents. Key Features: - Attendance Tracking: The system should allow teachers to mark and track the attendance of students. - Grade Management: An intuitive grade management system that enables teachers to input and calculate grades effectively. - Messaging System: A communication platform that facilitates seamless interaction between all stakeholders (students, teachers, administrators, and parents). By Whatsapp - Schedule Change Option: The system should have a feature that allows for the smooth management of schedule changes. User Base: - The system will cater to over 100 users, so scalability and performan...

I need to Extract followers of group members of the link I will provide

I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the proj...

I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.

...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...

I need a script that can scrape the Google Play store specific data from ...result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant experience and a brief overview of your proposed approach. The scrip...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you