Web scraping with ruby and nokogiri jobs

I'm loo...LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I value c...

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient ...

MAX BUDGET 45€ - No Dummy Offers . Please don't send me dummy offers just to make the initial Contact and then ask for more money. The Project: Develop the project in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create...

...data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency ...

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensi...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or automation is a plus.

Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership....

scrape data from darty site and export it into excel file.

I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these task...

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm in need of a skilled freelancer who can perform daily scraping of job titles from Indeed. Ideal Skills and Experience: - Proficient in web scraping, particularly from Indeed - Able to automate the scraping process on a daily basis - Competent in delivering data in CSV format Data Update Frequency: - It's essential that the scraping is carried out daily Delivery Format: - The scraped data should be provided in a CSV file Looking forward to your proposals.

...assist with a project that involves a blend of web scraping and data analysis, with a focus on the following tasks: - Extracting data from multiple websites - Automating data extraction and parsing - Analyzing and visualizing scraped data The ideal candidate should have: - Proficiency in Python, with a strong understanding of AI and Machine Learning - Hands-on experience with web scraping, particularly working with diverse data sources - Ability to automate data extraction and processing efficiently - Adept at data analysis, with the ability to visualize and interpret data Although I haven't specified any particular tools or libraries, your familiarity with tools...

In this project, I'm searching for an experienced Python Developer who exhibits strong proficiency in web scraping, artificial intelligence, and machine learning. Key Responsibilities: - Utilize your expertise in Python, specifically focusing on AI-related tasks. - Web scraping will also be a significant part of the project, though details on the targeted data type are yet to be defined. Ideal Skillset: - Extensive experience with Python - High proficiency with AI and machine learning algorithms - Proven record of successful web scraping projects Please include samples of relevant Python, AI, or web scraping projects you've completed as part of your bid. I look forward to collaborating on thi...

...a comprehensive product cross-referencing and price comparison tool developed for my e-commerce website. The tool should be capable of processing data from around 30,000 products across 5-10 different stores. Key Requirements: - Cross-reference 30,000 products from 5-10 stores: The tool should be able to analyze and compare prices for a substantial number of products across multiple listed stores. - Avoiding Captcha and ad blockers: The tool should be designed to function effectively while avoiding common barriers like Captcha or ad blockers. - User-friendly filters: The tool should offer a variety of filters to help users refine their search results. - Display results directly on product pages: The comparison results should be integrated and displayed o...

I am looking for a freelancer who can help me automate my web search for bid opportunities (RFPs) for my telecom company. Currently, I rely on searching manually, but this process is time-consuming and not as efficient as I'd like. Key Project Requirements: - You will be responsible for setting up an automated search that looks for RFPs related to "fiber optic" or other telecom-specific keywords, which are due every May 2024 or similar queries. - This automated search needs to run every 2-3 weeks, ensuring that I stay up-to-date with new bid opportunities and future due dates. - You should have a deep understanding of web scraping and automation to accomplish this task. Additional Information: - I would like to receive n...

...to make the initial Contact and then ask for more money. The Project: Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpage (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpage, indicating what needs to be extracted/copied to set up the new flow. For exa...

...in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages 1-1087 Freelancer must provide a sample file of 150 records to confirm the format and data accu...

I'm in need of a Chrome extension that can autom...in need of a Chrome extension that can automate certain tasks within the browser. Here's what I'm looking for: (I have some 3-5 extensions I want, so if you give attractive bid and do good work, you can expect to get more chrome extension projects from me) - **Functionality:** The primary purpose of this extension would be to check specific elements on the pages the user visits. - **Elements to Check:** The extension should be able to read and process the text content and links on the page. Ideal candidates should have experience in: - Chrome extension development - Web scraping and automation - JavaScript and possibly other relevant technologies for extension development...

...chrome extensions Key Tasks: - Develop a user-friendly Chrome extension - Implement data extraction techniques to collect and organize information from various web sources. The ability to filter and manage this data is crucial. - Set up the extension for browser automation tasks. It should be able to perform repetitive actions on a webpage without manual intervention. Communication: I prefer to manage communication with the selected freelancer through the messaging feature available on Freelancer.com. Ideal Candidate: The ideal candidate for this project should have a proven track record in developing Chrome extensions, particularly those involving web scraping and data extraction. Experience in browser automation is a plus. I am l...

...focused on data analysis, process automation, and digital marketing. Key Responsibilities: - Develop and implement an autonomous agent platform with Libraries of tasks, agents, tools to be organized by a user into Crews. - Ensure the agents are capable of accessing and interpreting data from a variety of sources, including databases, APIs, and websites. - Create a user-friendly Panel front end for the CrewAI platform that presents the user insights and controls of Crews in a clear and intuitive manner. Ideal Skills and Experience: - Proven experience in developing autonomous agents. Previous experience with AI, data analysis, process automation, and digital marketing would be highly desirable. - Proficiency in worki...

I am currently in need of a pro...this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through database creation. This project is crucial for our sales outreach and we are looking for ...

I need assistance with scraping data from a website and delivering it in an Excel file. The specifics of the project are as follows: I am looking for a person who will conduct scraping sessions for our business on a regular basis. Desired skills are knowledge of screen-scraper software, sql, Someone with Python knowledge will be better. Willing to follow instructions. Not cramped up with other jobs or other side hustles. Need to have solid internet connection. Expected work takes 5-10 hours per week, once fully trained. Must be responsible. Able to accept PayPal. - The source of the data is a website. This means the freelancer needs to have experience in web scraping. - The data should be delivered in an Excel file. Proficiency i...

I'm in a urgent need of Ruby Expert for the study project. I have a devloped code and it is running on heriku. The technology used are as below:- Ruby (Backend language) Ruby on Rails (Framework) Bootstrap (frontend library) Html + scss ( Front end) Jquery + JavaScript Database : Postgresql Due is tonight so if you are available now it will be helpful. Thank you. This is a time-sensitive project, so please only apply if you can dedicate the necessary time and expertise.

I'm looking for a freelancer to help me with email scraping to build a targeted email list in the education sector. Specifically, I'm interested in parents who are seeking tuition services for their children. Key Responsibilities: - Conducting research online to identify and extract email addresses of parents seeking tuition services for their children - Organizing the list in an easily accessible format that I can utilize for email marketing campaigns Skills and Experience: - Proficiency in email scraping and list-building - Prior experience in targeting the education sector is desirable - Understanding of lead generation and email marketing best practices

...platforms - Facebook and Instagram. Key Project Specifications: - Scrape email addresses from both Facebook and Instagram. - Selection of the profiles for scraping should be primarily based on the following criteria: levels of user engagement and followers count. - Along with the email addresses, extract additional user information namely: the account name and its location. Ideal Candidate Profile: - Must have experience in deducing complex social media algorithms. - Understanding of digital privacy laws to ensure compliance during the extraction process. - Fluency in software that can automate this extraction process would be advantageous. My ultimate goal is to utilize this function to better target digital marketing campaigns, i...

I'm seeking an expert in web scraping to specifically help extract data (price, stock availability, description, review content,..) from e-commerce platforms. Your specific task will entail: - Identifying and implementing the most efficient and effective way to scrape data. - extracting all data related to a product (picture, price, description, reviews, rating,...). Your method should maintain adherence to all legal and ethical guidelines - I'll need details on this as your bid. This project will require: - Proficiency in web scraping tools and techniques. - Sound knowledge of data extraction and storing processes. - Ability to work with undisclosed e-commerce platforms. - Familiarity with review str...

I'm in need of a skilled professional who can scrape data from Google. The project requires the extraction of names and email addresses for specific profiles to be used as a potential leads database. Upon successful extraction, the data needs to be presented in an Excel spreadsheet, CSV, etc. Ideal Skills and Experience: - Proven experience in data extraction from websites - Proficiency in Excel - Strong attention to detail and accuracy - Experience in extracting usernames and emails is a plus Deliverables: - The extracted Data - The data must be clean, organized, and formatted in an Excel spreadsheet I look forward to receiving your proposals!

I am looking to develop a web-based job extractor that's capable of aggregating job listing from various platforms across multiple countries with the following features: # Source Selection : The ability to select multiple sources for job scraping, including Google jobs. # Comprehensive Job Details: Extraction of all details included in the job listing, such as job title, company name, location, job description, requirements, etc. # Web Interface: A user-friendly web interface where users can enter the URL of the job listings page and initiate the scraping process. # Downloadable in .csv Format: The scraped job data should be downloadable in .csv format for easy analysis and storage. # Filtering Options: Ability to filter jo...

I am looking for an expert in web scraping who can efficiently extract business leads. While the primary purpose of the project was not specified, it is undeniable that these leads will play a pivotal role in marketing efforts, like sales lead generation, market research, and contact information collection. Although I did not mention a specific source site, note that the target is business owners, and their revenue and contact information. Therefore, having experience in scraping from professional networking and business directory websites such as LinkedIn or Yellow Pages would be welcomed. Lastly, the exact number of leads that I need hasn't been defined, so I am open to both small and large-scale operations. Ultimately, thei...

I'm currently using a Python scraping bot for my project, but I need to make some adjustments. Key Requirements: - The primary modification involves segmenting the scraped data by day. To achieve this, I would like to have a timestamp column added that differentiates data on a daily basis. This will allow me to have a better understanding of the data collected each day. Your Proposal: In your application, please provide a detailed project proposal. I'm interested in freelancers who can clearly articulate how they will approach this task and ensure its successful implementation. Ideal Skills and Experience: - Proven experience in Python scraping bot modification - Familiarity with data segmentation and timestamping

I'm looking for a skilled virtual assistant to help me with my day-to-day tasks. Key responsibilities include: - Social Media Management: Creating and scheduling posts, engaging with followers, and increasing online presence. - Data Entry: Assisting with inputting and managing crucial data for my projects. - Graphic Design: Developing simple yet eye-catching designs for online content. You should be proficient in: - Managing emails (sending and reviewing) - Social media platforms (scheduling posts on all social media platforms) - Graphic design tools (be able to edit images and be creative, creating cool images) - Data entry and analysis (data scraping and finding the relevant emails for individuals in com...

I need assistance in scraping the entirety of Grainger's online catalog and compiling it into a CSV. The CSV will need to include specific details about each product, including but not limited to the product name, description, price, manufacturer, Grainger number and SKU number. Key Responsibilities: - Scraping the Grainger website for all product details. - Compiling the scraped data into a CSV file. - Ensuring that the data is organized and categorized correctly. Ideal Skills for this Project: - Proficiency in web scraping tools and techniques. - Experience in organizing and compiling large datasets. - Understanding of CSV file format and its use. - Familiarity with Grainger's website and the ...

...experienced custom web developer to create a unique web application tailored to our specific needs. The ideal candidate will have expertise in the following areas: Recommended applications and Technology: HTML, CSS, JavaScript, React/Vue/Angular) Laravel, CodeIgniter, Node.js, Python, Ruby on Rails, PHP, or similar - Database management (MySQL, PostgreSQL, MongoDB, etc.) - API integration - Responsive design **Responsibilities:** - Develop and maintain the web application according to the project specifications. - Collaborate with our team to refine and improve features. - Ensure the application is secure, efficient, and scalable. **Requirements:** - Proven experience in custom web development. - Strong portfolio ...

...developer to partake in a web development project. The specific tasks were not explicitly listed, but based on the nature of the project, they may encompass: - Building and deploying web applications - Managing data & user interfaces - Testing and debugging The desired Python libraries or frameworks were not specified, so freelancers with a broad Python knowledge will be more suited to adapt to the project's requirements. Critical skills and experience include: - Python programming expertise - Familiarity with typical Python libraries and frameworks - Proven experience in web development - Knowledge of web scraping, data analysis, and API integration (optional). The main purpose of the Pyt...

I belong to a Stationery company. I want to sell products in the global market for which I require data of Distributors/ Dealers / Retailers such as Name, contact numbers, email id, shop address, coordinates, google rating etc. from google , amazon, cocoblu, flipkart etc along with all major websites related to stationery .

...candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this project. Skills required: - Web scrapin...

● Tailored Solutions: We create custom web applications that meet your specific business needs, enhancing productivity and operational efficiency. ● Versatile Applications: Our solutions range from customer portals to complex inventory management systems, each built to address unique business challenges. ● Technology Stack: Node.js, , Ruby on Rails, Django, Laravel, MongoDB, PostgreSQL, MySQL, AWS, Docker.

...candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this project. Skills required: - Web scrapin...

I have a specific custom Google map that I need data from. The data I require includes: Business name, Customers name, Address, City, State, Postcode, website, phone. Key points: - You will be scraping a specific custom Google map - The data needed includes Business name, Customers name, Address, City, State, Postcode, website, phone Ideal Skills: - Proficient in web scraping techniques - Expertise in data extraction from Google Maps - Experience in handling large datasets - Attention to detail for accurate data gathering. Ideally i would like this in a CSV format. There are aprox 720 records in the custom google map.

Gmail ActionMailer has stopped working and I'm encountering an authentication error. After I changed my email password, and now I'm unable to send emails from my application.

...working with a client who has an old website built in ColdFusion. The website is going to be moved over to WordPress to give the client more flexibility updating etc. One of the challenges I have is that I need to migrate over about 400 photo galleries from ColdFusion into a WordPress Custom Post Type. Here is the current Structure: Primary Gallery Name - Sub Category (Year) - Gallery (with all the gallery images) Now there are 18 primary galleries, then under each primary gallery there are approximately 19 subcategories (the years), then within the subcategory is the gallery itself. I am looking for someone who can scrape the content from the existing website, and structure it exactly the same way in WordPress using ACF (Advanced Custom Fields) and Pos...

...aggregates news from various sources and uses machine learning to curate content based on user preferences. The dashboard will feature an AI-driven recommendation system that not only presents news articles but also provides analytical insights into trending topics and sentiment analysis of news content. Objectives: Main Goal: Develop a web application that personalizes news content for users based on their reading habits and preferences. Secondary Goals: Implement data visualization features to display trends and sentiment analysis of news articles. Minimum Requirements: Content Aggregator: Develop a system that pulls news data from various APIs or web scraping. User Profile Management: Create functionality for users to register, login...

...can locate roofing contractors with $1M or more in revenue on LinkedIn Premium, run a speed test on their mobile site and post matching results on an xlsx page. Key Tasks: - Locating Roofing Contractors: The tool should be able to scrape specific data points from LinkedIn Premium, mainly Company name, Revenue, and Location. - Mobile Site Speed Test: Once located, the tool should be capable of running a mobile site speed test on the found contractors. This test should focus on checking mobile site responsiveness and evaluating overall mobile site performance. - Results Presentation: The final task is to present the matching results in an xlsx sheet. Ideal Skills and Experience: - Proficiency in AI development and web scraping t...

I require a proficient web scraper to extract varied data types including text content, images, and metadata from specific websites. The primary function will be to gather, organize and present data in a structured and usable format. - Skills and Experience Required: - Strong knowledge in web scraping tools and techniques - Familiarity with data extraction, mining, and storage - Proven track record in delivering similar projects Due to a time-sensitive nature, I will need this project to be completed within a month. The quick turnaround shouldn't compromise the quality or functionality of the web-scraper. Do bear in mind that reliability, efficiency, and accuracy of the data extraction...

This price is only to post this project. Price will be discussed after providing full requirements. I need a browser extension developer for Chrome and Firefox for long term. I have so many projects in my mind to start. So, I am looking for developer for long term. Key Requirements: - Development of a Browser extension for Chrome and Firefox - Primary function should be automation, scraping etc.. - More details will be provided to the selected Freelancer. New freelancer who have expertise in this skills can also apply and they will get the opportunity to work in a long term project and they will get good reviews to boost their profiles. Thanks.