Data scraping with node js jobs

I'm in need of a Python script that can crawl through a l...and export all the webpages it finds into a new Excel file. This task is aimed at scraping the entire content of the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites from an Excel file. - The script should use natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file handling in Python. - Experience...

I have a simple one page website at that has three bugs: 1) The footer's color is not working. The CSS attempts to set the footer color, but it shows up as white all the time. Could be a html tag issue or a css issue. 2) The Dark Mode / Light Mode selector in the fo...tag issue or a css issue. 2) The Dark Mode / Light Mode selector in the footer mostly works, but the CSS based animation of the toggle switch no longer works. This stopped working the same time bug number one appeared, so they are probably the same bug. 3) Clicking the Dark Mode / Light Mode selector does not always update the cat gif image. Sometimes it works, sometimes it doesn't work. Probably a JS issue. I would like to get these three bugs fixed now. Please only bid if you can fix these right now.

I need a professional who can help me extract photos from various websites for data analysis purpose. Key Requirements: - Image Extraction: The main task is to extract photos from a multitude of websites. The photos will be used for data analysis, so accuracy and completeness in this task is vital. Ideal Freelancer: - Data Extraction Expert: The ideal candidate would have experience in extracting data from websites. - Web Scraping Proficiency: Knowledge of web scraping tools and techniques would be highly beneficial. - Attention to Detail: The successful candidate will be diligent in ensuring all relevant photos are extracted. If you are confident in your ability to deliver a high-quality image extraction service, please submit your bid.

I'm looking for a skilled Python developer to help with web scraping and data analysis tasks. Key Tasks: - Web Scraping: Proficiency in using Beautiful Soup or Scrapy is essential. The person should be able to extract specific data sets from websites and present them in a structured format. - Data Analysis: Experience with Pandas and NumPy is crucial for this role. The ideal candidate should be able to manipulate and analyze large data sets efficiently. - Automation: Familiarity with Selenium for automating tasks is a plus. What I'm Looking For: - Experience: Please include details of your past projects and your experience with Python in your application. - Specific Libraries/Frameworks: A strong grasp o...

I have a web-app for teachers and I want to make a mobile app to access the same features on the go. I have an API ready and designs, I would like someone to make these screens (pixel perfect) as quickly as possibly) either natively or in a cross-platform framework for And...go. I have an API ready and designs, I would like someone to make these screens (pixel perfect) as quickly as possibly) either natively or in a cross-platform framework for Android and iOS. Please take a look at the current designs in Figma: ...and give me a quote for how long it would take for you to re-create these screens, closely matching the designs, with no functionality yet, just the designs.

...Developer to assist with my Google Images Downloader extension. I'm encountering two primary issues with the extension; it's failing to download images and images are not loading correctly. Key Tasks: - Fix the issue causing the extension to be unable to download images - Resolve the problem with images not loading properly - Identify the specific changes in Google's image classes and div elements that caused the extension malfunction. - Modify the extension code accordingly to adapt to these changes and ensure compatibility with the latest Google Images layout. Please note that I've already attempted to reinstall the extension in Google Chrome, but this hasn't resolved the issues. Ideal skills & experience: - Proficient in Ch...

I'm looking for a talented, experienced React JS and Laravel developer to join my team on a monthly salary basis. You'll be responsible for a range of tasks. Your responsibilities will include: - Front-end development: You'll need to be proficient in React JS, with the ability to create attractive, responsive user interfaces. - Back-end development: Strong Laravel skills are essential. You'll be responsible for building and maintaining the core functionality of our platform. - Bug fixing: You should have a keen eye for detail and be able to identify and resolve bugs in both the front-end and back-end. - Experience with mySQL is a must. In your application, please include your relevant experience in React JS and Laravel. I'm look...

...GO lang and React JS/Next JS? Project Description: We are in need of an expert developer to create a dynamic ecommerce platform focusing on digital goods and services. The project entails building three main sectors: Front-end Development: Implement user authentication, service listing, and seamless communication with the backend via API. Supplier Backend: Develop functionalities for suppliers to manage products, process orders, and handle cancellations efficiently. Admin Backend: Construct a robust admin panel to oversee order processing, site settings, and overall platform management. System Overview: Showcase popular services through a slider on the front end, adjustable by the admin. Customize service display based on date, name, or co...

I have a web application build in Angular. In this application i also want to gather real-time score data from football games, providing dynamic updates to users. And send notifications when goals are made. Key Features Required: - Robust scraping solution to ensure constant, consistent live score updates - User-friendly interface showcasing live scores in a digestible manner Ideal Skills and Experience: - Proficient in Angular-related development - Previous experience with web scraping technologies - Familiarity with designing user-friendly web interfaces - Excellent problem-solving skills to ensure the smooth delivery of live data updates and notifications.

...writer to extract specific business data from an online directory, specifically Myagedcare.gov.au. This project will need a freelancer that possesses: • Significant knowledge and experience in data scraping technology • An understanding of the structure and functioning of online directories • Keen attention to detail The successful freelancer will carry out: 1. Extraction of business data: I require accurate extraction of contact details and business names from businesses listed on the directory. 2. Specific Directory Focus: The targeted directory for this exercise is Myagedcare.gov.au. The end goal is to create a clean and organized database of businesses in the aged care sector. Prior experience with online directories and spec...

In this project, I am seeking a skilled Python developer with experience in using Playwright to develop a set of flexible data scraper tools. These tools will be deployed to capture data and screenshots from a variety of popularly visited websites such as e-commerce platforms, directories, social media and news sites which includes but not limited to eBay and clinicaltrials.gov. Key functionalities should include: - Capturing various data types such as product details, pricing information, ratings, reviews, and any other elements visible in a full-page screenshot. - Organizing the captured data and screenshots in a clear, easy-to-navigate folder structure. - Being adaptive enough to scrape data from a widely diverse set of websites. To be succ...

deploy next js app to cpanel i need it right now will be quick job with 5 star feedback if you know it start with "cpanel"

I need a professional to scrape data from the URL provided and deliver the extracted details in a CSV format. - The specific data elements required are the agent name and phone number. The scraping process does not require any filters or search criteria as it's a one-time extraction. The data should be organised and easily readable in a CSV document for further analysis. Ideal skills for this project would include: - Proficient in web scraping with experience in extracting data from similar websites - Strong expertise in delivering data in structured formats (CSV, Excel) - Attention to detail to ensure accuracy in the extracted data

Hi Kamati H., I noticed you posted a following project ( https://www.freelancer.com/projects/react-js/Echart-Tree-Diagram-React-Node/details )

I am seeking a data aggregator to formulate inclusive and accurate contact lists for my upcoming marketing campaigns. The information required in each list is a blend of phone numbers, email addresses, and the names of company owners. I'll be providing SIC codes as an accurate reference channel for the industries we'll be focusing on. Any freelancer applying for this project should exhibit a well-versed understanding of data aggregation, web scraping, and should be detail-oriented. A knowledge or background in marketing would also be beneficial. Please note information accuracy is paramount, as these lists will directly impact the effectiveness of our campaigns. Your tasks will include: - Gathering the aforementioned contact details - Aligning data...

I am seeking an experienced developer who is well-versed in React JS and Node JS for the development of an e-commerce platform. This platform will be designed to support a range of e-commerce functions, with the main focus being on product search and filter options. Key responsibilities & requirements: - Proficiency in React JS for front-end development - Experience with Node JS for back-end development - Strong understanding of e-commerce structures and functionalities - Ability to integrate user-friendly product search and filter options The ideal candidate should be someone who has not only the technical expertise, but also the vision and creativity to enhance the user experience through these key functionalities. A portfo...

I am looking for an experienced developer to create a mini software that will automatically fill out a specific Google form. The software should be developed using and Pupeteer/node js, employing Stealthfox to create cookies and for functionality. Key Requirements: - Utilize for creating a browser profile and Stealthfox for cookie generation - Capable of interfacing with - Automated form completion for a Google form Ideal Freelancer: - Skilled in Pupeteer and node js for browser automation - Experience with and Stealthfox - Proficient in web form automation In your application, please highlight your experience in similar projects. Thank you.

Ideal skills for this job include proficiency in Adobe XD, HTML, CSS, JavaScript, and experience with SP Admin 2. The project will involve taking visual designs and translating them into code, ensuring the functionality and UI match the original design. Your work should be clean, efficient, and maintain the integrity of the design.

I need a professional web scraping expert to scrape information from medical service providers directories that are publically available from the providers' websites. Requirements: - Extract data including name, address, phone, and location from the directories - Ensure the information is accurate and up-to-date I'm looking for a freelancer who: - Has extensive experience in web scraping - Can deliver high-quality results quickly - Has excellent attention to detail The project is urgent so I require someone who can work on it immediately and complete it as soon as possible.

...should be created to access this database. The user should have read/write access, I will again supply the username and password via command line. - The solution should include a set of servers to run both backend and frontend services. I want to be able to make a small change in the script to scale up or down the number of servers. This servers need to run AWS Linux, Java 21, node js 12, and datadog agent. We will start with 1 EC2 instance but as I said I want to be able to change that value and scale up (or down as needed). - The EC2 instances need to upload a config file for Datadog agent, part of this we need to supply the datadog api_key, which will be supplied in the command line via variables. The script needs to update that key in the datadog config file. ...

I'm in need of an expert to carry an advanced data scraping task on Github. Key project specifics: - The kind of data to be harvested includes not only text content and links, but also user IDs, emails and names. Therefore, this project requires someone with a skill set that allows for scraping beyond the surface level. Ideal Freelancer: - Ability to implement advanced scraping techniques to ensure quality and completeness of obtained data. - Experience in harvesting sensitive information like User IDs, emails and names. - Respectful of privacy laws and legal restrictions regarding data scraping. - Self-motivated, detail-oriented, and reliable. Please be ready to provide examples of similar projects you have comple...

I am looking for someone who whill help me to create Firefox Add-On for basic scraping on a website. Looking for fast delivery. Ready to award today.

I need a skilled web developer to create a website that will fetch and display HTML pages from another website. Here's what the project involves: - Users should be able to view these pages onli...download these pages as PDF files. - The site should be programmed to automatically update the HTML pages from the other site each time a user accesses a page. - We haven't yet decided how to handle multiple users accessing the same content simultaneously, so flexibility in your approach is key here. Ideal candidates would have experience with HTML5, CSS3, PHP, and knowledge of automated web tasks and conversion of various file formats. Previous experience with handling high traffic is a plus. Please provide examples of your past projects that demonstrate these skills whe...

I am seeking a skilled Python developer with expertise in troubleshooting to resolve an issue with an application. The main purpose of the application is data analysis, web scraping and automation. Currently, the application has been crashing or freezing right at the startup. The ideal candidate for this job should have: - Extensive experience in Python programming - A background in data analysis, automation and web scraping domains - Proven track records troubleshooting application start-up crashes or freezing - Good problem-solving skills, ability to diagnose and fix bugs efficiently. Your main task will be to identify and fix the issue causing the application to crash during the startup. This is a critical project, so a timely resolution i...

...GO lang and React JS/Next JS? Project Description: We are in need of an expert developer to create a dynamic ecommerce platform focusing on digital goods and services. The project entails building three main sectors: Front-end Development: Implement user authentication, service listing, and seamless communication with the backend via API. Supplier Backend: Develop functionalities for suppliers to manage products, process orders, and handle cancellations efficiently. Admin Backend: Construct a robust admin panel to oversee order processing, site settings, and overall platform management. System Overview: Showcase popular services through a slider on the front end, adjustable by the admin. Customize service display based on date, name, or co...

...skilled professional who can help me scrape text data from e-commerce sites for data analysis. Key Requirements: - Data Scraping: The primary task is to extract text data from various e-commerce websites. This includes product descriptions, reviews, and any other relevant textual information. - Data Cleaning: Ensure the scraped data is accurate, clean and ready for analysis. - Data Analysis: This project is focused on data analysis, so experience in this area is a must. The ability to extract meaningful insights and trends from the scraped text data is crucial. Ideal Skills and Experience: - Proficiency in Web Scraping: A strong background in web scraping and working with text data is ess...

I require an experienced professional to obtain text and images from a blog and store them in a CSV file. The ideal candidate should: - Have experience in scraping content from websites - Be adept at data management, specifically CSV files - Be proficient in handling both texts and images and store in easy way to manage and retrieve A strong track record of similar projects will be a plus. This job requires accuracy and attention to detail. I look forward to seeing your bids.

I am seeking a proficient programmer to develop a scraping application for the purpose of extracting text data from NETFLIX. This project is sensitive, considering that the targeted websites demand API keys for access. Accordingly, the ideal candidate should be familiar with both GET and POST methods as well as API integration and management. Experience with data extraction and web scraping from API authenticated websites is a must. Skill requirements: • Web scraping • HEADERS • CUSTOM HEADEARS • STRINGS • URLLIB • Working knowledge of GET & POST methods • Experience with API authentication • Exceptional skills in data extraction, especially text. • loliscript • SilverBulle...

I'm looking for a proficient Python developer to create a script that can efficiently scrape active IPs from a text file I will provide. The following specifics are required in this project: - The Skill-set: Strong Python programming skills, experience in IP scraping and working with text files would be an advantage. - Task Details: You need to extract the 'Activity Data' from these IPs. Profound knowledge in network protocols is a must-have. - Output Handling: The activity data extracted should directly be written to a text file. A clear understanding of FileIO operations in Python would be crucial. A successful completion of this project might lead to more future collaborations. I'm looking forward to seeing your proposals.

I need a skilled PHP developer to build a gambling website specifically for gamblers. The site should feature interesting and engaging colour prediction games and betting games like TC lottery. Leveraging your experience and skills, take inspiration from sites such as , , and Ideal experience and skills include: - Proficient in PHP or node js - Proven experience with similar websites, specifically gambling/betting sites - Ability to implement color prediction and lottery games Looking forward to seeing your interest, expertise and initial ideas.

Please Sign Up or Login to see details.

Hello, I am currently facing a challenge in accessing a specific website, , from my domain or through a proxy. I prefer not to expose my IPs directly to this website. Unfortunately, I am unable to access the site due to its geographical restrictions, as it is only accessible from within Italy. I require a solution that involves setting up a proxy. I will provide the proxy details via private message. The primary objective is to access the site without direct exposure of our IPs. Additionally, the website has a CORS (Cross-Origin Resource Sharing) policy that prevents third-party domains or IPs from accessing it. However, when I configure the proxy settings directly in the browser, it works perfectly. The requirement is to write a script either in Node.js or Python, which should run on ...

I'm currently looking for an expert who can design a data scraping script for me. However, I haven't decided on which particular website and kind of data (text content, images, links etc) should be scraped yet. Furthermore, the frequency for data collection hasn't been specified. Ideal Skills and Experience: - Commercial experience with Python or JavaScript - Proficiency in web scraping using tools such as BeautifulSoup, Scrapy, or Selenium - Ability to add flexibility for target URLs, data type, and collection frequency Please note: the project details will be finalized upon discussion. Your recommendations are welcome and appreciated. Only apply if you're comfortable proceeding considering these conditions.

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

I'm looking for a skilled developer who can take my SVG/FIGMA design and convert it into a responsive landing page using Bootstrap. Requirements: - Convert provided SVG/FIGM...looking for a skilled developer who can take my SVG/FIGMA design and convert it into a responsive landing page using Bootstrap. Requirements: - Convert provided SVG/FIGMA design to a responsive landing page - Implement the landing page using Bootstrap - Apply a color scheme Skills and Experience: - Proficient in HTML, CSS, and JS - Experience working with SVG images and/or FIGMA designs - Strong understanding and experience with Bootstrap - Prior experience with responsive web design Please note, the landing page doesn't need any specific sections like "About Us"...

...keep in mind: - Customizable node color and style: I need the freedom to customize the color and style of individual nodes within the tree structure. - Ability to handle large data sets: The tree diagram should be able to efficiently represent and navigate through large amounts of data without sacrificing performance. - Interactive features like drag and drop: The diagram should support interactive features such as drag and drop. The main objective of implementing the Echart tree diagram is to help us in: - Visualizing hierarchical data: The tree diagram should help us represent and understand the hierarchical structure of our data. - Analyzing relationships between data points: We aim to utilize the diagram to study the relationships betwe...

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

I am looking for professional css, html, and js developer who is familiar with django. Mostly interested in CSS. Knowlaage of SEO is required. I need to make my website look professional and add a few things to it such as map and others. I will give you my intial design and you need to work on it on your own. Intial design means htmls, css only but I will not provide any backend code. After you get done with the design you will remote into my machine and plug everything in so I can test it. Important: My remote computer is monitored from the server, any try to copy any code will be immediately blocked. Sorry I am trying to protect my work. If you have the skills and willing to work with me please submit a fair qoute.

I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.

I'm seeking a talented React JS developer to help fix some UI and functionality issues in my project. The bugs are more on the intermediate level, involving the malfunctioning of certain features. Key Tasks: - Identify and diagnose the existing issues in the UI - Fix the functionality problems that are impairing the user experience The ideal candidate must have: - Proven experience in React JS development - Strong problem-solving skills - A proactive attitude in identifying and resolving bugs - Previous experience in debugging intermediate level issues Please include your experience in your application, and ideally, some examples of past work where you've dealt with similar bugs.

I need a professional to scrape specific details from a ...scrape specific details from a website directory for a one-time project. - Specifics: The data of interest includes the company names, their URLs, and their expertise. This information is laid out in rows on the website. - I wish for the freelancer to carefully extract this data, ensuring no errors or omissions are made. - The final output is essential to be in a CSV file format. I require this scraping to be done just once, and I do not foresee a need for ongoing scraping after this initial task. As the data is crucial for my business development, I am seeking someone who can deliver accurate and complete results in a timely fashion. Prior experience with web scraping and ...

...contract management, and notifications. Requirements: Proficiency in app development with a focus on security and user experience. Ability to integrate APIs seamlessly. Familiarity with KYC processes and payment gateways. Strong communication skills and a proactive approach. Project Scope: Develop the app based on the Figma design. Implement sign-in, sign-out, and user management features. Integrate KYC, Wallet, Payin, and Payout APIs. Create a contract management system. Set up notification functionality. Note: Chat functionality is not required. Project Budget: The project budget is 25,000 INR. How to Apply: If you have the skills and experience required for this project, please submit your proposal with relevant examples of your previous work. Include a brie...

I need a data scraping tool to pull business names and addresses from Google and Google Maps. - The tool should be able to extract this information in an organized and comprehensive manner, enabling me to create a database for further analysis. Ideal skills and experience for this job include: - Proficiency in web scraping tools and techniques. - Experience working with Google and Google Maps APIs. - Ability to organize and structure data effectively. - Data to be compiled in an excel spreadsheet - Prior knowledge of extracting business information from online sources is a plus. Looking forward to your proposals.

I'm in need of a React JS expert to assist in the development of a single-page application, specifically an interactive user dashboard. The main goal of this project is to create a user-friendly platform that allows for effective user management. Key Responsibilities: - Developing a responsive and user-friendly single-page application - Implementing an interactive user dashboard - Creating a user management system which should include functionalities like user registration, login, and profile management. Ideal Candidate: - Proficient in React JS and its ecosystem - Experience in developing single-page applications - Previous work on user management systems - Strong understanding of responsive web design - Ability to work independently and meet deadlines - Good communi...

...advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collaborate on developing targeted outreach strategies based on collected data. Ideal Skills: Proficiency in advanced web scraping techniques, particularly on LinkedIn and other niche databases. Abi...

I'm in need of a expert who can fix issues relating to text alignment on my canvas. What I need - 1. The text should be always in the center position within the wrapper. 2. There will be a variable that has 3 options: a) automatic b) shorten c) line break. if the variable value is "automatic" - Then the text should be in one line whatever the text length it is. That means you need to decrease the font size accordingly. if the variable value is "shorten" - Then the text should be in one line too but if there is no space at the end it will cut the text. if the variable value is "line break" - Then the text should go to the next line if there is no space at the end. **** I have uploaded a zip file. Here all the code is done but based on file in ...

...able to perform the following tasks: - Data analysis: The bot should be equipped with moving averages, MACD, and RSI indicators for effective analysis and decision-making. - Web scraping: The ability to gather data from various sources is crucial for the bot's functionality. - Automation: The trading bot should be capable of executing trades autonomously based on predefined trading strategies and indicators. Ideal candidates for this project would have: - Profound knowledge and experience in Python programming - Prior experience in developing trading bots or similar automation projects - Familiarity with moving averages, MACD, RSI and other trading indicators - Strong understanding of data analysis and interpretation - Demonstrated experti...

URGENT, Need expert PHP, JS developer for my wordpress website it have a lot of errors after restarting my server.

As a detailed-minded individual who needs precise data for my endeavors, I am currently in need of enthusiastic freelancers with a specialty in data mining. - Required Skills: You should be able to comfortably scrape both text and numeric information off a webpage, particularly from Website 1. Your expertise should shine in extracting specific types of data, ensuring highly accurate data acquisitions. - Project Requirements: I don't need all information from the entire site. I am targeting very specific sections for data mining. Therefore, your ability to scrutinize site details and pinpoint the highest quality information will be essential for this project. I am looking to data scrap the real estate agents of 20 suburbs but will do ...