Scraping web data sql jobs

...meticulously extract table data from approximately 7500 pages of PDF files and transfer the data to Excel. The PDF tables are consistent across all pages, maintaining a fixed column structure which you need to duplicate in the Excel spreadsheets. The data you will be working with is primarily text-based as opposed to numerical. Necessary Skills and Experience: - Excellent attention to detail - Proficiency in optical character recognition (OCR) processing - Experience with data scraping or extraction - Valuable skills in MS Excel - Familiarity or experience with PDF data extraction software Swift and accurate execution is essential for the successful completion of this project. Please only apply if you are comfortable handling a high volume of...

I require a savvy data scraping professional who can efficiently collect specified details from retail giants Amazon, eBay, and Walmart. I'm interested in: - Extracting product details (name, price, description) This activity should be performed daily. The ideal candidate would have experience in data scraping, particularly from the mentioned websites. Proficiency in appropriate tools and a keen attention to detail is expected to ensure high-quality, timely, and consistent data harvesting.

...number of user coins and complete days must be saved in a local sql-lite database. Summary: - Create app with Expo 50 and TypeScript; - The data must be saved in a local database. This project is offline, but there must be online synchronization support with the offline-first approach. Save user coins, projects and days complete; - Number of days on screen 2 must be dynamic, according to what is selected by the user; - Create a service where it is possible to obtain the user's total coins and record of consecutive days marked; Screen 1: - When opening the app, if there is a project started, jump to screen 2. If not, list projects. - The user must choose a project from the list on the first screen to continue and start. - Get list data via http from

Seeking a developer with experience in C# and SQL for a predictive artificial intelligence project. Your role will involve developing a model to predict user behavior on a vending machine, utilizing data stored in SQL Server. Proficiency in artificial intelligence is required. Please don't send a bid to later try to increase it. Will be declined.

...skilled freelancer to help me with a data scraping project. The focus here is on website content, specifically, text elements. As the nature of text content was not specified, I anticipate a variety of text types which might include news articles, blog posts, product descriptions, among others. Ideal Candidate: - Experienced in Data Scraping projects, specifically with website content - Proficient in working with different types of text - Detail-oriented and accurate in collecting required information - Ability to handle tasks within given time frame Please ensure that you are equipped with appropriate data scraping tools and techniques, and able to adhere to legal guidelines for data collection. Your responsibility will be collecting ...

Stepping Back Through Data I have a table of orders, lets say. I'm trying to find all the "Completed" orders, and then step back through other "Cancelled" orders for the same Customer, that were created within 72 hours. The trick is, I want to keep stepping back until I don't find anymore orders (the 72 hour window will now be based on the last order found). Also, the logic should stop if it finds another "Completed" order for the same customer. I've included a test table and data, as well as an expected output. CREATE TABLE #Order ( OrderID int, CustomerID int, OrderDate datetime, OrderStatus varchar(25) ) INSERT INTO #Order VALUES (1, 1, '02/15/2024 07:00 AM', 'Cancelled...

I need a talented SQL developer to create a stored procedure that will automate the process of marking certain items as 'picked up' in our Microsoft SQL Server database. This script should essentially replicate the functionality of our existing Windows application, performing the necessary changes in the database to reflect this status. Key Requirements: - Strong command of SQL and experience in Microsoft SQL Server is essential. - Familiarity with Windows application development is a plus, as this script should mirror the behavior of our existing front-end tool. - Previous experience in creating SQL stored procedures for automating database actions is highly preferred. - Attention to detail and the ability to trace SQL commands accurate...

...capabilities. - Scraping: I'm looking to add a data scraping capability to my service. This will involve extracting data from various websites and integrating it into my existing database. - AI Data Analysis: I'd like to incorporate AI data analysis functionality into my service. Specifically, I'm interested in pattern recognition and data clustering. Other Enhancements: - Batch Searching: I need to implement a batch search functionality. - Additional Database Integration: I'm interested in integrating new databases into my service. Ideal Skills and Experience: - Extensive experience in developing and improving online database searching services. - Proficiency in advanced search options, scraping, and AI ...

I'm seeking a talented software engineer to construct a minimalist portfolio website for me on a custom domain. ...experience. My expectation is for a thorough, detailed-oriented professional who can capture my vision and translate it into a fully functional portfolio site. Things to be done Load an API data into on premise SQL server database Client will do some data calcution The new data will be available in the database and needs to be show in website with some base UI. Project involves show some other API data on the website as well Need not have a lot of experience in UI design but need experience showing data into a page. Website would look like this --- Odds data should be displayed like this show in the page. Along wit...

Monitor specific HTML div elements on various web pages. (differnt flows) -Send Telegram notifications when new elements or changes are found, including a subject to indicate which monitoring flow detected the change and a hyperlink to the relevant web page. -Explain the configuration of new monitoring flows, enabling addition of new web pages and specific HTML elements. Provide a list of required dependencies and setting up and configuring the flow, including telegram bot integration so I can install/config them on my Raspberry Pi.

I'm in need of a Python developer to assist me with web scraping. The data I'm after is sourced from APIs and once extracted, it needs to be stored in a CSV file. Key Requirements: - Proficiency in Python - Experience with web scraping - Knowledge of working with APIs - Ability to store scrapped data in a CSV file Ideal Skills: - Familiarity with popular Python libraries for web scraping, like Beautiful Soup or Scrapy - Understanding of API integration and usage - Strong data handling and manipulation skills It's a straightforward task that needs attention to detail and adherence to best practices in web scraping. If you have the right experience and are keen to assist, I look forward to hearing ...

I am looking for an experienced freelancer capable of creating a simple web scraping tool, able to extract text content, images, and links from a specific url (you just need to do one single url and I take it from there). The extracted information should be in a python dictionary and saved to pkl Skills: - Experience in web scraping - Proficient in handling js and automation This is a very simple project for the right individual. I need all the visible info and images (no maps) plus the info in the JS that must be reached by clicking a button. This is a couple of hours of work max, and needs to be done in Python and for today. I will provide the URL when I make sure you can handle the job. Thanks

I am seeking to acquire a comprehensive list of 10,000 fake domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job ...domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job would have a strong background in cyber security and a profound understanding of Web Sc...

I require a professional web scraper to collect both text (data points) and images from a long list of web pages about hotels and destinations. - The project involves saving the actual images of destinations/hotels —not just their URLs—from every webpage. - As for the text content, I'm particularly interested in several points - The extracted data and saved images should be meticulously organized in an Excel sheet for easy review and reference. Ideally, I'm seeking someone with an extensive background in web scraping and data extraction. Being proficient in Excel would be a significant plus. Accuracy, attention to details, and reliability are also crucial traits for this task.

I'm in need of a Python developer with specific skills in web scraping. The main task for this project is to fix bugs in existing web scraping scripts. Your role will be to primarily focus on this aspect, ensuring the scraping process runs smoothly, and is optimized for efficiency. If you perform well in this project, it will be a long term business opportunity. I have lots of projects in mind which need to start after this. New freelancers are welcome to bid.

...scraper to gather data from specific fashion retailers. You will scrape the data for a period of about 12 weeks. Starting mid June. We would target the 10 following fashion retailers: Guess, Tommy Hilfiger, Levis, GAP, Calvin Klein, Ralph Lauren, Desigual, Mango, River Island, Pepe Jeans. The data required is - Item characteristics (like audience [male/female/kids] and item type [pants/shorts/tshirt/shirt/...]) - Price points over time (and corresponding discounts) - Out-of-stock data over time (per item, not by size) The collected data should specifically focus on their clothing items (no accessories, shoes, underwear, home wear, gifts,...). The project start deadline is ASAP. A quick turnaround is essential. Ideal Skills and Experience: - Pro...

...proficient in Websocket and SQL, who can help me with an automation project. Key requirements: - Profound knowledge in Python, including advanced topics and best practices. - Strong understanding of Websocket and SQL. - Experience in automation tasks would be highly beneficial. - Ability to adapt to different mentoring methods, such as video calls, live chat, or in-person sessions. Your tasks: - Mentor me through the automation project, providing guidance and support. - Help me understand and implement Python, Websocket, and SQL concepts effectively. - Adapt to my preferred session mode, whether it be video calls, live chat. Ideal skills and experience: - Proven expertise in Python, particularly in automation applications. - Experience working with Websocket and...

Looking for experienced computer programmers skilled in Python for a web development project. Skills and Experience Required: - Proficiency in Python programming language - Strong knowledge of web development concepts and frameworks - Experience in building and maintaining web applications - Familiarity with front-end and back-end development - Ability to implement responsive design and ensure cross-browser compatibility - Good understanding of database management systems and SQL - Knowledge of version control systems and agile development methodologies Timeline: The project is expected to be completed within 3-4 weeks.

I need a Python expert to scrape tabular data from a series of PDFs and store it in a database. Ideal Skills and Experience: - Proficiency in Python. - Strong experience in web scraping with PDFs. - Familiarity with database management. The PDFs are consistent in format and all contain tables. The scraped data needs to be stored in a database.

I'm in need of an experienced developer who's well-versed in ASP.NET a...well-versed in ASP.NET and VB.NET. The project involves the event pages i need where user can login and acess the event throught calender with specific functionality.. i will share feature to slected one ... Ideal Skills and Experience: - Proficiency in ASP.NET & VB.NET is a must, with a proven track record of projects involving user authentication and database integration. - Strong understanding of SQL Server databases and how to effectively integrate them into a .NET environment. - Experience in implementing user authentication systems that cater to both roles and individual accounts. This project requires a developer who can deliver secure and efficient user authentication and database inte...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I require a skilled freelancer with experience in Amazon Web Services (AWS). We have a an ERP Developed on Laravel which is currently on a On-Premise Windows Server. We would like to move the application to AWS using a windows OS and SQL Server Database. Please guide as to which option would be better. The selected freelancer would have to set up a Windows operating system. Skills and Experience Required: - Proficiency in AWS, - Demonstrated experience deploying Please ensure to include examples of your previous AWS work in your bid. Your ability to efficiently handle tasks in the AWS environment is paramount for this project.

We've developed an MS Access database front end with a SQL Server back end. Now we need to install both of these with government agencies in South America whose IT people only speak Spanish. We provide written installation instructions in English. Our clients can only meet the contractor online for server installations during business hours in American time zones. This is periodic work, installing databases whenever clients request them. At present we have six clients in the queue. The applicant must guide and troubleshoot each installation online in fluent Spanish. The successful applicant will have a record of relevant database work. We're a university-based not-for-profit.

...ideal candidate must be skilled in web scraping and should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attention to detail to ensure all the m...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

Hi there, We are looking for someone who is: - Proficient in Python. - Experienced in automation and data scraping. Our budget is $3/hr for 20 hours on the initial project. This is a one-off task for now but could be ongoing work if successful. Please message with your CV/portfolio if interested

...au, , , , Facebook Market Place) and display the results in one convenient place. Key functionalities should include: - Advanced filtering options - Price range filtering - Location-based search Ideal expertise would entail experience in advanced web scraping and designing search algorithms, along with a deep understanding of diverse automobile databases and SEO. The candidate should be capable of verifying and testing the accuracy of the collected data as well. Efficiency in coding with an ability to manage site speed and response time is crucial, especially considering the breadth of services it will be searching. The final product should be a user-friendly platform that effectively and accurately condenses numerous individual searches into

MUST READ FIRST =============== MUST HAVE - Blazor experience of at least 3 years - Latest version of .NET & SQL Server - At least 1 hour of availability between 6:00PM and 11:00PM EST - Your price is the one that you REALLY want to have with 10% +- NOTE - APIs will be provided (you will not develop APIs) - No development will be done on My Computer. - DO NOT APPLY if your fees can exceed 10% or your bid PROJECT I have C# Blazor Web App that works using SQL Server Database & using APIs at the same time. For the functions that use the database, I want to replace them with the APIs 1- Make code debuggable. 2- Error message appear with no details, need to make the error message has Show More to display the details of the error. 3- Load Codes from APIs ins...

I need a skilled Bot Developer to create a multi-language web bot for me. - Tasks: The bot will mainly be responsible for web tasks like form filling, data scraping, and possibly social media automation. Unlike some bots, it won't interact with APIs or integrate with other web services. - Programming Languages: This is a multi-language project. I am open to using Python, JavaScript or PHP depending on what you think is best for this task. I need someone who is experienced in bot development and can create a reliable and efficient bot that performs these tasks seamlessly. Please have a look at the choices of programming languages I'm considering and let me know which one you think would best suit the goals of this project.

...and Power BI. Let's collaborate to convert raw data into clear, visual and interactive dashboards. Here are the specific needs for this project: Power BI Tasks - Effectively perform Data modeling, Data visualization and dashboard creation using Power BI - Work with various data sources that include Excel Spreadsheets, SQL databases, Online APIs, and Azure Graphics Tasks: -Even though I didn't specify any graphical needs, any creative approach or design skills you can bring to the project to enhance the visual aspect of the data would be appreciated. Ideal Candidate - Proficient in Power BI - Experienced in working with multiple data sources - Has a knack for graphic design - Detail-oriented and data-driven - Can effec...

...experienced data scientist with a strong background in trading or stock market data analysis. Your tasks will revolve around data analysis and visualisation, along with other key data science responsibilities. Contract duration: 3 months to 15 months Position open: 2 Data scientists Key Responsibilities: - Perform data analysis and visualisation on trading or stock market data - Use your data science skills to provide valuable insights - Ensure the accuracy and efficiency of your predictive modeling Ideal Skills and Experience: - Proven experience in trading or stock market data analysis - Proficiency in Python, R, and SQL - Strong analytical and problem-solving skills - Prior experience with predictive modeling a...

I need help fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and the influencers required here are trading influencers. 1 - Those who sell trading indicators. 2 - Who have special channels for trading.. 3 - Who have bots for automated trading Basic skills and experience required: - Deep understanding of Instagram, YouTube and TikTok – Experience in data mining or web scraping - Good at analyzing data - Flexible and adaptable working approach I will attach a file I created as an example of the requirements I want. If you see yourself as suitable for this job, create an example of the same file sent to you, but with different information, and send it to me

I need the names, addresses, and contact information from a specific web map extracted. The purpose of this project is to create a directory of locations from this data, and the information will need to be updated annually. The ideal freelancer for this job will have experience in web scraping and data extraction. Key requirements: - Web scraping experience - Proficient in data extraction techniques - Understanding of directory creation - Reliable and professional with an eye for detail.

I'm looking for a Python expert to help me build a simple yet effective project. I need a program that can scan barcodes of grocery items and then provide me with detailed information about these products. This information should include protein, calories, added sugar, and any other relevant nutritional facts. ...added sugar, and any other relevant nutritional facts. Key requirements: - The ability to scan barcodes effectively and quickly - Retrieving information about the scanned products from an online source - Displaying this information in an organized and easy to understand manner Ideal skills and experience: - Proficiency in Python - Experience in working with barcode scanning - Familiarity with web scraping for nutritional information - Ability to create a u...

I need a program that can scrape for the addresses of homes listed and compile them into a CSV file....com for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scraping (e.g. Python, Scrapy) - Knowledge of CSV file creation and data handling - Ability to automate processes for regular data updates Please note that the addresses should be stored in the CSV file wit...

Google app script expert needed for stock price and data for world wide countries. Basically we have done for few countries we need you to replicate for more different countries, each country will consists about 8 google sheet types and some types may have dozen or up to few hundreds google sheets. Then some of the data needs be transferred and stored to SQL and taken from SQL by API also. This is team work, you will be working with bunch of server guys and python guys. So you need to possess these abilities and criteria : 1. Able to make google sheets fast, make editor for the GS fast and send all of the Google sheets ownership to me. 2. Able to work on SQL and API. 3. Able to collaborate as a team. 4. Agile, fast delivery, and responsive 5. Integrity...

I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.

...looking for a dashboard that's dynamic and interactive. It should display the forecast for the Twitter data using a visually appealing interface. - **Real-time Data Updates**: The dashboard should be capable of updating in real-time to reflect any changes in the forecast. The ideal freelancer for this project should have proven experience in time series forecasting, Python programming, and developing interactive dashboards. A solid grasp of data visualization principles would be a plus. The output should be in a form of a python file with 4 models above and related dynamic visualizations. The text preprocessing is required and can be done in any necessary technologies (HADOOP/SPARK,NOSQL/SQL databases) - screenshots of the bash code are required....

I'm in need of a proficient data entry specialist to assist with a substantial volume of data entry work. This is a very basic task, a lead scraping website doesn't allow me to export data. So we will copy and paste from one website to a google sheet. There are 2,241 entries needed This project will take ~20 hours I am attaching a screenshot of the picture of the website and of the spreadsheet

I require a specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I ...specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in handling and extracting data from different business sources, specifically focusing on citations. - Advanced skills in programming and web scraping to efficiently channel through high amounts of data. - Understand the "citation" within the context of a business website as a direct link to the company's website. The ideal candidate would be someone with vast experience in data mining, web scraping, and progra...

I'm searching for an expert in Visual Studio 2022, MS SQL, and VB.net, for the main objective of maintaining and updating an existing software application. Key tasks: - Primarily, the project will involve optimizing the application's performance. Skills and experience: - Experience with Visual Studio 2022, MS SQL, and VB.net is a must. - Proven expertise in software optimization. - Knowledge of system maintenance and updating.

I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.

I have a 500MB XML file that I need loaded into SQL across approximately 20 tables. I'm in need of a Python script to handle the transformation. The script will need to handle normalization of the data. Key requirements: - Develop a Python script to read the XML file and transform the data into a normalized structure across 20 tables. - You will need to create the SQL tables as part of the normalization process. - Experience with large data transformations and SQL is vital.

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system for seamless data transfer.

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm seeking a skilled .Net developer to assist in developing a comprehensive retail system that has features such as user authentication and authorization, inventory and product management. Requirements: - Proficiency in C#, .Net, Entity Framework and SQL Server - Ability to develop a retail project from scratch - Strong understanding of user authentication and authorization - Experience in inventory management and product cataloging It's crucial that the chosen freelancer has prior experience in building online retail systems and a strong understanding of the retail business model. The ideal candidate should be able to deliver a secure, efficient and scalable retail project. Any experience with Angular/react/Node would be plus

I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file

...who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reduc...

I am in need of a freelance MIS Executive with strong skills in data analysis and database management. Responsibilities: - Conducting detailed data analysis using the provided tools - Proficiently manage and maintain a database Ideal Candidate: - Proficient in Microsoft Excel and SQL Server - Experience in database management and data analysis - Strong analytical skills - Excellent attention to detail This project requires someone who can work independently, has a good eye for detail, and can deliver high-quality results. A background in MIS or similar field would be a big plus.

I am looking for a talented and experienced web development team to create a unique, fully functional social media platform. Key Features: - User Profiles: A robust user profile system that allows users to create and customize their profiles. - Messaging System: A secure and interactive messaging feature that enables users to communicate seamlessly. Ideal Skills and Experience: - Proven experience in developing and deploying web applications, preferably in the social media domain. - Proficiency in programming languages and frameworks suitable for developing a dynamic web application. - Strong understanding and implementation of user experience and interface design. - Ability to create scalable, secure, and maintainable code. - Excellent teamwork and communication ski...