Scrapy crawler jobs

...extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Selenium, etc. Solid knowledge of HTML, CSS, and JavaScript to understand the structure of web pages. Ability to work independently and meet established deadlines. Excellent communication skills and ability to work in a team. Preferably, previous experience in data extraction projects related to the specific sector of the project (if applicable). If you have the skills and pass...

We are in search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories

I am seeking an expert capable of creating a highly detailed and intricate graphic line art rendition of a lattice boom crawler crane with a luffing jib (two independently controlled booms). This rendition must strictly capture the exterior features of the equipment ( there's a lot). Your focus should also be on all the components that make up the crane. I am open to starting with a more basic line art (outline) and seeing what we need to add. This would be the first design for a construction apparel line You need to have a meticulous eye for detail and at least have a portfolio that showcases any automotive art.

I'm looking for a proficient developer capable of creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer wit...

Purpose is to instlal Scrapy on an Ubuntu server, so it'll work with http ip proxies (i'll send you 2 IP proxies so you can test to confirm it's working fine)

I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT READ THIS: Auto-generated bids wil...

...users' specific usage of a small number of terms relating to claims of "stochastic terrorism" and "stochastic violence" Priority would be given to freelancers demonstrating: - Previous experience in web scraping, particularly from social media platforms. - Strong Python skills since Python-based tools are commonly used for web scraping. Knowledge of libraries such as BeautifulSoup, Selenium or Scrapy would be a plus. - Ability to organize and clean the data into an easy-to-understand format. - Understanding of Twitter’s policies on data scraping to ensure the legality of the data collection process. The prompt completion of this project isn't my main concern as we have a project planned out, but need your quotations to complete the costing p...

I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate will deliver a list of valid emails extracted from the indicated c...

As the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies and contribute to an exciting ...

I require an experienced data scrapping professional to extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. The tables have a mix of te...extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. The tables have a mix of textual and numeric data. The task requires accuracy in extracting these data elements. - Expertise: Ideal experts must have prior experience in HTML/CSS, Python, and Web Scrapping. Experience with BeautifulSoup, Scrapy, or similar tool is a plus, as it will make dealing with tables easier and more efficient. Please bid with your past experience and...

I'm looking for a specialist to create a scrapy bot flask to automate certain actions. The purpose of this project is predominantly aimed at automation processes. The specific platforms to be automated haven't been determined yet, so a versatile approach will be appreciated. Following are the skills and experiences required for this project: • Extensive knowledge and experience with scrapy, flask, and automation. • Familiarity and proficiency in working with different platforms. • Ability to create versatile bots that can be adjusted according to the platform. Though we have no stringent time limit for project completion, we appreciate a dedicated, efficient approach. The capability to work efficiently without strict deadlines will be a plus point.

I urgently need an experienced data scraper who can meticulously extract the text content and links from specific webpages. Your core respo...specific webpages. Your core responsibilities will include: - Accurate and efficient data extraction from targeted webpages - Utilizing cutting-edge scraping tools and scripts to automate the process - Ensuring all text content and links are correctly pulled and stored Ideal Skills: - Prior experience in data scraping, particularly with webpages. - Proficiency in using scraping tools such as Scrapy, BeautifulSoup, or other similar utilities. - Keen attention to detail and accuracy. - Ability to deliver work promptly as this project has high time sensitivity. Please bid if you can deliver this project ASAP without compromising the qualit...

I need an experienced Python developer who can proficiently extract tables from a PDF document. Key Requirements: - The tables in the PDF are mostly well-structured but there might be few exceptions where you will need to han...irregularities. - You must have extensive experience in handling and extracting data particularly for inconsistent or complex table structures. - The final scraped data should be delivered in an Excel file. Ideal Candidate: - Extensive experience with Python and data scraping, with particular experience in handling table data. - Proficient in using Python data scraping tools like BeautifulSoup, Scrapy etc. - Good understanding of handling and transforming data in Microsoft Excel. - Strong problem-solving skills to handle potential challenges with table s...

...2.⁠ ⁠Extract relevant data points such as election dates, candidates, voter turnout, election results, and any other pertinent information. 3.⁠ ⁠Ensure accuracy and completeness of scraped data. 4.⁠ ⁠Organize and format the scraped data for easy analysis and integration into our database. *Requirements:* 1.⁠ ⁠Proficiency in web scraping techniques using tools like Python's BeautifulSoup, Scrapy, or similar frameworks. 2.⁠ ⁠Experience in data extraction and manipulation. 3.⁠ ⁠Ability to work with large datasets and handle multiple sources simultaneously. 4.⁠ ⁠Attention to detail and accuracy in data collection. 5.⁠ ⁠Strong communication skills and ability to provide regular updates on progress. 6.⁠ ⁠Time commitment: Expected completion within 3 days from the start ...

I require an IAM role with specific permissions to interact with s3, glue, and Athena on AWS. This role will allow for efficient management of the AWS stack, specifically enabling the creation of a crawler to populate a glue catalog database and tables, and also allowing interaction with an Athena workgroup. What I need: - Read-only access: This permission should allow the IAM role to view S3 bucket contents, view Glue catalog information, and view Athena workgroup details. - Write access: This level of permission should enable the IAM role to create or update tables in the Glue catalog and modify Athena workgroup settings. Ideal Experience and Skills: - Solid understanding of IAM roles and permissions on AWS - Experience with AWS s3, Glue, and Athena - Capability to work on AWS I...

I need an experienced and proficient website crawler who can help me extract Text content from Database Tables on my website. Key requirements: • Acing in finding, fetching, and structuring data. • Proficient in delivering the retrieved data in Plain text format. • Emphasis on fetching Text content from the Database Table, thus understanding of database structures is a must. Ideal skills include web scraping, data mining, and database understanding. It would be best if you had an eye for detail as accuracy is key in this project. With your expertise, you should be able to navigate through complex website layers to get to the desired content.

We are in need of a knowledgeable and skillful programmer who can edit on GoLang code. The main task involves Ethereum network crawling. We already have a running code to crawling the Ethereum network. However, we still need to do some changes on GoLang code (designing crawler), such as partition the ID_space into sections, and crawl using multiple crawlers in Ethereum not only single crawler as what we have. In addition, there might be more few changes on the code. The ideal candidate will: - Understand DHT-based network and Kademlia - Knows a little about Ethereum (blockchain) - Have experience in GoLang - Possess a deep understanding of DHT network crawling (p2p) - Have previous experience with crawling networks Your responsibility will be building on top of running code...

...documentation outlining the scraping methodology, data schema, and instructions for executing the scraper. Compliance and Ethics: Ensure the scraping initiative adheres to online marketplace terms of service and abides by legal stipulations. Ideal Candidate: Demonstrated prowess in web scraping and data extraction ventures. Proficiency in scraping utilities and frameworks (e.g., Beautiful Soup, Selenium, Scrapy). Fluent in programming languages pertinent to web scraping, like Python or JavaScript. Capable of extracting data from dynamically generated content and sites reliant on JavaScript. A solid grasp of web fundamentals (HTML, CSS, DOM). Previous experience tackling anti-scraping mechanisms and CAPTCHAs will be considered a plus. A staunch advocate for ethical scraping practi...

Hoping to connect with a proficient web scraping specialist to extract data from Website 1. The type of information to be extracted has not been specifically ...type of information to be extracted has not been specifically pointed out, so ability to gather comprehensive data is instrumental. Key Requirements: - High-level understanding of web scraping techniques - Experience extracting different types of data (Product Information, User Reviews, Pricing Details, etc.) - The ability to complete the task in 2 days Ideal skills: - Experience with Python, Scrapy or other web scraping tools - Familiarity with data extraction and storage - Strong speed and accuracy, with proven ability to meet tight deadlines. Please provide examples of similar work in your bid. Immediate completion...

...opportunity to work on cutting-edge projects, collaborate with a dynamic team, and contribute to the success of our data-driven initiatives. If you have a strong background in web scraping techniques and tools, and are passionate about extracting and analyzing data from various sources, we want to hear from you! Key Responsibilities: Develop web scraping scripts using Python, Beautiful Soup, Scrapy, and other relevant technologies Extract data from websites, APIs, and databases Transform data into structured formats for analysis and visualization Collaborate with stakeholders to understand requirements and deliver tailored solutions Lead and manage web scraping projects from inception to completion Qualifications: Proven experience in web scraping and data extraction Proficien...

Python Script of web spiders to fetch data crawling the web data。familiar with BeautifulSoup or selenium or scrapy ,Request etc What type of data do you want to scrape and crawl from websites? Fbeautiful soup vs selenium vs scrapy The function is easy to design

I am looking for an expert in web scraping, preferably skilled in Beautiful Soup, Selenium, or Scrapy. The task at hand involves scraping 83 distinct URLs and integrating the collected data - specifically showtimes - onto my website's TV channels page. Key aspects of the project include: - Displaying current showtimes on the website - Automatically updating these showtimes This project is needed ASAP, and thus requires a freelancer able to swiftly yet accurately complete the task. Proficiency in Python, PHP and JavaScript would highly benefit the project execution. ----- I require a freelancer with expertise in web scraping to update my existing scraper tools which gather show time information from a multitude of television channel websites. You will use selenium, scrappy o...

Google Jobs Scraper project requiring skills in .NET, Python, Selenium and SQL. The task is to create a crawler to extract job listings based on predefined queries, manage the data in a structured manner, and provide an interface for controlling and monitoring the scraping process. The solution requires adept handling of rate limits and the use of rotating proxies for efficient data scraping. Data To Be Scraped: - Scrape all specified job listing data points. - Store and manage the scraped data in a SQL database for effective access and organization.

I'm currently facing issues with my web crawler code. Specifically, it's not managing to scrape all the required data and it's throwing errors inconsistently. This code has been built to scrape information from certain e-commerce platforms. The ideal freelancer for this task should show: - Proficiency in Node.js - Extensive experience with Puppeteer and web crawling, especially focusing on e-commerce platforms - Exceptional debugging skills Your challenge will be to inspect the code, identify the underlying issues and then fix them to ensure a comprehensive and seamless data scraping process. I look forward to collaborating with someone who can effectively resolve the issues and optimize the performance of this web crawler.

your website is causing the load spikes in question. You can consider reviewing this on your side additionally. We have also noticed that there is a lot of bot/crawler access to the website. Access requests originating from bots are registered every 2 to 5 seconds.

Hi, Today i have created a Scrapy crawler to crawl the website , but i'm not able to crawl the website because when i run the crawler, any request i do to the website, i got the 403 error to me. I just neeed you fix my code to do a request at someway the website return the code 200 instead of 403. I'm sending my code attached. Send me a print screen in the chat showing you received code 200 using the same url, then i will hire you to send me your code.

I'm seeking a proficient Python programmer who can build effective scraping scripts for the list of websites and LinkedIn profiles. Your task will include: - Using Python with Scrapy to collect desired information. - Developing scripts that can identify and retrieve the services provided by the mentioned sites, along with their relevant contact details. - Ensuring that the scripts can also gather a comprehensive list of requirements from LinkedIn profiles. - Lastly, providing the compiled data in an Excel file format. Experience with Python and Scrapy is vital, and a firm understanding of web scraping and data manipulation is necessary. A proven track record in similar tasks would be advantageous. The freelancer must also be aware of and adhere to the legal boundaries ...

...ideal candidate should be capable of developing versatile scrapers that can adapt to different website structures. Key responsibilities: - Develop a Python web scraping system - Ensure that the scraper is versatile for news, e-commerce, and social media sites Ideal Skills: - Extensive experience in Python - Proficiency in web scraping, preferably with Python libraries like Beautiful Soup and Scrapy - Familiarity with multiple website structures Although I did not specify the frequency at which the scraper should update, considering the variability of the sites we will be dealing with, it's critical you design a flexible and efficient system that allows for changes in the data update frequency. I didn't specify what information you should include in your applicatio...

...who can scrap textual content from a specific website and save the data into a .xlsx file. I want three different scripts to scrape different sections of content from the same domain. See attached example for each of the three inputs and outputs required. Key skills required: - Excellent command over Python programming, especially for web scraping - Experience with Libraries like BeautifulSoup, Scrapy - Familiarity with xlsx file operating in Python - Strong understanding of web automation and bots Please make sure you: - Have a good grasp of exception handling to make sure the scraping script can handle errors and won't crash. - Can design the script in a way that it respects the terms of the website and avoids the potential of getting blocked. - Are meticulous and car...

Looking for a seasoned AWS expert to assist in optimizing EC2 instances, S3 storage, and Lambda functions for improved performance. The ideal candidate will have: Mainly working on Aws glue jobs , S3,lambda, Crawler, step functions, dynamo DB ,Clouldwatchs, Appflow, parameter store , API Gateways, ETL Jobs,splunk logs CloudFormation - important big bucket,Spunk, Jenkins pipelines* CI/CD * , YAML for creating templates and manifest files * Sql mandatory for date base * ⁠using Postman for API calls * ⁠Python and spark Musk know

I need an experienced professional who's an expert in using Scrapy to daily scrape Information to be retrieved includes price, SKU or internal ID, product URL, breadcrumb, title, price, currency, and brand. Key requirements include: - Strong comprehension of Scrapy - Proven experience in web scraping, particularly e-commerce sites The freelancer should be adept in handling large datasets and ensuring the accuracy and consistency of the data gathered. An understanding of e-commerce dynamics, especially pricing, would be a beneficial addition. The milestone is completed once the Scrapy project is delivered and tested. We have many more websites to work with once the first one is delivered

I need an experienced professional who's an expert in using Scrapy to daily scrape Information to be retrieved includes price, SKU or internal ID, product URL, breadcrumb, title, price, currency, and brand. Key requirements include: - Strong comprehension of Scrapy - Proven experience in web scraping, particularly e-commerce sites The freelancer should be adept in handling large datasets and ensuring the accuracy and consistency of the data gathered. An understanding of e-commerce dynamics, especially pricing, would be a beneficial addition.

...developer to create a specialized web crawler focused on extracting vital data from e-commerce websites, primarily targeting ''. Key Requirements: The web crawler must adeptly parse text-based content and efficiently navigate the site's structure to extract pertinent information and links. Extensive expertise in Web crawling, Web scraping, and Data mining is essential for this project's success. Prior successful engagements in web scraping projects centered on e-commerce platforms would be greatly advantageous. Proficiency in programming Python is required. Familiarity with web scraping frameworks and libraries like BeautifulSoup, Scrapy, or Selenium is highly desirable. While the initial focus is on '', the developed crawler...

I'm looking for an expert Python/Vue Js developer to help with creating a task automation app, specifically aimed at web scraping, for Windows operating system. Notably, the application should be able to handle basic to intermediate data extraction tasks, details of which will be shared upon selection. Understanding of web scraping libraries like Beautiful Soup, Scrapy is highly desirable. Experience in automating tasks on Windows is a significant plus. Python prowess alongside Vue Js for interface creation is key. Optimal skills and experience include: - Proficiency in Python for scripting the automation tasks - Familiarity with web scraping libraries in Python - Experience with Vue Js for frontend development - Understanding of Windows platform and compatibility considerati...

We're in need of a skilled Scrapy/Python expert to assist us in setting up a bot capable of efficiently scraping large online databases. The ideal candidate should have extensive experience with web scraping techniques and be proficient in Python programming. Our primary goal is to automate the extraction of data from these databases. If you have the expertise required for this task, we'd love to hear from you. Website URl: Please include examples of your previous work in your proposal. Looking forward to your proposals.

...Load Balancing and server optimization is a plus. Qualifications: Minimum of 4 years of experience with Django apps, with a strong understanding of MVC architecture and ORM. Proficiency in SQLAlchemy for database management and optimization. Extensive experience with AWS services, including EC2, RDS, S3, Redis, and Lambda. Knowledge of web scraping techniques and tools, such as Beautiful Soup and Scrapy. Experience with deployment using Nginx and Gunicorn, with a focus on scalability and performance. Frontend web development and design skills are a must, with the ability to create visually appealing and user-friendly interfaces. Experience in load balancing and server optimization is a plus, with the ability to optimize performance and scalability for high-traffic applications. ...

I'm looking to gather ...this project should have significant experience in data scraping, particularly from the resources mentioned. A successful freelancer will demonstrate knowledge of legal and ethical considerations around data scraping, including understanding and working within the guidelines and terms of use for each website. Proficiency in relevant programming languages and tools, such as Python, BeautifulSoup, Scrapy, Selenium, or comparable technologies, is necessary. Experience within the recruitment industry would also be beneficial, as it could inform a more effective approach to refining and organizing the gathered data. It's essential that the successful candidate can deliver a clean, organized, and usable list of email contacts for IT professionals at the...

I am searching for a Python developer proficient in Scrapy to forge web security testing tools. As a key deliverable, these tools must have the features below: - Subdomain Enumeration: Subdomains to be listed and categorized. - Directory Enumeration - Sensitive Parameter Detection - XSS Testing - SQL Testing Proven experience in creating security software is ideal. The developer should be adept at creating intermediate-level subdomain enumeration features. The project completion requires an understanding and implementation of Scrapy. I expect a functional, well-tested software package at the end of the project.

...system for users to create new accounts and log in as desired. 2. Chat functionality powered by GPT: A well-equipped Chat-bot that's capable of handling inquiries based on proprietary documents. 3. Comprehensive integration with LLM (GPT): A system that is able to process different types of documents (text, web-pages, PDFs etc.), inferring from both internal and external sources. 4. Web-link Web-Crawler: An engine that can gather data from the web and cross-link it with Azure. 5. Advanced SEO: Optimization techniques to help improve website ranking and visibility. 6. Google Maps integration: An option for website users to connect with Google Maps. 7. Multi-platform accessibility: The site will need to function seamlessly on both PC browsers and mobile devices (Android and iO...

...- Details of the lawsuit - Analysis for legal issues - Case citations Adherence to ethical guidelines and laws is necessary, thus a strong understanding of legal operation is essential. The script needs to ensure efficient data retrieval and storage. A high standard for accuracy and reliability will be expected in the delivered work. Candidates with hands-on experience using Beautiful Soup, Scrapy, or similar web scraping tools will find this relevant. Sufficient knowledge in legal documentation and practice is also an added advantage. I have these other tasks that can be combined or individually parsed out. Project Workload Breakdown 1. Data Collection and Preparation • Task: Web Scraping and Data Acquisition • Task: PDF Text Extraction and Data Cleaning 2....

...Consideration should be given to the fact that the bot is intended to work specifically with LinkedIn Basic accounts. Previous experience developing similar tools or working with LinkedIn's APIs and interfaces will be a definite asset for this project. Key Skills and Qualifications: - Proficiency in Python programming language. - Experience with web scraping techniques and tools (e.g., BeautifulSoup, Scrapy). - Knowledge of automation frameworks such as Selenium. - Familiarity with email integration libraries (e.g., smtplib) and third-party email APIs. - Understanding of LinkedIn's API and user policies. - Strong problem-solving skills and attention to detail. - Ability to work independently and collaboratively in a team environment. - Excellent communication skills fo...

We are seeking an experienced free...Ensure automatic updating of data in the dashboard to reflect current market prices in real estate. Implement security measures to protect collected data and comply with data protection regulations. Required Skills: Proven experience in web development and dashboard creation. Strong programming skills, especially in Python, JavaScript, and the use of web scraping libraries such as BeautifulSoup, Scrapy, or similar. Knowledge of front-end development technologies for creating user interfaces (UI), such as HTML, CSS, and JavaScript frameworks (React, Vue.js, or Angular). Experience with SQL/NoSQL databases for storing and managing collected data. Understanding of data protection issues and the ability to implement secure practices in application de...

I'm looking for a Google Domains admin to help me fix an issue with page indexing and device permissions for my in-domain email addresses. Tasks: - Analyzing and resolving an issue with page indexing (the Google crawler is complaining about something but I can't tell what) - Setting device permissions for in-domain email addresses (I'm having trouble because users seem to be currently prohibited from logging in on their own devices and I can't find a setting to allow better functionality) Experience and Skills: - Expert knowledge of Google Domains - Proven track record of resolving similar issues Applications: - Only applications showcasing past work in Google domain administration will be considered. Please include the details of previous projects you have ...

This project involves conducting a dark web websites crawl with the primary objective of gathering dynamic intelligence and monitoring online activity. Key Details: - ACHE Crawler needs to be used to crawler dark web and collect available websites urls Required Skills and Experience: - You need to be proficient in Python programming and have previous experience in web crawling, especially on the dark web. - Familiarity with network security and understanding of dark web dynamics is highly preferred. - Familiarity with ACHE Crawler, Docker and Scrapy is needed. On completion, a detailed report of the findings, as well as the script code used, will be expected.

I'm currently in need of a solution that will allow for task automation through the collection of real-time data. More specifically, this data collection needs to support auto...the primary tasks for this project: - Establishing a system for collecting real-time data from web pages - Implementing this system so that data input tasks can be automated - Ensuring that the system runs smoothly and efficiently, with minimal errors Proficiency in programming languages commonly used for web scraping such as Python or Java, strong knowledge of web scraping frameworks such as Scrapy or Beautiful Soup, and understanding of web technologies such as HTML, CSS and JavaScript will be of strong advantage for this project. I look forward to discussing this project further with those who ha...

I am looking for an adept developer to create a data crawler that can efficiently harvest text data. The main area of focus for this project is to extract data from the MCA (Ministry of Corporate Affairs) of newly registered companies. Key Functionalities: • The crawler should be designed to extract text data. • It should specifically retrieve MCA data concerning newly registered companies. Expected Results: The solution should result in an efficient, accurate extraction of data from the designated sources, presented in a convenient, readily usable format. Timeline: The project needs to be completed within a month. Ideal Candidate: The ideal candidate for the project will have: • Extensive experience in data crawling and programming. • Demonstrated a...

As an indie game developer, I am in need of a Unity Game Designer to create multiple engaging, cave-like dungeons for a fantasy-themed dungeon crawler. The ideal candidate should possess: • Expertise in Unity3D and procedural level generation mechanisms • Creativity to design dungeons encapsulating a dark and eerie vibe cursed with an infused ancient mystery. Key Project Components: • Procedural Dungeon Creation: Dungeons must be designed using procedural generation techniques to bring forth the essence of unpredictable gameplay and replayability. Upon refreshing, a new layout should be generated. • Triple-trap system: The incorporation of multi-tier traps such as spikes and pitfalls, moving platforms, and hidden passages, is a must. The designer must come u...

...beautiful soup for processing. For this project, the main tasks include: - Designing and implementing effective scraping systems to collect and process data - Integrating to our current system Skills and Experience Ideal candidates for this project should have: - Proven experience in data engineering, API, ETL, and scraping projects. - Proficiency in Python Libraries such as BeautifulSoup or Scrapy. - Demonstrable past work related to data science or data engineering Here are some additional details to help you understand the specific project requirements: Background on What My Clients Need | Information to Help Salespeople: I help sales teams perform better by providing them information about their prospects. My clients (companies) are looking for information that can he...

I have a requirement to develop a Software as a Service (SaaS) solution which includes a crawler and a data presentation dashboard. Crawler: - The crawler needs to be designed to extract both text and images. - This data extraction has to happen on a daily basis. Dashboard: - The dashboard should present the data collected by the crawler in an understandable manner, ideally through visual graphs or charts. - It must also include a search function so specific data can be easily located. Ideal skills for this project include: - Proficiency in SaaS development. - Experience in buildling crawlers. - Strong knowledge in data visualization techniques. Please note, any additional recommendations for enhancements to this project are welcomed and appreciated....

...data integrity and efficiency. - Work with JSON for data interchange and leverage Pandas for data analysis and manipulation. - Conduct web scraping using Scrapy, Requests, Httpx, and implement automation with Selenium for browser tasks. - Utilize Redis and Celery for background task processing and message queueing to enhance application performance. Qualifications: - Proven experience as a Python Developer, with a strong portfolio of projects. - Proficient in Django, Flask, JavaScript, React JS, Axios, Docker, and cloud deployment (Digital Ocean preferred). - Experience with SQL, Postgres, MongoDB, JSON, Pandas, and web scraping tools (Scrapy, Requests, Httpx). - Knowledge of Redis, Celery, and Selenium for automation and task management. - Strong problem-solving skills, ...