Find Jobs
Hire Freelancers

Spyder web crawler that feeds from urls in web MYSQL -- 2

€750-1500 EUR

Closed
Posted over 2 years ago

€750-1500 EUR

Paid on delivery
Spyder web crawler that feeds from urls in web System working (manual work). We have a program done in visual basic (we have source code) which we have to load in xls (maximun 50,000 records) and scraps (it crawls domain sees number of urls crawls them and with regex patterns extract info and saves it in a xls), We would like to have a better system than that We would like to upload urls and that this spyder continouly works in the cloud with no need to have a computer or a virtual machine. Amazon Web services, or a mysql with a script, don’t know the best system that you see. The idea is to just focus on getting urls. Mysql would be the best system I think we would need to do some update queries every now and then to have the final results. We would like to have it centralized with a sole mysql and that automatically (without a virtual machine if possible)
Project ID: 31595387

About the project

25 proposals
Remote project
Active 2 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
25 freelancers are bidding on average €1,202 EUR for this job
User Avatar
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it because I have good skills with Amazon Web Services, Visual Basic, Python and MySQL. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https://www.freelancer.com/u/AwaisChaudhry?w=f Availability timings: 9am-9pm EST Regards, Awais
€1,500 EUR in 10 days
5.0 (24 reviews)
6.9
6.9
User Avatar
Good day, I’ve read your project requirements in detail. I have years of experience in web scraping. I am a full stack web and python developer, with 11 years of web app development experience. Will it be freeware or SaaS based system? What will be administrative user’s features? Will you be able to provide the design wireframes as well? Can you provide the full specification on user stories? Right now, I am placing a placeholder bid as the business details are yet to be discussed. Please initiate the chat for the same Happy to provide relevant portfolio in chat.
€1,500 EUR in 25 days
5.0 (18 reviews)
6.9
6.9
User Avatar
Hello, I have 5+ years of strong experience as Python Developer. I have expertise with Python, Django, Flask, Web Socket, AI, ML, Tensorflow, NLP, Deep Learning and Data Science. Can we have a quick chat/call to discuss this opportunity? I would like to show myself expertise and past quality work. Note:- This is a place holder bid. So the Actual price and time will be given after complete discussion. Looking forward to hear from you. Thanks & Regards, Virang.P
€1,500 EUR in 7 days
5.0 (33 reviews)
6.7
6.7
User Avatar
Hi! I am professional Python engineer. I am familiar with Python and I have a lot of work experiences in Python, MySQL, Visual Basic and Amazon Web Services. I can start right away. I want to discuss for this project in detail. Please contact me to discuss more about this project. Thanks & Regards
€1,000 EUR in 5 days
4.9 (10 reviews)
5.1
5.1
User Avatar
Hi! I have just noticed your project Spyder web crawler that feeds from urls in web MYSQL -- 2 and very interested in it. I am a developer who well skilled for this project and skills MySQL, Amazon Web Services, Visual Basic and Python. If you give me this project, I assure you that I will give you my best . Please send me a message here. Looking to discuss more details with my past works and experience Best
€1,125 EUR in 5 days
4.7 (12 reviews)
5.0
5.0
User Avatar
Hello, I hope this finds you well. I have just seen your project requiring; Python Visual Basic MySQL Amazon Web Services I believe that my 10-year experience in this field is what you need right away. Avoid the headache of looking further. Let's save time and focus on the real task. My proposed timelines and budget are just placeholder and an open for negotiation to increase or decrease as per the full requirements at hand. Allow me to prove how better my review can be. Smile all the way! Click the message button, so initiate the conversation. Regards, Fridah
€1,125 EUR in 7 days
3.6 (10 reviews)
5.5
5.5
User Avatar
Hi Alvaro, I have read the description carefully. As a full-stack software developer, I can build a crawler based on your requirements fully. Could we discuss it in detail via private chat? I look forward to hearing from you. Thanks, regards. Edgar
€1,250 EUR in 10 days
5.0 (1 review)
3.4
3.4
User Avatar
Hello there. I am a python web scraper and automation specialist. Before I built some crawling systems, and I built much scraping bots. And I think my mysql and aws knowledge are powerful. If you'd like, I will share my past works or scripts via chat. Please give me your chance, I will not disappoint you. I look forward to hearing from you. Regards.
€999 EUR in 7 days
5.0 (2 reviews)
3.6
3.6
User Avatar
Hello. I am python expert. I can do this task. Getting urls from sql and visit these urls to get data. I have to use python libraries such as beautify, selenium and so on. I am confident in your project. Let's talk. Thank you.
€1,200 EUR in 7 days
5.0 (6 reviews)
3.4
3.4
User Avatar
Hello, Dear client. I am so glad to see your job posting. I have read your posting carefully and I have a good understanding. I think I am the developer you are looking for now. Because I have 7+ years of experience in Website development. In my point of view, Only when a programmer is really familiar with PHP ( Laravel, CodeIgniter ), Python, Django, MySQL, MongoDB, JavaScript, jQuery, Website Design, Graphic Design, HTML/CSS. Maybe you can raise up your business and make it more colorful through this project. Hope to see magic? Then I will make your wish a reality. Waiting for your contact. Thanks.
€1,125 EUR in 7 days
5.0 (1 review)
2.6
2.6
User Avatar
Hi!I am a Python expert with over 5 years experience dealing with Software, I can help working with your projects. I've previously worked on the exact same project for another employer. Basick Knowledge: Pandas, Numpy, Coverage, UnitTests, Docker Web Automation with Selenium, Beautifulsoup Pdf Parsing, OCR, Parsing Grammar from formula, White noising. Network building like nb-iot with dataset, IDS building with CTU-13, KDD Dataset Fake News detection Script with Dataset, Tor network related Script MLP, NLP and more base for ml and dl deliver. Payment server building using Flask and Django Scraper building for several business ML and Deep Learning for classification and prediction(Tensorflow) using PIP, anaconada, Cuda - football prediction, football betting using MLP, Roc, Clustering - image recognization and face recognization using Keras, Pytorch - face recognition, video streaming integration for people verification Python trading strategy establishment and auto trading implmentation with api. ML and DL with web interface using Django Unit Testing with Coverage in Pycharm Database: Mysql, Sqlite, Mongo, Postgresql, Ms Sql When do you need this finished by? I understand how this task should be done with my skillsets, and can get this done for you quickly and qualifiedly! Please research my work sample i worked before and I look forward to working on this project with you. Thanks.
€1,125 EUR in 7 days
5.0 (2 reviews)
1.3
1.3
User Avatar
Hello. I have rich experience in responsive website design with php-laravel, react.js, vue.js, mysql DB. I have read your job description very carefully and got interested in this project because it fits on my skill stack. I will be realized with my skill and experience. I'd like to know a bit more about your project via chat. Best Regards, Sergey
€1,000 EUR in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear client I'm new here, but I have over 7 years experience of web crawling and search engine development. I can run crawler in hosting and update the domain list dynamically using popular Apache Nutch. I read your requirements carefully and I think I can finish your project very well. I will do my best to make clients satisfied with good quality and to meet timeline. I hope that we'll discuss about it in details. I'll wait for your reply. Regards
€750 EUR in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
i already have this prototyped crawler running i can get a demo up for you in 2 days if you have the cash i will belt this out by monday
€1,125 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Concerned, With immense pleasure introducing Radiant Network LLC, a specialized TECH company focusing on system evolution, digital core and intelligent technology. Our global infrastructure technology built on 13 years of innovation, collaboration and engineering excellence. Our inhouse 52 engineers in 14 different teams who are dedicated for our global clients. Our Capability & Expertise Describes us More: Front end : JavaScript - Angular v.2, v.5- jQuery,ReactJS Back end : Python 3, Django 2,ExpressJS,Meteor,, Nodejs, PHP (CI, Zend, Yii, Laravel,Zend,CakePhp,Lumen,Yii 2.0, Syphony), Java SE / EE- Spring- Hibernate,Python 3- Django 1.8,1.10,Node (Express) Design : HTML 5.0,CSS 3, jQuery, PSD to html, Graphics design, Create design Mockup, HTML template creation Tools : Jira, Teamwork, Asana, Trello, Git, SVN, TFS, Docker Our TECH analyses team has reviewed and confirmed that we are capable of providing your required services on project basis or monthly employee sharing basis at a competitive rate with quality service. Quality, Service, Delivered is our motto. Our reviews on numerous projects will make you believe we are the chosen one for your current and all future projects. Best Regards, Tahsinul Alam CEO
€1,414 EUR in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of SPAIN
madeira, Spain
5.0
36
Payment method verified
Member since Mar 21, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.