Periodic web crawler in Python/Rails for read data from web/download latest files and upload it to another sites via API

Cancelled Posted 4 years ago Paid on delivery

$30-250 USD

Paid on delivery

Cancelled Paid on delivery

Hello,

I need a Python or Ruby or PHP program to scrap one website and store the results in a PostgreSQL database. And also download file from to website and push it to another specified website via API. The program needs to keep running periodically to read the latest posts on the websites.

Sample website : https://app[dot]any[dot]run/tasks/d771a9a1-31ae-4d64-adb6-74e747ec3e16/

Please answer me 3 questions before you offer, I will not respond to anyone who haven't answer the following questions,

1. What is the sample website topic?

2. How will you make the program run periodically

3. What library will you use for crawler? Thanks.

PHP PostgreSQL Python Ruby Web Scraping

Project ID: #20007155

About the project

7 proposals Remote project Active 4 years ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

Awarded to:

CreoMark's Profile Picture
CreoMark

Dear Employer, I have read your requirement. I understood what you really want. 1. What is the sample website topic? - Server Monitoring Tool 2. How will you make the program run periodically - Using background jobs More

$140 USD in 3 days
(1 Review)
0.8

7 freelancers are bidding on average $144 for this job

naravila's Profile Picture
naravila

Dear Client! I read your description carefully and I am really interested in your project. I am a senior web developer and I have rich experience in python scraping. As I am an expert, I know what you really want. I a More

$140 USD in 7 days
(51 Reviews)
6.4
kipdev13's Profile Picture
kipdev13

Nice to meet you. I've read the task description and can develop definitely. I'll provide you with the highly skill to complete this task in time. I'll also do my best for you. Please contact with me. Thank you ve More

$98 USD in 3 days
(96 Reviews)
6.6
sky930320's Profile Picture
sky930320

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide More

$250 USD in 7 days
(37 Reviews)
6.9
mfaisal902's Profile Picture
mfaisal902

Greetings Sir, I am Muhammad Faisal and we are professional Software Developer and i will use Java Selenium to Scrap this website and we provide you quality work within your budget and time duration so, lets get start More

$30 USD in 2 days
(4 Reviews)
1.5
ghazaltaimur's Profile Picture
ghazaltaimur

Experience in latest development tools and technologies like Php, Node Js, Magento, Laravel, Wordpress, Html, Css, Typescript, GraphQL, React JS, React Native, Angular Js. Also handle server and deployments in AWS.

$200 USD in 3 days
(0 Reviews)
0.0
Post a project like this