Find Jobs
Hire Freelancers

Simple Python Web Scraping to JSON using BS4

$30-250 USD

Completed
Posted about 5 years ago

$30-250 USD

Paid on delivery
This should be very easy for someone who has done this before. Basically, we need a simple Python script to extract a list from one web page (few fields including item detail URL), and extract additional detail from item detail URL. The source is one index page and one detail page per item. There are less than 100 items. I'd like this done in the next few days. Please let me know if you have any questions. This is what the scraper's final JSON should look like: { "items": { "item": [ { "id": "1", "name": "Item Name 1", "description_short": "Sample item", "price": "$100", "detail_url": "http://some/page", "description_long": "Several sentences will be extracted here.", "features": [ "Feature 1", "Feature 2", "Feature 3" ], "need": [ "Need 1", "Need 2", "Need 3" ], "faq": [ { "id": "0", "question": "question 1", "answer": "answer 1" }, { "id": "1", "question": "question 2", "answer": "answer 2" }, { "id": "2", "question": "question 3", "answer": "answer 3" } ] }, { "id": "2", "name": "Item Name 2", "description_short": "Sample item", "price": "$100", "detail_url": "http://some/page", "description_long": "Several sentences will be extracted here.", "features": [ "Feature 1", "Feature 2", "Feature 3" ], "need": [ "Need 1", "Need 2", "Need 3" ], "faq": [ { "id": "0", "question": "question 1", "answer": "answer 1" }, { "id": "1", "question": "question 2", "answer": "answer 2" }, { "id": "2", "question": "question 3", "answer": "answer 3" } ] }, { "id": "3", "name": "Item Name 3", "description_short": "Sample item", "price": "$100", "detail_url": "http://some/page", "description_long": "Several sentences will be extracted here.", "features": [ "Feature 1", "Feature 2", "Feature 3" ], "need": [ "Need 1", "Need 2", "Need 3" ], "faq": [ { "id": "0", "question": "question 1", "answer": "answer 1" }, { "id": "1", "question": "question 2", "answer": "answer 2" }, { "id": "2", "question": "question 3", "answer": "answer 3" } ] } ] } }
Project ID: 18872440

About the project

11 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,
$55 USD in 3 days
4.9 (107 reviews)
5.9
5.9
11 freelancers are bidding on average $134 USD for this job
User Avatar
Hi, my name is Selim. I read your `Simple Python Web Scraping to JSON using BS4` project descriptions carefully before bidding. I checked the sample code as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product databases from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.
$200 USD in 3 days
5.0 (295 reviews)
8.1
8.1
User Avatar
Hello? How are you? I have seen the project - "Simple Python Web Scraping to JSON using BS4." I have been working in these fields((Data Scraping, Python, Software Architecture, Web Scraping)) for 7 yrs as a freelancer. I can work full time as you need. I will never disappoint you and i will try my best to deliver good result always. Hope to work with you. Thank you.
$155 USD in 3 days
4.9 (118 reviews)
7.0
7.0
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$220 USD in 3 days
4.9 (102 reviews)
7.0
7.0
User Avatar
Hi there, The requirements are quite clear and straightforward to implement so no questions really. I just need the website url then I can handle the rest. I am planning to use py3 and bs4 as you've requested. If you want me to target py2 branch instead please let me know, thanks.
$100 USD in 1 day
5.0 (37 reviews)
6.0
6.0
User Avatar
"5 Gold Star and 100% Job Completion Rate" Hi, Sir I've read your requirement carefully. I'm sure I can finish your task perfectly in a short time. As you can see my profile, I'm a senior Web developer. I've plenty of experiences and finished lots of project before. I can use Beautiful Soup and Python Selenium, PHP scrap. I finished 100% task perfectly. and I can work full time with you as you want. I'm looking forward to work with you. Thank you.
$98 USD in 3 days
5.0 (23 reviews)
5.7
5.7
User Avatar
Hi, I am a qualified all-round Python developer and web scraper, working with a small team of talented developers and confident of delivering your project as per your requirements. You can pay after the job is completed to your full satisfaction. Thanks, ADITYA
$250 USD in 3 days
5.0 (29 reviews)
5.8
5.8
User Avatar
Hi! Could you share a sample index URL page and a detail URL page? Thanks. I am bidding on this project because this is what I do 24x7 for my livelihood (solving issues on frontend and backend like these for my client who is himself a website designer) Thanks and have a nice day!
$100 USD in 2 days
5.0 (5 reviews)
4.3
4.3
User Avatar
I DO NOT OUTSOURCE I have been a freelancer for the past 8 years, I believe that my experience and skill in this background will prove to be of great help to you. Contact me to discuss more on the details
$150 USD in 3 days
4.2 (14 reviews)
4.7
4.7
User Avatar
Hello I am a full stack developer for over 5 years on the freelancer.com. I have read your description in more detail and have much interest in your project. I have many experiences what I have ever done before similar to your project. I think that I can finish your work perfectly as you need. If you need to discuss with me for any kind of suggestions or information, please knock me anytime. I am looking forward to hearing from you very soon. Thank you.
$100 USD in 3 days
5.0 (4 reviews)
2.7
2.7
User Avatar
Hello Sir, I have great experience in Web Development, especially in Python. I have done a large number of scraping project using python, scrapy, selenium, beautifulsoup and some other libraries. I will do your project within 2-3 hours depending on the complexity of the site. Hope we will work together soon. I am waiting for your response!!
$50 USD in 1 day
4.8 (5 reviews)
1.2
1.2

About the client

Flag of UNITED STATES
Chicago, United States
5.0
59
Payment method verified
Member since Feb 21, 2007

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.