Find Jobs
Hire Freelancers

Spark, Elastic Search, Python expert needed

₹1500-12500 INR

Closed
Posted almost 4 years ago

₹1500-12500 INR

Paid on delivery
Hi, I require a data engineer to model our data pipelines. We are operating a search engine and require to create data pipelines to update our database everyday. We intend to run this on top of elastic search.
Project ID: 26353013

About the project

11 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
11 freelancers are bidding on average ₹7,058 INR for this job
User Avatar
I am a data scientist and a big data developer with more than 4 years of experience in developing solutions for the client using advance technologies like Machine Learning, Deep Learning, Apache Spark and Spark Streaming using Python and R. Moreover I have hands on experience in deploying production ready models using cloud services like AWS and Azure. I have knowledge in developing complete data science life cycles which includes Data Collection, Data Wrangling, Feature Engineering, Data Modeling and Data Visualization. Below are the technologies i have experience in - Machine Learning - Supervised and Unsuperived ML Models Big Data - Spark and Hadoop Cloud Tech - AWS Datapipelines, AWS EMR, AWS Aurora DB, Amazon Redshift, AWS Lambda and more, same is with Azure. Orchestration Tools - Apache Airflow, Luigi, Ansible, CronJobs, etc. Reporting Tech - PowerBI and Tableau Programming Languages - Python, R and Scala. I can share with you my previous work in the related fields. I would like to know more about your project/assignment. Thanks.
₹5,556 INR in 1 day
4.9 (45 reviews)
5.9
5.9
User Avatar
I am a certified developer and designed and developed many enterprise level applications using spark and also integrated with many other nosql data bases such as Elastic search. Please let’s connect and discuss more on your requirements. You think of this is done. Thank, Naresh.
₹8,889 INR in 3 days
5.0 (6 reviews)
4.4
4.4
User Avatar
Hi, I am a python developer with 2+ years of experience. I have experience in the data pipeline, ETL, and elastic search. In one of my projects, I have used elastic search to get the result based on free text (multiple fields, fuzzy match) and geo boundary, and to keep the search engine up to date; the project had numerous sources of data some of which includes manual intervention. I have built a data pipeline that connects elastic search, PostgreSQL, GIS scripts, and a web GUI( for manual sanitization of data). The pipeline reduced 27% of the manual labor cost of the company (data entry). Where are you planning to host the pipeline? I have experience of working in AWS and Linode. Hope I can use my expertise in this project. Have a good day! (Bid amount is negotiable based on details)
₹8,000 INR in 7 days
4.8 (6 reviews)
3.6
3.6
User Avatar
Sharad: Note: I have done similar kind of work in spark , see my recent review where I created a data pipeline. 14 Years of Experience with best start ups in Java & J2EE technologies,spark ,scala, python want to do the things right at first hand. Looking to work independently and to learn through new challenges. Will deliver the best, working as an Architect. Would be glad to hear from you, once you share your project requirement, will provide you the detailed design and implementation plan. I am always ready to respond without any delay and work in real time manner.
₹4,444 INR in 10 days
5.0 (3 reviews)
3.2
3.2
User Avatar
I am a python developer and well experienced. I am interested to work on this project. If you are interested please reply and we will discuss about the project.
₹2,250 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Experience data scientist with 4+ years of total experience . Currently working on technologies like pyspark , Apache airflow , ELK ,CI/CD using gitlab . I am interested to do more work on spark and ELK .do let me know your thoughts
₹1,500 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
hi , I read your description thoroughly . I have a good experience in spark and elastic search . I can able finish this project . looking forward to hear from you
₹9,999 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have experience working on spark + python + elastic search stack for 2 large scale projects working on 2 TB+ data. I have mentorship from industry leaders and senior engineers(with 15+ years of experience) to ensure that your job gets done with high quality and within timelines. We can help you design, implement and optimize your elasticsearch queries. We can help you apply ML in your search results as well.
₹11,111 INR in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Mumbai, India
5.0
39
Payment method verified
Member since Aug 18, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.