Kafka, Cassandra, Hadoop, and Spark cloud solution in the backend. Please read complete description.

₹37500-75000 INR

Closed

Posted

almost 6 years ago

₹37500-75000 INR

Paid on delivery

I am developing an IoT solution for which i am expecting large data from edge devices to the cloud. looking for a freelancer to help me in: - writing requirements - designing solution - implementation - integration with Azure/AWS Cloud and other pieces of the solution - ongoing support for: - managing data streaming from edge (Kafka and probably spark/akka) that include connector/producer/consumer functionalities - storing the data in NoSQL (Cassandra) - analyzing and visualizing the data (Hadoop) SCOPE: Your scope of work start from the point the data leaves the edge network. - Receiving the data stream (NiFi or Kafka Connector) - collecting/consuming the data stream in Kafka (Kafka, Spark) - Storing the Data in NoSQL DB (Cassandra) - Analyzing and visualizing the data (Hadoop or its alternative) Need your help in starting from writing "specifications" to "GoLive" to "Ongoing Support". I already have: One engineer taking care of Firmware for Edge. One engineer taking care of APIs. One engineer taking care of Mobile App and Website. You will be interacting with these engineers during project execution. Please find below my project schedule: 1. Requirements Phase: Duration 1 month: Expecting at least 10 hours of time per week Tasks: Documenting specifications, tools/platforms/framework to be used, all interfaces defined 2. Design Phase: Duration 1 month: Expecting ate least 10 hours of your time every week Tasks: Documenting Low Level Design/architecture, APIs to be used at all interfaces, Data Modeling/Analysis/Visualization defined 3. Implementation/Integration Phase: Duration 2 months: Expecting ate least 10 hours of your time every week Tasks: Coding, Implementation, Configuring, Provisioning, Integration (as applicable) 4. Testing, Automation, Stabilization, Fixing all bugs Duration 1 month: Expecting ate least 10 hours of your time every week Tasks: Fixing all bugs, identifying any last minute gap based on my feedback or performance and implementing those 5. Cloud Hosting/Integration/GoLive Duration 1 month: Expecting ate least 10 hours of your time every week Tasks: Continue fixing bugs, GoLive on one of the cloud hosting environment (Azure or AWS) 6. Ongoing Support for 6 months after GoLive that does not include new feature Duration 6 month: Expecting at least 4 hours of your time every week Tasks: bug fixing, questions and answers on any code/document/design aspect of your part of code, documentation update if needed

Project ID: 17044636

About the project

18 proposals

Remote project

Active 6 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

18 freelancers are bidding on average ₹88,241 INR for this job

@dirisalagopal

Big data expert.

₹60,000 INR in 10 days

5.0

(12 reviews)

4.8

@waheni

i am interested with your project please send private message thanks ************************** ****************************************

₹62,500 INR in 60 days

4.8

(8 reviews)

4.6

@hemantjhalani

Hello I am expert in Kafka and Casandra , PHP so I am one of the suitable candidate for this project. Feel free to contact me. Thanks Hemant

₹70,000 INR in 20 days

4.9

(4 reviews)

3.4

@akshaynaidu9

Hello, I am willing to work on your project. It project requirement matches with my daily job profile. I work as Hadoop Administrator in a start-up company. Creating and managing pipelines involving Kafka, sqoop, hdfs, hive, etc is my daily routine work. I manage MongoDb cluster. We use AWS cloud in our ofice. I believe my skills would be useful in executing your project. Thanks & Regards, Akshay.

₹62,500 INR in 20 days

4.8

(5 reviews)

3.2

@imranchaushit

hi my name is imran Chaush i am having 5 year of experience in hadoop Administrator. i gone through your project requirements. and would like to work with you.i am good at AWS but also know GC & AZURE. which hadoop distribution we are going to deploying. we have a cluster up and running or from scratch we have to do it.

₹100,000 INR in 150 days

3.3

(2 reviews)

1.9

@MetaoriginLab

We are a Team of Data Scientists having healthy experience into Big Data technologies like Scala/Spark/Akka, Hadoop,MapReduce and Data Analytics like R,HBase etc. The Team has qualified engineers having expertise in solving complex problems.

₹375,003 INR in 3 days

0.0

(0 reviews)

0.0

@vw6689669vw

I have more than 14 years of industry experience in various technology. Majority I have worked on backed databases/applications. This would be best fit for my work criteria. Provide More detail. / Contact details so we can proceed.

₹88,888 INR in 20 days

0.0

(0 reviews)

0.0

@German75

what I propose to you: - use nifi to receive data and send it to the kafka - with spark you consume the data from the topic and send it to cassandra server I know very well NIFI, kafka, spark and cassandra. I have a question about spark, how do you want to work with spark standalone or with hadoop?

₹83,333 INR in 30 days

0.0

(0 reviews)

0.0

@prianshuhasija

As per your project description, I find my profile apt. I have already worked on data modelling and spark streaming jobs using kafka as intermediate connectors in micro jobs and saving data to Nosql DB at the end and writing APIs to interact with No SQL DB.

₹66,666 INR in 60 days