Looking to get Spark working on virtual machines using Mesos and Ipython/Jupyter
$10-30 USD
Closed
Posted over 8 years ago
$10-30 USD
Paid on delivery
We currently use SQL Server to store our data in the cloud. However, we would like to advantage of some of the other tools available namely Spark.
We have downloaded and installed Python, Spark, Java, and Hadoop (however, this does not imply we have done it correctly). We want to take advantage of the distributed nature of Spark, ideally taking advantage of Mesos for resource management. We want to be sure and connect the python instance to IPyton/Jupyter for our purposes.
We are looking for someone who can use Teamveiwer so we can document the process as you setup a fully functioning pyspark environment.
Success will be measured by us being able to achieve 1 or 2 queries using what has been developed.
Dear Madam or Sir,
I have great experience with Spark in combination with Mesos, Scala, and Python and Jupyter. While I cannot give you detailed instructions via teamviewer on such a small budget I can send you some docker contaieners which have everything configured.
Please give some furhter details about what exactly you want to do and which configuration/(in particular what cluster config).
Best regards