Changes

Jump to: navigation, search

Telemetry/Custom analysis with spark

4 bytes added, 19:14, 10 August 2016
Setting Up a Spark Cluster On ATMO
# A cluster will be launched on AWS preconfigured with Spark, IPython and some handy data analysis libraries like pandas and matplotlib.
Once the cluster is ready, you can tunnel IPython through SSH by following the instructions on the dashboard, e.g.run:
ssh -i my-private-key -L 8888:localhost:8888 hadoop@ec2-54-70-129-221.us-west-2.compute.amazonaws.com
Finally, you can launch IPython in Firefox by visiting http://localhost:8888.
29
edits

Navigation menu