Geek Answers Handbook

How to connect to Spark EMR from a locally running Spark Shell

I created a Spark EMR cluster. I would like to perform tasks either on my local host or in an EMR cluster.

Assuming that I run the spark shell on my local computer, how can I say that it connects to the Spark EMR cluster, what will be the exact configuration parameters and / or commands to run.

+4
source share
1 answer

It seems that others also failed and ended up working with the Spark driver on EMR, but then using, for example, Zeppelin or Jupyter working on EMR.

, , . , , . , , .

Spark pyspark, Jupyter Notebook . Jupyter node, , . , EBS node . [...]

. , S3 , EBS.

0

More articles:


All Articles