Geek Answers Handbook

Spark-submit not found exception

I am trying to run this simple spark application with the spark submit command using this quick start. http://spark.apache.org/docs/1.2.0/quick-start.html#self-contained-applications . when I try to run it using spark-1.4.0-bin-hadoop2.6 \ bin> spark-submit --class "SimpleApp" --master local [4] C: /.../ Documents / Sparkapp / target / scala - 2.10 / simple-project_2.10-1.0.jar I get the following exception:

java.lang.ClassNotFoundException: SimpleApp
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSub
mit$$runMain(SparkSubmit.scala:633)
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:16
9)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:192)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:111)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Using Spark default log4j profile: org/apache/spark/log4j-defaults.properties
15/06/17 09:45:11 INFO Utils: Shutdown hook called

Does anyone know how to fix this? Any help is appreciated.

+4
source share
3 answers

, , , , :

  • jar - > eclipse jar. - >

    jar cf myJar.jar myClass.class

  • :

    val jarFile = "SimpleApp.jar"; #path

    val conf = new SparkConf(). setAppName ( " " ). setJars (Array (jarFile));

0

main.java.SimpleApp, . Svend ,

+1

, "local" master, , .

0

More articles:


All Articles