java.lang.ClassNotFoundException

tip

This might be an issue with the file location in the Spark submit command. Try it with "spark-submit --master spark://master:7077 hello_world_from_pyspark.py {file location}"

tip

Check if you've set a name in Application -> Run. If you didn't, the generated XML is gonna have missing information and then this exception will be thrown.

tip

Needs to add netty-transport-native-epoll with a OS classifier to the classpath, it's not included in netty-all

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

  • Apache Spark Quick Notes :: Part - 1
    via by Unknown author,
  • Scala 2.11 support?
    via GitHub by Hydrotoast
    ,
  • Akka HelloWorld Not Compiling :-(
    via Stack Overflow by user1974297
    ,
  • How to invoke Akka helloworld?
    via Stack Overflow by blue-sky
    ,
    • java.lang.ClassNotFoundException: org.spark_project.protobuf.GeneratedMessage at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Unknown Source) at akka.actor.ReflectiveDynamicAccess$$anonfun$getClassFor$1.apply(ReflectiveDynamicAccess.scala:21) at akka.actor.ReflectiveDynamicAccess$$anonfun$getClassFor$1.apply(ReflectiveDynamicAccess.scala:20) at scala.util.Try$.apply(Try.scala:191) at akka.actor.ReflectiveDynamicAccess.getClassFor(ReflectiveDynamicAccess.scala:20) at akka.serialization.Serialization$$anonfun$6.apply(Serialization.scala:265) at akka.serialization.Serialization$$anonfun$6.apply(Serialization.scala:264) at scala.collection.TraversableLike$WithFilter$$anonfun$map$2.apply(TraversableLike.scala:728) at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221) at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428) at scala.collection.TraversableLike$WithFilter.map(TraversableLike.scala:727) at akka.serialization.Serialization.<init>(Serialization.scala:264) at akka.serialization.SerializationExtension$.createExtension(SerializationExtension.scala:15) at akka.serialization.SerializationExtension$.createExtension(SerializationExtension.scala:12) at akka.actor.ActorSystemImpl.registerExtension(ActorSystem.scala:745) at akka.actor.ExtensionId$class.apply(Extension.scala:79) at akka.serialization.SerializationExtension$.apply(SerializationExtension.scala:12) at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:175) at akka.actor.ActorSystemImpl.liftedTree2$1(ActorSystem.scala:656) at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:653) at akka.actor.ActorSystemImpl._start(ActorSystem.scala:653) at akka.actor.ActorSystemImpl.start(ActorSystem.scala:669) at akka.actor.ActorSystem$.apply(ActorSystem.scala:142) at akka.actor.ActorSystem$.apply(ActorSystem.scala:119) at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:122) at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:55) at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:54) at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1832) at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:160) at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1823) at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:57) at org.apache.spark.SparkEnv$.create(SparkEnv.scala:223) at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:163) at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:267) at org.apache.spark.SparkContext.<init>(SparkContext.scala:270) at org.test.scala.test1.main(test1.java:13)

    Users with the same issue

    HandemelindoHandemelindo
    1 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    rprp
    1 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    1580 more bugmates