Searched on Google with the first line of a JAVA stack trace?

We can recommend more relevant solutions and speed up debugging when you paste your entire stack trace with the exception message. Try a sample exception.

Recommended solutions based on your search

Samebug tips

  1. ,
    Expert tip

    This might be an issue with the file location in the Spark submit command. Try it with

    spark-submit --master spark://master:7077 \
         hello_world_from_pyspark.py {file location}
    
    
  2. ,
    via netty.io by Unknown author

    Needs to add netty-transport-native-epoll with a OS classifier to the classpath, it's not included in netty-all

Solutions on the web

via JIRA by Bhanu Pratap, 1 year ago
org/apache/spark/sql/DataFrame
via Stack Overflow by Karshit
, 6 months ago
via Stack Overflow by kouki_monem
, 6 months ago
org/apache/hadoop/hbase/regionserver/StoreFileWriter
via Stack Overflow by monti
, 1 year ago
org/apache/hadoop/hbase/regionserver/StoreFileWriter
java.lang.ClassNotFoundException: org.apache.spark.sql.DataFrame	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)	at java.lang.Class.getDeclaredMethods0(Native Method)	at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)	at java.lang.Class.getDeclaredMethod(Class.java:2128)	at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1475)	at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:72)	at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:498)	at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:472)	at java.security.AccessController.doPrivileged(Native Method)	at java.io.ObjectStreamClass.(ObjectStreamClass.java:472)	at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:369)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134)	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)	at scala.collection.immutable.List$SerializationProxy.writeObject(List.scala:468)	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)	at java.lang.reflect.Method.invoke(Method.java:498)	at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1028)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)	at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)	at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:43)	at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:100)	at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:295)	at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:288)	at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:108)	at org.apache.spark.SparkContext.clean(SparkContext.scala:2037)	at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1.apply(RDD.scala:763)	at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1.apply(RDD.scala:762)	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)	at org.apache.spark.rdd.RDD.withScope(RDD.scala:358)	at org.apache.spark.rdd.RDD.mapPartitions(RDD.scala:762)	at org.apache.spark.rdd.RDD$$anonfun$treeAggregate$1.apply(RDD.scala:1094)	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)	at org.apache.spark.rdd.RDD.withScope(RDD.scala:358)	at org.apache.spark.rdd.RDD.treeAggregate(RDD.scala:1085)	at com.mongodb.spark.sql.MongoInferSchema$.apply(MongoInferSchema.scala:76)	at com.mongodb.spark.sql.DefaultSource.createRelation(DefaultSource.scala:78)	at com.mongodb.spark.sql.DefaultSource.createRelation(DefaultSource.scala:53)	at com.mongodb.spark.sql.DefaultSource.createRelation(DefaultSource.scala:38)	at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:315)	at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:149)	at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:122)	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)	at java.lang.reflect.Method.invoke(Method.java:498)	at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:237)	at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)	at py4j.Gateway.invoke(Gateway.java:280)	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:128)	at py4j.commands.CallCommand.execute(CallCommand.java:79)	at py4j.GatewayConnection.run(GatewayConnection.java:211)	at java.lang.Thread.run(Thread.java:745)