org.apache.spark.SparkException: Task not serializable

Stack Overflow | insomniac | 2 months ago
  1. 0

    SparkException: Task not serializable (Even after class implements Serializable)

    Stack Overflow | 2 months ago | insomniac
    org.apache.spark.SparkException: Task not serializable
  2. 0

    KafkaSparkStreamingSpec.scala: NotSerializableException: org.apache.commons.pool2.impl.GenericObjectPool

    GitHub | 1 year ago | vvsh
    java.io.NotSerializableException: org.apache.commons.pool2.impl.GenericObjectPool
  3. 0

    java.util.HashMap$Values

    Coderanch | 1 decade ago | Roel De Nijs
    java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: java.util.HashMap$Values
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    JavaSparkContext not serializable

    Stack Overflow | 2 years ago | Amine CHERIFI
    org.apache.spark.SparkException: Task not serializable
  6. 0

    SparkException: Task not serializable in logs_analyzer/chapter1/java6

    GitHub | 2 years ago | MiguelPeralvo
    org.apache.spark.SparkException: Task not serializable

  1. kjhdofjosvs 1 times, last 1 week ago
  2. treefolk 1 times, last 2 weeks ago
  3. filpgame 4 times, last 2 weeks ago
  4. Handemelindo 15 times, last 3 weeks ago
  5. eti22 1 times, last 1 month ago
11 more registered users
50 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.NotSerializableException

    edu.emory.mathcs.nlp.decode.NLPDecoder

    at java.io.ObjectOutputStream.writeObject0()
  2. Java RT
    ObjectOutputStream.writeObject
    1. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
    2. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    3. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    4. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    5. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    6. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    7. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    8. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    9. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    10. java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
    10 frames
  3. Spark
    AbstractJavaRDDLike.flatMap
    1. org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:44)
    2. org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:80)
    3. org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164)
    4. org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158)
    5. org.apache.spark.SparkContext.clean(SparkContext.scala:1636)
    6. org.apache.spark.rdd.RDD.flatMap(RDD.scala:295)
    7. org.apache.spark.api.java.JavaRDDLike$class.flatMap(JavaRDDLike.scala:123)
    8. org.apache.spark.api.java.AbstractJavaRDDLike.flatMap(JavaRDDLike.scala:46)
    8 frames
  4. com.infosys.iip
    MultiClassification.main
    1. com.infosys.iip.nlp.spark.MultiClassification.main(MultiClassification.java:92)
    1 frame
  5. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:497)
    4 frames
  6. Spark
    SparkSubmit.main
    1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:569)
    2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
    3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
    4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
    5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
    5 frames