org.apache.spark.SparkException: Task not serializable

Stack Overflow | insomniac | 4 months ago
  1. 0

    SparkException: Task not serializable (Even after class implements Serializable)

    Stack Overflow | 4 months ago | insomniac
    org.apache.spark.SparkException: Task not serializable
  2. 0

    KafkaSparkStreamingSpec.scala: NotSerializableException: org.apache.commons.pool2.impl.GenericObjectPool

    GitHub | 2 years ago | vvsh
    java.io.NotSerializableException: org.apache.commons.pool2.impl.GenericObjectPool
  3. 0

    java.util.HashMap$Values

    Coderanch | 1 decade ago | Roel De Nijs
    java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: java.util.HashMap$Values
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    DynamoDB Table: java.io.NotSerializableException

    Stack Overflow | 2 months ago | acs254
    java.io.NotSerializableException: Exception in thread "main" org.apache.spark.SparkException: Task not serializable
  6. 0

    JavaSparkContext not serializable

    Stack Overflow | 2 years ago | Amine CHERIFI
    org.apache.spark.SparkException: Task not serializable

  1. batwalrus76 1 times, last 7 days ago
  2. treefolk 11 times, last 1 month ago
  3. kjhdofjosvs 1 times, last 2 months ago
  4. filpgame 4 times, last 2 months ago
  5. Handemelindo 15 times, last 2 months ago
12 more registered users
50 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.NotSerializableException

    edu.emory.mathcs.nlp.decode.NLPDecoder

    at java.io.ObjectOutputStream.writeObject0()
  2. Java RT
    ObjectOutputStream.writeObject
    1. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
    2. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    3. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    4. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    5. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    6. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    7. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    8. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    9. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    10. java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
    10 frames
  3. Spark
    AbstractJavaRDDLike.flatMap
    1. org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:44)
    2. org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:80)
    3. org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164)
    4. org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158)
    5. org.apache.spark.SparkContext.clean(SparkContext.scala:1636)
    6. org.apache.spark.rdd.RDD.flatMap(RDD.scala:295)
    7. org.apache.spark.api.java.JavaRDDLike$class.flatMap(JavaRDDLike.scala:123)
    8. org.apache.spark.api.java.AbstractJavaRDDLike.flatMap(JavaRDDLike.scala:46)
    8 frames
  4. com.infosys.iip
    MultiClassification.main
    1. com.infosys.iip.nlp.spark.MultiClassification.main(MultiClassification.java:92)
    1 frame
  5. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:497)
    4 frames
  6. Spark
    SparkSubmit.main
    1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:569)
    2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
    3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
    4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
    5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
    5 frames