org.apache.spark.SparkException: Task not serializable

Stack Overflow | Alan Lam | 3 months ago
  1. 0

    Scala: Xtream complains object not serializable

    Stack Overflow | 3 months ago | Alan Lam
    org.apache.spark.SparkException: Task not serializable
  2. 0

    Insert data on TitanDB using Spark (or SparkStreaming)

    Stack Overflow | 6 months ago | salvob
    org.apache.spark.SparkException: Task not serializable
  3. 0

    Serialization woes w/o State

    GitHub | 3 months ago | huitseeker
    org.apache.spark.SparkException: Task not serializable
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Spark Accumulator throws "Task not serializable" error

    Stack Overflow | 10 months ago | K M
    org.apache.spark.SparkException: Task not serializable
  6. 0

    spark java.io.NotSerializableException: org.apache.spark.SparkContext

    Stack Overflow | 9 months ago | Mike
    org.apache.spark.SparkException: Task not serializable

  1. Nikolay Rybak 2 times, last 1 month ago
  2. rp 1 times, last 4 months ago
1 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.NotSerializableException

    com.thoughtworks.xstream.XStream Serialization stack: - object not serializable (class: com.thoughtworks.xstream.XStream, value: com.thoughtworks.xstream.XStream@51e94b7d) - field (class: lab9$$anonfun$main$1, name: xstream$1, type: class com.thoughtworks.xstream.XStream) - object (class lab9$$anonfun$main$1, <function1>)

    at org.apache.spark.serializer.SerializationDebugger$.improveException()
  2. Spark
    RDD.foreach
    1. org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:40)
    2. org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:47)
    3. org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:101)
    4. org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:301)
    5. org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:294)
    6. org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:122)
    7. org.apache.spark.SparkContext.clean(SparkContext.scala:2055)
    8. org.apache.spark.rdd.RDD$$anonfun$foreach$1.apply(RDD.scala:911)
    9. org.apache.spark.rdd.RDD$$anonfun$foreach$1.apply(RDD.scala:910)
    10. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
    11. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)
    12. org.apache.spark.rdd.RDD.withScope(RDD.scala:316)
    13. org.apache.spark.rdd.RDD.foreach(RDD.scala:910)
    13 frames
  3. Unknown
    lab9.main
    1. lab9$.main(lab9.scala:63)
    2. lab9.main(lab9.scala)
    2 frames
  4. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:498)
    4 frames
  5. IDEA
    AppMain.main
    1. com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
    1 frame