com.fasterxml.jackson.module.scala.modifiers.SetTypeModifier$

spark-user | mickdelaney | 2 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    SparkException: Task not serializable - Jackson Json

    spark-user | 2 years ago | mickdelaney
    com.fasterxml.jackson.module.scala.modifiers.SetTypeModifier$

    Root Cause Analysis

    1. com.fasterxml.jackson.module.scala.modifiers.SetTypeModifier$

      No message provided

      at java.io.ObjectOutputStream.writeObject0()
    2. Java RT
      ObjectOutputStream.writeObject
      1. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183)
      2. java.io.ObjectOutputStream.writeArray(ObjectOutputStream.java:1377)
      3. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1173)
      4. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547)
      5. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508)
      6. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431)
      7. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177)
      8. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547)
      9. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508)
      10. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431)
      11. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177)
      12. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547)
      13. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508)
      14. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431)
      15. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177)
      16. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547)
      17. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508)
      18. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431)
      19. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177)
      20. java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547)
      21. java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508)
      22. java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431)
      23. java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177)
      24. java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347)
      24 frames
    3. Spark
      ClosureCleaner$.ensureSerializable
      1. org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:42)
      2. org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:73)
      3. org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164)
      3 frames