java.io.IOException: unexpected exception type

Stack Overflow | alexgbelov | 5 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Deserialization errors in Spark cluster although all objects implement Serializable

    Stack Overflow | 5 months ago | alexgbelov
    java.io.IOException: unexpected exception type

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Invalid lambda deserialization

      at com.mypackage.MyApp.$deserializeLambda$()
    2. com.mypackage
      MyApp.$deserializeLambda$
      1. com.mypackage.MyApp.$deserializeLambda$(MyApp.java:27)
      1 frame
    3. Java RT
      ObjectInputStream.readObject
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:498)
      5. java.lang.invoke.SerializedLambda.readResolve(SerializedLambda.java:230)
      6. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      7. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      8. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      9. java.lang.reflect.Method.invoke(Method.java:498)
      10. java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1148)
      11. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1810)
      12. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
      13. java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
      14. java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
      15. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
      16. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
      17. java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
      18. java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
      19. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
      20. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
      21. java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
      22. java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
      23. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
      24. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
      25. java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000)
      26. java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924)
      27. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)
      28. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
      29. java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
      29 frames
    4. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72)
      2. org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98)
      3. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
      4. org.apache.spark.scheduler.Task.run(Task.scala:88)
      5. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
      5 frames
    5. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames