com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not registered: scala.reflect.ManifestFactory$$anon$2 Note: To register this class use: kryo.register(scala.reflect.ManifestFactory$$anon$2.class); Serialization trace: evidence$1 (org.apache.spark.util.collection.CompactBuffer)

Stack Overflow | Pan Dazhao | 5 months ago
  1. 1

    Java.lang.ClassNotFoundException: scala.reflect.ManifestFactory$$anon$2.class

    Stack Overflow | 5 months ago | Pan Dazhao
    com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not registered: scala.reflect.ManifestFactory$$anon$2 Note: To register this class use: kryo.register(scala.reflect.ManifestFactory$$anon$2.class); Serialization trace: evidence$1 (org.apache.spark.util.collection.CompactBuffer)
  2. 0

    Spark cluster computing framework

    gmane.org | 1 year ago
    com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 0, required: 1
  3. 0

    Apache Spark User List - com.esotericsoftware.kryo.KryoException: Buffer overflow.

    nabble.com | 1 year ago
    com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 0, required: 133
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    How Kryo serializer allocates buffer in Spark

    Stack Overflow | 1 year ago | vvladymyrov
    com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 0, required: 57197
  6. 0

    sparkContext broadcast JedisPool not work

    Stack Overflow | 2 years ago | Guy
    com.esotericsoftware.kryo.KryoException: java.util.ConcurrentModificationException Serialization trace: classes (sun.misc.Launcher$AppClassLoader) classloader (java.security.ProtectionDomain) context (java.security.AccessControlContext) acc (org.apache.spark.executor.ExecutorURLClassLoader) factoryClassLoader (org.apache.commons.pool2.impl.GenericObjectPool) internalPool (redis.clients.jedis.JedisPool)

    4 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Class is not registered: scala.reflect.ManifestFactory$$anon$2 Note: To register this class use: kryo.register(scala.reflect.ManifestFactory$$anon$2.class);

      at com.esotericsoftware.kryo.Kryo.getRegistration()
    2. Kryo
      Kryo.writeClassAndObject
      1. com.esotericsoftware.kryo.Kryo.getRegistration(Kryo.java:442)
      2. com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:79)
      3. com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:472)
      4. com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.write(FieldSerializer.java:561)
      5. com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:213)
      6. com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:568)
      6 frames
    3. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:194)
      2. org.apache.spark.serializer.SerializationStream.writeValue(Serializer.scala:147)
      3. org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:185)
      4. org.apache.spark.util.collection.ExternalAppendOnlyMap.spill(ExternalAppendOnlyMap.scala:206)
      5. org.apache.spark.util.collection.ExternalAppendOnlyMap.spill(ExternalAppendOnlyMap.scala:55)
      6. org.apache.spark.util.collection.Spillable$class.maybeSpill(Spillable.scala:93)
      7. org.apache.spark.util.collection.ExternalAppendOnlyMap.maybeSpill(ExternalAppendOnlyMap.scala:55)
      8. org.apache.spark.util.collection.ExternalAppendOnlyMap.insertAll(ExternalAppendOnlyMap.scala:158)
      9. org.apache.spark.Aggregator.combineValuesByKey(Aggregator.scala:45)
      10. org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:89)
      11. org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
      12. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
      13. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
      14. org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
      15. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
      16. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
      17. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
      18. org.apache.spark.scheduler.Task.run(Task.scala:89)
      19. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
      19 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames