java.lang.IllegalArgumentException

Class is not registered: com.databricks.spark.avro.DefaultSource$SerializableConfiguration Note: To register this class use: kryo.register(com.databricks.spark.avro.DefaultSource$SerializableConfiguration.class);

Samebug tips0

We couldn't find tips for this exception.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web17

  • via GitHub by fooblahblah
    ,
  • via Stack Overflow by Aldibe
    ,
  • via GitHub by rgabo
    ,
  • Stack trace

    • java.lang.IllegalArgumentException: Class is not registered: com.databricks.spark.avro.DefaultSource$SerializableConfiguration Note: To register this class use: kryo.register(com.databricks.spark.avro.DefaultSource$SerializableConfiguration.class); at com.esotericsoftware.kryo.Kryo.getRegistration(Kryo.java:488) at com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:97) at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:517) at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:622) at org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:195) at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$blockifyObject$2.apply(TorrentBroadcast.scala:236) at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$blockifyObject$2.apply(TorrentBroadcast.scala:236) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1287) at org.apache.spark.broadcast.TorrentBroadcast$.blockifyObject(TorrentBroadcast.scala:237) at org.apache.spark.broadcast.TorrentBroadcast.writeBlocks(TorrentBroadcast.scala:107) at org.apache.spark.broadcast.TorrentBroadcast.<init>(TorrentBroadcast.scala:86) at org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34) at org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:56) at org.apache.spark.SparkContext.broadcast(SparkContext.scala:1370) at com.databricks.spark.avro.DefaultSource.buildReader(DefaultSource.scala:144) at org.apache.spark.sql.execution.datasources.FileFormat$class.buildReaderWithPartitionValues(fileSourceInterfaces.scala:260) at com.databricks.spark.avro.DefaultSource.buildReaderWithPartitionValues(DefaultSource.scala:46) at org.apache.spark.sql.execution.datasources.FileSourceStrategy$.apply(FileSourceStrategy.scala:112) at org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:60)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    GatgeagentGatgeagent
    2 times, last one