java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load(Ljava/lang/String;)Lorg/apache/spark/sql/Dataset;

GitHub | anayyar82 | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Exception in thread "main" java.lang.NoSuchMethodError

    GitHub | 7 months ago | anayyar82
    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load(Ljava/lang/String;)Lorg/apache/spark/sql/Dataset;

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.sql.DataFrameReader.load(Ljava/lang/String;)Lorg/apache/spark/sql/Dataset;

      at com.sabre.sparkavro.SparkAvroReader$delayedInit$body.apply()
    2. com.sabre.sparkavro
      SparkAvroReader$delayedInit$body.apply
      1. com.sabre.sparkavro.SparkAvroReader$delayedInit$body.apply(SparkAvroReader.scala:25)
      1 frame
    3. Scala
      App$class.main
      1. scala.Function0$class.apply$mcV$sp(Function0.scala:40)
      2. scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
      3. scala.App$$anonfun$main$1.apply(App.scala:71)
      4. scala.App$$anonfun$main$1.apply(App.scala:71)
      5. scala.collection.immutable.List.foreach(List.scala:318)
      6. scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32)
      7. scala.App$class.main(App.scala:71)
      7 frames