java.lang.NoSuchMethodError: org.apache.spark.network.util.JavaUtils.byteStringAs(Ljava/lang/String;Lorg/apache/spark/network/util/ByteUnit;)J

Stack Overflow | user1227810 | 2 months ago
  1. 0

    Is there an offical way to support both Spark 1.6.2 and 2.0.0 on Hadoop yarn 2.7.2 cluster?

    Stack Overflow | 2 months ago | user1227810
    java.lang.NoSuchMethodError: org.apache.spark.network.util.JavaUtils.byteStringAs(Ljava/lang/String;Lorg/apache/spark/network/util/ByteUnit;)J
  2. 0

    Exception in thread "main" java.lang.NoSuchMethodError

    GitHub | 4 months ago | anayyar82
    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load(Ljava/lang/String;)Lorg/apache/spark/sql/Dataset;
  3. 0

    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load

    GitHub | 4 months ago | kevin-duraj-zefr
    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Consume Kafka in Spark Streaming (Spark 2.0)

    Stack Overflow | 4 months ago | faustineinsun
    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.stream(Ljava/lang/String;)Lorg/apache/spark/sql/Dataset; ...
  6. 0

    GitHub comment 607#175195821

    GitHub | 10 months ago | randallwhitman
    java.lang.NoSuchMethodError: org.apache.spark.sql.types.StructType.add(Ljava/lang/String;Lorg/apache/spark/sql/types/DataType;)Lorg/apache/spark/sql/types/StructType;

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.network.util.JavaUtils.byteStringAs(Ljava/lang/String;Lorg/apache/spark/network/util/ByteUnit;)J

      at org.apache.spark.internal.config.ConfigHelpers$.byteFromString()
    2. org.apache.spark
      package$.<clinit>
      1. org.apache.spark.internal.config.ConfigHelpers$.byteFromString(ConfigBuilder.scala:63)
      2. org.apache.spark.internal.config.ConfigBuilder$$anonfun$bytesConf$1.apply(ConfigBuilder.scala:197)
      3. org.apache.spark.internal.config.ConfigBuilder$$anonfun$bytesConf$1.apply(ConfigBuilder.scala:197)
      4. org.apache.spark.internal.config.TypedConfigBuilder.createWithDefaultString(ConfigBuilder.scala:131)
      5. org.apache.spark.internal.config.package$.<init>(package.scala:41)
      6. org.apache.spark.internal.config.package$.<clinit>(package.scala)
      6 frames
    3. Spark Project YARN Stable API
      ApplicationMaster$$anonfun$main$1.apply$mcV$sp
      1. org.apache.spark.deploy.yarn.ApplicationMaster.<init>(ApplicationMaster.scala:69)
      2. org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:785)
      2 frames
    4. Spark
      SparkHadoopUtil$$anon$1.run
      1. org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:71)
      2. org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:70)
      2 frames
    5. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    6. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
      1 frame
    7. Spark
      SparkHadoopUtil.runAsSparkUser
      1. org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:70)
      1 frame
    8. Spark Project YARN Stable API
      ApplicationMaster.main
      1. org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:784)
      2. org.apache.spark.deploy.yarn.ApplicationMaster.main(ApplicationMaster.scala)
      2 frames