java.lang.NoSuchMethodError: org.apache.spark.scheduler.SparkListenerExecutorMetricsUpdate.taskMetrics()Lscala/collection/Seq;

GitHub | strong-code | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    NoSuchMethodError from JsonRelay

    GitHub | 7 months ago | strong-code
    java.lang.NoSuchMethodError: org.apache.spark.scheduler.SparkListenerExecutorMetricsUpdate.taskMetrics()Lscala/collection/Seq;

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.scheduler.SparkListenerExecutorMetricsUpdate.taskMetrics()Lscala/collection/Seq;

      at org.apache.spark.JsonRelay.onEvent()
    2. Spark
      LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply
      1. org.apache.spark.JsonRelay.onEvent(JsonRelay.scala:51)
      2. org.apache.spark.SparkFirehoseListener.onExecutorMetricsUpdate(SparkFirehoseListener.java:103)
      3. org.apache.spark.scheduler.SparkListenerBus$class.doPostEvent(SparkListenerBus.scala:59)
      4. org.apache.spark.scheduler.LiveListenerBus.doPostEvent(LiveListenerBus.scala:35)
      5. org.apache.spark.scheduler.LiveListenerBus.doPostEvent(LiveListenerBus.scala:35)
      6. org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:63)
      7. org.apache.spark.scheduler.LiveListenerBus.postToAll(LiveListenerBus.scala:35)
      8. org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(LiveListenerBus.scala:81)
      9. org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(LiveListenerBus.scala:66)
      10. org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(LiveListenerBus.scala:66)
      10 frames
    3. Scala
      DynamicVariable.withValue
      1. scala.util.DynamicVariable.withValue(DynamicVariable.scala:58)
      1 frame
    4. Spark
      LiveListenerBus$$anon$1.run
      1. org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(LiveListenerBus.scala:65)
      2. org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1229)
      3. org.apache.spark.scheduler.LiveListenerBus$$anon$1.run(LiveListenerBus.scala:64)
      3 frames