java.lang.ClassCastException

org.apache.spark.SparkContext$$anonfun$36 cannot be cast to org.apache.spark.ShuffleDependency

Solutions on the web19047

  • org.apache.spark.SparkContext$$anonfun$36 cannot be cast to org.apache.spark.ShuffleDependency
  • via Stack Overflow by Anji
    , 5 months ago
    $anonfun$1 cannot be cast to scala.Function3
  • $anonfun$1 cannot be cast to java.lang.Integer
  • Stack trace

    • java.lang.ClassCastException: org.apache.spark.SparkContext$$anonfun$36 cannot be cast to org.apache.spark.ShuffleDependency at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:64) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    Unknown user
    Once, 1 year ago