org.apache.spark.SparkException: Job cancelled because SparkContext was shut down

csdn.net | 4 months ago
  1. 0

    pastebin - Spark OOM Logs - post number 3078231

    pastebin.ca | 1 year ago
    org.apache.spark.SparkException: Job cancelled because SparkContext was shut down
  2. 0

    浅谈spark yarn模式的问题调试 - u012684933的专栏 - 博客频道 - CSDN.NET

    csdn.net | 4 months ago
    org.apache.spark.SparkException: Job cancelled because SparkContext was shut down
  3. 0

    GitHub comment 109#130664925

    GitHub | 1 year ago | cacti77
    org.apache.spark.SparkException: Job cancelled because SparkContext was shut down
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 109#134049748

    GitHub | 1 year ago | velvia
    org.apache.spark.SparkException: Job cancelled because SparkContext was shut down
  6. 0

    OOM in spark pagerank

    Stack Overflow | 2 years ago | Piyush Agal
    org.apache.spark.SparkException: Job cancelled because SparkContext was shut down

  1. tyson925 1 times, last 3 weeks ago
  2. Nikolay Rybak 2 times, last 4 weeks ago
  3. tyson925 12 times, last 2 months ago
3 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.spark.SparkException

    Job cancelled because SparkContext was shut down

    at org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply()
  2. Spark
    DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply
    1. org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:699)
    2. org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:698)
    2 frames
  3. Scala
    HashSet.foreach
    1. scala.collection.mutable.HashSet.foreach(HashSet.scala:79)
    1 frame
  4. Spark
    YarnClientSchedulerBackend$$anon$1.run
    1. org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(DAGScheduler.scala:698)
    2. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onStop(DAGScheduler.scala:1411)
    3. org.apache.spark.util.EventLoop.stop(EventLoop.scala:84)
    4. org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:1346)
    5. org.apache.spark.SparkContext.stop(SparkContext.scala:1380)
    6. org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend$$anon$1.run(YarnClientSchedulerBackend.scala:143)
    6 frames