org.apache.spark.SparkException: Job cancelled because SparkContext was shut down


Solutions on the web

Solution icon of web
Job cancelled because SparkContext was shut down

Solution icon of web
via pastebin.ca by Unknown author, 1 year ago
Job cancelled because SparkContext was shut down

Solution icon of github
via GitHub by freemanwyz
, 1 year ago
Job cancelled because SparkContext was shut down

Solution icon of github
Job cancelled because SparkContext was shut down

Solution icon of googlegroups
via Google Groups by sunil v, 4 months ago
Job cancelled because SparkContext was shut down

Solution icon of apache
via spark-dev by Alexander Pivovarov, 1 year ago
Job cancelled because SparkContext was shut down

Solution icon of stackoverflow
Job cancelled because SparkContext was shut down

Solution icon of web
Job cancelled because SparkContext was shut down

Solution icon of web
Job cancelled because SparkContext was shut down

Solution icon of github
Job cancelled because SparkContext was shut down

Stack trace

org.apache.spark.SparkException: Job cancelled because SparkContext was shut down
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:699)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:698)
	at scala.collection.mutable.HashSet.foreach(HashSet.scala:79)
	at org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(DAGScheduler.scala:698)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onStop(DAGScheduler.scala:1411)
	at org.apache.spark.util.EventLoop.stop(EventLoop.scala:84)
	at org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:1346)
	at org.apache.spark.SparkContext.stop(SparkContext.scala:1380)
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend$$anon$1.run(YarnClientSchedulerBackend.scala:143)

Write tip

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

Users with the same issue

Once, 4 months ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
2 times, 1 month ago
Once, 4 months ago
4 more bugmates