java.lang.IllegalStateException: Spark context stopped while waiting for backend

Stack Overflow | aks | 3 months ago
  1. 0

    How to know what is the reason for ClosedChannelExceptions with spark-shell in YARN client mode?

    Stack Overflow | 3 months ago | aks
    java.lang.IllegalStateException: Spark context stopped while waiting for backend
  2. 0

    Spark Shell - __spark_libs__.zip does not exist

    Stack Overflow | 5 days ago | Ryan Nel
    java.lang.IllegalStateException: Spark context stopped while waiting for backend
  3. 0

    Running yarn with spark not working with Java 8

    Stack Overflow | 4 months ago | jmoa
    java.lang.IllegalStateException: Spark context stopped while waiting for backend
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Spark context stopped while waiting for backend

      at org.apache.spark.scheduler.TaskSchedulerImpl.waitBackendReady()
    2. Spark
      SparkContext$.getOrCreate
      1. org.apache.spark.scheduler.TaskSchedulerImpl.waitBackendReady(TaskSchedulerImpl.scala:581)
      2. org.apache.spark.scheduler.TaskSchedulerImpl.postStartHook(TaskSchedulerImpl.scala:162)
      3. org.apache.spark.SparkContext.<init>(SparkContext.scala:549)
      4. org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2256)
      4 frames
    3. Spark Project SQL
      SparkSession$Builder$$anonfun$8.apply
      1. org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:831)
      2. org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:823)
      2 frames
    4. Scala
      Option.getOrElse
      1. scala.Option.getOrElse(Option.scala:121)
      1 frame
    5. Spark Project SQL
      SparkSession$Builder.getOrCreate
      1. org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:823)
      1 frame
    6. Spark REPL
      Main$.createSparkSession
      1. org.apache.spark.repl.Main$.createSparkSession(Main.scala:95)
      1 frame