java.lang.IllegalStateException: Spark context stopped while waiting for backend

Stack Overflow | jmoa | 8 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Running yarn with spark not working with Java 8

    Stack Overflow | 8 months ago | jmoa
    java.lang.IllegalStateException: Spark context stopped while waiting for backend
  2. 0

    Unable to run pyspark in yarn-client mode (pyspark standalone is working though)

    Stack Overflow | 2 months ago | aamirr
    java.lang.IllegalStateException: Spark context stopped while waiting for backend
  3. 0

    PySpark in Pycharm- unable to connect to remote server

    Stack Overflow | 2 years ago | Ashish
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    amazon web services: Can't connect to Spark cluster in EC2 using pyspark

    blogspot.com | 1 year ago
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  6. 0

    PySpark in Pycharm- unable to connect to remote server

    gmane.org | 1 year ago
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext at $apache$spark$SparkContext$$assertNotStopped(SparkContext.scala:103)

  1. johnxfly 1 times, last 4 months ago
2 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.IllegalStateException

    Spark context stopped while waiting for backend

    at org.apache.spark.scheduler.TaskSchedulerImpl.waitBackendReady()
  2. Spark
    JavaSparkContext.<init>
    1. org.apache.spark.scheduler.TaskSchedulerImpl.waitBackendReady(TaskSchedulerImpl.scala:581)
    2. org.apache.spark.scheduler.TaskSchedulerImpl.postStartHook(TaskSchedulerImpl.scala:162)
    3. org.apache.spark.SparkContext.<init>(SparkContext.scala:549)
    4. org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
    4 frames
  3. Java RT
    Constructor.newInstance
    1. sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    2. sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    3. sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    4. java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    4 frames
  4. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:240)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
    3. py4j.Gateway.invoke(Gateway.java:236)
    4. py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80)
    5. py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69)
    6. py4j.GatewayConnection.run(GatewayConnection.java:211)
    6 frames
  5. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame