java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext

Google Groups | Kuli Gábor | 9 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Cannot call methods on a stopped SparkContext

    Google Groups | 9 months ago | Kuli Gábor
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  2. 0

    Prediction IO - Cannot call methods on a stopped SparkContext

    Stack Overflow | 9 months ago | solarenqu
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  3. 0

    Cannot call methods on a stopped SparkContext

    GitHub | 5 months ago | wukaishanda08
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Apache Spark User List - stopped SparkContext remaining active

    nabble.com | 11 months ago
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext
  6. 0

    GitHub comment 195#172252690

    GitHub | 1 year ago | jramos
    java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext. This stopped SparkContext was created at: org.apache.spark.SparkContext.<init>(SparkContext.scala:147) io.prediction.workflow.SharedSparkContext$class.beforeAll(BaseTest.scala:65) io.prediction.controller.EngineSuite.beforeAll(EngineTest.scala:18) org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) io.prediction.controller.EngineSuite.beforeAll(EngineTest.scala:18) org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253) io.prediction.controller.EngineSuite.run(EngineTest.scala:18) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:444) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:651) sbt.TestRunner.runTest$1(TestFramework.scala:76) sbt.TestRunner.run(TestFramework.scala:85) sbt.TestFramework$$anon$2$$anonfun$$init$$1$$anonfun$apply$8.apply(TestFramework.scala:202) sbt.TestFramework$$anon$2$$anonfun$$init$$1$$anonfun$apply$8.apply(TestFramework.scala:202) sbt.TestFramework$.sbt$TestFramework$$withContextLoader(TestFramework.scala:185) sbt.TestFramework$$anon$2$$anonfun$$init$$1.apply(TestFramework.scala:202) sbt.TestFramework$$anon$2$$anonfun$$init$$1.apply(TestFramework.scala:202) sbt.TestFunction.apply(TestFramework.scala:207) sbt.Tests$.sbt$Tests$$processRunnable$1(Tests.scala:239) sbt.Tests$$anonfun$makeSerial$1.apply(Tests.scala:245) sbt.Tests$$anonfun$makeSerial$1.apply(Tests.scala:245) The currently active SparkContext was created at: (No active SparkContext.)

    1 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Cannot call methods on a stopped SparkContext

      at org.apache.spark.SparkContext.org$apache$spark$SparkContext$$assertNotStopped()
    2. Spark
      SparkContext.parallelize$default$2
      1. org.apache.spark.SparkContext.org$apache$spark$SparkContext$$assertNotStopped(SparkContext.scala:104)
      2. org.apache.spark.SparkContext.defaultParallelism(SparkContext.scala:2061)
      3. org.apache.spark.SparkContext.parallelize$default$2(SparkContext.scala:723)
      3 frames
    3. Unknown
      Algorithm.predict
      1. Algorithm.predict(Algorithm.scala:56)
      2. Algorithm.predict(Algorithm.scala:9)
      2 frames
    4. io.prediction.controller
      P2LAlgorithm.predictBase
      1. io.prediction.controller.P2LAlgorithm.predictBase(P2LAlgorithm.scala:70)
      1 frame
    5. io.prediction.workflow
      ServerActor$$anonfun$24$$anonfun$25.apply
      1. io.prediction.workflow.ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:536)
      2. io.prediction.workflow.ServerActor$$anonfun$24$$anonfun$25.apply(CreateServer.scala:535)
      2 frames
    6. Scala
      AbstractTraversable.map
      1. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      2. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      3. scala.collection.immutable.List.foreach(List.scala:318)
      4. scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
      5. scala.collection.AbstractTraversable.map(Traversable.scala:105)
      5 frames
    7. io.prediction.workflow
      ServerActor$$anonfun$24.apply
      1. io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:535)
      2. io.prediction.workflow.ServerActor$$anonfun$24.apply(CreateServer.scala:513)
      2 frames
    8. Spray Routing
      ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply
      1. spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(ApplyConverterInstances.scala:25)
      2. spray.routing.ApplyConverterInstances$$anon$22$$anonfun$apply$1.apply(ApplyConverterInstances.scala:24)
      3. spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$anonfun$apply$1.apply(Directive.scala:38)
      4. spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1$$anonfun$apply$1.apply(Directive.scala:37)
      5. spray.routing.directives.BasicDirectives$$anon$1.happly(BasicDirectives.scala:26)
      6. spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:37)
      7. spray.routing.ConjunctionMagnet$$anon$1$$anon$2$$anonfun$happly$1.apply(Directive.scala:36)
      8. spray.routing.directives.BasicDirectives$$anon$2.happly(BasicDirectives.scala:79)
      9. spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
      10. spray.routing.Directive$$anon$7$$anonfun$happly$4.apply(Directive.scala:86)
      11. spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
      12. spray.routing.directives.BasicDirectives$$anon$3$$anonfun$happly$1.apply(BasicDirectives.scala:92)
      13. spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply$mcV$sp(ExecutionDirectives.scala:89)
      14. spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
      15. spray.routing.directives.ExecutionDirectives$$anonfun$detach$1$$anonfun$apply$7$$anonfun$apply$3.apply(ExecutionDirectives.scala:89)
      15 frames
    9. Scala
      ForkJoinWorkerThread.run
      1. scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
      2. scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
      3. scala.concurrent.impl.ExecutionContextImpl$$anon$3.exec(ExecutionContextImpl.scala:107)
      4. scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
      5. scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
      6. scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
      7. scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
      7 frames