org.apache.spark.SparkException: Checkpoint directory has not been set in the SparkContext

GitHub | delenius | 3 months ago
  1. 0

    Checkpoint directory has not been set in the SparkContext

    GitHub | 3 months ago | delenius
    org.apache.spark.SparkException: Checkpoint directory has not been set in the SparkContext
  2. 0

    GitHub comment 54#71801487

    GitHub | 2 years ago | velvia
    org.apache.spark.SparkException: SparkContext has been shutdown
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    Test fails with SparkContext has been shutdown

    GitHub | 2 years ago | jamborta
    org.apache.spark.SparkException: SparkContext has been shutdown
  5. 0

    Multiple SparkContext detected in the same JVM

    Stack Overflow | 11 months ago | Guforu
    org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243). To ignore this error, set spark.driver.allowMultipleContexts = true. The currently running SparkContext was created at: org.apache.spark.SparkContext.<init>(SparkContext.scala:81) test.MLlib.BinarryClassification.main(BinaryClassification.java:41)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Checkpoint directory has not been set in the SparkContext

      at org.apache.spark.rdd.RDD.checkpoint()
    2. Spark
      RDD.checkpoint
      1. org.apache.spark.rdd.RDD.checkpoint(RDD.scala:1495)
      1 frame
    3. pl.appsilon.marek
      DatabaseRepr$$anonfun$checkpoint$1.apply
      1. pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13)
      2. pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13)
      2 frames
    4. Scala
      MapLike$FilteredKeys.foreach
      1. scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231)
      2. scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231)
      3. scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
      4. scala.collection.MapLike$FilteredKeys.foreach(MapLike.scala:231)
      4 frames