org.apache.spark.SparkException: Checkpoint directory has not been set in the SparkContext

GitHub | delenius | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Checkpoint directory has not been set in the SparkContext

    GitHub | 7 months ago | delenius
    org.apache.spark.SparkException: Checkpoint directory has not been set in the SparkContext

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Checkpoint directory has not been set in the SparkContext

      at org.apache.spark.rdd.RDD.checkpoint()
    2. Spark
      RDD.checkpoint
      1. org.apache.spark.rdd.RDD.checkpoint(RDD.scala:1495)
      1 frame
    3. pl.appsilon.marek
      DatabaseRepr$$anonfun$checkpoint$1.apply
      1. pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13)
      2. pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13)
      2 frames
    4. Scala
      MapLike$FilteredKeys.foreach
      1. scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231)
      2. scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231)
      3. scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
      4. scala.collection.MapLike$FilteredKeys.foreach(MapLike.scala:231)
      4 frames