org.apache.spark.SparkException

Checkpoint directory has not been set in the SparkContext

Samebug tips0

There are no available Samebug tips for this exception. If you know how to solve this issue, help other users by writing a short tip.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web1883

  • Checkpoint directory has not been set in the SparkContext
  • SparkContext has been shutdown
  • via GitHub by velvia
    , 1 year ago
    SparkContext has been shutdown
  • Stack trace

    • org.apache.spark.SparkException: Checkpoint directory has not been set in the SparkContext at org.apache.spark.rdd.RDD.checkpoint(RDD.scala:1495) at pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13) at pl.appsilon.marek.sparkdatalog.eval.DatabaseRepr$$anonfun$checkpoint$1.apply(DatabaseRepr.scala:13) at scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231) at scala.collection.MapLike$FilteredKeys$$anonfun$foreach$1.apply(MapLike.scala:231) at scala.collection.immutable.Map$Map2.foreach(Map.scala:137) at scala.collection.MapLike$FilteredKeys.foreach(MapLike.scala:231)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    You’re the first here who have seen this exception.