java.io.NotSerializableException: org.apache.spark.SparkContext

spark-user | lihu | 3 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Task not serializable: java.io.NotSerializableException: org.apache.spark.SparkContext

    spark-user | 3 years ago | lihu
    java.io.NotSerializableException: org.apache.spark.SparkContext

    Root Cause Analysis

    1. java.io.NotSerializableException

      org.apache.spark.SparkContext

      at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply()
    2. Spark
      DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply
      1. org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1028)
      2. org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1026)
      2 frames