org.apache.spark.SparkException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • spark jobserver job crash
    via Stack Overflow by Quentin
    ,
  • GitHub comment 86#197195764
    via GitHub by kwin-wang
    ,
  • Non-SQL df queries failing
    via GitHub by sdesikan6
    ,
  • Slave lost error in pyspark
    via Stack Overflow by newleaf
    ,
  • slave lost and very slow join in spark
    via Stack Overflow by newleaf
    ,
    • org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)[scala-library-2.10.6.jar:na] at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)[scala-library-2.10.6.jar:na] at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at scala.Option.foreach(Option.scala:236)[scala-library-2.10.6.jar:na] at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at org.apache.spark.SparkContext.runJob(SparkContext.scala:1922)[spark-core_2.10-1.6.2.1.jar:1.6.2.1] at com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:37)[spark-cassandra-connector_2.10-1.6.0.jar:1.6.0] at com.my.sparkJob.init(sparkJob.scala:228)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na] at com.my.sparkJob$.runJob(sparkJob.scala:166)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na] at com.my.sparkJob$.runJob(sparkJob.scala:122)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na] at com.my.sparkJob$.runJob(sparkJob.scala:119)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na] at spark.jobserver.JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply(JobManagerActor.scala:235)[spark-job-server.jar:0.5.2.501] at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)[scala-library-2.10.6.jar:na] at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)[scala-library-2.10.6.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[na:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[na:1.8.0_101] at java.lang.Thread.run(Thread.java:745)[na:1.8.0_101]

    Users with the same issue

    tyson925tyson925
    2 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    johnxflyjohnxfly
    1 times, last one,
    Nikolay RybakNikolay Rybak
    1 times, last one,
    menealmeneal
    1 times, last one,
    20 more bugmates