org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException

Stack Overflow | Quentin | 2 months ago
  1. 0

    spark jobserver job crash

    Stack Overflow | 2 months ago | Quentin
    org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException
  2. 0

    GitHub comment 86#197195764

    GitHub | 9 months ago | kwin-wang
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 2.0 failed 1 times, most recent failure: Lost task 3.0 in stage 2.0 (TID 11, localhost): UnknownReason Driver stacktrace:
  3. 0

    spark throws exception when querying large amount of data in mysql

    Stack Overflow | 9 months ago | snodawn
    org.apache.spark.SparkException: Job aborted.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Position for 'field' not found in row; typically this is caused by a mapping inconsistency

    GitHub | 11 months ago | zlosim
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): UnknownReason Driver stacktrace:
  6. 0

    Training data with the UniversalRecommender causing "UnknownReason"

    Google Groups | 9 months ago | Carlos Henrique
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 68.0 failed 4 times, most recent failure: Lost task 0.3 in stage 68.0 (TID 182, 10.0.0.139): UnknownReason Driver stacktrace:

  1. Nikolay Rybak 1 times, last 1 month ago
  2. tyson925 2 times, last 2 months ago
  3. tyson925 1 times, last 4 months ago
  4. meneal 1 times, last 4 months ago
20 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.spark.SparkException

    Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException

    at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages()
  2. Spark
    DAGScheduler$$anonfun$abortStage$1.apply
    1. org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3 frames
  3. Scala
    ArrayBuffer.foreach
    1. scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)[scala-library-2.10.6.jar:na]
    2. scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)[scala-library-2.10.6.jar:na]
    2 frames
  4. Spark
    DAGScheduler$$anonfun$handleTaskSetFailed$1.apply
    1. org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3 frames
  5. Scala
    Option.foreach
    1. scala.Option.foreach(Option.scala:236)[scala-library-2.10.6.jar:na]
    1 frame
  6. Spark
    SparkContext.runJob
    1. org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    4. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    5. org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    6. org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    7. org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    8. org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    9. org.apache.spark.SparkContext.runJob(SparkContext.scala:1922)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    9 frames
  7. spark-cassandra-connector
    RDDFunctions.saveToCassandra
    1. com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:37)[spark-cassandra-connector_2.10-1.6.0.jar:1.6.0]
    1 frame
  8. com.my
    sparkJob$.runJob
    1. com.my.sparkJob.init(sparkJob.scala:228)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    2. com.my.sparkJob$.runJob(sparkJob.scala:166)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    3. com.my.sparkJob$.runJob(sparkJob.scala:122)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    4. com.my.sparkJob$.runJob(sparkJob.scala:119)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    4 frames
  9. spark.jobserver
    JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply
    1. spark.jobserver.JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply(JobManagerActor.scala:235)[spark-job-server.jar:0.5.2.501]
    1 frame
  10. Scala
    Future$PromiseCompletingRunnable.run
    1. scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)[scala-library-2.10.6.jar:na]
    2. scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)[scala-library-2.10.6.jar:na]
    2 frames
  11. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[na:1.8.0_101]
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[na:1.8.0_101]
    3. java.lang.Thread.run(Thread.java:745)[na:1.8.0_101]
    3 frames