org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException

Stack Overflow | Quentin | 5 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    spark jobserver job crash

    Stack Overflow | 5 months ago | Quentin
    org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException
  2. 0

    GitHub comment 86#197195764

    GitHub | 1 year ago | kwin-wang
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 2.0 failed 1 times, most recent failure: Lost task 3.0 in stage 2.0 (TID 11, localhost): UnknownReason Driver stacktrace:
  3. 0

    spark throws exception when querying large amount of data in mysql

    Stack Overflow | 1 year ago | snodawn
    org.apache.spark.SparkException: Job aborted.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Position for 'field' not found in row; typically this is caused by a mapping inconsistency

    GitHub | 1 year ago | zlosim
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): UnknownReason Driver stacktrace:
  6. 0

    Training data with the UniversalRecommender causing "UnknownReason"

    Google Groups | 1 year ago | Carlos Henrique
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 68.0 failed 4 times, most recent failure: Lost task 0.3 in stage 68.0 (TID 182, 10.0.0.139): UnknownReason Driver stacktrace:

  1. tyson925 2 times, last 2 months ago
  2. johnxfly 1 times, last 1 week ago
  3. Nikolay Rybak 1 times, last 2 months ago
  4. meneal 1 times, last 8 months ago
20 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.spark.SparkException

    Job aborted due to stage failure: Exception while getting task result: java.lang.NullPointerException

    at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages()
  2. Spark
    DAGScheduler$$anonfun$abortStage$1.apply
    1. org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3 frames
  3. Scala
    ArrayBuffer.foreach
    1. scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)[scala-library-2.10.6.jar:na]
    2. scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)[scala-library-2.10.6.jar:na]
    2 frames
  4. Spark
    DAGScheduler$$anonfun$handleTaskSetFailed$1.apply
    1. org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3 frames
  5. Scala
    Option.foreach
    1. scala.Option.foreach(Option.scala:236)[scala-library-2.10.6.jar:na]
    1 frame
  6. Spark
    SparkContext.runJob
    1. org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    2. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    3. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    4. org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    5. org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    6. org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    7. org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    8. org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    9. org.apache.spark.SparkContext.runJob(SparkContext.scala:1922)[spark-core_2.10-1.6.2.1.jar:1.6.2.1]
    9 frames
  7. spark-cassandra-connector
    RDDFunctions.saveToCassandra
    1. com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:37)[spark-cassandra-connector_2.10-1.6.0.jar:1.6.0]
    1 frame
  8. com.my
    sparkJob$.runJob
    1. com.my.sparkJob.init(sparkJob.scala:228)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    2. com.my.sparkJob$.runJob(sparkJob.scala:166)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    3. com.my.sparkJob$.runJob(sparkJob.scala:122)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    4. com.my.sparkJob$.runJob(sparkJob.scala:119)[csm-spark-2016-10-14T10_04_36.212+02_00.jar:na]
    4 frames
  9. spark.jobserver
    JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply
    1. spark.jobserver.JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply(JobManagerActor.scala:235)[spark-job-server.jar:0.5.2.501]
    1 frame
  10. Scala
    Future$PromiseCompletingRunnable.run
    1. scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)[scala-library-2.10.6.jar:na]
    2. scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)[scala-library-2.10.6.jar:na]
    2 frames
  11. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[na:1.8.0_101]
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[na:1.8.0_101]
    3. java.lang.Thread.run(Thread.java:745)[na:1.8.0_101]
    3 frames