scheduler.TaskSetManager: Lost task 0.0 in stage 1.0 (TID 1, localhost): java.lang.NullPointerException

Stack Overflow | gloopy-rocket | 8 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    HiveContext causes a NullPointer on spark

    Stack Overflow | 8 months ago | gloopy-rocket
    scheduler.TaskSetManager: Lost task 0.0 in stage 1.0 (TID 1, localhost): java.lang.NullPointerException

    Root Cause Analysis

    1. scheduler.TaskSetManager

      Lost task 0.0 in stage 1.0 (TID 1, localhost): java.lang.NullPointerException

      at org.apache.spark.sql.SQLConf.setConf()
    2. Spark Project SQL
      SQLContext.setConf
      1. org.apache.spark.sql.SQLConf.setConf(SQLConf.scala:588)
      2. org.apache.spark.sql.SQLContext.setConf(SQLContext.scala:128)
      2 frames
    3. Spark Project Hive
      HiveContext.parseSql
      1. org.apache.spark.sql.hive.HiveContext.hiveconf$lzycompute(HiveContext.scala:555)
      2. org.apache.spark.sql.hive.HiveContext.hiveconf(HiveContext.scala:553)
      3. org.apache.spark.sql.hive.HiveContext.parseSql(HiveContext.scala:333)
      3 frames
    4. Spark Project SQL
      SQLContext.sql
      1. org.apache.spark.sql.SQLContext.sql(SQLContext.scala:817)
      1 frame
    5. Hive_Cis
      DataTableReader.apply
      1. Hive_Cis.DataTableReader.apply(DataTableReader.java:53)
      2. Hive_Cis.DataTableReader.apply(DataTableReader.java:16)
      2 frames
    6. Scala
      AbstractIterator.foreach
      1. scala.collection.Iterator$class.foreach(Iterator.scala:727)
      2. scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
      2 frames
    7. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.rdd.RDD$$anonfun$foreach$1$$anonfun$apply$32.apply(RDD.scala:912)
      2. org.apache.spark.rdd.RDD$$anonfun$foreach$1$$anonfun$apply$32.apply(RDD.scala:912)
      3. org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1869)
      4. org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1869)
      5. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
      6. org.apache.spark.scheduler.Task.run(Task.scala:89)
      7. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
      7 frames
    8. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames