java.lang.Exception: here

Apache's JIRA Issue Tracker | Josh Rosen | 1 year ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.

Root Cause Analysis

  1. java.lang.Exception

    here

    at org.apache.spark.memory.TaskMemoryManager.acquireExecutionMemory()
  2. org.apache.spark
    TaskMemoryManager.acquireExecutionMemory
    1. org.apache.spark.memory.TaskMemoryManager.acquireExecutionMemory(TaskMemoryManager.java:187)
    1 frame
  3. Spark
    Executor$TaskRunner.run
    1. org.apache.spark.util.collection.Spillable$class.maybeSpill(Spillable.scala:82)
    2. org.apache.spark.util.collection.ExternalAppendOnlyMap.maybeSpill(ExternalAppendOnlyMap.scala:55)
    3. org.apache.spark.util.collection.ExternalAppendOnlyMap.insertAll(ExternalAppendOnlyMap.scala:158)
    4. org.apache.spark.Aggregator.combineValuesByKey(Aggregator.scala:45)
    5. org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:89)
    6. org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
    7. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
    8. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
    9. org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
    10. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
    11. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
    12. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
    13. org.apache.spark.scheduler.Task.run(Task.scala:89)
    14. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
    14 frames
  4. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    3. java.lang.Thread.run(Thread.java:745)
    3 frames