java.lang.Exception: here

Apache's JIRA Issue Tracker | Josh Rosen | 1 year ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.

Root Cause Analysis

  1. java.lang.Exception

    here

    at org.apache.spark.memory.TaskMemoryManager.releaseExecutionMemory()
  2. org.apache.spark
    TaskMemoryManager.releaseExecutionMemory
    1. org.apache.spark.memory.TaskMemoryManager.releaseExecutionMemory(TaskMemoryManager.java:197)
    1 frame
  3. Spark
    Executor$TaskRunner.run
    1. org.apache.spark.util.collection.Spillable$class.releaseMemory(Spillable.scala:111)
    2. org.apache.spark.util.collection.ExternalAppendOnlyMap.releaseMemory(ExternalAppendOnlyMap.scala:55)
    3. org.apache.spark.util.collection.ExternalAppendOnlyMap.org$apache$spark$util$collection$ExternalAppendOnlyMap$$freeCurrentMap(ExternalAppendOnlyMap.scala:259)
    4. org.apache.spark.util.collection.ExternalAppendOnlyMap$$anonfun$iterator$1.apply$mcV$sp(ExternalAppendOnlyMap.scala:251)
    5. org.apache.spark.util.CompletionIterator$$anon$1.completion(CompletionIterator.scala:46)
    6. org.apache.spark.util.CompletionIterator.hasNext(CompletionIterator.scala:35)
    7. org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:197)
    8. org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:103)
    9. org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:98)
    10. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
    11. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
    12. org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
    13. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
    14. org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
    15. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
    16. org.apache.spark.scheduler.Task.run(Task.scala:89)
    17. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
    17 frames
  4. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    3. java.lang.Thread.run(Thread.java:745)
    3 frames