java.lang.OutOfMemoryError: error while calling spill() on org.apache.spark.shuffle.sort.ShuffleExternalSorter@6438a928 : No space left on device

tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Apache Spark job taking too much scratch space (local.dir)

    Stack Overflow | 5 months ago | Adetiloye Philip Kehinde
    java.lang.OutOfMemoryError: error while calling spill() on org.apache.spark.shuffle.sort.ShuffleExternalSorter@6438a928 : No space left on device
  2. 0

    java.lang.OutOfMemoryError: Unable to acquire bytes of memory

    spark-dev | 11 months ago | Nezih Yigitbasi
    java.lang.OutOfMemoryError: Unable to acquire 128 bytes of memory, got 0
  3. 0

    java.lang.OutOfMemoryError: Unable to acquire bytes of memory

    spark-dev | 11 months ago | Nezih Yigitbasi
    java.lang.OutOfMemoryError: Unable to acquire 128 bytes of memory, got 0
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Apache Spark Developers List - java.lang.OutOfMemoryError: Unable to acquire bytes of memory

    nabble.com | 1 week ago
    java.lang.OutOfMemoryError: Unable to acquire bytes of memory, got

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      error while calling spill() on org.apache.spark.shuffle.sort.ShuffleExternalSorter@6438a928 : No space left on device

      at org.apache.spark.memory.TaskMemoryManager.acquireExecutionMemory()
    2. org.apache.spark
      MemoryConsumer.allocatePage
      1. org.apache.spark.memory.TaskMemoryManager.acquireExecutionMemory(TaskMemoryManager.java:179)
      2. org.apache.spark.memory.TaskMemoryManager.allocatePage(TaskMemoryManager.java:245)
      3. org.apache.spark.memory.MemoryConsumer.allocatePage(MemoryConsumer.java:121)
      3 frames
    3. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.shuffle.sort.ShuffleExternalSorter.acquireNewPageIfNecessary(ShuffleExternalSorter.java:364)
      2. org.apache.spark.shuffle.sort.ShuffleExternalSorter.insertRecord(ShuffleExternalSorter.java:387)
      3. org.apache.spark.shuffle.sort.UnsafeShuffleWriter.insertRecordIntoSorter(UnsafeShuffleWriter.java:235)
      4. org.apache.spark.shuffle.sort.UnsafeShuffleWriter.write(UnsafeShuffleWriter.java:162)
      5. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:79)
      6. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:47)
      7. org.apache.spark.scheduler.Task.run(Task.scala:85)
      8. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
      8 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames