java.io.FileNotFoundException: /dfs1/hadoop/yarn/local/usercache/mitchus/appcache/application_1465987751317_1172/blockmgr-f367f43b-f4c8-4faf-a829-530da30fb040/1c/temp_shuffle_581adb36-1561-4db8-a556-c4ac0e6400ed (No such file or directory)

Stack Overflow | mitchus | 4 months ago
  1. 0

    Spark job fails: storage.DiskBlockObjectWriter: Uncaught exception while reverting partial writes to file

    Stack Overflow | 4 months ago | mitchus
    java.io.FileNotFoundException: /dfs1/hadoop/yarn/local/usercache/mitchus/appcache/application_1465987751317_1172/blockmgr-f367f43b-f4c8-4faf-a829-530da30fb040/1c/temp_shuffle_581adb36-1561-4db8-a556-c4ac0e6400ed (No such file or directory)
  2. 0

    Spark Executor: Managed memory leak detected

    Stack Overflow | 1 year ago | auxdx
    java.io.FileNotFoundException: /tmp/blockmgr-3acec504-4a55-4aa8-a3e5-dda97ce5d055/03/temp_shuffle_cb37f147-c055-4014-a6ae-fd505cb49f57 (Too many open files)
  3. 0

    What could have caused this error - Java.io.FileNotFoundException: /tmp/spark...?

    Google Groups | 1 year ago | Cuong Tham
    java.io.FileNotFoundException: /tmp/spark-90507c1d-e983-422d-9e01-74ff0a5a2806/executor-360151d5-6b83-4e3e-a0c6-6ddc955cb16c/blockmgr-bca2bde9-212f-4219-af8b-ef0415d60bfa/26/temp_shuffle_98deadd9-f7c3-4a12-9a30-7749f097b5c8 (No such file or directory)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Scala Spark FileNotFoundException in windows shared folder

    Stack Overflow | 10 months ago | Paner
    java.io.FileNotFoundException: /media/Ji-share/tmp/blockmgr-2860ab59-1d38-4265-a709-c8372895ace6/13/shuffle_11_49_0.index (Input/output error)
  6. 0

    How to achieve Hadoop/HDFS Streaming

    codegur.net | 8 months ago
    java.io.FileNotFoundException: /tmp/blockmgr-3acec504-4a55-4aa8-a3e5-dda97ce5d055/03/temp_shuffle_cb37f147-c055-4014-a6ae-fd505cb49f57 (Too many open files)

  1. tyson925 49 times, last 2 weeks ago
  2. tyson925 95 times, last 1 month ago
  3. tvrmsmith 1 times, last 5 days ago
  4. eti22 3 times, last 3 weeks ago
  5. MoYapro 1 times, last 1 month ago
24 more registered users
70 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.FileNotFoundException

    /dfs1/hadoop/yarn/local/usercache/mitchus/appcache/application_1465987751317_1172/blockmgr-f367f43b-f4c8-4faf-a829-530da30fb040/1c/temp_shuffle_581adb36-1561-4db8-a556-c4ac0e6400ed (No such file or directory)

    at java.io.FileOutputStream.open0()
  2. Java RT
    FileOutputStream.<init>
    1. java.io.FileOutputStream.open0(Native Method)
    2. java.io.FileOutputStream.open(FileOutputStream.java:270)
    3. java.io.FileOutputStream.<init>(FileOutputStream.java:213)
    3 frames
  3. Spark
    Executor$TaskRunner.run
    1. org.apache.spark.storage.DiskBlockObjectWriter.revertPartialWritesAndClose(BlockObjectWriter.scala:189)
    2. org.apache.spark.util.collection.ExternalSorter.spillToMergeableFile(ExternalSorter.scala:328)
    3. org.apache.spark.util.collection.ExternalSorter.spill(ExternalSorter.scala:257)
    4. org.apache.spark.util.collection.ExternalSorter.spill(ExternalSorter.scala:95)
    5. org.apache.spark.util.collection.Spillable$class.maybeSpill(Spillable.scala:83)
    6. org.apache.spark.util.collection.ExternalSorter.maybeSpill(ExternalSorter.scala:95)
    7. org.apache.spark.util.collection.ExternalSorter.maybeSpillCollection(ExternalSorter.scala:240)
    8. org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:220)
    9. org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
    10. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:70)
    11. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
    12. org.apache.spark.scheduler.Task.run(Task.scala:70)
    13. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
    13 frames
  4. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    3. java.lang.Thread.run(Thread.java:745)
    3 frames