java.io.FileNotFoundException: /var/opt/hosting/data/disk1/hadoop/yarn/usercache/nlevert/appcache/application_1472802379984_2249/blockmgr-f71761be-e12b-4bbc-bf38-9e6f7ddbb3a2/14/shuffle_2171_7_0.data (No such file or directory)

Stack Overflow | user2459075 | 3 months ago
  1. 0

    I'm having a "GC overhead limit exceeded" on Spark 1.5.2 (reproductible every ~20 hours)

    Stack Overflow | 3 months ago | user2459075
    java.io.FileNotFoundException: /var/opt/hosting/data/disk1/hadoop/yarn/usercache/nlevert/appcache/application_1472802379984_2249/blockmgr-f71761be-e12b-4bbc-bf38-9e6f7ddbb3a2/14/shuffle_2171_7_0.data (No such file or directory)
  2. 0

    Spark Executor: Managed memory leak detected

    Stack Overflow | 1 year ago | auxdx
    java.io.FileNotFoundException: /tmp/blockmgr-3acec504-4a55-4aa8-a3e5-dda97ce5d055/03/temp_shuffle_cb37f147-c055-4014-a6ae-fd505cb49f57 (Too many open files)
  3. 0

    What could have caused this error - Java.io.FileNotFoundException: /tmp/spark...?

    Google Groups | 1 year ago | Cuong Tham
    java.io.FileNotFoundException: /tmp/spark-90507c1d-e983-422d-9e01-74ff0a5a2806/executor-360151d5-6b83-4e3e-a0c6-6ddc955cb16c/blockmgr-bca2bde9-212f-4219-af8b-ef0415d60bfa/26/temp_shuffle_98deadd9-f7c3-4a12-9a30-7749f097b5c8 (No such file or directory)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Scala Spark FileNotFoundException in windows shared folder

    Stack Overflow | 11 months ago | Paner
    java.io.FileNotFoundException: /media/Ji-share/tmp/blockmgr-2860ab59-1d38-4265-a709-c8372895ace6/13/shuffle_11_49_0.index (Input/output error)
  6. 0

    How to achieve Hadoop/HDFS Streaming

    codegur.net | 8 months ago
    java.io.FileNotFoundException: /tmp/blockmgr-3acec504-4a55-4aa8-a3e5-dda97ce5d055/03/temp_shuffle_cb37f147-c055-4014-a6ae-fd505cb49f57 (Too many open files)

  1. tyson925 49 times, last 2 weeks ago
  2. tyson925 95 times, last 1 month ago
  3. tvrmsmith 1 times, last 6 days ago
  4. eti22 3 times, last 3 weeks ago
  5. MoYapro 1 times, last 1 month ago
24 more registered users
70 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.FileNotFoundException

    /var/opt/hosting/data/disk1/hadoop/yarn/usercache/nlevert/appcache/application_1472802379984_2249/blockmgr-f71761be-e12b-4bbc-bf38-9e6f7ddbb3a2/14/shuffle_2171_7_0.data (No such file or directory)

    at java.io.FileOutputStream.open0()
  2. Java RT
    FileOutputStream.<init>
    1. java.io.FileOutputStream.open0(Native Method)
    2. java.io.FileOutputStream.open(FileOutputStream.java:270)
    3. java.io.FileOutputStream.<init>(FileOutputStream.java:213)
    3 frames
  3. Spark
    Executor$TaskRunner.run
    1. org.apache.spark.storage.DiskBlockObjectWriter.open(DiskBlockObjectWriter.scala:88)
    2. org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:177)
    3. org.apache.spark.util.collection.WritablePartitionedPairCollection$$anon$1.writeNext(WritablePartitionedPairCollection.scala:55)
    4. org.apache.spark.util.collection.ExternalSorter.writePartitionedFile(ExternalSorter.scala:681)
    5. org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:80)
    6. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:73)
    7. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
    8. org.apache.spark.scheduler.Task.run(Task.scala:88)
    9. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
    9 frames
  4. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    3. java.lang.Thread.run(Thread.java:745)
    3 frames