java.io.FileNotFoundException: /scratch/hadoop-pireddu/nm-local-dir/usercache/pireddu/appcache/application_1458040326462_0013/blockmgr-f0736f14-dac3-4b4c-9051-af39da7b4518/30/temp_shuffle_862ed764-f7fe-44df-b197-3ef7eedf860e (No such file or directory)


Solutions on the web

Solution icon of googlegroups
via Google Groups by Luca Pireddu, 9 months ago
/scratch/hadoop-pireddu/nm-local-dir/usercache/pireddu/appcache/application_1458040326462_0013/blockmgr-f0736f14-dac3-4b4c-9051-af39da7b4518/30/temp_shuffle_862ed764-f7fe-44df-b197-3ef7eedf860e (No such file or directory)

Solution icon of stackoverflow
/mnt/var/lib/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1413396780703_0003/container_1413396780703_0003_01_000218/container_tokens (No such file or directory)

Solution icon of github
via GitHub by linxixiong
, 1 year ago
/data2/hadoop/hd_space/tmp/nm-local-dir/usercache/linxixiong/appcache/application_1432021926412_9808/spark-82b1829f-7662-4480-82ca-9abf7cc6618d/10/shuffle_5_106_0.data (No such file or directory)

Solution icon of github
via GitHub by thanigaiv
, 1 year ago
/data/yarn/nm/usercache/root/appcache/application_1426812029369_0893/spark-local-20150331165623-6233/19/shuffle_5_0_0.data (No such file or directory)

Solution icon of cask
via Cask Community Issue Tracker by Rohit Sinha, 1 year ago
/yarn/nm/usercache/cdap/appcache/application_1452032088425_0016/container_1452032088425_0016_01_000002/data/tmp/1452034359293-0/metrics590591166370057424.properties (No such file or directory)

Solution icon of stackoverflow
file:/usr/local/hadoop/hadoop/app/hadoop/tmp/mapred/local/1471097931752/cache.txt (No such file or directory)

Solution icon of stackoverflow
hdfs:/localhost/usr/local/tmp/hadoop/hadoop-${user}/data/input/file.csv (No such file or directory)

Solution icon of stackoverflow
file:/tmp/hadoop-cdh-hadoop/mapred/local***/1386234263343/StopWords.txt (No such file or directory)

Solution icon of github
file:/app/hadoop/tmp/mapred/local/1438589083883/user_agents (No such file or directory)

Solution icon of github
file:/tmp/hadoop-ec2-user/mapred/local/1424810224594/splits.txt (No such file or directory)

Stack trace

java.io.FileNotFoundException: /scratch/hadoop-pireddum-local-dir/usercache/pireddu/appcache/application_1458040326462_0013/blockmgr-f0736f14-dac3-4b4c-9051-af39da7b4518/30/temp_shuffle_862ed764-f7fe-44df-b197-3ef7eedf860e 
(No such file or directory)
	at java.io.FileInputStream.open(Native Method)
	at java.io.FileInputStream.<init>(FileInputStream.java:138)
	at org.apache.spark.util.collection.ExternalSorter$SpillReader.nextBatchStream(ExternalSorter.scala:562)
	at org.apache.spark.util.collection.ExternalSorter$SpillReader.org$apache$spark$util$collection$ExternalSorter$SpillReader$$readNextItem(ExternalSorter.scala:611)

Write tip

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

Users with the same issue

8 times, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
207 more bugmates