java.io.FileNotFoundException: File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip

Stack Overflow | 0x6 | 5 months ago
  1. 0

    Spark 1.5.2 on YARN with Ambari: Failed 2 times due to AM Container exited with exitCode: -1000

    Stack Overflow | 5 months ago | 0x6
    java.io.FileNotFoundException: File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip
  2. 0

    File not found exception when submitting spark job to EMR

    Stack Overflow | 4 months ago | cscan
    java.io.FileNotFoundException: File does not exist: hdfs://ip.us-west-2.compute.internal:8020/user/hadoop/.sparkStaging/application_1470941709244_0001/__spark_libs__3533384422462530422.zip
  3. 0

    SPARK_CONF not found in AWS EMR

    Stack Overflow | 1 year ago | user3771946
    java.io.FileNotFoundException: File does not exist: hdfs://ip-10-184-176-172.ec2.internal:8020/user/hadoop/.sparkStaging/application_1446113189622_0004/__spark_conf__2712437380309904293.zip
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Cannot run Spark step in EMR

    Stack Overflow | 8 months ago | Sovann
    java.io.FileNotFoundException: File does not exist: hdfs://ip-172-31-26-247.ap-northeast-1.compute.internal:8020/user/hadoop/.sparkStaging/application_1459839685827_0001/__spark_conf__9006968814682693730.zip
  6. 0

    YARN Application exited with exitCode: -1000

    Stack Overflow | 5 months ago | Tony Tannous
    java.io.FileNotFoundException: File does not exist: hdfs://master/user/vagrant/.sparkStaging/application_1467230784881_0002/__spark_conf__3453304962733471881.zip

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.FileNotFoundException

      File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip

      at org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall()
    2. Apache Hadoop HDFS
      DistributedFileSystem$24.doCall
      1. org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1373)
      2. org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1365)
      2 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1365)
      1 frame
    5. hadoop-yarn-common
      FSDownload$2.run
      1. org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:253)
      2. org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:63)
      3. org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:361)
      4. org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359)
      4 frames
    6. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    7. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
      1 frame
    8. hadoop-yarn-common
      FSDownload.call
      1. org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:358)
      2. org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
      2 frames
    9. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      2. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      3. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      4. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      5. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      6. java.lang.Thread.run(Thread.java:745)
      6 frames