java.io.FileNotFoundException: File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip

Stack Overflow | 0x6 | 7 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Spark 1.5.2 on YARN with Ambari: Failed 2 times due to AM Container exited with exitCode: -1000

    Stack Overflow | 7 months ago | 0x6
    java.io.FileNotFoundException: File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip

    Root Cause Analysis

    1. java.io.FileNotFoundException

      File does not exist: hdfs://dataproducts01.datadomain:8020/user/root/.sparkStaging/application_1469121546721_0017/__spark_conf__3054858276021527629.zip

      at org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall()
    2. Apache Hadoop HDFS
      DistributedFileSystem$24.doCall
      1. org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1373)
      2. org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1365)
      2 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1365)
      1 frame
    5. hadoop-yarn-common
      FSDownload$2.run
      1. org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:253)
      2. org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:63)
      3. org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:361)
      4. org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359)
      4 frames
    6. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    7. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
      1 frame
    8. hadoop-yarn-common
      FSDownload.call
      1. org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:358)
      2. org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
      2 frames
    9. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      2. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      3. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      4. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      5. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      6. java.lang.Thread.run(Thread.java:745)
      6 frames