java.io.FileNotFoundException: File does not exist: hdfs://hns4.sea1.qc:21000/tmp/hadoop-mr20/mapred/staging/dadkins/.staging/job_201009090022_0001/job.xml

Apache's JIRA Issue Tracker | Dan Adkins | 6 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    I get the following strange error on the jobtracker when attempting to submit a job: 10/09/09 20:31:35 INFO ipc.Server: IPC Server handler 7 on 31000, call submitJob(job_201009092028_0001, hdfs://hns4.sea1.qc:21000/tmp/hadoop-mr20/mapred/staging/dadkins/.staging/job_201009092028_0001, org.apache.hadoop.security.Credentials@20c87621) from 10.128.130.145:49253: error: java.io.IOException: Filesystem closed java.io.IOException: Filesystem closed at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:307) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:1212) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:494) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1491) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:395) at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3078) at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3014) at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:2996) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:349) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1380) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1376) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1105) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1374)

    Apache's JIRA Issue Tracker | 6 years ago | Dan Adkins
    java.io.FileNotFoundException: File does not exist: hdfs://hns4.sea1.qc:21000/tmp/hadoop-mr20/mapred/staging/dadkins/.staging/job_201009090022_0001/job.xml
  2. 0

    wordcount example using local file system instead of distributed one?

    hadoop-hdfs-user | 6 years ago | Hiller, Dean (Contractor)
    org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException: File file: /tmp/hadoop-root/mapred/system/job_201012080654_0010/job.xml does not exist.
  3. 0

    RE: wordcount example using local file system instead of distributed one?

    hadoop-hdfs-user | 6 years ago | Hiller, Dean (Contractor)
    org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException: File file: /tmp/hadoop-root/mapred/system/job_201012080654_0010/job.xml does not exist.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    RE: wordcount example using local file system instead of distributed one?

    hadoop-hdfs-user | 6 years ago | Hiller, Dean (Contractor)
    org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException: File file: /tmp/hadoop-root/mapred/system/job_201012080654_0010/job.xml does not exist.
  6. 0

    [jira] Commented: (HADOOP-2228) Jobs fail because job.xml exists

    hadoop-common-dev | 9 years ago | Hudson (JIRA)
    org.apache.hadoop.ipc.RemoteException: java.io.IOException: Target /var/storage/4/mapred/local/jobTracker/job_200711081903_3976.xml already exists

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.FileNotFoundException

      File does not exist: hdfs://hns4.sea1.qc:21000/tmp/hadoop-mr20/mapred/staging/dadkins/.staging/job_201009090022_0001/job.xml

      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus()
    2. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:732)
      1 frame
    3. Hadoop
      FileSystem.copyToLocalFile
      1. org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:231)
      2. org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:183)
      3. org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1587)
      4. org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1568)
      4 frames
    4. Hadoop
      JobTracker.main
      1. org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:426)
      2. org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3048)
      3. org.apache.hadoop.mapred.JobTracker.access$1200(JobTracker.java:125)
      4. org.apache.hadoop.mapred.JobTracker$RecoveryManager.recover(JobTracker.java:1171)
      5. org.apache.hadoop.mapred.JobTracker.offerService(JobTracker.java:1733)
      6. org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4257)
      6 frames