org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed

GitHub | jinhyukchang | 6 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    GitHub comment 1186#241139147

    GitHub | 6 months ago | jinhyukchang
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed
  2. 0

    java.io.IOException: Filesystem closed

    GitHub | 6 months ago | jinhyukchang
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed

    Root Cause Analysis

    1. org.apache.hadoop.mapred.YarnChild

      Exception running child : java.io.IOException: Filesystem closed

      at org.apache.hadoop.hdfs.DFSClient.checkOpen()
    2. Apache Hadoop HDFS
      DistributedFileSystem$17.doCall
      1. org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:689)
      2. org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1744)
      3. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1112)
      4. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1108)
      4 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1108)
      1 frame
    5. Hadoop
      FileSystem.exists
      1. org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1399)
      1 frame
    6. gobblin.metastore
      FsStateStore.put
      1. gobblin.metastore.FsStateStore.put(FsStateStore.java:135)
      1 frame
    7. gobblin.runtime
      AbstractJobLauncher.runWorkUnits
      1. gobblin.runtime.AbstractJobLauncher.runWorkUnits(AbstractJobLauncher.java:644)
      1 frame
    8. gobblin.runtime.mapreduce
      MRJobLauncher$TaskRunner.run
      1. gobblin.runtime.mapreduce.MRJobLauncher$TaskRunner.run(MRJobLauncher.java:597)
      1 frame
    9. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
      2. org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
      3. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
      3 frames
    10. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    11. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
      1 frame
    12. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
      1 frame