org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed

GitHub | jinhyukchang | 7 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    GitHub comment 1186#241139147

    GitHub | 7 months ago | jinhyukchang
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed
  2. 0

    java.io.IOException: Filesystem closed

    GitHub | 7 months ago | jinhyukchang
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Filesystem closed

    Root Cause Analysis

    1. org.apache.hadoop.mapred.YarnChild

      Exception running child : java.io.IOException: Filesystem closed

      at org.apache.hadoop.hdfs.DFSClient.checkOpen()
    2. Apache Hadoop HDFS
      DistributedFileSystem$17.doCall
      1. org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:689)
      2. org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1744)
      3. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1112)
      4. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1108)
      4 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1108)
      1 frame
    5. Hadoop
      FileSystem.exists
      1. org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1399)
      1 frame
    6. gobblin.metastore
      FsStateStore.put
      1. gobblin.metastore.FsStateStore.put(FsStateStore.java:135)
      1 frame
    7. gobblin.runtime
      AbstractJobLauncher.runWorkUnits
      1. gobblin.runtime.AbstractJobLauncher.runWorkUnits(AbstractJobLauncher.java:644)
      1 frame
    8. gobblin.runtime.mapreduce
      MRJobLauncher$TaskRunner.run
      1. gobblin.runtime.mapreduce.MRJobLauncher$TaskRunner.run(MRJobLauncher.java:597)
      1 frame
    9. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
      2. org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
      3. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
      3 frames
    10. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    11. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
      1 frame
    12. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
      1 frame