java.io.IOException: DFSOutputStream is closed*

flume-user | Jeff Lord | 4 years ago
  1. 0

    Re: HDFS Sink stops writing events because HDFSWriter failed to append and close a file

    flume-user | 4 years ago | Jeff Lord
    java.io.IOException: DFSOutputStream is closed*
  2. 0

    All datanodes are bad. Aborting...). Closing file - Cloudera Community

    cloudera.com | 1 year ago
    java.io.IOException: All datanodes 172.16.0.106:50010 are bad. Aborting...
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    0.95.2 upgrade errors

    Google Groups | 3 years ago | Kiru Pakkirisamy
    java.io.IOException: DFSOutputStream is closed

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      DFSOutputStream is closed*

      at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync()
    2. Apache Hadoop HDFS
      DFSClient$DFSOutputStream.sync
      1. org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3669)
      1 frame
    3. Hadoop
      FSDataOutputStream.sync
      1. org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
      1 frame
    4. org.apache.flume
      HDFSEventSink$2.call
      1. org.apache.flume.sink.hdfs.HDFSCompressedDataStream.sync(HDFSCompressedDataStream.java:96)
      2. org.apache.flume.sink.hdfs.BucketWriter.doFlush(BucketWriter.java:345)
      3. org.apache.flume.sink.hdfs.BucketWriter.access$500(BucketWriter.java:53)
      4. org.apache.flume.sink.hdfs.BucketWriter$4.run(BucketWriter.java:310)
      5. org.apache.flume.sink.hdfs.BucketWriter$4.run(BucketWriter.java:308)
      6. org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:143)
      7. org.apache.flume.sink.hdfs.BucketWriter.flush(BucketWriter.java:308)
      8. org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:257)
      9. org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:382)
      10. org.apache.flume.sink.hdfs.HDFSEventSink$2.call(HDFSEventSink.java:729)
      11. org.apache.flume.sink.hdfs.HDFSEventSink$2.call(HDFSEventSink.java:727)
      11 frames
    5. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:138)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      4. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      5. java.lang.Thread.run(Thread.java:662)
      5 frames