blk_8857674139042547711_2143611java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/<datanode_ip>:41129 remote=/<datanode2_ip>:60010]

flume-user | Jeff Lord | 4 years ago
  1. 0

    Re: HDFS Sink stops writing events because HDFSWriter failed to append and close a file

    flume-user | 4 years ago | Jeff Lord
    blk_8857674139042547711_2143611java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/<datanode_ip>:41129 remote=/<datanode2_ip>:60010]

    Root Cause Analysis

    1. blk_8857674139042547711_2143611java.net.SocketTimeoutException

      69000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/<datanode_ip>:41129 remote=/<datanode2_ip>:60010]

      at org.apache.hadoop.net.SocketIOWithTimeout.doIO()
    2. Hadoop
      SocketInputStream.read
      1. org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
      2. org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
      3. org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
      3 frames
    3. Java RT
      DataInputStream.readLong
      1. java.io.DataInputStream.readFully(DataInputStream.java:178)
      2. java.io.DataInputStream.readLong(DataInputStream.java:399)
      2 frames