machinejava.io.IOException: Offset 0 and length 17073479 don't match block blk_4137524355009640437_53760530 ( blockLen 16999670 )

Google Groups | Ming Yang | 4 months ago
  1. 0

    (BUG)Failed to read block error when enable replication

    Google Groups | 4 months ago | Ming Yang
    machinejava.io.IOException: Offset 0 and length 17073479 don't match block blk_4137524355009640437_53760530 ( blockLen 16999670 )
  2. 0

    (BUG)ShortCircuitLocalReads Failed when enabled replication

    Google Groups | 4 months ago | Ming Yang
    machinejava.io.IOException: Offset 0 and length 17073479 don't match block blk_4137524355009640437_53760530 ( blockLen 16999670 )
  3. 0

    (BUG)ShortCircuitLocalReads Failed when enabled replication

    Google Groups | 4 months ago | Ming Yang
    machinejava.io.IOException: Offset 0 and length 17073479 don't match block blk_4137524355009640437_53760530 ( blockLen 16999670 ) at org.apache.hadoop.hdfs.BlockReaderLocal.<init>( BlockReaderLocal.java:287) at org.apache.hadoop.hdfs.BlockReaderLocal.newBlockReader( BlockReaderLocal.java:171) at org.apache.hadoop.hdfs.DFSClient.getLocalBlockReader( DFSClient.java:358)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. machinejava.io.IOException

      Offset 0 and length 17073479 don't match block blk_4137524355009640437_53760530 ( blockLen 16999670 )

      at org.apache.hadoop.hdfs.BlockReaderLocal.<init>()
    2. Apache Hadoop HDFS
      DFSClient$DFSInputStream.read
      1. org.apache.hadoop.hdfs.BlockReaderLocal.<init>(BlockReaderLocal.java:287)
      2. org.apache.hadoop.hdfs.BlockReaderLocal.newBlockReader(BlockReaderLocal.java:171)
      3. org.apache.hadoop.hdfs.DFSClient.getLocalBlockReader(DFSClient.java:358)
      4. org.apache.hadoop.hdfs.DFSClient.access$800(DFSClient.java:74)
      5. org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:2073)
      6. org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:2224)
      6 frames
    3. Java RT
      DataInputStream.readFully
      1. java.io.DataInputStream.read(DataInputStream.java:149)
      2. java.io.DataInputStream.readFully(DataInputStream.java:195)
      3. java.io.DataInputStream.readFully(DataInputStream.java:169)
      3 frames
    4. Hadoop
      SequenceFile$Reader.<init>
      1. org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
      2. org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
      3. org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
      4. org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
      4 frames
    5. HBase - Client
      HLog.getReader
      1. org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:55)
      2. org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:178)
      3. org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:734)
      3 frames
    6. HBase
      ReplicationSource.run
      1. org.apache.hadoop.hbase.replication.regionserver.ReplicationHLogReaderManager.openReader(ReplicationHLogReaderManager.java:69)
      2. org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.openReader(ReplicationSource.java:574)
      3. org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:364)
      3 frames