Premature EOF from inputStream

Apache's JIRA Issue Tracker | gao shan | 4 months ago
  1. 0

    The following is the steps to reproduce: 1) hadoop fs -mkdir /ec 2) set erasured code policy as "6-3" 3) "write" data by : time hadoop jar /opt/hadoop/hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-SNAPSHOT.jar TestDFSIO -D -write -nrFiles 30 -fileSize 12288 -bufferSize 1073741824 4) Manually down 3 nodes. Kill the threads of "datanode" and "nodemanager" in 3 DataNode. 5) By using erasured code to "read" data by: time hadoop jar /opt/hadoop/hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-SNAPSHOT.jar TestDFSIO -D -read -nrFiles 30 -fileSize 12288 -bufferSize 1073741824 then the failure occurs and the exception is thrown as: INFO mapreduce.Job: Task Id : attempt_1465445965249_0008_m_000034_2, Status : FAILED Error: 4 missing blocks, the stripe is: Offset=0, length=8388608, fetchedChunksNum=0, missingChunksNum=4 at org.apache.hadoop.hdfs.DFSStripedInputStream$StripeReader.checkMissingBlocks( at org.apache.hadoop.hdfs.DFSStripedInputStream$StripeReader.readParityChunks( at org.apache.hadoop.hdfs.DFSStripedInputStream$StripeReader.readStripe( at org.apache.hadoop.hdfs.DFSStripedInputStream.readOneStripe( at org.apache.hadoop.hdfs.DFSStripedInputStream.readWithStrategy( at at at org.apache.hadoop.fs.TestDFSIO$ReadMapper.doIO( at org.apache.hadoop.fs.TestDFSIO$ReadMapper.doIO( at at at at org.apache.hadoop.mapred.MapTask.runOldMapper( at at org.apache.hadoop.mapred.YarnChild$ at Method) at at at org.apache.hadoop.mapred.YarnChild.main(

    Apache's JIRA Issue Tracker | 4 months ago | gao shan Premature EOF from inputStream
  2. 0

    DataNode READ_BLOCK or WRITE_BLOCK error

    Stack Overflow | 3 years ago | user2926672 Premature EOF from inputStream
  3. 0

    Problem syncing commit log: /hypertable/servers/rs18/log/user/3252: Error flushing DFS fd 73135

    Google Groups | 3 years ago | David Premature EOF from inputStream
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    RegionServers Crashing every hour in production env

    Google Groups | 4 years ago | Pablo Musa Premature EOF from inputStream
  6. 0

    RegionServer crashes silently under heavy RowKey scans

    Google Groups | 4 years ago | Jim Abramson Premature EOF from inputStream

    6 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis


      Premature EOF from inputStream

    2. Hadoop
      1 frame
    3. Apache Hadoop HDFS
      1. org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(
      2. org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(
      3. org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(
      4. org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(
      5. org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(
      6. org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(
      7. org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(
      8. org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(
      9 frames
    4. Java RT
      1 frame