org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Negative value-length not allowed: -6 org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12

apache.org | 3 months ago
  1. 0

    [MAPREDUCE-5028] Maps fail when io.sort.mb is set to high value - ASF JIRA

    apache.org | 1 year ago
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Negative value-length not allowed: -6 org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12
  2. 0

    [MAPREDUCE-5028] Maps fail when io.sort.mb is set to high value - ASF JIRA

    apache.org | 3 months ago
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Negative value-length not allowed: -6 org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12
  3. 0

    Verified the problem exists on branch-1 with the following configuration: Pseudo-dist mode: 2 maps/ 1 reduce, mapred.child.java.opts=-Xmx2048m, io.sort.mb=1280, dfs.block.size=2147483648 Run teragen to generate 4 GB data Maps fail when you run wordcount on this configuration with the following error: {noformat} java.io.IOException: Spill failed at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1031) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:692) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:45) at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:34) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.io.IntWritable.readFields(IntWritable.java:38) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:67) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:40) at org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:116) at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:175) at org.apache.hadoop.mapred.Task$NewCombinerRunner.combine(Task.java:1505) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1438) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:855) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1346) {noformat}

    Apache's JIRA Issue Tracker | 4 years ago | Karthik Kambatla
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Negative value-length not allowed: -6 for org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Verified the problem exists on branch-1 with the following configuration: Pseudo-dist mode: 2 maps/ 1 reduce, mapred.child.java.opts=-Xmx2048m, io.sort.mb=1280, dfs.block.size=2147483648 Run teragen to generate 4 GB data Maps fail when you run wordcount on this configuration with the following error: {noformat} java.io.IOException: Spill failed at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1031) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:692) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:45) at org.apache.hadoop.examples.WordCount$TokenizerMapper.map(WordCount.java:34) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.io.IntWritable.readFields(IntWritable.java:38) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:67) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:40) at org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:116) at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:175) at org.apache.hadoop.mapred.Task$NewCombinerRunner.combine(Task.java:1505) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1438) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:855) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1346) {noformat}

    Apache's JIRA Issue Tracker | 4 years ago | Karthik Kambatla
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Negative value-length not allowed: -6 for org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12
  6. 0

    GitHub comment 560#144067195

    GitHub | 1 year ago | boliza
    org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Unable to initialize any output collector

    3 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.mapred.YarnChild

      Exception running child : java.io.IOException: Negative value-length not allowed: -6 org.apache.hadoop.mapred.MapTask$MapOutputBuffer$InMemValBytes@1b1f1f12

      at org.apache.hadoop.mapred.IFile$Writer.append()
    2. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapred.IFile$Writer.append(IFile.java:243)
      2. org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1597)
      3. org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1462)
      4. org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:694)
      5. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:762)
      6. org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
      7. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158)
      7 frames
    3. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:396)
      2 frames
    4. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
      1 frame
    5. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153)
      1 frame