org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#3

Stack Overflow | Justin Jose | 8 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Negative Array Size Exception while inserting into Hive Bucketed Table

    Stack Overflow | 8 months ago | Justin Jose
    org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#3

    1 unregistered visitors

    Root Cause Analysis

    1. java.lang.NegativeArraySizeException

      No message provided

      at org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>()
    2. Hadoop
      BoundedByteArrayOutputStream.<init>
      1. org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:56)
      2. org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:46)
      2 frames
    3. Hadoop
      Fetcher.run
      1. org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput.<init>(InMemoryMapOutput.java:63)
      2. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.unconditionalReserve(MergeManagerImpl.java:305)
      3. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.reserve(MergeManagerImpl.java:295)
      4. org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyMapOutput(Fetcher.java:514)
      5. org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:336)
      6. org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:193)
      6 frames