org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#3

Stack Overflow | Justin Jose | 10 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Negative Array Size Exception while inserting into Hive Bucketed Table

    Stack Overflow | 10 months ago | Justin Jose
    org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#3

    1 unregistered visitors

    Root Cause Analysis

    1. java.lang.NegativeArraySizeException

      No message provided

      at org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>()
    2. Hadoop
      BoundedByteArrayOutputStream.<init>
      1. org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:56)
      2. org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:46)
      2 frames
    3. Hadoop
      Fetcher.run
      1. org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput.<init>(InMemoryMapOutput.java:63)
      2. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.unconditionalReserve(MergeManagerImpl.java:305)
      3. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.reserve(MergeManagerImpl.java:295)
      4. org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyMapOutput(Fetcher.java:514)
      5. org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:336)
      6. org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:193)
      6 frames