org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge

pig-user | Billy Watson | 11 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 11 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  2. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 11 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  3. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 11 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 11 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  6. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 11 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ClassCastException

      org.apache.pig.backend.hadoop.hbase.TableSplitComparable cannot be cast to org.apache.hadoop.hbase.mapreduce.TableSplit

      at org.apache.pig.backend.hadoop.hbase.TableSplitComparable.compareTo()
    2. org.apache.pig
      PigTupleSortComparator.compare
      1. org.apache.pig.backend.hadoop.hbase.TableSplitComparable.compareTo(TableSplitComparable.java:26)
      2. org.apache.pig.data.DataType.compare(DataType.java:566)
      3. org.apache.pig.data.DataType.compare(DataType.java:464)
      4. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareDatum(BinInterSedes.java:1106)
      5. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compare(BinInterSedes.java:1082)
      6. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareBinSedesTuple(BinInterSedes.java:787)
      7. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compare(BinInterSedes.java:728)
      8. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTupleSortComparator.compare(PigTupleSortComparator.java:100)
      8 frames
    3. Hadoop
      Merger$MergeQueue.lessThan
      1. org.apache.hadoop.mapred.Merger$MergeQueue.lessThan(Merger.java:587)
      1 frame
    4. Hadoop
      PriorityQueue.put
      1. org.apache.hadoop.util.PriorityQueue.upHeap(PriorityQueue.java:128)
      2. org.apache.hadoop.util.PriorityQueue.put(PriorityQueue.java:55)
      2 frames
    5. Hadoop
      Shuffle.run
      1. org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:678)
      2. org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:596)
      3. org.apache.hadoop.mapred.Merger.merge(Merger.java:131)
      4. org.apache.hadoop.mapred.Merger.merge(Merger.java:115)
      5. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.finalMerge(MergeManagerImpl.java:722)
      6. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.close(MergeManagerImpl.java:370)
      7. org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:158)
      7 frames