org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge

pig-user | Billy Watson | 9 months ago
  1. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 9 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  2. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 9 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  3. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 9 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 9 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge
  6. 0

    Re: HBaseStorage Merge Join NoClassDef Error

    pig-user | 9 months ago | Billy Watson
    org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: Error while doing final merge

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ClassCastException

      org.apache.pig.backend.hadoop.hbase.TableSplitComparable cannot be cast to org.apache.hadoop.hbase.mapreduce.TableSplit

      at org.apache.pig.backend.hadoop.hbase.TableSplitComparable.compareTo()
    2. org.apache.pig
      PigTupleSortComparator.compare
      1. org.apache.pig.backend.hadoop.hbase.TableSplitComparable.compareTo(TableSplitComparable.java:26)
      2. org.apache.pig.data.DataType.compare(DataType.java:566)
      3. org.apache.pig.data.DataType.compare(DataType.java:464)
      4. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareDatum(BinInterSedes.java:1106)
      5. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compare(BinInterSedes.java:1082)
      6. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareBinSedesTuple(BinInterSedes.java:787)
      7. org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compare(BinInterSedes.java:728)
      8. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTupleSortComparator.compare(PigTupleSortComparator.java:100)
      8 frames
    3. Hadoop
      Merger$MergeQueue.lessThan
      1. org.apache.hadoop.mapred.Merger$MergeQueue.lessThan(Merger.java:587)
      1 frame
    4. Hadoop
      PriorityQueue.put
      1. org.apache.hadoop.util.PriorityQueue.upHeap(PriorityQueue.java:128)
      2. org.apache.hadoop.util.PriorityQueue.put(PriorityQueue.java:55)
      2 frames
    5. Hadoop
      Shuffle.run
      1. org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:678)
      2. org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:596)
      3. org.apache.hadoop.mapred.Merger.merge(Merger.java:131)
      4. org.apache.hadoop.mapred.Merger.merge(Merger.java:115)
      5. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.finalMerge(MergeManagerImpl.java:722)
      6. org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.close(MergeManagerImpl.java:370)
      7. org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:158)
      7 frames