java.io.IOException: java.io.IOException: java.io.IOException: DeprecatedInputFormatWrapper - value is different and no value copier provided. current reader class : class com.twitter.elephantbird.mapreduce.input.LzoLineRecordReader

Google Groups | Irfan Mohammed | 3 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Lzo Compression using EB fails when dealing with hive "union all" like queries

    Google Groups | 3 years ago | Irfan Mohammed
    java.io.IOException: java.io.IOException: java.io.IOException: DeprecatedInputFormatWrapper - value is different and no value copier provided. current reader class : class com.twitter.elephantbird.mapreduce.input.LzoLineRecordReader

    Root Cause Analysis

    1. java.io.IOException

      DeprecatedInputFormatWrapper - value is different and no value copier provided. current reader class : class com.twitter.elephantbird.mapreduce.input.LzoLineRecordReader

      at com.twitter.elephantbird.mapred.input.DeprecatedInputFormatWrapper$RecordReaderWrapper.next()
    2. Elephant Bird Core
      DeprecatedInputFormatWrapper$RecordReaderWrapper.next
      1. com.twitter.elephantbird.mapred.input.DeprecatedInputFormatWrapper$RecordReaderWrapper.next(DeprecatedInputFormatWrapper.java:325)
      1 frame
    3. Hive Query Language
      HiveContextAwareRecordReader.next
      1. org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:274)
      2. org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:101)
      3. org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:41)
      4. org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:108)
      4 frames
    4. Hive Shims
      HadoopShimsSecure$CombineFileRecordReader.next
      1. org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.doNextWithExceptionHandler(HadoopShimsSecure.java:309)
      2. org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.next(HadoopShimsSecure.java:227)
      2 frames
    5. Hadoop
      LocalJobRunner$Job.run
      1. org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:210)
      2. org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:195)
      3. org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
      4. org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
      5. org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
      6. org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)
      6 frames