java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected

JIRA | Russell Jurney | 2 years ago
  1. 0

    ----------------------- 2015-01-26 14:40:26,421 [LocalJobRunner Map Task Executor #0] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader - Current split being processed file:/tmp/atomic_nile/views_by_user.avro/part-r-00000.avro:704643072+10604132 2015-01-26 14:40:26,422 [LocalJobRunner Map Task Executor #0] INFO com.mongodb.hadoop.pig.MongoStorage - Store Location Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, file:/tmp/hadoop-rjurney/mapred/local/localRunner/rjurney/job_local2089078013_0001/job_local2089078013_0001.xml For URI: mongodb://localhost:27017/atomic_nile.views_by_user 2015-01-26 14:40:26,423 [LocalJobRunner Map Task Executor #0] INFO com.mongodb.hadoop.pig.MongoStorage - OutputFormat... com.mongodb.hadoop.MongoOutputFormat@7c945cbe 2015-01-26 14:40:26,423 [Thread-46] INFO org.apache.hadoop.mapred.LocalJobRunner - map task executor complete. 2015-01-26 14:40:26,424 [Thread-46] INFO com.mongodb.hadoop.pig.MongoStorage - Store Location Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, file:/tmp/hadoop-rjurney/mapred/local/localRunner/rjurney/job_local2089078013_0001/job_local2089078013_0001.xml For URI: mongodb://localhost:27017/atomic_nile.views_by_user should cleanup job 2015-01-26 14:40:26,426 [Thread-46] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local2089078013_0001 java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) Caused by: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at com.mongodb.hadoop.MongoOutputFormat.getRecordWriter(MongoOutputFormat.java:44) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:81) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:644) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2015-01-26 14:40:29,983 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2015-01-26 14:40:29,983 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - job job_local2089078013_0001 has failed! Stop running all dependent jobs 2015-01-26 14:40:29,983 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete 2015-01-26 14:40:29,984 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2015-01-26 14:40:29,987 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2015-01-26 14:40:29,988 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed! 2015-01-26 14:40:29,989 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersion PigVersion UserId StartedAt FinishedAt Features 2.6.0 0.14.0-SNAPSHOT rjurney 2015-01-26 14:40:22 2015-01-26 14:40:29 UNKNOWN Failed! Failed Jobs: JobId Alias Feature Message Outputs job_local2089078013_0001 views_by_user MAP_ONLY Message: Job failed! mongodb://localhost:27017/atomic_nile.views_by_user, Input(s): Failed to read data from "/tmp/atomic_nile/views_by_user.avro" Output(s): Failed to produce result in "mongodb://localhost:27017/atomic_nile.views_by_user" Counters: Total records written : 0 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2089078013_0001 2015-01-26 14:40:29,989 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed! 2015-01-26 14:40:29,991 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 0: java.io.IOException: No FileSystem for scheme: mongodb 2015-01-26 14:40:29,991 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.io.IOException: No FileSystem for scheme: mongodb at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:535) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:280) at org.apache.pig.PigServer.launchPlan(PigServer.java:1390) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375) at org.apache.pig.PigServer.execute(PigServer.java:1364) at org.apache.pig.PigServer.executeBatch(PigServer.java:415) at org.apache.pig.PigServer.executeBatch(PigServer.java:398) at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) at org.apache.pig.Main.run(Main.java:624) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.io.IOException: No FileSystem for scheme: mongodb at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) at org.apache.pig.StoreFunc.cleanupOnFailureImpl(StoreFunc.java:193) at org.apache.pig.StoreFunc.cleanupOnFailure(StoreFunc.java:161) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:526) ... 18 more Details also at logfile: /private/tmp/pig_1422312019838.log 2015-01-26 14:40:30,007 [main] INFO org.apache.pig.Main - Pig script completed in 10 seconds and 263 milliseconds (10263 ms)

    JIRA | 2 years ago | Russell Jurney
    java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
  2. 0

    ----------------------- 2015-01-26 14:40:26,421 [LocalJobRunner Map Task Executor #0] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader - Current split being processed file:/tmp/atomic_nile/views_by_user.avro/part-r-00000.avro:704643072+10604132 2015-01-26 14:40:26,422 [LocalJobRunner Map Task Executor #0] INFO com.mongodb.hadoop.pig.MongoStorage - Store Location Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, file:/tmp/hadoop-rjurney/mapred/local/localRunner/rjurney/job_local2089078013_0001/job_local2089078013_0001.xml For URI: mongodb://localhost:27017/atomic_nile.views_by_user 2015-01-26 14:40:26,423 [LocalJobRunner Map Task Executor #0] INFO com.mongodb.hadoop.pig.MongoStorage - OutputFormat... com.mongodb.hadoop.MongoOutputFormat@7c945cbe 2015-01-26 14:40:26,423 [Thread-46] INFO org.apache.hadoop.mapred.LocalJobRunner - map task executor complete. 2015-01-26 14:40:26,424 [Thread-46] INFO com.mongodb.hadoop.pig.MongoStorage - Store Location Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml, file:/tmp/hadoop-rjurney/mapred/local/localRunner/rjurney/job_local2089078013_0001/job_local2089078013_0001.xml For URI: mongodb://localhost:27017/atomic_nile.views_by_user should cleanup job 2015-01-26 14:40:26,426 [Thread-46] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local2089078013_0001 java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) Caused by: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at com.mongodb.hadoop.MongoOutputFormat.getRecordWriter(MongoOutputFormat.java:44) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:81) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:644) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2015-01-26 14:40:29,983 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure. 2015-01-26 14:40:29,983 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - job job_local2089078013_0001 has failed! Stop running all dependent jobs 2015-01-26 14:40:29,983 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete 2015-01-26 14:40:29,984 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2015-01-26 14:40:29,987 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2015-01-26 14:40:29,988 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed! 2015-01-26 14:40:29,989 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersion PigVersion UserId StartedAt FinishedAt Features 2.6.0 0.14.0-SNAPSHOT rjurney 2015-01-26 14:40:22 2015-01-26 14:40:29 UNKNOWN Failed! Failed Jobs: JobId Alias Feature Message Outputs job_local2089078013_0001 views_by_user MAP_ONLY Message: Job failed! mongodb://localhost:27017/atomic_nile.views_by_user, Input(s): Failed to read data from "/tmp/atomic_nile/views_by_user.avro" Output(s): Failed to produce result in "mongodb://localhost:27017/atomic_nile.views_by_user" Counters: Total records written : 0 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2089078013_0001 2015-01-26 14:40:29,989 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed! 2015-01-26 14:40:29,991 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 0: java.io.IOException: No FileSystem for scheme: mongodb 2015-01-26 14:40:29,991 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.io.IOException: No FileSystem for scheme: mongodb at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:535) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:280) at org.apache.pig.PigServer.launchPlan(PigServer.java:1390) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375) at org.apache.pig.PigServer.execute(PigServer.java:1364) at org.apache.pig.PigServer.executeBatch(PigServer.java:415) at org.apache.pig.PigServer.executeBatch(PigServer.java:398) at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) at org.apache.pig.Main.run(Main.java:624) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.io.IOException: No FileSystem for scheme: mongodb at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) at org.apache.pig.StoreFunc.cleanupOnFailureImpl(StoreFunc.java:193) at org.apache.pig.StoreFunc.cleanupOnFailure(StoreFunc.java:161) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:526) ... 18 more Details also at logfile: /private/tmp/pig_1422312019838.log 2015-01-26 14:40:30,007 [main] INFO org.apache.pig.Main - Pig script completed in 10 seconds and 263 milliseconds (10263 ms)

    JIRA | 2 years ago | Russell Jurney
    java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
  3. 0

    Unable to Read/Write Avro RDD on cluster. (YARN cluster)

    Stack Overflow | 2 years ago | deepujain
    java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Spark App exception running in IntelliJ IDEA

    Stack Overflow | 2 years ago | guanjunwang
    java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
  6. 0

    GitHub comment 25#159776489

    GitHub | 1 year ago | sadikovi
    java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IncompatibleClassChangeError

      Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected

      at com.mongodb.hadoop.MongoOutputFormat.getRecordWriter()
    2. com.mongodb.hadoop
      MongoOutputFormat.getRecordWriter
      1. com.mongodb.hadoop.MongoOutputFormat.getRecordWriter(MongoOutputFormat.java:44)
      1 frame
    3. org.apache.pig
      PigOutputFormat.getRecordWriter
      1. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:81)
      1 frame
    4. Hadoop
      LocalJobRunner$Job$MapTaskRunnable.run
      1. org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:644)
      2. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
      3. org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      4. org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
      4 frames
    5. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:262)
      3. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      4. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      5. java.lang.Thread.run(Thread.java:724)
      5 frames