java.lang.reflect.InvocationTargetException

Stack Overflow | KIM | 5 months ago
  1. 0

    Exception while executing rowcounter

    Stack Overflow | 5 months ago | KIM
    java.lang.reflect.InvocationTargetException
  2. 0

    Recently, we saw the following scenario: 1. The user setup a cluster of hadoop 2.3., which contains YARN 2.3 and MR 2.3. 2. The user client on a machine that MR 2.2 is installed and in the classpath. Then, when the user submitted a simple wordcount job, he saw the following message: {code} 16:00:41,027 INFO main mapreduce.Job:1345 - map 100% reduce 100% 16:00:41,036 INFO main mapreduce.Job:1356 - Job job_1396468045458_0006 completed successfully 16:02:20,535 WARN main mapreduce.JobRunner:212 - Cannot start job [wordcountJob] java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES at java.lang.Enum.valueOf(Enum.java:236) at org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.valueOf(FrameworkCounterGroup.java:148) at org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.findCounter(FrameworkCounterGroup.java:182) at org.apache.hadoop.mapreduce.counters.AbstractCounters.findCounter(AbstractCounters.java:154) at org.apache.hadoop.mapreduce.TypeConverter.fromYarn(TypeConverter.java:240) at org.apache.hadoop.mapred.ClientServiceDelegate.getJobCounters(ClientServiceDelegate.java:370) at org.apache.hadoop.mapred.YARNRunner.getJobCounters(YARNRunner.java:511) at org.apache.hadoop.mapreduce.Job$7.run(Job.java:756) at org.apache.hadoop.mapreduce.Job$7.run(Job.java:753) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.mapreduce.Job.getCounters(Job.java:753) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1361) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1289) . . . {code} The problem is that the wordcount job was running on one or more than one nodes of the YARN cluster, where MR 2.3 libs were installed, and JobCounter.MB_MILLIS_REDUCES is available in the counters. On the other side, due to the classpath setting, the client was likely to run with MR 2.2 libs. After the client retrieved the counters from MR AM, it tried to construct the Counter object with the received counter name. Unfortunately, the enum didn't exist in the client's classpath. Therefore, "No enum constant" exception is thrown here. JobCounter.MB_MILLIS_REDUCES is brought to MR2 via MAPREDUCE-5464 since Hadoop 2.3.

    Apache's JIRA Issue Tracker | 3 years ago | Zhijie Shen
    java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES
  3. 0

    No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES from mahout

    Stack Overflow | 2 years ago | jychan
    java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    [jira] [Created] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

    apache.org | 1 year ago
    java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES
  6. 0

    [jira] [Resolved] (MAPREDUCE-6168) Old MR client is still broken when receiving new counters from MR job

    hadoop-mapreduce-dev | 2 years ago | Junping Du (JIRA)
    java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_REDUCES

  1. linxiaolong 1 times, last 4 days ago
  2. davidvanlaatum 1 times, last 2 weeks ago
  3. MoYapro 3 times, last 3 weeks ago
  4. iridic 116 times, last 3 weeks ago
  5. maxxi 4 times, last 2 months ago
12 more registered users
12 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.IllegalArgumentException

    No enum constant org.apache.hadoop.mapreduce.JobCounter.MB_MILLIS_MAPS

    at java.lang.Enum.valueOf()
  2. Java RT
    Enum.valueOf
    1. java.lang.Enum.valueOf(Enum.java:236)
    1 frame
  3. Hadoop
    Job$7.run
    1. org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.valueOf(FrameworkCounterGroup.java:148)
    2. org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.findCounter(FrameworkCounterGroup.java:182)
    3. org.apache.hadoop.mapreduce.counters.AbstractCounters.findCounter(AbstractCounters.java:154)
    4. org.apache.hadoop.mapreduce.TypeConverter.fromYarn(TypeConverter.java:240)
    5. org.apache.hadoop.mapred.ClientServiceDelegate.getJobCounters(ClientServiceDelegate.java:370)
    6. org.apache.hadoop.mapred.YARNRunner.getJobCounters(YARNRunner.java:511)
    7. org.apache.hadoop.mapreduce.Job$7.run(Job.java:756)
    8. org.apache.hadoop.mapreduce.Job$7.run(Job.java:753)
    8 frames
  4. Java RT
    Subject.doAs
    1. java.security.AccessController.doPrivileged(Native Method)
    2. javax.security.auth.Subject.doAs(Subject.java:415)
    2 frames
  5. Hadoop
    UserGroupInformation.doAs
    1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
    1 frame
  6. Hadoop
    Job.waitForCompletion
    1. org.apache.hadoop.mapreduce.Job.getCounters(Job.java:753)
    2. org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1361)
    3. org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1289)
    3 frames
  7. HBase
    RowCounter.main
    1. org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:211)
    1 frame
  8. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:606)
    4 frames
  9. Hadoop
    ProgramDriver.driver
    1. org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
    2. org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
    3. org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
    3 frames
  10. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:606)
    4 frames
  11. HBase
    Driver.main
    1. org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:54)
    1 frame