java.io.IOException: Can't get JobTracker Kerberos principal for use as renewer

Apache's JIRA Issue Tracker | Anupam Seth | 5 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    We are seeing the following Kerberos exception upon trying to run terasort on secure single and multi-node clusters using the latest build from branch 0.23. java.io.IOException: Can't get JobTracker Kerberos principal for use as renewer at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:106) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:90) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:83) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:205) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269) at org.apache.hadoop.examples.terasort.TeraInputFormat.getSplits(TeraInputFormat.java:318) at org.apache.hadoop.examples.terasort.TeraInputFormat.writePartitionFile(TeraInputFormat.java:169) at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:306) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:325) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:189) Adding debug output shows that the job configuration is not loading up yarn-site.xml causing the above failure to happen.

    Apache's JIRA Issue Tracker | 5 years ago | Anupam Seth
    java.io.IOException: Can't get JobTracker Kerberos principal for use as renewer
  2. 0

    We are seeing the following Kerberos exception upon trying to run terasort on secure single and multi-node clusters using the latest build from branch 0.23. java.io.IOException: Can't get JobTracker Kerberos principal for use as renewer at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:106) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:90) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:83) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:205) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269) at org.apache.hadoop.examples.terasort.TeraInputFormat.getSplits(TeraInputFormat.java:318) at org.apache.hadoop.examples.terasort.TeraInputFormat.writePartitionFile(TeraInputFormat.java:169) at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:306) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:325) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:189) Adding debug output shows that the job configuration is not loading up yarn-site.xml causing the above failure to happen.

    Apache's JIRA Issue Tracker | 5 years ago | Anupam Seth
    java.io.IOException: Can't get JobTracker Kerberos principal for use as renewer
  3. 0

    Comma separated list with AvroStorage in Pig

    Stack Overflow | 5 years ago | Philipp Pahl
    rg.apache.pig.backend.executionengine.ExecException: ERROR 2118: No input paths specified in job
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    If a PartitionedFileSet dataset is used as the input for a MapReduce job and a PartitionFilter is specified that matches zero partitions, the MapReduce job will throw an exception: {code} java.lang.RuntimeException: java.io.IOException: No input paths specified in job at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-13.0.1.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.startUp(MapReduceRuntimeService.java:301) ~[classes/:na] at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:47) [guava-13.0.1.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService$2$1.run(MapReduceRuntimeService.java:402) [classes/:na] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] Caused by: java.io.IOException: No input paths specified in job at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:231) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:340) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] {code} This is the behavior in Hadoop MapReduce (if no input path is specified for FileInputFormat). A possibility to consider is to use a temp file as the input, to at least create an empty partition, if no input partitions are matched/specified.

    Cask Community Issue Tracker | 2 years ago | Ali Anwar
    java.lang.RuntimeException: java.io.IOException: No input paths specified in job

    Root Cause Analysis

    1. java.io.IOException

      Can't get JobTracker Kerberos principal for use as renewer

      at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal()
    2. Hadoop
      FileInputFormat.getSplits
      1. org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:106)
      2. org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:90)
      3. org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:83)
      4. org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:205)
      5. org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269)
      5 frames
    3. Apache Hadoop MapReduce Examples
      TeraSort.run
      1. org.apache.hadoop.examples.terasort.TeraInputFormat.getSplits(TeraInputFormat.java:318)
      2. org.apache.hadoop.examples.terasort.TeraInputFormat.writePartitionFile(TeraInputFormat.java:169)
      3. org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:306)
      3 frames
    4. Hadoop
      ToolRunner.run
      1. org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
      1 frame
    5. Apache Hadoop MapReduce Examples
      TeraSort.main
      1. org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:325)
      1 frame
    6. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      4. java.lang.reflect.Method.invoke(Method.java:597)
      4 frames
    7. Hadoop
      ProgramDriver.driver
      1. org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
      2. org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
      2 frames
    8. Apache Hadoop MapReduce Examples
      ExampleDriver.main
      1. org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
      1 frame
    9. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      4. java.lang.reflect.Method.invoke(Method.java:597)
      4 frames
    10. Hadoop
      RunJar.main
      1. org.apache.hadoop.util.RunJar.main(RunJar.java:189)
      1 frame