java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.

Apache's JIRA Issue Tracker | Hitesh Shah | 4 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. Speed up your debug routine!

    Automated exception search integrated into your IDE

  2. 0

    Apache Spark Server installation requires Hadoop? Not automatically installed?

    Stack Overflow | 8 months ago | jgp
    java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
  3. 0

    sample spark CSV and JSON program not running in windows

    Stack Overflow | 5 months ago | subho
    java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

  1. tyson925 8 times, last 1 month ago
5 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.IOException

    HADOOP_HOME or hadoop.home.dir are not set.

    at org.apache.hadoop.util.Shell.checkHadoopHome()
  2. Hadoop
    StringUtils.<clinit>
    1. org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:163)
    2. org.apache.hadoop.util.Shell.<clinit>(Shell.java:186)
    3. org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:77)
    3 frames
  3. Hadoop
    FileInputFormat.setInputPaths
    1. org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:339)
    1 frame
  4. org.apache.pig
    PigServer$registerScript.call
    1. org.apache.pig.builtin.PigStorage.setLocation(PigStorage.java:374)
    2. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:473)
    3. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:294)
    4. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
    5. org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
    6. org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
    7. org.apache.pig.PigServer.execute(PigServer.java:1239)
    8. org.apache.pig.PigServer.access$400(PigServer.java:121)
    9. org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1553)
    10. org.apache.pig.PigServer.registerQuery(PigServer.java:516)
    11. org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:991)
    12. org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:412)
    13. org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
    14. org.apache.pig.PigServer.registerScript(PigServer.java:590)
    15. org.apache.pig.PigServer$registerScript.call(Unknown Source)
    15 frames
  5. Groovy
    AbstractCallSite.call
    1. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    2. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    3. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:124)
    3 frames
  6. org.apache.hadoop
    IntegrationTestBase.registerPigResource
    1. org.apache.hadoop.fs.swift.integration.IntegrationTestBase.registerPigResource(IntegrationTestBase.groovy:196)
    1 frame
  7. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  8. Groovy
    AbstractCallSite.callCurrent
    1. org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:267)
    2. org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:52)
    3. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:46)
    4. org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:133)
    5. org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
    5 frames
  9. org.apache.hadoop
    TestPig.testLoadGeneratedData
    1. org.apache.hadoop.fs.swift.integration.pig.TestPig.testLoadGeneratedData(TestPig.groovy:48)
    1 frame
  10. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  11. JUnit
    ParentRunner.run
    1. org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
    2. org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
    3. org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
    4. org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
    5. org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
    6. org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
    7. org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
    8. org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
    9. org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
    10. org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
    11. org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
    12. org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
    13. org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
    14. org.junit.runners.ParentRunner.run(ParentRunner.java:300)
    14 frames
  12. JUnit4 Provider
    JUnit4Provider.invoke
    1. org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
    2. org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
    3. org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
    3 frames
  13. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  14. SureFire
    ForkedBooter.main
    1. org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:208)
    2. org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:158)
    3. org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:86)
    4. org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
    5. org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:95)
    5 frames