java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.

Apache's JIRA Issue Tracker | Hitesh Shah | 4 years ago
  1. Speed up your debug routine!

    Automated exception search integrated into your IDE

  2. 0

    Apache Spark Server installation requires Hadoop? Not automatically installed?

    Stack Overflow | 5 months ago | jgp
    java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
  3. 0

    sample spark CSV and JSON program not running in windows

    Stack Overflow | 2 months ago | subho
    java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

  1. tyson925 1 times, last 6 months ago
5 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.IOException

    HADOOP_HOME or hadoop.home.dir are not set.

    at org.apache.hadoop.util.Shell.checkHadoopHome()
  2. Hadoop
    StringUtils.<clinit>
    1. org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:163)
    2. org.apache.hadoop.util.Shell.<clinit>(Shell.java:186)
    3. org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:77)
    3 frames
  3. Hadoop
    FileInputFormat.setInputPaths
    1. org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:339)
    1 frame
  4. org.apache.pig
    PigServer$registerScript.call
    1. org.apache.pig.builtin.PigStorage.setLocation(PigStorage.java:374)
    2. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:473)
    3. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:294)
    4. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
    5. org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
    6. org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
    7. org.apache.pig.PigServer.execute(PigServer.java:1239)
    8. org.apache.pig.PigServer.access$400(PigServer.java:121)
    9. org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1553)
    10. org.apache.pig.PigServer.registerQuery(PigServer.java:516)
    11. org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:991)
    12. org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:412)
    13. org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
    14. org.apache.pig.PigServer.registerScript(PigServer.java:590)
    15. org.apache.pig.PigServer$registerScript.call(Unknown Source)
    15 frames
  5. Groovy
    AbstractCallSite.call
    1. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    2. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    3. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:124)
    3 frames
  6. org.apache.hadoop
    IntegrationTestBase.registerPigResource
    1. org.apache.hadoop.fs.swift.integration.IntegrationTestBase.registerPigResource(IntegrationTestBase.groovy:196)
    1 frame
  7. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  8. Groovy
    AbstractCallSite.callCurrent
    1. org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:267)
    2. org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:52)
    3. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:46)
    4. org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:133)
    5. org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
    5 frames
  9. org.apache.hadoop
    TestPig.testLoadGeneratedData
    1. org.apache.hadoop.fs.swift.integration.pig.TestPig.testLoadGeneratedData(TestPig.groovy:48)
    1 frame
  10. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  11. JUnit
    ParentRunner.run
    1. org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
    2. org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
    3. org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
    4. org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
    5. org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
    6. org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
    7. org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
    8. org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
    9. org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
    10. org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
    11. org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
    12. org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
    13. org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
    14. org.junit.runners.ParentRunner.run(ParentRunner.java:300)
    14 frames
  12. JUnit4 Provider
    JUnit4Provider.invoke
    1. org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
    2. org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
    3. org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
    3 frames
  13. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    4. java.lang.reflect.Method.invoke(Method.java:597)
    4 frames
  14. SureFire
    ForkedBooter.main
    1. org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:208)
    2. org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:158)
    3. org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:86)
    4. org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
    5. org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:95)
    5 frames