java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

tip
Do you find the tips below useful? Click on the to mark them and say thanks to rp . Or join the community to write better ones.
  1. 0

    Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Setting default log level to "WARN"

    Stack Overflow | 1 month ago | Salahudin Malik
    java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
  2. 0

    pyspark: In spite of adding winutils to HADOOP_HOME, getting error: Could not locate executable null\bin\winutils.exe in the Hadoop binaries

    Stack Overflow | 2 months ago | kaks
    java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0
    samebug tip
    Download the winutils.exe for your Hadoop version: https://github.com/steveloughran/winutils . Save it to HADOOP_HOME/bin
  5. 0

    Running Spark Applications on Windows · Mastering Apache Spark 2

    gitbooks.io | 2 days ago
    java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

  1. rp 1 times, last 3 months ago
  2. muffinmannen 3 times, last 12 months ago
4 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.IOException

    Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

    at org.apache.hadoop.util.Shell.getQualifiedBinPath()
  2. Hadoop
    Shell.<clinit>
    1. org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:379)
    2. org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:394)
    3. org.apache.hadoop.util.Shell.<clinit>(Shell.java:387)
    3 frames
  3. Hive Common
    HiveConf.<clinit>
    1. org.apache.hadoop.hive.conf.HiveConf$ConfVars.findHadoopBinary(HiveConf.java:2327)
    2. org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:365)
    3. org.apache.hadoop.hive.conf.HiveConf.<clinit>(HiveConf.java:105)
    3 frames
  4. Java RT
    Class.forName
    1. java.lang.Class.forName0(Native Method)
    2. java.lang.Class.forName(Class.java:348)
    2 frames
  5. Py4J
    GatewayConnection.run
    1. py4j.reflection.CurrentThreadClassLoadingStrategy.classForName(CurrentThreadClassLoadingStrategy.java:40)
    2. py4j.reflection.ReflectionUtil.classForName(ReflectionUtil.java:51)
    3. py4j.reflection.TypeUtil.forName(TypeUtil.java:243)
    4. py4j.commands.ReflectionCommand.getUnknownMember(ReflectionCommand.java:175)
    5. py4j.commands.ReflectionCommand.execute(ReflectionCommand.java:87)
    6. py4j.GatewayConnection.run(GatewayConnection.java:214)
    6 frames
  6. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame