java.lang.IllegalArgumentException: Error while instantiating 'org.apache.spark.sql.hive.HiveSessionState':

Stack Overflow | nanounanue | 4 months ago
tip
Do you find the tips below useful? Click on the to mark them and say thanks to rafael . Or join the community to write better ones.
  1. 0
    samebug tip
    This might be an issue with the file location in the Spark submit command. Try it with "spark-submit --master spark://master:7077 hello_world_from_pyspark.py {file location}"
  2. 0
    samebug tip
    You might need to add the permission 777, run this in your cmd (as admin) "C:\hadoop\bin>winutils.exe chmod 777 \tmp\hive"
  3. 4

    Error in spark-submit but not in pyspark

    Stack Overflow | 4 months ago | nanounanue
    java.lang.IllegalArgumentException: Error while instantiating 'org.apache.spark.sql.hive.HiveSessionState':
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Apache Spark installation Windows 10 64 bit

    Stack Overflow | 1 week ago | Harsh Trivedi
    java.lang.IllegalArgumentException: Error while instantiating 'org.apache.spark.sql.hive.HiveSessionState':
  6. 0

    Getting Error when I ran hive UDF written in Java in pyspark EMR 5.x

    Stack Overflow | 4 months ago | braj259
    py4j.protocol.Py4JJavaError: An error occurred while calling o43.sql. : java.lang.NoSuchMethodError: org.apache.hadoop.hive.conf.HiveConf.getTimeVar(Lorg/apache/hadoop/hive/conf/HiveConf$ConfVars;Ljava/util/concurrent/TimeUnit;)J

  1. bandoca 2 times, last 1 week ago
  2. jokester 2 times, last 1 week ago
  3. arturgajowy 8 times, last 1 week ago
  4. rp 1 times, last 2 weeks ago
  5. tzrlk 1 times, last 1 month ago
64 more registered users
31 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.ClassNotFoundException

    org.apache.spark.sql.hive.HiveSessionState

    at java.net.URLClassLoader.findClass()
  2. Java RT
    Class.forName
    1. java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    2. java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    3. java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    4. java.lang.Class.forName0(Native Method)
    5. java.lang.Class.forName(Class.java:348)
    5 frames
  3. Spark
    Utils$.classForName
    1. org.apache.spark.util.Utils$.classForName(Utils.scala:228)
    1 frame
  4. Spark Project SQL
    SparkSession.conf
    1. org.apache.spark.sql.SparkSession$.org$apache$spark$sql$SparkSession$$reflect(SparkSession.scala:947)
    2. org.apache.spark.sql.SparkSession.sessionState$lzycompute(SparkSession.scala:111)
    3. org.apache.spark.sql.SparkSession.sessionState(SparkSession.scala:110)
    4. org.apache.spark.sql.SparkSession.conf$lzycompute(SparkSession.scala:133)
    5. org.apache.spark.sql.SparkSession.conf(SparkSession.scala:133)
    5 frames
  5. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:498)
    4 frames
  6. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:237)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
    3. py4j.Gateway.invoke(Gateway.java:280)
    4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
    5. py4j.commands.CallCommand.execute(CallCommand.java:79)
    6. py4j.GatewayConnection.run(GatewayConnection.java:214)
    6 frames
  7. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame