java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx--

Stack Overflow | ML_Passion | 5 months ago
  1. 0

    Error in pyspark with udf: You must build Spark with Hive. Export 'SPARK_HIVE=true' and run build/sbt assembly

    Stack Overflow | 5 months ago | ML_Passion
    java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx--
  2. 0

    Branch 1.6 by naujlove · Pull Request #11413 · apache/spark · GitHub

    github.com | 8 months ago
    java.lang.RuntimeException: java.net.ConnectException: Call From jzhangMBPr.local/127.0.0.1 to 0.0.0.0:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:
  3. 0

    Unable to create udf in pyspark in interactive shell

    Stack Overflow | 7 months ago | Swadeep
    java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Cu rrent permissions are: rw-rw-rw-
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    EC2 spark-shell failed on connection exception: java.net.ConnectException: Connection ref

    Stack Overflow | 10 months ago | Null-Hypothesis
    java.lang.RuntimeException: java.net.ConnectException: Call to ec2-XXX-XX-XX-XX.compute-1.amazonaws.com/XX.XXX.XX.XXX:9000 failed on connection exception: java.net.ConnectException: Connection refused

  1. muffinmannen 3 times, last 8 months ago
14 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.RuntimeException

    The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------

    at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir()
  2. Hive Query Language
    SessionState.start
    1. org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:612)
    2. org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:554)
    3. org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:508)
    3 frames
  3. org.apache.spark
    IsolatedClientLoader.createClient
    1. org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:204)
    2. org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:238)
    2 frames
  4. Spark Project Hive
    HiveContext.functionRegistry
    1. org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:218)
    2. org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:208)
    3. org.apache.spark.sql.hive.HiveContext.functionRegistry$lzycompute(HiveContext.scala:462)
    4. org.apache.spark.sql.hive.HiveContext.functionRegistry(HiveContext.scala:461)
    4 frames
  5. Spark Project SQL
    SQLContext.<init>
    1. org.apache.spark.sql.UDFRegistration.<init>(UDFRegistration.scala:40)
    2. org.apache.spark.sql.SQLContext.<init>(SQLContext.scala:330)
    2 frames
  6. Spark Project Hive
    HiveContext.<init>
    1. org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:90)
    2. org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:101)
    2 frames
  7. Java RT
    Constructor.newInstance
    1. sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    2. sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    3. sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    4. java.lang.reflect.Constructor.newInstance(Constructor.java:422)
    4 frames
  8. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
    3. py4j.Gateway.invoke(Gateway.java:214)
    4. py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
    5. py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
    6. py4j.GatewayConnection.run(GatewayConnection.java:209)
    6 frames
  9. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame