org.apache.spark.SparkException: Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse

GitHub | Explorer89 | 4 months ago
tip
Do you find the tips below useful? Click on the to mark them and say thanks to rafael and poroszd . Or join the community to write better ones.
  1. 0

    spark -2.0.1 Exception in thread "main" org.apache.spark.SparkException: Unable to create database default as failed to create its directory

    GitHub | 4 months ago | Explorer89
    org.apache.spark.SparkException: Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse
  2. 0
    samebug tip
    Change the queue name to hadoop
  3. 0
    samebug tip
    You should use java.sql.Timestamp or Date to map BsonDateTime from mongodb.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 393#218949711

    GitHub | 11 months ago | chenliang613
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 0.0 failed 1 times, most recent failure: Lost task 1.0 in stage 0.0 (TID 1, localhost): java.io.IOException: Mkdirs failed to create file:/user/hive/warehouse/perftestgeneratedtable/_temporary/0/_temporary/attempt_201605122121_0000_m_000001_0 (exists=false, cwd=file:/Users/apple/Carbon-dev/for393)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse

      at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1$1()
    2. org.apache.spark
      InMemoryCatalog.liftedTree1$1
      1. org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1$1(InMemoryCatalog.scala:114)
      1 frame