org.apache.spark.SparkException: Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse

GitHub | Explorer89 | 2 months ago
tip
Do you find the tips below useful? Click on the to mark them and say thanks to poroszd . Or join the community to write better ones.
  1. 0

    spark -2.0.1 Exception in thread "main" org.apache.spark.SparkException: Unable to create database default as failed to create its directory

    GitHub | 2 months ago | Explorer89
    org.apache.spark.SparkException: Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse
  2. 0
    samebug tip
    You should use java.sql.Timestamp or Date to map BsonDateTime from mongodb.
  3. 0

    GitHub comment 393#218949711

    GitHub | 9 months ago | chenliang613
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 0.0 failed 1 times, most recent failure: Lost task 1.0 in stage 0.0 (TID 1, localhost): java.io.IOException: Mkdirs failed to create file:/user/hive/warehouse/perftestgeneratedtable/_temporary/0/_temporary/attempt_201605122121_0000_m_000001_0 (exists=false, cwd=file:/Users/apple/Carbon-dev/for393)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Intellij IDEA : Spark code running results in java.lang.VerifyError

    Stack Overflow | 6 months ago | kn_pavan
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 1.0 failed 1 times, most recent failure: Lost task 1.0 in stage 1.0 (TID 3, localhost): java.lang.VerifyError: (class: org/apache/spark/sql/catalyst/expressions/GeneratedClass$SpecificOrdering, method: tryCompare signature: (Ljava/lang/Object;Ljava/lang/Object;)Lscala/Some;) Wrong return type in function

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse

      at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1$1()
    2. org.apache.spark
      InMemoryCatalog.liftedTree1$1
      1. org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1$1(InMemoryCatalog.scala:114)
      1 frame