org.apache.spark.SparkException

Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse

Solutions on the web1858

  • Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse
  • Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.io.IOException: Mkdirs failed to create file:/user/spark/scv/mlc-processed/_temporary/0/_temporary
  • Job aborted due to stage failure: Task 1 in stage 0.0 failed 1 times, most recent failure: Lost task 1.0 in stage 0.0 (TID 1, localhost): java.io.IOException: Mkdirs failed to create file:/user/hive/warehouse/perftestgeneratedtable/_temporary/0/_temporary/attempt_201605122121_0000_m_000001_0 (exists=false, cwd=file:/Users/apple/Carbon-dev/for393)
  • Stack trace

    • org.apache.spark.SparkException: Unable to create database default as failed to create its directory hdfs://xxxx.cluster:8020/ascratch/hadoop/uc3/spark-warehouse at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1$1(InMemoryCatalog.scala:114)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    You are the first who have seen this exception. Write a tip to help other users and build your expert profile.