org.apache.spark.sql.AnalysisException: org.apache.spark.sql.test.DefaultSourceWithoutUserSpecifiedSchema does not allow user-specified schemas.;

github.com | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Spark-16669:Adding partition prunning to Metastore statistics for better join selection. by Parth-Brahmbhatt · Pull Request #14305 · apache/spark · GitHub

    github.com | 7 months ago
    org.apache.spark.sql.AnalysisException: org.apache.spark.sql.test.DefaultSourceWithoutUserSpecifiedSchema does not allow user-specified schemas.;

    Root Cause Analysis

    1. org.apache.spark.sql.AnalysisException

      org.apache.spark.sql.test.DefaultSourceWithoutUserSpecifiedSchema does not allow user-specified schemas.;

      at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation()
    2. org.apache.spark
      DataSource.write
      1. org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:319)
      2. org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:494)
      2 frames
    3. Spark Project SQL
      DataFrameWriter.save
      1. org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:211)
      1 frame