org.apache.spark.sql.AnalysisException: path file:/Users/code/Development/warcraft-avatar-history/wowah_data.parquet already exists.;

GitHub | koaning | 7 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Feature: be able to overwrite parquet file

    GitHub | 7 months ago | koaning
    org.apache.spark.sql.AnalysisException: path file:/Users/code/Development/warcraft-avatar-history/wowah_data.parquet already exists.;
  2. 0

    org.apache.spark.sql.AnalysisException: path "s3n://..." already exists

    Stack Overflow | 4 months ago | Lobsterrrr
    org.apache.spark.sql.AnalysisException: path s3n://data-platform/test/test.json already exists
  3. 0

    Can't not run spark job on yarn..

    Google Groups | 8 months ago | Eric DONG
    org.apache.spark.sql.AnalysisException: path alluxio://208.208.102.230:19998/test already exists.;
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Can't run spark job on yarn

    Google Groups | 8 months ago | Zeheng Dong
    org.apache.spark.sql.AnalysisException: path alluxio://208.208.102.230:19998/test already exists.;

    Root Cause Analysis

    1. org.apache.spark.sql.AnalysisException

      path file:/Users/code/Development/warcraft-avatar-history/wowah_data.parquet already exists.;

      at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation.run()
    2. org.apache.spark
      InsertIntoHadoopFsRelation.run
      1. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation.run(InsertIntoHadoopFsRelation.scala:76)
      1 frame
    3. Spark Project SQL
      SparkPlan$$anonfun$execute$5.apply
      1. org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58)
      2. org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56)
      3. org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:70)
      4. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:132)
      5. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:130)
      5 frames
    4. Spark
      RDDOperationScope$.withScope
      1. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
      1 frame
    5. Spark Project SQL
      QueryExecution.toRdd$lzycompute
      1. org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:130)
      2. org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:55)
      2 frames