org.apache.spark.SparkException: Job aborted.

GitHub | mpinese | 3 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    GitHub comment 227#249985046

    GitHub | 7 months ago | wilvancleve
    org.apache.spark.SparkException: Job aborted.
  2. 0

    While writing file in Spark I'm getting error Text data source supports only a string column, but you have binary

    Stack Overflow | 1 month ago | Prateek Prateek
    org.apache.spark.sql.AnalysisException: Text data source supports only a string column, but you have binary.;
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted.

      at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply$mcV$sp()
    2. org.apache.spark
      InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply
      1. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelationCommand.scala:149)
      2. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply(InsertIntoHadoopFsRelationCommand.scala:115)
      3. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply(InsertIntoHadoopFsRelationCommand.scala:115)
      3 frames
    3. Spark Project SQL
      SQLExecution$.withNewExecutionId
      1. org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:57)
      1 frame
    4. org.apache.spark
      ExecutedCommandExec.doExecute
      1. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand.run(InsertIntoHadoopFsRelationCommand.scala:115)
      2. org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:58)
      3. org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:56)
      4. org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:74)
      4 frames
    5. Spark Project SQL
      SparkPlan$$anonfun$executeQuery$1.apply
      1. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:115)
      2. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:115)
      3. org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:136)
      3 frames
    6. Spark
      RDDOperationScope$.withScope
      1. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
      1 frame
    7. Spark Project SQL
      QueryExecution.toRdd
      1. org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:133)
      2. org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:114)
      3. org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:86)
      4. org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:86)
      4 frames
    8. org.apache.spark
      DataSource.write
      1. org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:525)
      1 frame
    9. Spark Project SQL
      DataFrameWriter.parquet
      1. org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:211)
      2. org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:194)
      3. org.apache.spark.sql.DataFrameWriter.parquet(DataFrameWriter.scala:488)
      3 frames
    10. org.broadinstitute.hail
      Main$$anonfun$runCommands$1.apply
      1. org.broadinstitute.hail.variant.RichVDS.write(VariantSampleMatrix.scala:1073)
      2. org.broadinstitute.hail.driver.Write$.run(Write.scala:35)
      3. org.broadinstitute.hail.driver.Write$.run(Write.scala:6)
      4. org.broadinstitute.hail.driver.Command.runCommand(Command.scala:259)
      5. org.broadinstitute.hail.driver.Main$.runCommand(Main.scala:91)
      6. org.broadinstitute.hail.driver.Main$$anonfun$runCommands$1$$anonfun$1.apply(Main.scala:115)
      7. org.broadinstitute.hail.driver.Main$$anonfun$runCommands$1$$anonfun$1.apply(Main.scala:115)
      8. org.broadinstitute.hail.utils.package$.time(package.scala:119)
      9. org.broadinstitute.hail.driver.Main$$anonfun$runCommands$1.apply(Main.scala:114)
      10. org.broadinstitute.hail.driver.Main$$anonfun$runCommands$1.apply(Main.scala:108)
      10 frames
    11. Scala
      ArrayOps$ofRef.foldLeft
      1. scala.collection.IndexedSeqOptimized$class.foldl(IndexedSeqOptimized.scala:57)
      2. scala.collection.IndexedSeqOptimized$class.foldLeft(IndexedSeqOptimized.scala:66)
      3. scala.collection.mutable.ArrayOps$ofRef.foldLeft(ArrayOps.scala:186)
      3 frames
    12. org.broadinstitute.hail
      Main.main
      1. org.broadinstitute.hail.driver.Main$.runCommands(Main.scala:108)
      2. org.broadinstitute.hail.driver.Main$.main(Main.scala:233)
      3. org.broadinstitute.hail.driver.Main.main(Main.scala)
      3 frames