co.cask.tephra.TransactionFailureException

Exception raised in transactional execution. Cause: Output directory not set.

Samebug tips0

There are no available Samebug tips.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web14

  • via by Sharanya Santhanam,
  • via by Sharanya Santhanam,
  • Stack trace

    • co.cask.tephra.TransactionFailureException: Exception raised in transactional execution. Cause: Output directory not set. at co.cask.cdap.data2.transaction.Transactions.asTransactionFailure(Transactions.java:87)[co.cask.cdap.cdap-data-fabric-3.4.2.jar:na] at co.cask.cdap.data2.transaction.Transactions.asTransactionFailure(Transactions.java:73)[co.cask.cdap.cdap-data-fabric-3.4.2.jar:na] at co.cask.cdap.app.runtime.spark.SparkTransactional.execute(SparkTransactional.java:215)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] at co.cask.cdap.app.runtime.spark.DefaultSparkExecutionContext.saveAsDataset(DefaultSparkExecutionContext.scala:202)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] at co.cask.cdap.api.spark.SparkMain$SparkProgramRDDFunctions.saveAsDataset(SparkMain.scala:121)[co.cask.cdap.cdap-api-spark-3.4.2.jar:na] at co.cask.cdap.scala.WordCountProgram.run(WordCountProgram.scala:65)[program.expanded.jar/:na] at co.cask.cdap.app.runtime.spark.SparkMainWrapper$.main(SparkMainWrapper.scala:92)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] at co.cask.cdap.app.runtime.spark.SparkMainWrapper.main(SparkMainWrapper.scala)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[na:1.8.0_60] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)[na:1.8.0_60] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[na:1.8.0_60] at java.lang.reflect.Method.invoke(Method.java:497)[na:1.8.0_60] at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:525)[spark-assembly-1.5.2-**.1] Caused by: org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set. at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:138)[hadoop-mapreduce-client-core-2.6.0-**] at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply$mcV$sp(PairRDDFunctions.scala:1011)[spark-assembly-1.5.2-**] at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:998)[spark-assembly-1.5.2-**] at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:998)[spark-assembly-1.5.2-**] at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147)[spark-assembly-1.5.2-**] at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:108)[spark-assembly-1.5.2-**] at org.apache.spark.rdd.RDD.withScope(RDD.scala:310)[spark-assembly-1.5.2**] at org.apache.spark.rdd.PairRDDFunctions.saveAsNewAPIHadoopDataset(PairRDDFunctions.scala:998)[spark-assembly-1.5.2-**] at co.cask.cdap.app.runtime.spark.DefaultSparkExecutionContext$$anon$2.run(DefaultSparkExecutionContext.scala:224)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] at co.cask.cdap.app.runtime.spark.SparkTransactional.execute(SparkTransactional.java:197)[co.cask.cdap.cdap-spark-core-3.4.2.jar:na] ... 10 more

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    No Bugmate found.