yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed

spark-user | Jean-Baptiste Onofré | 1 year ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Spark cluster computing framework

    gmane.org | 1 year ago
    yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed
  2. 0

    Re: Spark Submit - java.lang.IllegalArgumentException: requirement failed

    spark-user | 1 year ago | Jean-Baptiste Onofré
    yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed

    Root Cause Analysis

    1. yarn.Client

      Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed

      at scala.Predef$.require()
    2. Scala
      Predef$.require
      1. scala.Predef$.require(Predef.scala:221)
      1 frame
    3. Spark Project YARN Stable API
      Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply
      1. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply(Client.scala:392)
      2. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply(Client.scala:390)
      2 frames
    4. Scala
      ArrayOps$ofRef.foreach
      1. scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
      2. scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
      2 frames
    5. Spark Project YARN Stable API
      Client$$anonfun$prepareLocalResources$6.apply
      1. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6.apply(Client.scala:390)
      2. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6.apply(Client.scala:388)
      2 frames
    6. Scala
      List.foreach
      1. scala.collection.immutable.List.foreach(List.scala:318)
      1 frame
    7. Spark Project YARN Stable API
      Client.main
      1. org.apache.spark.deploy.yarn.Client.prepareLocalResources(Client.scala:388)
      2. org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:629)
      3. org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:119)
      4. org.apache.spark.deploy.yarn.Client.run(Client.scala:907)
      5. org.apache.spark.deploy.yarn.Client$.main(Client.scala:966)
      6. org.apache.spark.deploy.yarn.Client.main(Client.scala)
      6 frames