yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed

spark-user | Jean-Baptiste Onofré | 12 months ago
  1. 0

    Spark cluster computing framework

    gmane.org | 11 months ago
    yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed
  2. 0

    Re: Spark Submit - java.lang.IllegalArgumentException: requirement failed

    spark-user | 12 months ago | Jean-Baptiste Onofré
    yarn.Client: Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed
  3. 0

    Encrypting HDFS on EMR 4.2.0

    Stack Overflow | 11 months ago | user5786682
    yarn.Client: Deleting staging directory .sparkStaging/application_1452702204221_0002 Exception in thread "main" org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/root/.sparkStaging/application_1452702204221_0002/spark-assembly-1.5.2-hadoop2.6.0-amzn-2.jar could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    RE: spark job hangs/fails with localizer failing

    apache.org | 1 year ago
    yarn.Client: Application report for application_1431482563856_0001 (state: FAILED) 15/05/13 02:09:06 INFO yarn.Client: client token: N/A diagnostics: Application application_1431482563856_0001 failed 2 times due to AM Container for appattempt_1431482563856_0001_000002 exited with exitCode: 10 For more detailed output, check application tracking page:https://ip-10-10-127-10.ec2.internal:8090/proxy/application_1431482563856_0001/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1431482563856_0001_02_000001 Exit code: 10 Stack trace: ExitCodeException exitCode=10:
  6. 0

    scala jar step fail on EMR with exit code 10

    Stack Overflow | 10 months ago | Zahiro Mor
    yarn.Client: client token: N/A diagnostics: Application application_1455007292848_0007 failed 2 times due to AM Container for appattempt_1455007292848_0007_000002 exited with exitCode: 10 For more detailed output, check application tracking page:http://ip-10-65-65-226.ec2.internal:8088/cluster/app/application_1455007292848_0007Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1455007292848_0007_02_000001 Exit code: 10 Stack trace: ExitCodeException exitCode=10:

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. yarn.Client

      Deleting staging directory .sparkStaging/application_1447442727308_0126 Exception in thread "main" java.lang.IllegalArgumentException: requirement failed

      at scala.Predef$.require()
    2. Scala
      Predef$.require
      1. scala.Predef$.require(Predef.scala:221)
      1 frame
    3. Spark Project YARN Stable API
      Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply
      1. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply(Client.scala:392)
      2. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6$$anonfun$apply$2.apply(Client.scala:390)
      2 frames
    4. Scala
      ArrayOps$ofRef.foreach
      1. scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
      2. scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
      2 frames
    5. Spark Project YARN Stable API
      Client$$anonfun$prepareLocalResources$6.apply
      1. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6.apply(Client.scala:390)
      2. org.apache.spark.deploy.yarn.Client$$anonfun$prepareLocalResources$6.apply(Client.scala:388)
      2 frames
    6. Scala
      List.foreach
      1. scala.collection.immutable.List.foreach(List.scala:318)
      1 frame
    7. Spark Project YARN Stable API
      Client.main
      1. org.apache.spark.deploy.yarn.Client.prepareLocalResources(Client.scala:388)
      2. org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:629)
      3. org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:119)
      4. org.apache.spark.deploy.yarn.Client.run(Client.scala:907)
      5. org.apache.spark.deploy.yarn.Client$.main(Client.scala:966)
      6. org.apache.spark.deploy.yarn.Client.main(Client.scala)
      6 frames