org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=aditghosh OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1468349436383_0001 failed 2 times due to AM Container for appattempt_1468349436383_0001_000002 exited with exitCode: 127 For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1468349436383_0001Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1468349436383_0001_02_000001 Exit code: 127 Stack trace: ExitCodeException exitCode=127:

Stack Overflow | error_404 | 5 months ago
  1. 0

    Unable to run Map Reduce Jobs on Hadoop

    Stack Overflow | 5 months ago | error_404
    org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=aditghosh OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1468349436383_0001 failed 2 times due to AM Container for appattempt_1468349436383_0001_000002 exited with exitCode: 127 For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1468349436383_0001Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1468349436383_0001_02_000001 Exit code: 127 Stack trace: ExitCodeException exitCode=127:
  2. 0

    GitHub comment 5#130511543

    GitHub | 1 year ago | AllenFang
    org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=user1 OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1439169262151_0057 failed 2 times due to AM Container for appattempt_1439169262151_0057_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException:
  3. 0

    Error launching spark application from Windows to Linux YARN Cluster - Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher

    incubator-spark-user | 2 years ago | dxrodri
    org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=spark OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1411473500741_0002 failed 2 times due to AM Container for appattempt_1411473500741_0002_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException:
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Re: Help with Giraph on Yarn

    giraph-user | 2 years ago | D Adams
    org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hduser OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1416359131664_0003 2014-11-19 02:38:52,775 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1416359131664_0003,name=Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation,user=hduser,queue=default,state=FINISHED,trackingUrl= http://roosevelt:8088/proxy/application_1416359131664_0003/A,appMasterHost=,startTime=1416385579074,finishTime=1416386331979,finalStatus=FAILED 2014-11-19 02:38:52,775 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1416359131664_0003_000001 is done. finalState=FINISHED On Sun, Nov 23, 2014 at 8:34 AM, D Adams <dadamszx@gmail.com> wrote: > Sorry, in the previous email, I meant to say: when I run with only > -yj giraph-examples-1.1.0-hadoop-2.5.1-jar-with-dependencies.jar > the container log complains that it did not contain giraph-core and those > were the resulting errors. > > > > On Sun, Nov 23, 2014 at 9:28 AM, D Adams <dadamszx@gmail.com> wrote: > Well, maybe my giraph build did not build correctly because when I run 2014-11-19 02:04:21,764 INFO [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:main(421)) - Starting GitaphAM 2014-11-19 02:04:23,137 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-11-19 02:04:25,548 INFO [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:<init>(168)) - GiraphAM for ContainerId container_1416359131664_0002_01_000001 ApplicationAttemptId appattempt_1416359131664_0002_000001 2014-11-19 02:04:25,890 INFO [main] client.RMProxy (RMProxy.java:createRMProxy(92)) - Connecting to ResourceManager at localhost/127.0.0.1:8030 2014-11-19 02:04:25,924 INFO [main] impl.NMClientAsyncImpl (NMClientAsyncImpl.java:serviceInit(107)) - Upper bound of the thread pool size is 500 2014-11-19 02:04:25,925 INFO [main] impl.ContainerManagementProtocolProxy (ContainerManagementProtocolProxy.java:<init>(78)) - yarn.client.max-nodemanagers-proxies : 500 2014-11-19 02:04:26,309 INFO [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:setupContainerAskForRM(279)) - Requested container ask: Capability[<memory:3000, vCores:0>]Priority[10] 2014-11-19 02:04:26,577 INFO [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:setupContainerAskForRM(279)) - Requested container ask: Capability[<memory:3000, vCores:0>]Priority[10] 2014-11-19 02:04:26,577 INFO [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:run(185)) - Wait to finish .. 2014-11-19 02:04:28,612 INFO [AMRM Heartbeater thread] impl.AMRMClientImpl (AMRMClientImpl.java:populateNMTokens(299)) - Received new token for : roosevelt:58195 2014-11-19 02:04:28,614 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersAllocated(605)) - Got response from RM for container ask, allocatedCnt=1 2014-11-19 02:04:28,614 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersAllocated(608)) - Total allocated # of container so far : 1 allocated out of 2 required. 2014-11-19 02:04:28,614 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:startContainerLaunchingThreads(359)) - Launching command on a new container., containerId=container_1416359131664_0002_01_000002, containerNode=roosevelt:58195, containerNodeURI=roosevelt:8042, containerResourceMemory=3072 2014-11-19 02:04:28,615 INFO [pool-4-thread-1] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(492)) - Setting up container launch container for containerid=container_1416359131664_0002_01_000002 2014-11-19 02:04:28,629 INFO [pool-4-thread-1] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(498)) - Conatain launch Commands :java -Xmx3000M -Xms3000M -cp .:${CLASSPATH} org.apache.giraph.yarn.GiraphYarnTask 1416359131664 2 2 1 1><LOG_DIR>/task-2-stdout.log 2><LOG_DIR>/task-2-stderr.log 2014-11-19 02:04:28,630 INFO [pool-4-thread-1] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(518)) - Setting username in ContainerLaunchContext to: hduser 2014-11-19 02:04:29,149 INFO [pool-4-thread-1] yarn.YarnUtils (YarnUtils.java:addFsResourcesToMap(72)) - Adding giraph-examples-1.1.0-hadoop-2.5.1-jar-with-dependencies.jar to LocalResources for export.to hdfs://localhost:9000/user/hduser/giraph_yarn_jar_cache/application_1416359131664_0002/giraph-examples-1.1.0-hadoop-2.5.1-jar-with-dependencies.jar 2014-11-19 02:04:29,188 INFO [pool-4-thread-1] yarn.YarnUtils (YarnUtils.java:addFileToResourceMap(160)) - Registered file in LocalResources :: hdfs://localhost:9000/user/hduser/giraph_yarn_jar_cache/application_1416359131664_0002/giraph-examples-1.1.0-hadoop-2.5.1-jar-with-dependencies.jar*2014-11-19 02:04:29,188 WARN [pool-4-thread-1] yarn.YarnUtils (YarnUtils.java:addFsResourcesToMap(81)) - Job jars (-yj option) didn't include giraph-core.* 2014-11-19 02:04:29,189 INFO [pool-4-thread-1] yarn.YarnUtils (YarnUtils.java:addFileToResourceMap(160)) - Registered file in LocalResources :: hdfs://localhost:9000/user/hduser/giraph_yarn_jar_cache/application_1416359131664_0002/giraph-conf.xml 2014-11-19 02:04:29,201 INFO [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] impl.NMClientAsyncImpl (NMClientAsyncImpl.java:run(531)) - Processing Event EventType: START_CONTAINER for Container container_1416359131664_0002_01_000002 2014-11-19 02:04:29,202 INFO [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] impl.ContainerManagementProtocolProxy (ContainerManagementProtocolProxy.java:newProxy(212)) - Opening proxy : roosevelt:58195 2014-11-19 02:04:29,257 INFO [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #1] impl.NMClientAsyncImpl (NMClientAsyncImpl.java:run(531)) - Processing Event EventType: QUERY_CONTAINER for Container container_1416359131664_0002_01_000002 2014-11-19 02:04:29,618 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersAllocated(605)) - Got response from RM for container ask, allocatedCnt=1 2014-11-19 02:04:29,618 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersAllocated(608)) - Total allocated # of container so far : 2 allocated out of 2 required. 2014-11-19 02:04:29,618 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:startContainerLaunchingThreads(359)) - Launching command on a new container., containerId=container_1416359131664_0002_01_000003, containerNode=roosevelt:58195, containerNodeURI=roosevelt:8042, containerResourceMemory=3072 2014-11-19 02:04:29,619 INFO [pool-4-thread-2] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(492)) - Setting up container launch container for containerid=container_1416359131664_0002_01_000003 2014-11-19 02:04:29,619 INFO [pool-4-thread-2] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(498)) - Conatain launch Commands :java -Xmx3000M -Xms3000M -cp .:${CLASSPATH} org.apache.giraph.yarn.GiraphYarnTask 1416359131664 2 3 1 1><LOG_DIR>/task-3-stdout.log 2><LOG_DIR>/task-3-stderr.log 2014-11-19 02:04:29,619 INFO [pool-4-thread-2] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:buildContainerLaunchContext(518)) - Setting username in ContainerLaunchContext to: hduser 2014-11-19 02:04:29,620 INFO [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #2] impl.NMClientAsyncImpl (NMClientAsyncImpl.java:run(531)) - Processing Event EventType: START_CONTAINER for Container container_1416359131664_0002_01_000003 2014-11-19 02:04:29,623 INFO [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #3] impl.NMClientAsyncImpl (NMClientAsyncImpl.java:run(531)) - Processing Event EventType: QUERY_CONTAINER for Container container_1416359131664_0002_01_000003 2014-11-19 02:04:30,620 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersCompleted(571)) - Got response from RM for container ask, completedCnt=2 2014-11-19 02:04:30,620 INFO [AMRM Callback Handler Thread] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onContainersCompleted(574)) - Got container status for containerID=container_1416359131664_0002_01_000002, state=COMPLETE, exitStatus=1, diagnostics=Exception from container-launch: ExitCodeException exitCode=1: ExitCodeException exitCode=1:
  6. 0

    Error launching spark application from Windows to Linux YARN Cluster - Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher

    spark-user | 2 years ago | dxrodri
    org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=spark OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1411473500741_0002 failed 2 times due to AM Container for appattempt_1411473500741_0002_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException:

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger

      USER=aditghosh OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1468349436383_0001 failed 2 times due to AM Container for appattempt_1468349436383_0001_000002 exited with exitCode: 127 For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1468349436383_0001Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1468349436383_0001_02_000001 Exit code: 127 Stack trace: ExitCodeException exitCode=127:

      at org.apache.hadoop.util.Shell.runCommand()
    2. Hadoop
      Shell$ShellCommandExecutor.execute
      1. org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
      2. org.apache.hadoop.util.Shell.run(Shell.java:456)
      3. org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
      3 frames
    3. hadoop-yarn-server-nodemanager
      ContainerLaunch.call
      1. org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
      2. org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
      3. org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
      3 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      2. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      4. java.lang.Thread.run(Thread.java:745)
      4 frames