org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146

Pentaho BI Platform Tracking | Ihar Chekan | 2 years ago
  1. 0

    If Spoon is run on windows 'Start a YARN Kettle Cluster' step doesn't work. It seems, that /opt/pentaho/mapreduce/kettle-yarn.jar path is hard-coded. 'PDI Client Archive' setting of the 'Start a YARN Kettle Cluster' step does not help. Stacktrace: 2014/07/24 19:18:48 - YARN-Kettle-test - Starting entry [Start a YARN Kettle Cluster] 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ${JAVA_HOME}/bin/java org.pentaho.hadoop.yarn.kettle.KettleClusterApplicationMaster 3 55555 512 1 bpass \"Encrypted 2be98afc86aa7f2e4cb79ce72ce93bcc9\" \"aaaa\" 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - PDI CE archive already exists at hdfs://10.6.11.22:8020/opt/pentaho/mapreduce/pdi-client-STAGED-ARCHIVE.zip Not staging a new version. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Staging a new application master jar to /opt/pentaho/mapreduce/kettle-yarn.jar This will overwrite the existing one if it exists. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Submitting application application_1406210744622_0006 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : Unable to start cluster of Carte instances on Yarn 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:714) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:856) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:530) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.run(Job.java:422) 2014/07/24 19:18:52 - YARN-Kettle-test - Finished job entry [Start a YARN Kettle Cluster] (result=[false])

    Pentaho BI Platform Tracking | 2 years ago | Ihar Chekan
    org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146
  2. 0

    If Spoon is run on windows 'Start a YARN Kettle Cluster' step doesn't work. It seems, that /opt/pentaho/mapreduce/kettle-yarn.jar path is hard-coded. 'PDI Client Archive' setting of the 'Start a YARN Kettle Cluster' step does not help. Stacktrace: 2014/07/24 19:18:48 - YARN-Kettle-test - Starting entry [Start a YARN Kettle Cluster] 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ${JAVA_HOME}/bin/java org.pentaho.hadoop.yarn.kettle.KettleClusterApplicationMaster 3 55555 512 1 bpass \"Encrypted 2be98afc86aa7f2e4cb79ce72ce93bcc9\" \"aaaa\" 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - PDI CE archive already exists at hdfs://10.6.11.22:8020/opt/pentaho/mapreduce/pdi-client-STAGED-ARCHIVE.zip Not staging a new version. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Staging a new application master jar to /opt/pentaho/mapreduce/kettle-yarn.jar This will overwrite the existing one if it exists. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Submitting application application_1406210744622_0006 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : Unable to start cluster of Carte instances on Yarn 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:714) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:856) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:530) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.run(Job.java:422) 2014/07/24 19:18:52 - YARN-Kettle-test - Finished job entry [Start a YARN Kettle Cluster] (result=[false])

    Pentaho BI Platform Tracking | 2 years ago | Ihar Chekan
    org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146
  3. 0

    Re: Tez job killed immediately

    incubator-tez-user | 3 years ago | Manu Zhang
    org.apache.hadoop.yarn.exceptions.YarnException: Container >> container_1374734563467_0003_01_000001 is not handled by this NodeManager at >> org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45) at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.authorizeGetAndStopContainerRequest(ContainerManagerImpl.java:614) at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.stopContainer(ContainerManagerImpl.java:538) at >> org.apache.hadoop.yarn.api.impl.pb.service.ContainerManagementProtocolPBServiceImpl.stopContainer(ContainerManagementProtocolPBServiceImpl.java:88) at >> org.apache.hadoop.yarn.proto.ContainerManagementProtocol$ContainerManagementProtocolService$2.callBlockingMethod(ContainerManagementProtocol.java:85) at >> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Re: Tez job killed immediately

    tez-user | 3 years ago | Manu Zhang
    org.apache.hadoop.yarn.exceptions.YarnException: Container >> container_1374734563467_0003_01_000001 is not handled by this NodeManager at >> org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45) at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.authorizeGetAndStopContainerRequest(ContainerManagerImpl.java:614) at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.stopContainer(ContainerManagerImpl.java:538) at >> org.apache.hadoop.yarn.api.impl.pb.service.ContainerManagementProtocolPBServiceImpl.stopContainer(ContainerManagementProtocolPBServiceImpl.java:88) at >> org.apache.hadoop.yarn.proto.ContainerManagementProtocol$ContainerManagementProtocolService$2.callBlockingMethod(ContainerManagementProtocol.java:85) at >> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507)
  6. 0

    Apache Spark User List - parallelize for a large Seq is extreamly slow.

    nabble.com | 1 year ago
    org.apache.hadoop.yarn.exceptions.YarnException: Application doesn't exist in cache appattempt_1398305021882_0069_000001

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.yarn.exceptions.YarnException

      Application kettle-cluster is FAILED at 1406218732146

      at org.pentaho.hadoop.yarn.kettle.c.b()
    2. org.pentaho.hadoop
      c.b
      1. org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243)
      1 frame
    3. org.pentaho.di
      Job.run
      1. org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298)
      2. org.pentaho.di.job.Job.execute(Job.java:714)
      3. org.pentaho.di.job.Job.execute(Job.java:856)
      4. org.pentaho.di.job.Job.execute(Job.java:530)
      5. org.pentaho.di.job.Job.run(Job.java:422)
      5 frames