org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146

Pentaho BI Platform Tracking | Ihar Chekan | 3 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    If Spoon is run on windows 'Start a YARN Kettle Cluster' step doesn't work. It seems, that /opt/pentaho/mapreduce/kettle-yarn.jar path is hard-coded. 'PDI Client Archive' setting of the 'Start a YARN Kettle Cluster' step does not help. Stacktrace: 2014/07/24 19:18:48 - YARN-Kettle-test - Starting entry [Start a YARN Kettle Cluster] 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ${JAVA_HOME}/bin/java org.pentaho.hadoop.yarn.kettle.KettleClusterApplicationMaster 3 55555 512 1 bpass \"Encrypted 2be98afc86aa7f2e4cb79ce72ce93bcc9\" \"aaaa\" 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - PDI CE archive already exists at hdfs://10.6.11.22:8020/opt/pentaho/mapreduce/pdi-client-STAGED-ARCHIVE.zip Not staging a new version. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Staging a new application master jar to /opt/pentaho/mapreduce/kettle-yarn.jar This will overwrite the existing one if it exists. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Submitting application application_1406210744622_0006 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : Unable to start cluster of Carte instances on Yarn 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:714) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:856) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:530) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.run(Job.java:422) 2014/07/24 19:18:52 - YARN-Kettle-test - Finished job entry [Start a YARN Kettle Cluster] (result=[false])

    Pentaho BI Platform Tracking | 3 years ago | Ihar Chekan
    org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146
  2. 0

    If Spoon is run on windows 'Start a YARN Kettle Cluster' step doesn't work. It seems, that /opt/pentaho/mapreduce/kettle-yarn.jar path is hard-coded. 'PDI Client Archive' setting of the 'Start a YARN Kettle Cluster' step does not help. Stacktrace: 2014/07/24 19:18:48 - YARN-Kettle-test - Starting entry [Start a YARN Kettle Cluster] 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ${JAVA_HOME}/bin/java org.pentaho.hadoop.yarn.kettle.KettleClusterApplicationMaster 3 55555 512 1 bpass \"Encrypted 2be98afc86aa7f2e4cb79ce72ce93bcc9\" \"aaaa\" 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - PDI CE archive already exists at hdfs://10.6.11.22:8020/opt/pentaho/mapreduce/pdi-client-STAGED-ARCHIVE.zip Not staging a new version. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Staging a new application master jar to /opt/pentaho/mapreduce/kettle-yarn.jar This will overwrite the existing one if it exists. 2014/07/24 19:18:48 - [YARN-Kettle-test].Start a YARN Kettle Cluster - Submitting application application_1406210744622_0006 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : Unable to start cluster of Carte instances on Yarn 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - ERROR (version 5.1-NIGHTLY, build 1 from 2014-07-19_04-20-28 by buildguy) : org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:714) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:856) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.execute(Job.java:530) 2014/07/24 19:18:52 - [YARN-Kettle-test].Start a YARN Kettle Cluster - at org.pentaho.di.job.Job.run(Job.java:422) 2014/07/24 19:18:52 - YARN-Kettle-test - Finished job entry [Start a YARN Kettle Cluster] (result=[false])

    Pentaho BI Platform Tracking | 3 years ago | Ihar Chekan
    org.apache.hadoop.yarn.exceptions.YarnException: Application kettle-cluster is FAILED at 1406218732146

    Root Cause Analysis

    1. org.apache.hadoop.yarn.exceptions.YarnException

      Application kettle-cluster is FAILED at 1406218732146

      at org.pentaho.hadoop.yarn.kettle.c.b()
    2. org.pentaho.hadoop
      c.b
      1. org.pentaho.hadoop.yarn.kettle.c.b(SourceFile:243)
      1 frame
    3. org.pentaho.di
      Job.run
      1. org.pentaho.di.job.entries.startyarncluster.StartYarnCluster.execute(SourceFile:298)
      2. org.pentaho.di.job.Job.execute(Job.java:714)
      3. org.pentaho.di.job.Job.execute(Job.java:856)
      4. org.pentaho.di.job.Job.execute(Job.java:530)
      5. org.pentaho.di.job.Job.run(Job.java:422)
      5 frames