hudson.AbortException: Failed to run slave container JenkinsSlavesECS-16e94238750e85

Jenkins JIRA | Luis Silva | 5 months ago
  1. 0

    With the latest plugin version (1.4) my tasks fail to run on the ecs slaves. They sit waiting for executors forever. I made sure I had two servers with plenty of resources connected to ECS. It looks like the task is assigned to a node but then immediately disconnects. After downgrading to version 1.3 it all started working perfectly again. I tested it with the same number of servers, same tasks, same jenkins versions, etc. See the logs below for both versions. Version 1.4 failures: {quote} Jul 06, 2016 8:37:33 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources INFO: Instance arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/ceb4eece-2abe-4f19-aad3-8d3cbd18a7ee has 3,767mb of free memory. 3,000mb are required Jul 06, 2016 8:37:33 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources INFO: Instance arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/ceb4eece-2abe-4f19-aad3-8d3cbd18a7ee has 1,024 units of free cpu. 512 units are required Jul 06, 2016 8:37:33 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: Created Slave: JenkinsSlavesECS-16e94238750e85 Jul 06, 2016 8:37:33 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService runEcsTask WARNING: Slave JenkinsSlavesECS-16e94238750e85 - Failure to run task with definition arn:aws:ecs:eu-west-1:AWS_ACC:task-definition/jenkins-slave:78 on ECS cluster arn:aws:ecs:eu-west-1:AWS_ACC:cluster/JenkinsSlaves Jul 06, 2016 8:37:33 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService runEcsTask WARNING: Slave JenkinsSlavesECS-16e94238750e85 - Failure reason=RESOURCE:MEMORY, arn=arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/e949c164-1e0c-4e9c-85c3-36b035b5b601 Jul 06, 2016 8:37:43 AM hudson.slaves.NodeProvisioner$2 run WARNING: Provisioned agent ECS Slave BackendTests failed to launch java.lang.IllegalStateException: ECS Slave JenkinsSlavesECS-16e9422efc9bc3 (ecs task arn:aws:ecs:eu-west-1:AWS_ACC:task/b6621ca4-b397-46ad-9659-9c6fe1633b32) not connected since 7/6/16 8:37 AM seconds at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:278) at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:219) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Jul 06, 2016 8:37:43 AM hudson.slaves.NodeProvisioner$2 run WARNING: Provisioned agent ECS Slave BackendTests failed to launch hudson.AbortException: Failed to run slave container JenkinsSlavesECS-16e94238750e85 at com.cloudbees.jenkins.plugins.amazonecs.ECSService.runEcsTask(ECSService.java:157) at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:250) at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:219) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Jul 06, 2016 8:37:43 AM hudson.slaves.NodeProvisioner$StandardStrategyImpl apply INFO: Started provisioning ECS Slave BackendTests from JenkinsSlavesECS with 1 executors. Remaining excess workload: 0.816 Jul 06, 2016 8:37:43 AM hudson.slaves.NodeProvisioner$StandardStrategyImpl apply INFO: Started provisioning ECS Slave BackendTests from JenkinsSlavesECS with 1 executors. Remaining excess workload: -0.184 Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources .......... Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources INFO: Resources found in instance arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/e949c164-1e0c-4e9c-85c3-36b035b5b601: [{Name: CPU,Type: INTEGER,DoubleValue: 0.0,LongValue: 0,IntegerValue: 1024,StringSetValue: []}, {Name: MEMORY,Type: INTEGER,DoubleValue: 0.0,LongValue: 0,IntegerValue: 3767,StringSetValue: []}, {Name: PORTS,Type: STRINGSET,DoubleValue: 0.0,LongValue: 0,IntegerValue: 0,StringSetValue: [22, 2376, 2375, 51678]}, {Name: PORTS_UDP,Type: STRINGSET,DoubleValue: 0.0,LongValue: 0,IntegerValue: 0,StringSetValue: []}] Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources INFO: Instance arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/e949c164-1e0c-4e9c-85c3-36b035b5b601 has 3,767mb of free memory. 3,000mb are required Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSService waitForSufficientClusterResources INFO: Instance arn:aws:ecs:eu-west-1:AWS_ACC:container-instance/e949c164-1e0c-4e9c-85c3-36b035b5b601 has 1,024 units of free cpu. 512 units are required Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: Created Slave: JenkinsSlavesECS-16e9448c0da1df Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: Slave JenkinsSlavesECS-16e9448c0da1df - Slave Task Started : arn:aws:ecs:eu-west-1:AWS_ACC:task/d8ad05da-902d-4c10-8b58-c55f612bb0da Jul 06, 2016 8:37:43 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call WARNING: ECS Slave JenkinsSlavesECS-16e9448c0da1df (ecs task arn:aws:ecs:eu-west-1:AWS_ACC:task/d8ad05da-902d-4c10-8b58-c55f612bb0da) not connected since 7/6/16 8:37 AM seconds Jul 06, 2016 8:37:43 AM jenkins.model.Jenkins$21 onAttained INFO: Started termination Jul 06, 2016 8:37:43 AM jenkins.model.Jenkins$21 onAttained INFO: Completed termination Jul 06, 2016 8:37:43 AM jenkins.model.Jenkins _cleanUpDisconnectComputers INFO: Starting node disconnection {quote} After downgrade to version 1.3, working well: {quote} Jul 06, 2016 8:40:06 AM hudson.slaves.NodeProvisioner$StandardStrategyImpl apply INFO: Started provisioning ECS Slave BackendTests from JenkinsSlavesECS with 1 executors. Remaining excess workload: 0.303 Jul 06, 2016 8:40:06 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: Created Slave: JenkinsSlavesECS-16e965bf8c0ffe Jul 06, 2016 8:40:07 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: Slave JenkinsSlavesECS-16e965bf8c0ffe - Slave Task Started : arn:aws:ecs:eu-west-1:AWS_ACC:task/efa27aa4-599c-4da8-89fb-a8e21740882c Jul 06, 2016 8:40:11 AM hudson.TcpSlaveAgentListener$ConnectionHandler run INFO: Accepted connection #1 from /XX.XX.XX.XX:YY Jul 06, 2016 8:40:15 AM com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback call INFO: ECS Slave JenkinsSlavesECS-16e965bf8c0ffe (ecs task arn:aws:ecs:eu-west-1:AWS_ACC:task/efa27aa4-599c-4da8-89fb-a8e21740882c) connected Jul 06, 2016 8:40:16 AM hudson.slaves.NodeProvisioner$2 run INFO: ECS Slave BackendTests provisioning successfully completed. We have now 3 computer(s) {quote}

    Jenkins JIRA | 5 months ago | Luis Silva
    hudson.AbortException: Failed to run slave container JenkinsSlavesECS-16e94238750e85
  2. 0

    [JIRA] (JENKINS-36468) Tasks fail to run on ECS after upgrade to 1.4

    Google Groups | 5 months ago | lu...@vvoosh.com (JIRA)
    hudson.AbortException: Failed to run slave container JenkinsSlavesECS-16e94238750e85
  3. 0

    My steps: Base CentOS 6.0 AMI. > Install Java 7 via RPM as root. > Save as custom AMI. > Use new custom AMI for Jenkins slaves > Set up EC2 plugin as reflected in the attachment image. > Run a build, and get the following errors: Building remotely on i-0326a672 in workspace workspace/FriendList Installing tools/hudson.model.JDK/java7/jdk.sh [java7] $ tar xvzf tools/hudson.model.JDK/java7/jdk.sh tar (child): tools/hudson.model.JDK/java7/jdk.sh: Cannot open: No such file or directory tar (child): Error is not recoverable: exiting now tar: Child returned status 2 tar: Error is not recoverable: exiting now ERROR: Failed to install JDK. Exit code=2 Archiving artifacts Installing tools/hudson.model.JDK/java7/jdk.sh [java7] $ tar xvzf tools/hudson.model.JDK/java7/jdk.sh tar (child): tools/hudson.model.JDK/java7/jdk.sh: Cannot open: No such file or directory tar (child): Error is not recoverable: exiting now tar: Child returned status 2 tar: Error is not recoverable: exiting now ERROR: Failed to archive artifacts: target/*.jar hudson.AbortException: Failed to install JDK. Exit code=2 at hudson.tools.JDKInstaller.install(JDKInstaller.java:189) at hudson.tools.JDKInstaller.performInstallation(JDKInstaller.java:132) at hudson.tools.InstallerTranslator.getToolHome(InstallerTranslator.java:61) at hudson.tools.ToolLocationNodeProperty.getToolHome(ToolLocationNodeProperty.java:107) at hudson.tools.ToolInstallation.translateFor(ToolInstallation.java:203) at hudson.model.JDK.forNode(JDK.java:122) at hudson.model.AbstractProject.getEnvironment(AbstractProject.java:311) at hudson.model.Run.getEnvironment(Run.java:1993) at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:936) at hudson.maven.AbstractMavenBuild.getEnvironment(AbstractMavenBuild.java:59) at hudson.maven.MavenModuleSetBuild.getEnvironment(MavenModuleSetBuild.java:154) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:115) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785) at hudson.maven.MavenModuleSetBuild$MavenModuleSetBuildExecution.post2(MavenModuleSetBuild.java:946) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732) at hudson.model.Run.execute(Run.java:1568) at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:477) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:236) Finished: FAILURE

    Jenkins JIRA | 4 years ago | First Last
    hudson.AbortException: Failed to install JDK. Exit code=2
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Problem with downloading html oracle sdk - instead of ask on credential occur again - now for java 8. Started by user anonymous Building in workspace /var/lib/jenkins/jobs/redmineplay/workspace Installing JDK jdk-8-oth-JPR Downloading JDK from http://download.oracle.com/otn-pub/java/jdk/8-b132/jdk-8-linux-x64.tar.gz Downloading 5307bytes Installing /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh [JDK] $ /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh -noregister /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 1: html: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 2: head: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 3: title: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 4: META: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 5: link: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 6: link: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 7: : command not found /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 8: body: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 9: div: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 10: table: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 11: tr: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 12: syntax error near unexpected token `<' /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 12: ` <td rowspan="2" valign="middle" nowrap><a href="http://www.oracle.com"><img src="/errors/us/assets/oralogo-small.gif" width="154" height="19" hspace="10" vspace="25" border="0" ></a></td> ' ERROR: Failed to install JDK. Exit code=2 Archiving artifacts Installing JDK jdk-8-oth-JPR Downloading JDK from http://download.oracle.com/otn-pub/java/jdk/8-b132/jdk-8-linux-x64.tar.gz Downloading 5307bytes Installing /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh [JDK] $ /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh -noregister /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 1: html: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 2: head: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 3: title: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 4: META: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 5: link: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 6: link: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 7: : command not found /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 8: body: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 9: div: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 10: table: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 11: tr: No such file or directory /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 12: syntax error near unexpected token `<' /var/lib/jenkins/tools/hudson.model.JDK/JDK/jdk.sh: line 12: ` <td rowspan="2" valign="middle" nowrap><a href="http://www.oracle.com"><img src="/errors/us/assets/oralogo-small.gif" width="154" height="19" hspace="10" vspace="25" border="0" ></a></td> ' ERROR: Failed to archive artifacts: smtpserver/target/*.tar.gz hudson.AbortException: Failed to install JDK. Exit code=2 at hudson.tools.JDKInstaller.install(JDKInstaller.java:189) at hudson.tools.JDKInstaller.performInstallation(JDKInstaller.java:132) at hudson.tools.InstallerTranslator.getToolHome(InstallerTranslator.java:61) at hudson.tools.ToolLocationNodeProperty.getToolHome(ToolLocationNodeProperty.java:107) at hudson.tools.ToolInstallation.translateFor(ToolInstallation.java:204) at hudson.model.JDK.forNode(JDK.java:126) at hudson.model.AbstractProject.getEnvironment(AbstractProject.java:352) at hudson.model.Run.getEnvironment(Run.java:2196) at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:871) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:136) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:742) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:714) at hudson.model.Build$BuildExecution.post2(Build.java:183) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:663) at hudson.model.Run.execute(Run.java:1713) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:231) Finished: FAILURE

    Jenkins JIRA | 3 years ago | Andrzej Jóźwik
    hudson.AbortException: Failed to install JDK. Exit code=2
  6. 0

    [JIRA] (JENKINS-17366) ssh slave login via keyfile not working in 0.23

    Google Groups | 3 months ago | vasu...@yahoo.com (JIRA)
    hudson.AbortException: Authentication failed.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. hudson.AbortException

      Failed to run slave container JenkinsSlavesECS-16e94238750e85

      at com.cloudbees.jenkins.plugins.amazonecs.ECSService.runEcsTask()
    2. com.cloudbees.jenkins
      ECSCloud$ProvisioningCallback.call
      1. com.cloudbees.jenkins.plugins.amazonecs.ECSService.runEcsTask(ECSService.java:157)
      2. com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:250)
      3. com.cloudbees.jenkins.plugins.amazonecs.ECSCloud$ProvisioningCallback.call(ECSCloud.java:219)
      3 frames
    3. jenkins.util
      ContextResettingExecutorService$2.call
      1. jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      1 frame
    4. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:262)
      2. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      4. java.lang.Thread.run(Thread.java:745)
      4 frames