java.lang.IllegalStateException: Unknown instance terminated: i-cdcef210

Jenkins JIRA | jude vais | 3 months ago
  1. 0

    Scenario: I've created a fleet under clouds in jenkins config, and selected my spot request. test returns an error, which may or may not be related. the ids i've redacted all match the ids i see in the ec2 management console. The SpotFleetRequestId(s) sfr-<stuff> do not exist. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidSpotFleetRequestId.NotFound; Request ID: <other stuff> ) to test the plugin, i set it up with a max cluster size of 3, scaledown timeout of 15 minutes. the spot request capacity defaults to 1. expected: when the test job runs, two additional slaves are created, backed by new spot instances. everything runs fine until the job is done and the scaledown timeout hits, at which point the slaves are not removed. one or more may show disconnected, and the log begins to show errors: SEVERE: I/O error in channel i-cdcef210 java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:50) Caused by: java.io.EOFException at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2332) at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2801) at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801) at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299) at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48) SEVERE: Timer task hudson.slaves.ComputerRetentionWork@5654d212 failed java.lang.IllegalStateException: Unknown instance terminated: i-cdcef210 at com.amazon.jenkins.ec2fleet.EC2FleetCloud.terminateInstance(EC2FleetCloud.java:266) at com.amazon.jenkins.ec2fleet.IdleRetentionStrategy.check(IdleRetentionStrategy.java:28) at com.amazon.jenkins.ec2fleet.IdleRetentionStrategy.check(IdleRetentionStrategy.java:12) at hudson.slaves.ComputerRetentionWork$1.run(ComputerRetentionWork.java:72) at hudson.model.Queue._withLock(Queue.java:1315) at hudson.model.Queue.withLock(Queue.java:1192) at hudson.slaves.ComputerRetentionWork.doRun(ComputerRetentionWork.java:63) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) the second of those errors repeats until the slave is manually removed (which sometimes results in a jenkins stack trace in the UI with the same error), at which point the rest of the process is unblocked. the spot instances are terminated and the slaves are removed. the plugin is essentially nonfunctional in this state

    Jenkins JIRA | 3 months ago | jude vais
    java.lang.IllegalStateException: Unknown instance terminated: i-cdcef210
  2. 0

    [JIRA] (JENKINS-38115) spot instance slaves are not removed, blocks instance termination

    Google Groups | 3 months ago | jv...@soasta.com (JIRA)
    java.lang.IllegalStateException: Unknown instance terminated: i-cdcef210
  3. 0

    [JIRA] (JENKINS-36242) Conflicts with ec2-plugin when there are dead spot fleet instances still registered

    Google Groups | 5 months ago | jdra...@nationaltheatre.org.uk (JIRA)
    java.lang.IllegalStateException: Unknown instance terminated: i-1fa5d993
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Ugly stacktrace when provisioner fails to create node

    GitHub | 2 years ago | pveentjer
    java.lang.IllegalStateException: node(us-east-1/i-9046f37b) terminated
  6. 0

    Proguard and Netty 5 on Android

    Stack Overflow | 2 years ago | Aesen Vismea
    java.lang.IllegalStateException: unknown type parameter 'I': class io.netty.channel.SimpleChannelInboundHandler

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Unknown instance terminated: i-cdcef210

      at com.amazon.jenkins.ec2fleet.EC2FleetCloud.terminateInstance()
    2. com.amazon.jenkins
      IdleRetentionStrategy.check
      1. com.amazon.jenkins.ec2fleet.EC2FleetCloud.terminateInstance(EC2FleetCloud.java:266)
      2. com.amazon.jenkins.ec2fleet.IdleRetentionStrategy.check(IdleRetentionStrategy.java:28)
      3. com.amazon.jenkins.ec2fleet.IdleRetentionStrategy.check(IdleRetentionStrategy.java:12)
      3 frames
    3. Hudson
      SafeTimerTask.run
      1. hudson.slaves.ComputerRetentionWork$1.run(ComputerRetentionWork.java:72)
      2. hudson.model.Queue._withLock(Queue.java:1315)
      3. hudson.model.Queue.withLock(Queue.java:1192)
      4. hudson.slaves.ComputerRetentionWork.doRun(ComputerRetentionWork.java:63)
      5. hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50)
      5 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      2. java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
      3. java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
      4. java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      5. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      6. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      7. java.lang.Thread.run(Thread.java:745)
      7 frames