java.util.concurrent.CompletionException: java.util.concurrent.TimeoutException: Timedout waiting for reply

JIRA | Shimizu Sho | 3 months ago
  1. 0

    NettyMessagingManagerTest.testSendAndReceive() sometimes occurs time out. Here is a log when it occured. [https://jenkins.onosproject.org/job/onos-gerrit-buck/5014/console] {quote} 08:33:20 FAIL CACHED 1 Passed 0 Skipped 1 Failed org.onosproject.store.cluster.messaging.impl.NettyMessagingManagerTest 08:33:20 FAILURE org.onosproject.store.cluster.messaging.impl.NettyMessagingManagerTest testSendAndReceive: java.util.concurrent.TimeoutException: Timedout waiting for reply 08:33:20 java.util.concurrent.CompletionException: java.util.concurrent.TimeoutException: Timedout waiting for reply 08:33:20 at java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:326) 08:33:20 at java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:338) 08:33:20 at java.util.concurrent.CompletableFuture.uniRelay(CompletableFuture.java:911) 08:33:20 at java.util.concurrent.CompletableFuture$UniRelay.tryFire(CompletableFuture.java:899) 08:33:20 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) 08:33:20 at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$Callback.lambda$completeExceptionally$1(NettyMessagingManager.java:598) 08:33:20 at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$Callback.completeExceptionally(NettyMessagingManager.java:598) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$1.onRemoval(NettyMessagingManager.java:117) 08:33:20 at com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1960) 08:33:20 at com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3475) 08:33:20 at com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3451) 08:33:20 at com.google.common.cache.LocalCache$Segment.remove(LocalCache.java:3122) 08:33:20 at com.google.common.cache.LocalCache.remove(LocalCache.java:4188) 08:33:20 at com.google.common.cache.LocalCache$LocalManualCache.invalidate(LocalCache.java:4816) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager.dispatchLocally(NettyMessagingManager.java:556) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager.access$900(NettyMessagingManager.java:94) 08:33:20 at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$InboundMessageDispatcher.channelRead0(NettyMessagingManager.java:503) 08:33:20 at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:345) 08:33:20 at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293) 08:33:20 at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:267) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:345) 08:33:20 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) 08:33:20 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352) 08:33:20 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911) 08:33:20 at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131) 08:33:20 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:572) 08:33:20 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:513) 08:33:20 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:427) 08:33:20 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:399) 08:33:20 at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140) 08:33:20 at java.lang.Thread.run(Thread.java:745) 08:33:20 Caused by: java.util.concurrent.TimeoutException: Timedout waiting for reply 08:33:20 ... 30 more 08:33:20 {quote}

    JIRA | 3 months ago | Shimizu Sho
    java.util.concurrent.CompletionException: java.util.concurrent.TimeoutException: Timedout waiting for reply
  2. 0

    When init script fail to complete in time, slave is silently not provisioned. There is no indication in logs as well. Manual provisioning shows following: {noformat} javax.servlet.ServletException: java.lang.RuntimeException: org.jclouds.compute.RunNodesException: error running 1 node group(slave-name) location(LOCATION) image(ca365c26-dbda-40a1-9def-7deb0fb885b2) size(16) options({loginUser=root, loginPasswordPresent=true, loginPrivateKeyPresent=true, scriptPresent=true, userMetadata={Name=slave-name}, keyPairName=key-pair-name, userData=[B@2f6a014a, configDrive=false}) Execution failures: 0 error[s] Node failures: 1) RuntimeException on node LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b: java.lang.RuntimeException: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at shaded.com.google.common.base.Throwables.propagate(Throwables.java:160) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:63) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:77) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:125) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:146) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:53) at shaded.com.google.common.util.concurrent.Futures$1.apply(Futures.java:711) at shaded.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:849) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:196) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:60) ... 9 more Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task. at shaded.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:269) at shaded.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96) at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:194) ... 10 more 1 error[s] at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:778) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:858) at org.kohsuke.stapler.MetaClass$6.doDispatch(MetaClass.java:248) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:728) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:858) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:631) at org.kohsuke.stapler.Stapler.service(Stapler.java:225) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:686) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1494) at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:96) at hudson.plugins.greenballs.GreenBallFilter.doFilter(GreenBallFilter.java:58) at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:99) at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:88) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482) at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:48) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84) at hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:51) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at jenkins.security.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:117) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at org.acegisecurity.ui.basicauth.BasicProcessingFilter.doFilter(BasicProcessingFilter.java:174) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at jenkins.security.ApiTokenFilter.doFilter(ApiTokenFilter.java:74) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249) at hudson.security.HttpSessionContextIntegrationFilter2.doFilter(HttpSessionContextIntegrationFilter2.java:67) at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87) at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76) at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:164) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482) at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:46) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482) at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:81) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1474) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:499) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:533) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:428) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:960) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1021) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: org.jclouds.compute.RunNodesException: error running 1 node group(slave-name) location(LOCATION) image(ca365c26-dbda-40a1-9def-7deb0fb885b2) size(16) options({loginUser=root, loginPasswordPresent=true, loginPrivateKeyPresent=true, scriptPresent=true, userMetadata={Name=slave-name}, keyPairName=key-pair-name, userData=[B@2f6a014a, configDrive=false}) Execution failures: 0 error[s] Node failures: 1) RuntimeException on node LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b: java.lang.RuntimeException: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at shaded.com.google.common.base.Throwables.propagate(Throwables.java:160) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:63) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:77) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:125) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:146) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:53) at shaded.com.google.common.util.concurrent.Futures$1.apply(Futures.java:711) at shaded.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:849) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:196) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:60) ... 9 more Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task. at shaded.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:269) at shaded.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96) at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:194) ... 10 more 1 error[s] at shaded.com.google.common.base.Throwables.propagate(Throwables.java:160) at jenkins.plugins.jclouds.compute.JCloudsSlaveTemplate.destroyBadNodesAndPropagate(JCloudsSlaveTemplate.java:347) at jenkins.plugins.jclouds.compute.JCloudsSlaveTemplate.get(JCloudsSlaveTemplate.java:336) at jenkins.plugins.jclouds.compute.JCloudsSlaveTemplate.provisionSlave(JCloudsSlaveTemplate.java:191) at jenkins.plugins.jclouds.compute.JCloudsCloud.doProvision(JCloudsCloud.java:281) at sun.reflect.GeneratedMethodAccessor1963.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:298) at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:161) at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:96) at org.kohsuke.stapler.MetaClass$1.doDispatch(MetaClass.java:120) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:728) ... 66 more Caused by: org.jclouds.compute.RunNodesException: error running 1 node group(slave-name) location(LOCATION) image(ca365c26-dbda-40a1-9def-7deb0fb885b2) size(16) options({loginUser=root, loginPasswordPresent=true, loginPrivateKeyPresent=true, scriptPresent=true, userMetadata={Name=slave-name}, keyPairName=key-pair-name, userData=[B@2f6a014a, configDrive=false}) Execution failures: 0 error[s] Node failures: 1) RuntimeException on node LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b: java.lang.RuntimeException: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at shaded.com.google.common.base.Throwables.propagate(Throwables.java:160) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:63) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:77) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:125) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:146) at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.apply(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:53) at shaded.com.google.common.util.concurrent.Futures$1.apply(Futures.java:711) at shaded.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:849) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:196) at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.doCall(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:60) ... 9 more Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task. at shaded.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:269) at shaded.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96) at org.jclouds.compute.callables.BlockUntilInitScriptStatusIsZeroThenReturnOutput.get(BlockUntilInitScriptStatusIsZeroThenReturnOutput.java:194) ... 10 more 1 error[s] at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:227) at sun.reflect.GeneratedMethodAccessor210.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.google.inject.internal.DelegatingInvocationHandler.invoke(DelegatingInvocationHandler.java:40) at com.sun.proxy.$Proxy88.createNodesInGroup(Unknown Source) at jenkins.plugins.jclouds.compute.JCloudsSlaveTemplate.get(JCloudsSlaveTemplate.java:334) ... 77 more {noformat} Running init script can be essential to log in and therefore to see logs in {{/tmp/bootstrap/}}.

    Jenkins JIRA | 2 years ago | Oliver Gond┼ża
    java.lang.RuntimeException: org.jclouds.compute.callables.ScriptStillRunningException: time up waiting 600s for BlockUntilInitScriptStatusIsZeroThenReturnOutput{commandRunner=RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete{node=LOCATION/976594b1-5dbf-45ad-87c5-5a288d0a8f3b, name=bootstrap, runAsRoot=true}} to complete. call get() on this exception to get access to the task in progress
  3. 0

    OS X Support

    GitHub | 3 years ago | lanefeltis
    java.lang.RuntimeException: Unable to show stage
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Tests are randomly failing on Travis CI

    GitHub | 2 years ago | skiwi2
    java.lang.RuntimeException: Unable to show stage
  6. 0

    Test FX doesn't appear to correctly tear down. Causes hanging.

    GitHub | 2 years ago | purringpigeon
    java.util.concurrent.TimeoutException: Timeout waiting for task.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.util.concurrent.TimeoutException

      Timedout waiting for reply

      at org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$1.onRemoval()
    2. org.onosproject.store
      NettyMessagingManager$1.onRemoval
      1. org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$1.onRemoval(NettyMessagingManager.java:117)
      1 frame
    3. Guava
      LocalCache$LocalManualCache.invalidate
      1. com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1960)
      2. com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3475)
      3. com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3451)
      4. com.google.common.cache.LocalCache$Segment.remove(LocalCache.java:3122)
      5. com.google.common.cache.LocalCache.remove(LocalCache.java:4188)
      6. com.google.common.cache.LocalCache$LocalManualCache.invalidate(LocalCache.java:4816)
      6 frames
    4. org.onosproject.store
      NettyMessagingManager$InboundMessageDispatcher.channelRead0
      1. org.onosproject.store.cluster.messaging.impl.NettyMessagingManager.dispatchLocally(NettyMessagingManager.java:556)
      2. org.onosproject.store.cluster.messaging.impl.NettyMessagingManager.access$900(NettyMessagingManager.java:94)
      3. org.onosproject.store.cluster.messaging.impl.NettyMessagingManager$InboundMessageDispatcher.channelRead0(NettyMessagingManager.java:503)
      3 frames
    5. Netty
      SingleThreadEventExecutor$2.run
      1. io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
      2. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
      3. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352)
      4. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:345)
      5. io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293)
      6. io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:267)
      7. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
      8. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352)
      9. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:345)
      10. io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
      11. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
      12. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:352)
      13. io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
      14. io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
      15. io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:572)
      16. io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:513)
      17. io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:427)
      18. io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:399)
      19. io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140)
      19 frames
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame