org.apache.kafka.streams.errors.StreamsException: Failed to rebalance

Google Groups | Thijs Cadier | 4 months ago
  1. 0

    org.apache.kafka.streams.errors.StreamsException: Failed to rebalance

    Google Groups | 4 months ago | Thijs Cadier
    org.apache.kafka.streams.errors.StreamsException: Failed to rebalance
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  3. 0

    This one seems to be rather tricky. After upgrade to 1.587, I saw this exception during the the run of the sonar plugin in a post step: {code} 20:19:33 Warte bis Jenkins die Datensammlung abgeschlossen hat 20:19:33 [ERROR] Internal error: java.lang.IllegalStateException: cannot change build result while in COMPLETED -> [Help 1] 20:19:33 org.apache.maven.InternalErrorException: Internal error: java.lang.IllegalStateException: cannot change build result while in COMPLETED 20:19:33 at org.apache.maven.lifecycle.internal.BuilderCommon.handleBuildError(BuilderCommon.java:128) 20:19:33 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:95) 20:19:33 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) 20:19:33 at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) 20:19:33 at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) 20:19:33 at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) 20:19:33 at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) 20:19:33 at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:117) 20:19:33 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 20:19:33 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 20:19:33 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 20:19:33 at java.lang.reflect.Method.invoke(Method.java:597) 20:19:33 at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) 20:19:33 at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) 20:19:33 at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:178) 20:19:33 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 20:19:33 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 20:19:33 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 20:19:33 at java.lang.reflect.Method.invoke(Method.java:597) 20:19:33 at hudson.maven.Maven3Builder.call(Maven3Builder.java:136) 20:19:33 at hudson.maven.Maven3Builder.call(Maven3Builder.java:71) 20:19:33 at hudson.remoting.UserRequest.perform(UserRequest.java:121) 20:19:33 at hudson.remoting.UserRequest.perform(UserRequest.java:49) 20:19:33 at hudson.remoting.Request$2.run(Request.java:324) 20:19:33 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) 20:19:33 at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) 20:19:33 at java.util.concurrent.FutureTask.run(FutureTask.java:138) 20:19:33 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) 20:19:33 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) 20:19:33 at java.lang.Thread.run(Thread.java:662) 20:19:33 Caused by: java.lang.IllegalStateException: cannot change build result while in COMPLETED 20:19:33 at hudson.model.Run.setResult(Run.java:458) 20:19:33 at hudson.maven.MavenBuild$ProxyImpl.setResult(MavenBuild.java:494) 20:19:33 at hudson.maven.MavenBuild$ProxyImpl2.setResult(MavenBuild.java:547) 20:19:33 at sun.reflect.GeneratedMethodAccessor318.invoke(Unknown Source) 20:19:33 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 20:19:33 at java.lang.reflect.Method.invoke(Method.java:483) 20:19:33 at hudson.model.Executor$1.call(Executor.java:579) 20:19:33 at hudson.util.InterceptingProxy$1.invoke(InterceptingProxy.java:23) 20:19:33 at com.sun.proxy.$Proxy91.setResult(Unknown Source) 20:19:33 at sun.reflect.GeneratedMethodAccessor318.invoke(Unknown Source) 20:19:33 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 20:19:33 at java.lang.reflect.Method.invoke(Method.java:483) 20:19:33 at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:320) 20:19:33 at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:295) 20:19:33 at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:254) 20:19:33 at hudson.remoting.UserRequest.perform(UserRequest.java:121) 20:19:33 at hudson.remoting.UserRequest.perform(UserRequest.java:49) 20:19:33 at hudson.remoting.Request$2.run(Request.java:324) 20:19:33 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) 20:19:33 at org.jenkinsci.remoting.CallableDecorator.call(CallableDecorator.java:18) 20:19:33 at hudson.remoting.CallableDecoratorList$1.call(CallableDecoratorList.java:21) 20:19:33 at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) 20:19:33 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 20:19:33 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 20:19:33 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 20:19:33 at java.lang.Thread.run(Thread.java:745) 20:19:33 at ......remote call to channel(Native Method) 20:19:33 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356) 20:19:33 at hudson.remoting.UserResponse.retrieve(UserRequest.java:221) 20:19:33 at hudson.remoting.Channel.call(Channel.java:752) 20:19:33 at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:173) 20:19:33 at com.sun.proxy.$Proxy7.setResult(Unknown Source) 20:19:33 at hudson.maven.MavenBuildProxy$Filter.setResult(MavenBuildProxy.java:235) 20:19:33 at hudson.maven.Maven3Builder$MavenExecutionListener.recordProjectEnded(Maven3Builder.java:554) 20:19:33 at hudson.maven.Maven3Builder$MavenExecutionListener.projectSucceeded(Maven3Builder.java:538) 20:19:33 at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:74) 20:19:33 at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42) 20:19:33 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:91) 20:19:33 ... 28 more {code} A also found mentions of similar behaviour here: https://groups.google.com/forum/#!topic/jenkinsci-users/jrkAQyq6jLs Downgrading to 1.583 did work for me. Somehow, the State of the run seems to be changed to COMPLETED before the actual build is finished. I think the reason for this to show up only now lies here: https://github.com/jenkinsci/jenkins/commit/28dfd90d2d6ae99c57eb174871c46f4e07e303ba#diff-c4f9931d88bca347279b881007d71f0eL445 Earlier, since asserts are disabled by default, it never presented a problem until this change.

    Jenkins JIRA | 2 years ago | Stephan Pauxberger
    org.apache.maven.InternalErrorException: Internal error: java.lang.IllegalStateException: cannot change build result while in COMPLETED

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Log end offset should not change while restoring

      at org.apache.kafka.streams.processor.internals.ProcessorStateManager.restoreActiveState()
    2. org.apache.kafka
      ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete
      1. org.apache.kafka.streams.processor.internals.ProcessorStateManager.restoreActiveState(ProcessorStateManager.java:257)
      2. org.apache.kafka.streams.processor.internals.ProcessorStateManager.register(ProcessorStateManager.java:212)
      3. org.apache.kafka.streams.processor.internals.ProcessorContextImpl.register(ProcessorContextImpl.java:116)
      4. org.apache.kafka.streams.state.internals.RocksDBWindowStore.init(RocksDBWindowStore.java:184)
      5. org.apache.kafka.streams.state.internals.MeteredWindowStore.init(MeteredWindowStore.java:66)
      6. org.apache.kafka.streams.processor.internals.AbstractTask.initializeStateStores(AbstractTask.java:81)
      7. org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:115)
      8. org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
      9. org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
      10. org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
      11. org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
      12. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:234)
      13. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$2.onSuccess(AbstractCoordinator.java:255)
      14. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$2.onSuccess(AbstractCoordinator.java:250)
      15. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      16. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      17. org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
      18. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      19. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      20. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:459)
      21. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:445)
      22. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:702)
      23. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:681)
      24. org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
      25. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      26. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      27. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
      27 frames
    3. Apache Kafka
      NetworkClient.poll
      1. org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
      1 frame
    4. org.apache.kafka
      ConsumerCoordinator.ensurePartitionAssignment
      1. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
      2. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
      3. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
      4. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
      5. org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:266)
      6. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:366)
      6 frames
    5. Apache Kafka
      KafkaConsumer.poll
      1. org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:975)
      2. org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
      2 frames
    6. org.apache.kafka
      StreamThread.run
      1. org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
      2. org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
      2 frames