org.apache.kafka.streams.errors.StreamsException: Failed to rebalance

Google Groups | Thijs Cadier | 8 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    org.apache.kafka.streams.errors.StreamsException: Failed to rebalance

    Google Groups | 8 months ago | Thijs Cadier
    org.apache.kafka.streams.errors.StreamsException: Failed to rebalance

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Log end offset should not change while restoring

      at org.apache.kafka.streams.processor.internals.ProcessorStateManager.restoreActiveState()
    2. org.apache.kafka
      ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete
      1. org.apache.kafka.streams.processor.internals.ProcessorStateManager.restoreActiveState(ProcessorStateManager.java:257)
      2. org.apache.kafka.streams.processor.internals.ProcessorStateManager.register(ProcessorStateManager.java:212)
      3. org.apache.kafka.streams.processor.internals.ProcessorContextImpl.register(ProcessorContextImpl.java:116)
      4. org.apache.kafka.streams.state.internals.RocksDBWindowStore.init(RocksDBWindowStore.java:184)
      5. org.apache.kafka.streams.state.internals.MeteredWindowStore.init(MeteredWindowStore.java:66)
      6. org.apache.kafka.streams.processor.internals.AbstractTask.initializeStateStores(AbstractTask.java:81)
      7. org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:115)
      8. org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
      9. org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
      10. org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
      11. org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
      12. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:234)
      13. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$2.onSuccess(AbstractCoordinator.java:255)
      14. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$2.onSuccess(AbstractCoordinator.java:250)
      15. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      16. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      17. org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
      18. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      19. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      20. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:459)
      21. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:445)
      22. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:702)
      23. org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:681)
      24. org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
      25. org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
      26. org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
      27. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
      27 frames
    3. Apache Kafka
      NetworkClient.poll
      1. org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
      1 frame
    4. org.apache.kafka
      ConsumerCoordinator.ensurePartitionAssignment
      1. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
      2. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
      3. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
      4. org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
      5. org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:266)
      6. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:366)
      6 frames
    5. Apache Kafka
      KafkaConsumer.poll
      1. org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:975)
      2. org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
      2 frames
    6. org.apache.kafka
      StreamThread.run
      1. org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
      2. org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
      2 frames