org.springframework.integration.kafka.core.TopicNotFoundException: No topic named 'foo3.0' found

Spring JIRA | Glenn renfro | 2 years ago
  1. 0

    XD Version Spring XD 1.1.1.Release 1 Admin on own (on-metal) Rackspace machine 2 Containers each having own (on-metal) rackspace machine 1 zookeeper node collocated with admin While executing XD performance testing on Rackspace using Kafka as a transport we occasionally get the following exception: {noformat} 2015-03-26 18:36:30,677 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Path cache event: path=/deployments/modules/allocated/4c3c9ccf-44db-4772-87c2-70c63b82c3aa/foo3.sink.throughput.1, type=CHILD_ADDED 2015-03-26 18:36:30,685 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module 'throughput' for stream 'foo3' 2015-03-26 18:36:30,820 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module [ModuleDescriptor@19f0b0a6 moduleName = 'throughput', moduleLabel = 'throughput', group = 'foo3', sourceChannelName = [null], sinkChannelName = [null], index = 1, type = sink, parameters = map[[empty]], children = list[[empty]]] 2015-03-26 18:36:31,372 1.1.1.RELEASE ERROR DeploymentsPathChildrenCache-0 server.DeploymentListener - Exception deploying module org.springframework.integration.kafka.core.TopicNotFoundException: No topic named 'foo3.0' found at org.springframework.integration.kafka.core.DefaultConnectionFactory.getPartitions(DefaultConnectionFactory.java:209) at org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.createKafkaConsumer(KafkaMessageBus.java:640) at org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.bindConsumer(KafkaMessageBus.java:454) at org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindMessageConsumer(AbstractMessageBusBinderPlugin.java:275) at org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindConsumerAndProducers(AbstractMessageBusBinderPlugin.java:158) at org.springframework.xd.dirt.plugins.stream.StreamPlugin.postProcessModule(StreamPlugin.java:73) at org.springframework.xd.dirt.module.ModuleDeployer.postProcessModule(ModuleDeployer.java:238) at org.springframework.xd.dirt.module.ModuleDeployer.doDeploy(ModuleDeployer.java:218) at org.springframework.xd.dirt.module.ModuleDeployer.deploy(ModuleDeployer.java:200) at org.springframework.xd.dirt.server.DeploymentListener.deployModule(DeploymentListener.java:363) at org.springframework.xd.dirt.server.DeploymentListener.deployStreamModule(DeploymentListener.java:332) at org.springframework.xd.dirt.server.DeploymentListener.onChildAdded(DeploymentListener.java:179) at org.springframework.xd.dirt.server.DeploymentListener.childEvent(DeploymentListener.java:147) at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:509) at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:503) at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83) at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:500) at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) at org.apache.curator.framework.recipes.cache.PathChildrenCache$10.run(PathChildrenCache.java:762) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) {noformat} stream used to create the exception: stream create foo4 --definition "load-generator --messageSize=1000 --messageCount=10000000 | throughput" --deploy After failed deployment. I destroy the stream and recreate it and it works fine.

    Spring JIRA | 2 years ago | Glenn renfro
    org.springframework.integration.kafka.core.TopicNotFoundException: No topic named 'foo3.0' found
  2. 0

    XD Version Spring XD 1.1.1.Release 1 Admin on own (on-metal) Rackspace machine 2 Containers each having own (on-metal) rackspace machine 1 zookeeper node collocated with admin While executing XD performance testing on Rackspace using Kafka as a transport we occasionally get the following exception: {noformat} 2015-03-26 18:36:30,677 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Path cache event: path=/deployments/modules/allocated/4c3c9ccf-44db-4772-87c2-70c63b82c3aa/foo3.sink.throughput.1, type=CHILD_ADDED 2015-03-26 18:36:30,685 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module 'throughput' for stream 'foo3' 2015-03-26 18:36:30,820 1.1.1.RELEASE INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module [ModuleDescriptor@19f0b0a6 moduleName = 'throughput', moduleLabel = 'throughput', group = 'foo3', sourceChannelName = [null], sinkChannelName = [null], index = 1, type = sink, parameters = map[[empty]], children = list[[empty]]] 2015-03-26 18:36:31,372 1.1.1.RELEASE ERROR DeploymentsPathChildrenCache-0 server.DeploymentListener - Exception deploying module org.springframework.integration.kafka.core.TopicNotFoundException: No topic named 'foo3.0' found at org.springframework.integration.kafka.core.DefaultConnectionFactory.getPartitions(DefaultConnectionFactory.java:209) at org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.createKafkaConsumer(KafkaMessageBus.java:640) at org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.bindConsumer(KafkaMessageBus.java:454) at org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindMessageConsumer(AbstractMessageBusBinderPlugin.java:275) at org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindConsumerAndProducers(AbstractMessageBusBinderPlugin.java:158) at org.springframework.xd.dirt.plugins.stream.StreamPlugin.postProcessModule(StreamPlugin.java:73) at org.springframework.xd.dirt.module.ModuleDeployer.postProcessModule(ModuleDeployer.java:238) at org.springframework.xd.dirt.module.ModuleDeployer.doDeploy(ModuleDeployer.java:218) at org.springframework.xd.dirt.module.ModuleDeployer.deploy(ModuleDeployer.java:200) at org.springframework.xd.dirt.server.DeploymentListener.deployModule(DeploymentListener.java:363) at org.springframework.xd.dirt.server.DeploymentListener.deployStreamModule(DeploymentListener.java:332) at org.springframework.xd.dirt.server.DeploymentListener.onChildAdded(DeploymentListener.java:179) at org.springframework.xd.dirt.server.DeploymentListener.childEvent(DeploymentListener.java:147) at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:509) at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:503) at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83) at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:500) at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) at org.apache.curator.framework.recipes.cache.PathChildrenCache$10.run(PathChildrenCache.java:762) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) {noformat} stream used to create the exception: stream create foo4 --definition "load-generator --messageSize=1000 --messageCount=10000000 | throughput" --deploy After failed deployment. I destroy the stream and recreate it and it works fine.

    Spring JIRA | 2 years ago | Glenn renfro
    org.springframework.integration.kafka.core.TopicNotFoundException: No topic named 'foo3.0' found

Root Cause Analysis

  1. org.springframework.integration.kafka.core.TopicNotFoundException

    No topic named 'foo3.0' found

    at org.springframework.integration.kafka.core.DefaultConnectionFactory.getPartitions()
  2. org.springframework.integration
    DefaultConnectionFactory.getPartitions
    1. org.springframework.integration.kafka.core.DefaultConnectionFactory.getPartitions(DefaultConnectionFactory.java:209)
    1 frame
  3. org.springframework.xd
    DeploymentListener.childEvent
    1. org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.createKafkaConsumer(KafkaMessageBus.java:640)
    2. org.springframework.xd.dirt.integration.kafka.KafkaMessageBus.bindConsumer(KafkaMessageBus.java:454)
    3. org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindMessageConsumer(AbstractMessageBusBinderPlugin.java:275)
    4. org.springframework.xd.dirt.plugins.AbstractMessageBusBinderPlugin.bindConsumerAndProducers(AbstractMessageBusBinderPlugin.java:158)
    5. org.springframework.xd.dirt.plugins.stream.StreamPlugin.postProcessModule(StreamPlugin.java:73)
    6. org.springframework.xd.dirt.module.ModuleDeployer.postProcessModule(ModuleDeployer.java:238)
    7. org.springframework.xd.dirt.module.ModuleDeployer.doDeploy(ModuleDeployer.java:218)
    8. org.springframework.xd.dirt.module.ModuleDeployer.deploy(ModuleDeployer.java:200)
    9. org.springframework.xd.dirt.server.DeploymentListener.deployModule(DeploymentListener.java:363)
    10. org.springframework.xd.dirt.server.DeploymentListener.deployStreamModule(DeploymentListener.java:332)
    11. org.springframework.xd.dirt.server.DeploymentListener.onChildAdded(DeploymentListener.java:179)
    12. org.springframework.xd.dirt.server.DeploymentListener.childEvent(DeploymentListener.java:147)
    12 frames
  4. Fabric8
    PathChildrenCache$5.apply
    1. org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:509)
    2. org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:503)
    2 frames
  5. Curator Framework
    ListenerContainer$1.run
    1. org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92)
    1 frame
  6. Guava
    MoreExecutors$SameThreadExecutorService.execute
    1. com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
    1 frame
  7. Curator Framework
    ListenerContainer.forEach
    1. org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83)
    1 frame
  8. Fabric8
    PathChildrenCache$10.run
    1. org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:500)
    2. org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35)
    3. org.apache.curator.framework.recipes.cache.PathChildrenCache$10.run(PathChildrenCache.java:762)
    3 frames
  9. Java RT
    Thread.run
    1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    2. java.util.concurrent.FutureTask.run(FutureTask.java:262)
    3. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    4. java.util.concurrent.FutureTask.run(FutureTask.java:262)
    5. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    6. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    7. java.lang.Thread.run(Thread.java:745)
    7 frames