java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available.

Google Groups | Peter Quirk | 2 months ago
  1. 0

    Error in Transforming your Data section of Introduction to CDAP

    Google Groups | 2 months ago | Peter Quirk
    java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available.
  2. 0

    Since audit.enabled is set true by default, running standalone on IDE produces a lot of error message (because Kafka is not started). Need a better way on handling this case. {code} RROR [Endure-Service-:c.c.c.d.a.KafkaAuditPublisher@74] - Got exception publishing audit message AuditMessage{version=1, time=1461966592920, entityId=artifact:system.transform-plugins.1.3.0-SNAPSHOT, user='.cdap', type=METADATA_CHANGE, payload=MetadataPayload{previous={SYSTEM=Metadata{properties={plugin-version:CSVParser:transform=CSVParser:1.3.0-SNAPSHOT, plugin:Hasher:transform=Hasher:transform, plugin-version:StreamFormatter:transform=StreamFormatter:1.3.0-SNAPSHOT, plugin-version:JSONParser:transform=JSONParser:1.3.0-SNAPSHOT, plugin:StreamFormatter:transform=StreamFormatter:transform, plugin-version:Decompressor:transform=Decompressor:1.3.0-SNAPSHOT, plugin:Encoder:transform=Encoder:transform, plugin:CSVFormatter:transform=CSVFormatter:transform, plugin:JSONFormatter:transform=JSONFormatter:transform, plugin-version:Encoder:transform=Encoder:1.3.0-SNAPSHOT, plugin-version:Compressor:transform=Compressor:1.3.0-SNAPSHOT, plugin:JSONParser:transform=JSONParser:transform, plugin:CloneRecord:transform=CloneRecord:transform, plugin-version:CSVFormatter:transform=CSVFormatter:1.3.0-SNAPSHOT, plugin-version:JSONFormatter:transform=JSONFormatter:1.3.0-SNAPSHOT, plugin:CSVParser:transform=CSVParser:transform, plugin-version:Decoder:transform=Decoder:1.3.0-SNAPSHOT, plugin:Decoder:transform=Decoder:transform, plugin-version:CloneRecord:transform=CloneRecord:1.3.0-SNAPSHOT, plugin:Compressor:transform=Compressor:transform, plugin:Decompressor:transform=Decompressor:transform, plugin-version:Hasher:transform=Hasher:1.3.0-SNAPSHOT}, tags=[]}}, additions={SYSTEM=Metadata{properties={}, tags=[transform-plugins]}}, deletions={SYSTEM=Metadata{properties={}, tags=[]}}} AuditPayload{}}. Exception: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available. at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) ~[guava-13.0.1.jar:na] at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) ~[guava-13.0.1.jar:na] at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) ~[guava-13.0.1.jar:na] at co.cask.cdap.data2.audit.KafkaAuditPublisher.publish(KafkaAuditPublisher.java:72) ~[classes/:na] at co.cask.cdap.data2.audit.AuditPublishers.publishAudit(AuditPublishers.java:112) [classes/:na] at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.publishAudit(DefaultMetadataStore.java:510) [classes/:na] at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.publish(DefaultMetadataStore.java:502) [classes/:na] at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.addTags(DefaultMetadataStore.java:168) [classes/:na] at co.cask.cdap.data2.metadata.system.AbstractSystemMetadataWriter.write(AbstractSystemMetadataWriter.java:103) [classes/:na] at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.writeSystemMetadata(ArtifactRepository.java:893) [classes/:na] at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addArtifact(ArtifactRepository.java:486) [classes/:na] at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifact(ArtifactRepository.java:707) [classes/:na] at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifacts(ArtifactRepository.java:686) [classes/:na] at co.cask.cdap.internal.app.runtime.artifact.SystemArtifactLoader$1$1.doStart(SystemArtifactLoader.java:48) [classes/:na] at com.google.common.util.concurrent.AbstractService.start(AbstractService.java:170) [guava-13.0.1.jar:na] at com.google.common.util.concurrent.AbstractService.startAndWait(AbstractService.java:220) [guava-13.0.1.jar:na] at co.cask.cdap.common.service.RetryOnStartFailureService$1.run(RetryOnStartFailureService.java:62) [classes/:na] Caused by: java.lang.IllegalStateException: No kafka producer available. at org.apache.twill.internal.kafka.client.SimpleKafkaPublisher$SimplePreparer.send(SimpleKafkaPublisher.java:120) ~[twill-core-0.7.0-incubating.jar:0.7.0-incubating] ... 14 common frames omitted 2016-04-29 15:03:01,567 - ERROR [New I/O worker #57:c.c.c.g.r.h.OutboundHandler@72] - Got exception [id: 0x3a3f32b9, /127.0.0.1:50440 :> localhost/127.0.0.1:63602] java.nio.channels.ClosedChannelException: null at org.jboss.netty.channel.socket.nio.AbstractNioWorker.cleanUpWriteBuffer(AbstractNioWorker.java:434) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:374) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:93) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) ~[netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.6.Final.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] {code}

    Cask Community Issue Tracker | 7 months ago | Edwin Elia
    java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available.
  3. 0

    I see a few exceptions/stack traces from KafkaAuditPublisher mentioning that it failed to publish audit log messages to Kafka. And some of these initial audit log messages are missed (but all of these messages are related to system dataset creations). {code} 2016-04-27 21:40:41,847 - ERROR [netty-executor-0:c.c.c.d.a.KafkaAuditPublisher@74] - Got exception publishing audit message AuditMessage{version=1, time=1461818441798, entityId=dataset:system.app.meta, user='', type=CREATE, payload=AuditPayload{}}. Exception: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available. at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) ~[com.google.guava.guava-13.0.1.jar:na] at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) ~[com.google.guava.guava-13.0.1.jar:na] at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) ~[com.google.guava.guava-13.0.1.jar:na] at co.cask.cdap.data2.audit.KafkaAuditPublisher.publish(KafkaAuditPublisher.java:72) ~[co.cask.cdap.cdap-data-fabric-3.4.0-SNAPSHOT.jar:na] at co.cask.cdap.data2.audit.AuditPublishers.publishAudit(AuditPublishers.java:112) [co.cask.cdap.cdap-data-fabric-3.4.0-SNAPSHOT.jar:na] at co.cask.cdap.data2.datafabric.dataset.service.DatasetInstanceService.publishAudit(DatasetInstanceService.java:427) [co.cask.cdap.cdap-data-fabric-3.4.0-SNAPSHOT.jar:na] at co.cask.cdap.data2.datafabric.dataset.service.DatasetInstanceService.create(DatasetInstanceService.java:224) [co.cask.cdap.cdap-data-fabric-3.4.0-SNAPSHOT.jar:na] at co.cask.cdap.data2.datafabric.dataset.service.DatasetInstanceHandler.create(DatasetInstanceHandler.java:103) [co.cask.cdap.cdap-data-fabric-3.4.0-SNAPSHOT.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_60] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_60] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_60] at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_60] at co.cask.http.HttpMethodInfo.invoke(HttpMethodInfo.java:80) [co.cask.http.netty-http-0.14.0.jar:na] at co.cask.http.HttpDispatcher.messageReceived(HttpDispatcher.java:38) [co.cask.http.netty-http-0.14.0.jar:na] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [io.netty.netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [io.netty.netty-3.6.6.Final.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [io.netty.netty-3.6.6.Final.jar:na] at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43) [io.netty.netty-3.6.6.Final.jar:na] at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67) [io.netty.netty-3.6.6.Final.jar:na] at org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor$ChildExecutor.run(OrderedMemoryAwareThreadPoolExecutor.java:314) [io.netty.netty-3.6.6.Final.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_60] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_60] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60] Caused by: java.lang.IllegalStateException: No kafka producer available. at org.apache.twill.internal.kafka.client.SimpleKafkaPublisher$SimplePreparer.send(SimpleKafkaPublisher.java:120) ~[org.apache.twill.twill-core-0.7.0-incubating.jar:0.7.0-incubating] ... 20 common frames omitted {code}

    Cask Community Issue Tracker | 7 months ago | Gokul Gunasekaran
    java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    No token available exception

    Google Groups | 6 years ago | ~rohit~
    java.lang.IllegalStateException: No Token available.
  6. 0

    i am getting an error while requesting a new jsp

    Oracle Community | 8 years ago | 843844
    java.lang.IllegalStateException: No Java compiler available

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      No kafka producer available.

      at org.apache.twill.internal.kafka.client.SimpleKafkaPublisher$SimplePreparer.send()
    2. org.apache.twill
      SimpleKafkaPublisher$SimplePreparer.send
      1. org.apache.twill.internal.kafka.client.SimpleKafkaPublisher$SimplePreparer.send(SimpleKafkaPublisher.java:120)[org.apache.twill.twill-core-0.8.0-SNAPSHOT.jar:0.8.0-SNAPSHOT]
      1 frame
    3. co.cask.cdap
      PartitionedFileSetDataset.postTxCommit
      1. co.cask.cdap.data2.audit.KafkaAuditPublisher.publish(KafkaAuditPublisher.java:72)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      2. co.cask.cdap.data2.audit.AuditPublishers.publishAccess(AuditPublishers.java:72)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      3. co.cask.cdap.data2.metadata.writer.LineageWriterDatasetFramework.publishAudit(LineageWriterDatasetFramework.java:215)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      4. co.cask.cdap.data2.metadata.writer.LineageWriterDatasetFramework.writeLineage(LineageWriterDatasetFramework.java:190)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      5. co.cask.cdap.data2.metadata.writer.LineageWriterDatasetFramework$BasicDatasetAccessRecorder.recordLineage(LineageWriterDatasetFramework.java:267)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      6. co.cask.cdap.data2.dataset2.DefaultDatasetRuntimeContext.recordAccess(DefaultDatasetRuntimeContext.java:178)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      7. co.cask.cdap.data2.dataset2.DefaultDatasetRuntimeContext.onMethodEntry(DefaultDatasetRuntimeContext.java:166)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      8. co.cask.cdap.data2.dataset2.lib.file.FileSetDataset.exists(FileSetDataset.java)[na:na]
      9. co.cask.cdap.data2.dataset2.lib.file.FileSetDataset.access$300(FileSetDataset.java:61)[na:na]
      10. co.cask.cdap.data2.dataset2.lib.file.FileSetDataset$FileSetLocation.exists(FileSetDataset.java:405)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      11. co.cask.cdap.data2.dataset2.lib.partitioned.PartitionedFileSetDataset.postTxCommit(PartitionedFileSetDataset.java:155)[na:na]
      11 frames
    4. org.apache.tephra
      TransactionContext.finish
      1. org.apache.tephra.TransactionContext.postCommit(TransactionContext.java:311)[org.apache.tephra.tephra-core-0.8.0-incubating.jar:0.8.0-incubating]
      2. org.apache.tephra.TransactionContext.finish(TransactionContext.java:119)[org.apache.tephra.tephra-core-0.8.0-incubating.jar:0.8.0-incubating]
      2 frames
    5. co.cask.cdap
      MapReduceRuntimeService.startUp
      1. co.cask.cdap.data2.dataset2.SingleThreadDatasetCache$DelayedDiscardingTransactionContext.finish(SingleThreadDatasetCache.java:410)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      2. co.cask.cdap.data2.transaction.Transactions.execute(Transactions.java:172)[co.cask.cdap.cdap-data-fabric-4.0.0-SNAPSHOT.jar:na]
      3. co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.beforeSubmit(MapReduceRuntimeService.java:499)[co.cask.cdap.cdap-app-fabric-4.0.0-SNAPSHOT.jar:na]
      4. co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.startUp(MapReduceRuntimeService.java:217)[co.cask.cdap.cdap-app-fabric-4.0.0-SNAPSHOT.jar:na]
      4 frames
    6. Guava
      AbstractExecutionThreadService$1$1.run
      1. com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:47)[com.google.guava.guava-13.0.1.jar:na]
      1 frame
    7. co.cask.cdap
      MapReduceRuntimeService$1$1.run
      1. co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService$1$1.run(MapReduceRuntimeService.java:417)[co.cask.cdap.cdap-app-fabric-4.0.0-SNAPSHOT.jar:na]
      1 frame
    8. Java RT
      Thread.run
      1. java.lang.Thread.run(Unknown Source)[na:1.8.0_101]
      1 frame