org.apache.spark.SparkException: Couldn't find leader offsets for Set([stream,0])

Stack Overflow | innovatism | 7 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Spark streaming kafka Couldn't find leader offsets for Set

    Stack Overflow | 7 months ago | innovatism
    org.apache.spark.SparkException: Couldn't find leader offsets for Set([stream,0])
  2. 0

    Spark Streaming + Kafka: SparkException: Couldn't find leader offsets for Set

    Stack Overflow | 1 year ago | facha
    org.apache.spark.SparkException: Couldn't find leader offsets for Set([test-topic,0])
  3. 0

    Direct Kafka Stream with PySpark (Apache Spark 1.6)

    Stack Overflow | 1 year ago | cynical biscuit
    org.apache.spark.SparkException: java.nio.channels.ClosedChannelException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    第91课:SparkStreaming基于Kafka Direct案例实战和内幕源码解密 java.lang.ClassNotFoundException 踩坑解决问题详细内幕版本

    csdn.net | 10 months ago
    org.apache.spark.SparkException: Error getting partition metadata for 'SparkStreamingDirected'. Does the topic  exist?
  6. 0

    Kafka - SimpleConsumer not working after port change

    Stack Overflow | 5 months ago | Navarro
    org.apache.spark.SparkException: java.nio.channels.ClosedChannelException

    6 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Couldn't find leader offsets for Set([stream,0])

      at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply()
    2. Spark Project External Kafka
      KafkaCluster$$anonfun$checkErrors$1.apply
      1. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2 frames
    3. Scala
      Either.fold
      1. scala.util.Either.fold(Either.scala:97)
      1 frame
    4. Spark Project External Kafka
      KafkaUtils$createDirectStream.call
      1. org.apache.spark.streaming.kafka.KafkaCluster$.checkErrors(KafkaCluster.scala:365)
      2. org.apache.spark.streaming.kafka.KafkaUtils$.getFromOffsets(KafkaUtils.scala:222)
      3. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:484)
      4. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:607)
      5. org.apache.spark.streaming.kafka.KafkaUtils.createDirectStream(KafkaUtils.scala)
      6. org.apache.spark.streaming.kafka.KafkaUtils$createDirectStream.call(Unknown Source)
      6 frames
    5. Groovy
      AbstractCallSite.call
      1. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
      2. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
      2 frames
    6. com.privowny.classification
      StreamingClassification.main
      1. com.privowny.classification.jobs.StreamingClassification.main(StreamingClassification.groovy:48)
      1 frame
    7. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:483)
      4 frames
    8. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
      2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
      3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
      4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      5 frames