org.apache.spark.SparkException: Couldn't find leader offsets for Set([stream,0])

Stack Overflow | innovatism | 3 months ago
  1. 0

    Spark streaming kafka Couldn't find leader offsets for Set

    Stack Overflow | 3 months ago | innovatism
    org.apache.spark.SparkException: Couldn't find leader offsets for Set([stream,0])
  2. 0

    Direct Kafka Stream with PySpark (Apache Spark 1.6)

    Stack Overflow | 9 months ago | cynical biscuit
    org.apache.spark.SparkException: java.nio.channels.ClosedChannelException
  3. 0

    Kafka - SimpleConsumer not working after port change

    Stack Overflow | 2 months ago | Navarro
    org.apache.spark.SparkException: java.nio.channels.ClosedChannelException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 113#158861911

    GitHub | 1 year ago | ssamynathan
    org.apache.spark.SparkException: java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.
  6. 0

    Spark Streaming + Kafka: SparkException: Couldn't find leader offsets for Set

    Stack Overflow | 12 months ago | facha
    org.apache.spark.SparkException: Couldn't find leader offsets for Set([test-topic,0])

    6 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Couldn't find leader offsets for Set([stream,0])

      at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply()
    2. Spark Project External Kafka
      KafkaCluster$$anonfun$checkErrors$1.apply
      1. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2 frames
    3. Scala
      Either.fold
      1. scala.util.Either.fold(Either.scala:97)
      1 frame
    4. Spark Project External Kafka
      KafkaUtils$createDirectStream.call
      1. org.apache.spark.streaming.kafka.KafkaCluster$.checkErrors(KafkaCluster.scala:365)
      2. org.apache.spark.streaming.kafka.KafkaUtils$.getFromOffsets(KafkaUtils.scala:222)
      3. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:484)
      4. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:607)
      5. org.apache.spark.streaming.kafka.KafkaUtils.createDirectStream(KafkaUtils.scala)
      6. org.apache.spark.streaming.kafka.KafkaUtils$createDirectStream.call(Unknown Source)
      6 frames
    5. Groovy
      AbstractCallSite.call
      1. org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
      2. org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
      2 frames
    6. com.privowny.classification
      StreamingClassification.main
      1. com.privowny.classification.jobs.StreamingClassification.main(StreamingClassification.groovy:48)
      1 frame
    7. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:483)
      4 frames
    8. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
      2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
      3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
      4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      5 frames