org.apache.spark.SparkException: Error getting partition metadata for 'SparkStreamingDirected'. Does the topic  exist?

csdn.net | 4 months ago
  1. 0

    第91课:SparkStreaming基于Kafka Direct案例实战和内幕源码解密 java.lang.ClassNotFoundException 踩坑解决问题详细内幕版本

    csdn.net | 6 months ago
    org.apache.spark.SparkException: Error getting partition metadata for 'SparkStreamingDirected'. Does the topic  exist?
  2. 0

    Spark Streaming Kafka Consumer

    Stack Overflow | 2 months ago | Ken Alton
    java.lang.reflect.InvocationTargetException
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    GitHub comment 113#158861911

    GitHub | 1 year ago | ssamynathan
    org.apache.spark.SparkException: java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.
  5. 0

    Connection spark streaming to kafka within eclipse: error-Couldn't find leader offsets

    Stack Overflow | 4 months ago | user1849773
    org.apache.spark.SparkException: Couldn't find leader offsets for Set([test2,0])

    6 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Error getting partition metadata for 'SparkStreamingDirected'. Does the topic  exist?

      at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply()
    2. Spark Project External Kafka
      KafkaCluster$$anonfun$checkErrors$1.apply
      1. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2. org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)
      2 frames
    3. Scala
      Either.fold
      1. scala.util.Either.fold(Either.scala:97)
      1 frame
    4. Spark Project External Kafka
      KafkaUtils.createDirectStream
      1. org.apache.spark.streaming.kafka.KafkaCluster$.checkErrors(KafkaCluster.scala:365)
      2. org.apache.spark.streaming.kafka.KafkaUtils$.getFromOffsets(KafkaUtils.scala:222)
      3. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:484)
      4. org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:607)
      5. org.apache.spark.streaming.kafka.KafkaUtils.createDirectStream(KafkaUtils.scala)
      5 frames
    5. com.dt.spark
      SparkStreamingOnKafkaDirected.main
      1. com.dt.spark.SparkApps.SparkStreaming.SparkStreamingOnKafkaDirected.main(SparkStreamingOnKafkaDirected.java:68)
      1 frame
    6. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:497)
      4 frames
    7. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
      2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
      3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
      4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      5 frames