org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log

GitHub | vikeshkhanna | 7 months ago
  1. 0

    Recovery persistently fails due to empty WAL file

    GitHub | 7 months ago | vikeshkhanna
    org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

    8 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.EOFException

      No message provided

      at java.io.DataInputStream.readFully()
    2. Java RT
      DataInputStream.readFully
      1. java.io.DataInputStream.readFully(DataInputStream.java:197)
      2. java.io.DataInputStream.readFully(DataInputStream.java:169)
      2 frames
    3. io.confluent.connect
      HdfsSinkTask.onPartitionsAssigned
      1. io.confluent.connect.hdfs.wal.WALFile$Reader.init(WALFile.java:590)
      2. io.confluent.connect.hdfs.wal.WALFile$Reader.initialize(WALFile.java:558)
      3. io.confluent.connect.hdfs.wal.WALFile$Reader.<init>(WALFile.java:535)
      4. io.confluent.connect.hdfs.wal.WALFile$Writer.<init>(WALFile.java:214)
      5. io.confluent.connect.hdfs.wal.WALFile.createWriter(WALFile.java:67)
      6. io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:73)
      7. io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
      8. io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:448)
      9. io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:204)
      10. io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:236)
      11. io.confluent.connect.hdfs.DataWriter.onPartitionsAssigned(DataWriter.java:299)
      12. io.confluent.connect.hdfs.HdfsSinkTask.onPartitionsAssigned(HdfsSinkTask.java:103)
      12 frames
    4. org.apache.kafka
      ConsumerCoordinator.ensurePartitionAssignment
      1. org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:362)
      2. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:194)
      3. org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:225)
      4. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:311)
      4 frames
    5. Apache Kafka
      KafkaConsumer.poll
      1. org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:890)
      2. org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:853)
      2 frames
    6. org.apache.kafka
      ShutdownableThread.run
      1. org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:171)
      2. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.iteration(WorkerSinkTaskThread.java:90)
      3. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.execute(WorkerSinkTaskThread.java:58)
      4. org.apache.kafka.connect.util.ShutdownableThread.run(ShutdownableThread.java:82)
      4 frames