org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log

GitHub | vikeshkhanna | 9 months ago
  1. 0

    Recovery persistently fails due to empty WAL file

    GitHub | 9 months ago | vikeshkhanna
    org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  1. jpvee 4 times, last 1 month ago
8 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.EOFException

    No message provided

    at java.io.DataInputStream.readFully()
  2. Java RT
    DataInputStream.readFully
    1. java.io.DataInputStream.readFully(DataInputStream.java:197)
    2. java.io.DataInputStream.readFully(DataInputStream.java:169)
    2 frames
  3. io.confluent.connect
    HdfsSinkTask.onPartitionsAssigned
    1. io.confluent.connect.hdfs.wal.WALFile$Reader.init(WALFile.java:590)
    2. io.confluent.connect.hdfs.wal.WALFile$Reader.initialize(WALFile.java:558)
    3. io.confluent.connect.hdfs.wal.WALFile$Reader.<init>(WALFile.java:535)
    4. io.confluent.connect.hdfs.wal.WALFile$Writer.<init>(WALFile.java:214)
    5. io.confluent.connect.hdfs.wal.WALFile.createWriter(WALFile.java:67)
    6. io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:73)
    7. io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
    8. io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:448)
    9. io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:204)
    10. io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:236)
    11. io.confluent.connect.hdfs.DataWriter.onPartitionsAssigned(DataWriter.java:299)
    12. io.confluent.connect.hdfs.HdfsSinkTask.onPartitionsAssigned(HdfsSinkTask.java:103)
    12 frames
  4. org.apache.kafka
    ConsumerCoordinator.ensurePartitionAssignment
    1. org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:362)
    2. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:194)
    3. org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:225)
    4. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:311)
    4 frames
  5. Apache Kafka
    KafkaConsumer.poll
    1. org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:890)
    2. org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:853)
    2 frames
  6. org.apache.kafka
    ShutdownableThread.run
    1. org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:171)
    2. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.iteration(WorkerSinkTaskThread.java:90)
    3. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.execute(WorkerSinkTaskThread.java:58)
    4. org.apache.kafka.connect.util.ShutdownableThread.run(ShutdownableThread.java:82)
    4 frames