org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log

GitHub | vikeshkhanna | 1 year ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Recovery persistently fails due to empty WAL file

    GitHub | 1 year ago | vikeshkhanna
    org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://bikeshed//kafka_connect/logs/goscribe.mp-hash_events/48/log
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  1. jpvee 4 times, last 5 months ago
8 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.EOFException

    No message provided

    at java.io.DataInputStream.readFully()
  2. Java RT
    DataInputStream.readFully
    1. java.io.DataInputStream.readFully(DataInputStream.java:197)
    2. java.io.DataInputStream.readFully(DataInputStream.java:169)
    2 frames
  3. io.confluent.connect
    HdfsSinkTask.onPartitionsAssigned
    1. io.confluent.connect.hdfs.wal.WALFile$Reader.init(WALFile.java:590)
    2. io.confluent.connect.hdfs.wal.WALFile$Reader.initialize(WALFile.java:558)
    3. io.confluent.connect.hdfs.wal.WALFile$Reader.<init>(WALFile.java:535)
    4. io.confluent.connect.hdfs.wal.WALFile$Writer.<init>(WALFile.java:214)
    5. io.confluent.connect.hdfs.wal.WALFile.createWriter(WALFile.java:67)
    6. io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:73)
    7. io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
    8. io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:448)
    9. io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:204)
    10. io.confluent.connect.hdfs.DataWriter.recover(DataWriter.java:236)
    11. io.confluent.connect.hdfs.DataWriter.onPartitionsAssigned(DataWriter.java:299)
    12. io.confluent.connect.hdfs.HdfsSinkTask.onPartitionsAssigned(HdfsSinkTask.java:103)
    12 frames
  4. org.apache.kafka
    ConsumerCoordinator.ensurePartitionAssignment
    1. org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:362)
    2. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:194)
    3. org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:225)
    4. org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:311)
    4 frames
  5. Apache Kafka
    KafkaConsumer.poll
    1. org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:890)
    2. org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:853)
    2 frames
  6. org.apache.kafka
    ShutdownableThread.run
    1. org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:171)
    2. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.iteration(WorkerSinkTaskThread.java:90)
    3. org.apache.kafka.connect.runtime.WorkerSinkTaskThread.execute(WorkerSinkTaskThread.java:58)
    4. org.apache.kafka.connect.util.ShutdownableThread.run(ShutdownableThread.java:82)
    4 frames