java.lang.IllegalStateException: close() was called on BatchedWriteAheadLog before write request with time 1454020507521 could be fulfilled.

amazon.com | 4 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    AWS Developer Forums: Unable to stop Spark 1.5.2 Streaming ...

    amazon.com | 4 months ago
    java.lang.IllegalStateException: close() was called on BatchedWriteAheadLog before write request with time 1454020507521 could be fulfilled.

    Root Cause Analysis

    1. java.lang.IllegalStateException

      close() was called on BatchedWriteAheadLog before write request with time 1454020507521 could be fulfilled.

      at org.apache.spark.streaming.util.BatchedWriteAheadLog.write()
    2. Spark Project Streaming
      JobGenerator$$anon$1.onReceive
      1. org.apache.spark.streaming.util.BatchedWriteAheadLog.write(BatchedWriteAheadLog.scala:83)
      2. org.apache.spark.streaming.scheduler.ReceivedBlockTracker.writeToLog(ReceivedBlockTracker.scala:232)
      3. org.apache.spark.streaming.scheduler.ReceivedBlockTracker.cleanupOldBatches(ReceivedBlockTracker.scala:169)
      4. org.apache.spark.streaming.scheduler.ReceiverTracker.cleanupOldBlocksAndBatches(ReceiverTracker.scala:223)
      5. org.apache.spark.streaming.scheduler.JobGenerator.clearCheckpointData(JobGenerator.scala:285)
      6. org.apache.spark.streaming.scheduler.JobGenerator.org$apache$spark$streaming$scheduler$JobGenerator$$processEvent(JobGenerator.scala:185)
      7. org.apache.spark.streaming.scheduler.JobGenerator$$anon$1.onReceive(JobGenerator.scala:87)
      8. org.apache.spark.streaming.scheduler.JobGenerator$$anon$1.onReceive(JobGenerator.scala:86)
      8 frames
    3. Spark
      EventLoop$$anon$1.run
      1. org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
      1 frame