java.lang.IllegalStateException: close() was called on BatchedWriteAheadLog before write request with time 1467910440000 could be fulfilled.

amazon.com | 3 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    AWS Developer Forums: Unable to stop Spark 1.5.2 Streaming ...

    amazon.com | 3 months ago
    java.lang.IllegalStateException: close() was called on BatchedWriteAheadLog before write request with time 1467910440000 could be fulfilled.

    Root Cause Analysis

    1. java.lang.IllegalStateException

      close() was called on BatchedWriteAheadLog before write request with time 1467910440000 could be fulfilled.

      at org.apache.spark.streaming.util.BatchedWriteAheadLog.write()
    2. Spark Project Streaming
      JobGenerator$$anonfun$3.apply
      1. org.apache.spark.streaming.util.BatchedWriteAheadLog.write(BatchedWriteAheadLog.scala:83)
      2. org.apache.spark.streaming.scheduler.ReceivedBlockTracker.writeToLog(ReceivedBlockTracker.scala:232)
      3. org.apache.spark.streaming.scheduler.ReceivedBlockTracker.allocateBlocksToBatch(ReceivedBlockTracker.scala:116)
      4. org.apache.spark.streaming.scheduler.ReceiverTracker.allocateBlocksToBatch(ReceiverTracker.scala:203)
      5. org.apache.spark.streaming.scheduler.JobGenerator$$anonfun$3.apply(JobGenerator.scala:247)
      6. org.apache.spark.streaming.scheduler.JobGenerator$$anonfun$3.apply(JobGenerator.scala:246)
      6 frames