com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can t hold the lease shard

amazon.com | 3 weeks ago
  1. 0

    AWS Developer Forums: Unable to stop Spark 1.5.2 Streaming ...

    amazon.com | 3 weeks ago
    com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can t hold the lease shard
  2. 0

    Kinesis Spark Streaming longevity issues

    Stack Overflow | 8 months ago | sreejith
    com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can't update checkpoint - instance doesn't hold the lease for this shard
  3. 0

    Error: refusing to update lease with key shardId-xxxxx because concurrency tokens don't match

    GitHub | 2 years ago | rantav
    com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can't update checkpoint - instance doesn't hold the lease for this shard
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    KCL version 1.6.3 doesn't shutdown worker cleanly

    GitHub | 6 months ago | matthewbogner
    com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can't update checkpoint - instance doesn't hold the lease for this shard
  6. 0

    GitHub comment 4#153480808

    GitHub | 1 year ago | fozzylyon
    com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException: Can't update checkpoint - instance doesn't hold the lease for this shard at com.amazonaws.services.kinesis.clientlibrary.lib.worker.KinesisClientLibLeaseCoordinator.setCheckpoint(com/amazonaws/services/kinesis/clientlibrary/lib/worker/KinesisClientLibLeaseCoordinator.java:120) at com.amazonaws.services.kinesis.clientlibrary.lib.worker.RecordProcessorCheckpointer.advancePosition(com/amazonaws/services/kinesis/clientlibrary/lib/worker/RecordProcessorCheckpointer.java:216) at com.amazonaws.services.kinesis.clientlibrary.lib.worker.RecordProcessorCheckpointer.checkpoint(com/amazonaws/services/kinesis/clientlibrary/lib/worker/RecordProcessorCheckpointer.java:77) at java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:483) at RUBY.shutdown(/opt/logstash/vendor/local_gems/b42e9da0/logstash-input-dynamodb-1.0.0-java/lib/logstash/inputs/LogStashRecordProcessor.rb:56)

    Root Cause Analysis

    1. com.amazonaws.services.kinesis.clientlibrary.exceptions.ShutdownException

      Can t hold the lease shard

      at com.amazonaws.services.kinesis.clientlibrary.lib.worker.KinesisClientLibLeaseCoordinator.setCheckpoint()
    2. Amazon Kinesis Client Library for Java
      RecordProcessorCheckpointer.checkpoint
      1. com.amazonaws.services.kinesis.clientlibrary.lib.worker.KinesisClientLibLeaseCoordinator.setCheckpoint(KinesisClientLibLeaseCoordinator.java:120)
      2. com.amazonaws.services.kinesis.clientlibrary.lib.worker.RecordProcessorCheckpointer.advancePosition(RecordProcessorCheckpointer.java:216)
      3. com.amazonaws.services.kinesis.clientlibrary.lib.worker.RecordProcessorCheckpointer.checkpoint(RecordProcessorCheckpointer.java:137)
      4. com.amazonaws.services.kinesis.clientlibrary.lib.worker.RecordProcessorCheckpointer.checkpoint(RecordProcessorCheckpointer.java:103)
      4 frames
    3. Spark Kinesis Integration
      KinesisCheckpointer$$anonfun$checkpoint$1$$anonfun$apply$1.apply
      1. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$checkpoint$1$$anonfun$apply$1.apply$mcV$sp(KinesisCheckpointer.scala:81)
      2. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$checkpoint$1$$anonfun$apply$1.apply(KinesisCheckpointer.scala:81)
      3. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$checkpoint$1$$anonfun$apply$1.apply(KinesisCheckpointer.scala:81)
      3 frames
    4. Scala
      Try$.apply
      1. scala.util.Try$.apply(Try.scala:161)
      1 frame
    5. Spark Kinesis Integration
      KinesisCheckpointer$$anonfun$checkpoint$1.apply
      1. org.apache.spark.streaming.kinesis.KinesisRecordProcessor$.retryRandom(KinesisRecordProcessor.scala:145)
      2. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$checkpoint$1.apply(KinesisCheckpointer.scala:81)
      3. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$checkpoint$1.apply(KinesisCheckpointer.scala:75)
      3 frames
    6. Scala
      Option.foreach
      1. scala.Option.foreach(Option.scala:236)
      1 frame
    7. Spark Kinesis Integration
      KinesisCheckpointer$$anonfun$1.apply$mcVJ$sp
      1. org.apache.spark.streaming.kinesis.KinesisCheckpointer.checkpoint(KinesisCheckpointer.scala:75)
      2. org.apache.spark.streaming.kinesis.KinesisCheckpointer.org$apache$spark$streaming$kinesis$KinesisCheckpointer$$checkpointAll(KinesisCheckpointer.scala:103)
      3. org.apache.spark.streaming.kinesis.KinesisCheckpointer$$anonfun$1.apply$mcVJ$sp(KinesisCheckpointer.scala:117)
      3 frames
    8. Spark Project Streaming
      RecurringTimer$$anon$1.run
      1. org.apache.spark.streaming.util.RecurringTimer.triggerActionForNextInterval(RecurringTimer.scala:94)
      2. org.apache.spark.streaming.util.RecurringTimer.org$apache$spark$streaming$util$RecurringTimer$$loop(RecurringTimer.scala:106)
      3. org.apache.spark.streaming.util.RecurringTimer$$anon$1.run(RecurringTimer.scala:29)
      3 frames