java.util.concurrent.TimeoutException: We have timed out waiting on the current schema mutation lock holder. We have tried to grab the lock for 255275 milliseconds unsuccessfully. This indicates that the current lock holder has died without releasing the lock and will require manual intervention. Shut down all AtlasDB clients and then run the clean-cass-locks-state cli command.

GitHub | tpetracca | 5 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    GitHub comment 989#249715592

    GitHub | 5 months ago | tpetracca
    java.util.concurrent.TimeoutException: We have timed out waiting on the current schema mutation lock holder. We have tried to grab the lock for 255275 milliseconds unsuccessfully. This indicates that the current lock holder has died without releasing the lock and will require manual intervention. Shut down all AtlasDB clients and then run the clean-cass-locks-state cli command.

    Root Cause Analysis

    1. java.util.concurrent.TimeoutException

      We have timed out waiting on the current schema mutation lock holder. We have tried to grab the lock for 255275 milliseconds unsuccessfully. This indicates that the current lock holder has died without releasing the lock and will require manual intervention. Shut down all AtlasDB clients and then run the clean-cass-locks-state cli command.

      at com.palantir.atlasdb.keyvalue.cassandra.SchemaMutationLock.generateSchemaLockTimeoutException()
    2. com.palantir.atlasdb
      AtlasDbCliCommand.run
      1. com.palantir.atlasdb.keyvalue.cassandra.SchemaMutationLock.generateSchemaLockTimeoutException(SchemaMutationLock.java:182)[atlasdb-cassandra-0.15.0.jar:na]
      2. com.palantir.atlasdb.keyvalue.cassandra.SchemaMutationLock.lambda$waitForSchemaMutationLock$34(SchemaMutationLock.java:157)[atlasdb-cassandra-0.15.0.jar:na]
      3. com.palantir.atlasdb.keyvalue.cassandra.CassandraClientPoolingContainer.runWithGoodResource(CassandraClientPoolingContainer.java:117)[atlasdb-cassandra-0.15.0.jar:na]
      4. com.palantir.atlasdb.keyvalue.cassandra.CassandraClientPoolingContainer.runWithPooledResource(CassandraClientPoolingContainer.java:94)[atlasdb-cassandra-0.15.0.jar:na]
      5. com.palantir.atlasdb.keyvalue.cassandra.CassandraClientPool.runWithRetryOnHost(CassandraClientPool.java:467)[atlasdb-cassandra-0.15.0.jar:na]
      6. com.palantir.atlasdb.keyvalue.cassandra.CassandraClientPool.runWithRetry(CassandraClientPool.java:450)[atlasdb-cassandra-0.15.0.jar:na]
      7. com.palantir.atlasdb.keyvalue.cassandra.SchemaMutationLock.waitForSchemaMutationLock(SchemaMutationLock.java:122)[atlasdb-cassandra-0.15.0.jar:na]
      8. com.palantir.atlasdb.keyvalue.cassandra.SchemaMutationLock.runWithLock(SchemaMutationLock.java:72)[atlasdb-cassandra-0.15.0.jar:na]
      9. com.palantir.atlasdb.keyvalue.cassandra.CassandraKeyValueService.createTables(CassandraKeyValueService.java:1427)[atlasdb-cassandra-0.15.0.jar:na]
      10. com.palantir.atlasdb.keyvalue.cassandra.CassandraKeyValueService.createTable(CassandraKeyValueService.java:1415)[atlasdb-cassandra-0.15.0.jar:na]
      11. com.palantir.atlasdb.keyvalue.cassandra.CassandraKeyValueService.init(CassandraKeyValueService.java:225)[atlasdb-cassandra-0.15.0.jar:na]
      12. com.palantir.atlasdb.keyvalue.cassandra.CassandraKeyValueService.create(CassandraKeyValueService.java:177)[atlasdb-cassandra-0.15.0.jar:na]
      13. com.palantir.atlasdb.keyvalue.cassandra.CassandraKeyValueService.create(CassandraKeyValueService.java:163)[atlasdb-cassandra-0.15.0.jar:na]
      14. com.palantir.atlasdb.cli.command.CleanCassLocksStateCommand.call(CleanCassLocksStateCommand.java:36)[atlasdb-cli-0.15.0.jar:na]
      15. com.palantir.atlasdb.cli.command.CleanCassLocksStateCommand.call(CleanCassLocksStateCommand.java:27)[atlasdb-cli-0.15.0.jar:na]
      16. com.palantir.atlasdb.dropwizard.commands.AtlasDbCliCommand.run(AtlasDbCliCommand.java:150)[atlasdb-dropwizard-bundle-0.15.0.jar:na]
      16 frames
    3. Dropwizard
      ConfiguredCommand.run
      1. io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:77)[dropwizard-core-0.9.1.jar:0.9.1]
      1 frame
    4. com.palantir.atlasdb
      AtlasDbConfiguredCommand.run
      1. com.palantir.atlasdb.dropwizard.AtlasDbConfiguredCommand.run(AtlasDbConfiguredCommand.java:66)[atlasdb-dropwizard-bundle-0.15.0.jar:na]
      1 frame
    5. Dropwizard
      Application.run
      1. io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:77)[dropwizard-core-0.9.1.jar:0.9.1]
      2. io.dropwizard.cli.Cli.run(Cli.java:70)[dropwizard-core-0.9.1.jar:0.9.1]
      3. io.dropwizard.Application.run(Application.java:80)[dropwizard-core-0.9.1.jar:0.9.1]
      3 frames