java.util.concurrent.ExecutionException: com.hazelcast.core.OperationTimeoutException: ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-09-19 23:51:43.946. Total elapsed time: 120291 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=548584131, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1474318183655 (2016-09-19 23:49:43.655), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1474318183655, firstInvocationTime='2016-09-19 23:49:43.655', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:12923, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=null}

GitHub | hasancelik | 2 months ago
  1. 0

    GitHub comment 8709#248246087

    GitHub | 2 months ago | hasancelik
    java.util.concurrent.ExecutionException: com.hazelcast.core.OperationTimeoutException: ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-09-19 23:51:43.946. Total elapsed time: 120291 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=548584131, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1474318183655 (2016-09-19 23:49:43.655), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1474318183655, firstInvocationTime='2016-09-19 23:49:43.655', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:12923, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=null}
  2. 0

    GracefulShutdownTest.shutdownMemberAndCluster_concurrently_withoutPartitionInitialization

    GitHub | 4 months ago | hasancelik
    java.util.concurrent.ExecutionException: com.hazelcast.core.OperationTimeoutException: ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-08-12 05:18:34.300. Total elapsed time: 120544 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=1167652188, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1470968193738 (2016-08-12 05:16:33.738), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1470968193756, firstInvocationTime='2016-08-12 05:16:33.756', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:8850, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=MockConnection{localEndpoint=[127.0.0.1]:8851, remoteEndpoint=[127.0.0.1]:8850}}
  3. 0

    GitHub comment 8709#257244497

    GitHub | 1 month ago | hasancelik
    java.util.concurrent.ExecutionException: com.hazelcast.core.OperationTimeoutException: ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-10-27 05:47:25.839. Start time: 2016-10-27 05:45:24.965. Total elapsed time: 120874 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=501998777, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1477536324965 (2016-10-27 05:45:24.965), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1477536324965, firstInvocationTime='2016-10-27 05:45:24.965', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:12202, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=null}
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 8709#259354740

    GitHub | 3 weeks ago | hasancelik
    java.util.concurrent.ExecutionException: com.hazelcast.core.OperationTimeoutException: ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-11-09 05:37:57.806. Start time: 2016-11-09 05:35:57.555. Total elapsed time: 120251 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=1809387280, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1478662557555 (2016-11-09 05:35:57.555), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1478662557555, firstInvocationTime='2016-11-09 05:35:57.555', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:12120, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=MockConnection{localEndpoint=[127.0.0.1]:12123, remoteEndpoint=[127.0.0.1]:12120}}
  6. 0

    GitHub comment 8831#256363162

    GitHub | 1 month ago | jmcshane
    com.hazelcast.core.OperationTimeoutException: SizeOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-10-26 01:22:16.431. Total elapsed time: 65999 ms. Last operation heartbeat: never. Last operation heartbeat from member: 2016-10-26 01:23:14.403. Invocation{op=com.hazelcast.collection.impl.queue.operations.SizeOperation{serviceName='hz:impl:queueService', identityHash=2068134089, partitionId=268, replicaIndex=0, callId=0, invocationTime=1477459202474 (2016-10-26 01:20:02.474), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1477459336434, firstInvocationTime='2016-10-26 01:22:16.434', lastHeartbeatMillis=0, lastHeartbeatTime='1969-12-31 19:00:00.000', target=[10.MYHOST1]:5715, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=Connection[id=64, /10.MYHOST2:34860->/10.MYHOST1:5715, endpoint=[10.MYHOST1]:5715, alive=true, type=MEMBER]}

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. com.hazelcast.core.OperationTimeoutException

      ChangeClusterStateOperation invocation failed to complete due to operation-heartbeat-timeout. Current time: 2016-09-19 23:51:43.946. Total elapsed time: 120291 ms. Last operation heartbeat: never. Last operation heartbeat from member: never. Invocation{op=com.hazelcast.internal.cluster.impl.operations.ChangeClusterStateOperation{serviceName='hz:core:clusterService', identityHash=548584131, partitionId=-1, replicaIndex=0, callId=0, invocationTime=1474318183655 (2016-09-19 23:49:43.655), waitTimeout=-1, callTimeout=60000}, tryCount=250, tryPauseMillis=500, invokeCount=1, callTimeoutMillis=60000, firstInvocationTimeMs=1474318183655, firstInvocationTime='2016-09-19 23:49:43.655', lastHeartbeatMillis=0, lastHeartbeatTime='1970-01-01 02:00:00.000', target=[127.0.0.1]:12923, pendingResponse={VOID}, backupsAcksExpected=0, backupsAcksReceived=0, connection=null}

      at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.newOperationTimeoutException()
    2. com.hazelcast.spi
      InvocationFuture.resolveAndThrow
      1. com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.newOperationTimeoutException(InvocationFuture.java:150)
      2. com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:98)
      3. com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrow(InvocationFuture.java:74)
      3 frames
    3. Hazelcast
      AbstractInvocationFuture.get
      1. com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:186)
      1 frame
    4. hazelcast
      FutureUtil.waitWithDeadline
      1. com.hazelcast.util.FutureUtil.executeWithDeadline(FutureUtil.java:326)
      2. com.hazelcast.util.FutureUtil.waitWithDeadline(FutureUtil.java:310)
      3. com.hazelcast.util.FutureUtil.waitWithDeadline(FutureUtil.java:284)
      3 frames
    5. Hazelcast
      TransactionImpl.commit
      1. com.hazelcast.transaction.impl.TransactionImpl.commit(TransactionImpl.java:292)
      1 frame
    6. com.hazelcast.internal
      GracefulShutdownTest$6.run
      1. com.hazelcast.internal.cluster.impl.ClusterStateManager.changeClusterState(ClusterStateManager.java:274)
      2. com.hazelcast.internal.cluster.impl.ClusterStateManager.changeClusterState(ClusterStateManager.java:241)
      3. com.hazelcast.internal.cluster.impl.ClusterServiceImpl.changeClusterState(ClusterServiceImpl.java:850)
      4. com.hazelcast.internal.cluster.impl.AdvancedClusterStateTest.changeClusterStateEventually(AdvancedClusterStateTest.java:794)
      5. com.hazelcast.internal.partition.GracefulShutdownTest$6.run(GracefulShutdownTest.java:459)
      5 frames
    7. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:262)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames