java.net.SocketException

If you like a tip written by other Samebug users, mark is as helpful! Marks help our algorithm provide you better solutions and also help other users.
tip

Upgrade your docker-selenium

tip

Probably there is a bug in TestNG Eclipse plugin (6.8.6.20130607_0745), try an other version (e.g. 6.8.0.20121120_1820)

tip

before running my test in debug mode, i open the debug view, and remove some breakpoints (such as some remaining on NullPointersExceptions, and Sockets)

tip

Try removing all the breakpoints (even if breakpoints are disabled the problem still occurs, yes even if both disabled entirely and piecewise).

tip

There is a known issue between TestNG 6.4 and IDEA, the next EAP will fix this but in the meantime, use the previous version.

tip

Client closed the websocket connection (safe to ignore)

tip

*not english*


poroszdporoszd
tip

Nginx does not handle websocket requests. Configure nginx proxy for websockets.

tip

Set larger socket timeout (or 0 to set no timeout).

tip

Upgrade your nanohttpd

tip

It takes too long time for the JVM to find enough entropy for secure connection. Use this jvm option: '-Djava.security.egd=file:/dev/./urandom'.

tip

Upgrade yokozuna

tip

Here is a animation for the life cycle. http://tcp.cs.st-andrews.ac.uk/index.shtml?page=connection_lifecycle

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

  • call packages\sdkdclient\bin\brun.bat -A S3Creds_tmp -I cluster_conf ig.ini -I sdkd.args --variants HYBRID -d all:trace [0.32 INFO] (BRun run:436) Initializing S3 [1.19 INFO] (BRun run:441) Initializing history database [1.82 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools ============================================================ Running ReAdd2-HYBRID: 2014-08-26 22:52:11 workload=HybridWorkloadGroup failover/next_action=FO_READD_REBALANCE failover/count=2 failover/next_delay=45 testcase=FailoverScenario Logging to c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-1174\ReAdd2-HYBRID\08-26-14\0211 31\68eb149dd819e0fcf974500c9b7554ef To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ \ --workload HybridWorkloadGroup --failover-next_action \ FO_READD_REBALANCE --failover-count 2 --failover-next_delay 45 \ --testcase FailoverScenario -C share\rexec --rexec_path \ C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port 8675 \ --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase --cluster_useSSL=True ---------------------------------------->8 [57.94 INFO] (Workload setupDesign:63) Creating design test_design [57.95 TRACE] (CouchbaseAdmin getResponseJson:167) PUT http://10.3.121.134:8092/default/_design/test_design [58.19 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8092/default/_design/test_design/_view/test_view?limit= 1 [58.23 INFO] (Workload setupDesign:80) Design creation done [58.23 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [58.24 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=true, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [58.24 TRACE] (Handle sendMessageAsync:185) > {"Command":"NEWHANDLE","Handle":101,"ReqID":1,"CommandData":{"Port":8091,"Bucket":"d efault","Options":{"SSL":true,"Username":"default","Password":"","OtherNodes":[["10.3.121.135",8091],["10.3.121.136",8091],["10.3. 3.206",8091]]},"Hostname":"10.3.121.134"}} [58.25 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101 [58.27 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net [58.27 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToke n=af08829b84f0328e [58.30 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net [58.30 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d42611 5821 [58.58 INFO] (SDKD log:137) [58.59 INFO] (SDKD log:137) Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of an obje ct. [198.47 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [198.48 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.2 [198.48 INFO] (SDKD log:137) at Couchbase.IO.Strategies.SslConnection.Send[T](IOperation`1 operation) in c:\jenkins\workspace\. net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\SslConnection.cs:line 53 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation, IConnection connection) in c:\jenkins\workspace \.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 35 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-and rei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 45 at Couchbase.Configuration.Server.Providers.CarrierPublication.CarrierPublicationProvider.GetConfig(String bucketName, String p assword) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\Carr ierPublication\CarrierPublicationProvider.cs:line 41 at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-a ndrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 159 at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei \couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 84 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs :line 134 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boo lean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean pre serveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [198.49 TRACE] (Handle sendMessageAsync:185) > {"Command":"CLOSEHANDLE","Handle":101,"ReqID":2,"CommandData":{}} [198.50 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] [199.41 INFO] (BRun uploadFile:141) Uploaded RAW => http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-3.0.0-1174/Re Add2-HYBRID/08-26-14/021131/68eb149dd819e0fcf974500c9b7554ef.zip [199.42 ERROR] (BRun main:513) Caught exception com.couchbase.sdkdclient.context.HarnessException: java.net.SocketException: Connection reset at com.couchbase.sdkdclient.context.HarnessException.create(HarnessException.java:56) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.scenario.PhasedScenario.run(PhasedScenario.java:80) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$4.call(RunContext.java:169) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$4.call(RunContext.java:165) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamDecoder.readBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamDecoder.implRead(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamDecoder.read(Unknown Source) ~[na:1.6.0_27] seems like it's a regression for ssl
    via by Andrei Baranouski,
  • very often in different tests I see the following exception http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/38/consoleFull Running SvcRestart-HYBRID: 2014-07-25 05:20:15 .............. [365.86 INFO] (SDKD log:137) Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of an object. [366.20 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [366.20 INFO] (SDKD log:137)  at Couchbase.Configuration.CouchbaseConfigContext.LoadConfig(IBucketConfig bucketConfig) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\CouchbaseConfigContext.cs:line 51 at Couchbase.Configuration.ConfigContextBase..ctor(IBucketConfig bucketConfig, ClientConfiguration clientConfig, Func`2 ioStrategyFactory, Func`3 connectionPoolFactory, Func`5 saslFactory, IByteConverter converter, ITypeSerializer serializer) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\ConfigContextBase.cs:line 51 at Couchbase.Configuration.CouchbaseConfigContext..ctor(IBucketConfig bucketConfig, ClientConfiguration clientConfig, Func`2 ioStrategyFactory, Func`3 connectionPoolFactory, Func`5 saslFactory, IByteConverter converter, ITypeSerializer serializer) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\CouchbaseConfigContext.cs:line 22 at Couchbase.Configuration.Server.Providers.CarrierPublication.CarrierPublicationProvider.GetConfig(IBucketConfig bucketConfig) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\CarrierPublication\CarrierPublicationProvider.cs:line 63 at Couchbase.Configuration.Server.Providers.CarrierPublication.CarrierPublicationProvider.GetConfig(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\CarrierPublication\CarrierPublicationProvider.cs:line 44 at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 155 at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 82 at Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 55 at Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 262 at SdkdConsole.Daemon.Handle.CreateHandle(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 84 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 103 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [366.20 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [366.21 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@203.259 [366.21 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] client logs http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/38/artifact/log.txt Jeff, believe that this is a problem on client side?
    via by Andrei Baranouski,
  • git log commit 86219ee99ccafdd00c98d577c9bc2b97efef35bb Author: jeffrymorris <jeffrymorris@gmail.com> Date: Wed Aug 20 17:44:45 2014 -0700 NCBC-592: AuthenticationException in CouchbaseBucket.SendWithRetry Running Rb2Out-KV: 2014-08-20 23:33:57 ..... [25.05 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@121.33 [25.05 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@121.43 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [25.05 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_GET  [25.06 INFO] (Scenario run:83) RAMP phase started. Waiting for 30 seconds [25.06 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: { [25.06 INFO] (SDKD log:137)  "DSType": "DSTYPE_SEEDED", [25.06 INFO] (SDKD log:137)  "DS": { [25.07 INFO] (SDKD log:137)  "KSeed": "SimpleKey", [25.07 INFO] (SDKD log:137)  "VSeed": "SimpleValue", [25.07 INFO] (SDKD log:137)  "Count": 10, [25.07 INFO] (SDKD log:137)  "Continuous": true, [25.07 INFO] (SDKD log:137)  "VSize": 128, [25.07 INFO] (SDKD log:137)  "Repeat": "REP", [25.07 INFO] (SDKD log:137)  "KSize": 32 [25.07 INFO] (SDKD log:137)  }, [25.07 INFO] (SDKD log:137)  "Options": { [25.07 INFO] (SDKD log:137)  "DelayMax": 10, [25.07 INFO] (SDKD log:137)  "DelayMin": 1, [25.07 INFO] (SDKD log:137)  "IterWait": 1, [25.07 INFO] (SDKD log:137)  "TimeRes": 1 [25.09 INFO] (SDKD log:137)  } [25.09 INFO] (SDKD log:137) }  [55.06 INFO] (Scenario run:86) Starting CHANGE phase [55.08 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0% [56.10 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0% [57.12 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 2% [58.13 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 4% [59.14 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 7% ................................. [99.67 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 94% [100.69 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 96% [101.70 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 98% [102.70 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [103.71 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [104.72 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [105.72 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [106.74 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [107.74 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [108.75 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [109.76 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [110.76 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [111.77 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 100% [112.75 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409  [112.78 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete [112.79 INFO] (Scenario run:97) CHANGE phase done [112.79 INFO] (Scenario run:103) Starting REBOUND for 90 seconds [113.23 INFO] (SDKD log:137)  [113.26 INFO] (SDKD log:137) Unhandled Exception: Couchbase.ServerUnavailableException: Exception of type 'Couchbase.ServerUnavailableException' was thrown. [125.87 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [125.88 INFO] (SDKD log:137)  at Couchbase.Configuration.ConfigContextBase.GetServer() in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Configuration\ConfigContextBase.cs:line 212 at Couchbase.Core.Buckets.CouchbaseBucket.HandleIOError[T](IOperation`1 operation, IServer server) in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 194 at Couchbase.Core.Buckets.CouchbaseBucket.CanRetryOperation[T](IOperationResult`1 operationResult, IOperation`1 operation, IServer server) in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 179 at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](IOperation`1 operation) in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 104 at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 888 at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 18 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 235 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 156 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [125.89 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [125.89 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.44 [125.90 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]
    via by Andrei Baranouski,
  • after some time the tests begin to fall with 2014-07-28 00:59:20,864 [27] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism. Running Rb2Out-HYBRID: 2014-07-28 00:05:18 rebalance/mode=out workload=HybridWorkloadGroup rebalance/count=2 testcase=RebalanceScenario Logging to c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-973\Rb2Out-HYBRID\07-28-14\025518\7d8cf558a26ca99fe4dc3028bc6b2ec0 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ --rebalance-mode out --workload HybridWorkloadGroup \ --rebalance-count 2 --testcase RebalanceScenario -C share\rexec \ --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port \ 8675 --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase ---------------------------------------->8 [1.47 WARN] (Drivers getDriver:76) 'rexec' is now mapped to *local* execution only. Use RemoteExecutingDriver for remote execution [1.87 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds. [1.88 INFO] (RunContext run:124) Starting cluster and driver [1.89 INFO] (CBCluster startCluster:360) Node http://10.3.121.134:8091 is master now [1.89 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe'  [1.89 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations.. [2.26 INFO] (SDKD log:137) --- Logging Self-Test --- [2.27 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message  [2.27 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675  [2.42 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0 [2.43 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [2.76 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":{"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true},"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.17929"}} [4.02 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.135:8091,ns_1@10.3.121.135> [4.06 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.136:8091,ns_1@10.3.121.136> [4.11 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.3.206:8091,ns_1@10.3.3.206> [4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [4.70 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.134:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.3.206:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.135:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.136:8091 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.134 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.3.206 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.136 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.135 [4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@641a034d [4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@19c6866d [4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@51c293f8 [4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@5a9b8ff9 [4.95 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@6e0f0ad [18.52 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.135:8091 [26.45 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.136:8091 [30.42 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.3.206:8091 [35.78 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance [35.84 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0% [36.84 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete [36.85 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups [36.85 INFO] (CBCluster setupMainBucket:209) Creating bucket default [36.87 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted [42.18 INFO] (CBCluster waitForBucketReady:203) Bucket creation done [42.23 INFO] (RunContext run:143) Driver and cluster initialized [42.26 INFO] (RunContext call:167) Running scenario.. [42.26 INFO] (Scenario run:72) Starting RAMP phase [42.26 INFO] (Workload setupDesign:63) Creating design test_design [42.51 INFO] (Workload setupDesign:80) Design creation done [42.51 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [42.52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [42.53 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101  [42.54 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net  [42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e  [42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net  [42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821  [42.91 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@101.1 [42.91 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@101.2 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}} [43.02 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409  [43.39 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: { [43.39 INFO] (SDKD log:137)  "0": 44, [43.40 INFO] (SDKD log:137)  "264": 956 [43.40 INFO] (SDKD log:137) }  [43.40 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@101.2 => {[OK]: 44, [MEMD:GENERIC]: 956} [43.40 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.3 [43.40 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@102.4 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 102  [43.41 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.42 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@102.4 [43.42 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@102.5 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}} [43.82 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: { [43.82 INFO] (SDKD log:137)  "0": 39, [43.83 INFO] (SDKD log:137)  "264": 961 [43.83 INFO] (SDKD log:137) }  [43.83 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@102.5 => {[OK]: 39, [MEMD:GENERIC]: 961} [43.83 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.6 [43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@103.7 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 103  [43.83 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.85 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@103.7 [43.85 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@103.8 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.85 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@104.9 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.85 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.86 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 104  [43.86 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.87 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@104.9 [43.88 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@104.10 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.88 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@105.11 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 105  [43.88 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.90 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@105.11 [43.90 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@105.12 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.90 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.90 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@106.13 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.91 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 106  [43.91 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.92 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@106.13 [43.93 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@106.14 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.93 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.93 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@107.15 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 107  [43.94 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.97 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@107.15 [43.97 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@107.16 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.97 INFO] (Workload call:112) Preloading items into cluster before workload [43.97 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.97 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@108.17 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.98 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 108  [43.98 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.99 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@108.17 [43.99 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@108.18 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=false, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=0, DelayMin=0, IterWait=100, TimeRes=0}} [51.93 DEBUG] (Handle receiveMessage:158) < MC_DS_MUTATE_SET@108.18 => {[OK]: 364, [MEMD:GENERIC]: 14636} [51.93 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@108.19 [51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@111.22 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@112.23 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@115.26 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@116.27 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@110.21 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@109.20 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@114.25 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@113.24 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@117.28 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.95 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@118.29 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@111.22 [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@111.30 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 111  [52.00 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 110  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 115  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 109  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 114  [52.01 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@119.31 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 116  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 117  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 118  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 112  [52.02 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 113  [52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.03 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@110.21 [52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 119  [52.03 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.03 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@110.32 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.04 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@120.33 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.04 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.05 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 120  [52.07 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.07 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@115.26 [52.07 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@115.34 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.08 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.08 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@121.35 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.09 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 121  [52.10 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.10 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@109.20 [52.10 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@109.36 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.11 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.11 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@122.37 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.12 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 122  [52.12 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.13 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@114.25 [52.13 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@114.38 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.13 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@123.39 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.13 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.14 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 123  [52.16 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.16 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@116.27 [52.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@116.40 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.17 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@124.41 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.17 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.18 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 124  [52.24 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.25 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@117.28 [52.25 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@117.42 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.26 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@125.43 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.26 INFO] (SDKD log:137)  [52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 125  [52.27 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.30 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.30 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@118.29 [52.31 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 1 [52.31 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@118.44 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.31 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40 at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82 at Couchbase.Core.Buckets.CouchbaseBucket.Upsert[T](String key, T value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 121 at Sdkd.Commands.SetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\SetCommand.cs:line 77 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [52.31 INFO] (SDKD log:137)  [52.32 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.32 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@126.45 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.32 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.33 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 126  [52.34 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.35 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@112.23 [52.35 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@112.46 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.37 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@127.47 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 127  [52.40 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@113.24 [52.40 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@113.48 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.40 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@128.49 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.42 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 128  [52.45 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.45 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@119.31 [52.46 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@119.50 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.52 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.53 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@120.33 [52.53 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@120.51 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.55 INFO] (SDKD log:137) +++ Received exception of ID 0 [52.55 INFO] (SDKD log:137)  [52.56 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.63 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.63 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@121.35 [52.63 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@121.52 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.67 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.68 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@122.37 [52.68 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@122.53 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.76 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.77 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@123.39 [52.77 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@123.54 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.05 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [53.05 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@124.41 [53.05 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@124.55 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.15 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [53.15 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@125.43 [53.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@125.56 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.17 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 3 [53.18 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40 at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82 at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 282 at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 18 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [53.18 INFO] (SDKD log:137)  [53.19 INFO] (SDKD log:137) Unhandled Exception: Couchbase.Configuration.ConfigException: Could not bootstrap default. See log for details. [65.28 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [65.29 INFO] (SDKD log:137)  at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 210 at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 82 at Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 55 at Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 262 at SdkdConsole.Daemon.Handle.CreateHandle(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 84 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 103 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [65.30 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [65.31 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.57 [65.31 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]
    via by Andrei Baranouski,
  • call packages\sdkdclient\bin\brun.bat -A S3Creds_tmp -I cluster_conf ig.ini -I sdkd.args --variants HYBRID -d all:trace [0.30 INFO] (BRun run:436) Initializing S3 [1.12 INFO] (BRun run:441) Initializing history database [1.75 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools ============================================================ Running ReAdd2-HYBRID: 2014-08-26 22:31:28 workload=HybridWorkloadGroup failover/next_action=FO_READD_REBALANCE failover/count=2 failover/next_delay=45 testcase=FailoverScenario Logging to c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-1174\ReAdd2-HYBRID\08-26-14\0198 88\0dcd5a5bc61e625f06a757ab9dfa7db5 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ \ --workload HybridWorkloadGroup --failover-next_action \ FO_READD_REBALANCE --failover-count 2 --failover-next_delay 45 \ --testcase FailoverScenario -C share\rexec --rexec_path \ C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port 8675 \ --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 --cluster_ssh-username=root --cluster_ssh-password=couchbase ..... [123.71 INFO] (Scenario run:86) Starting CHANGE phase [123.71 INFO] (CBCluster failoverNodes:588) Failing over <URI:10.3.121.135:8091,ns_1@10.3.121.135> [123.72 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/failOver [124.10 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409 [124.13 INFO] (CBCluster failoverNodes:588) Failing over <URI:10.3.121.136:8091,ns_1@10.3.121.136> [124.14 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/failOver [124.40 INFO] (FailoverAction change:104) Nodes failed over. Requested sleep for 45 seconds [125.61 INFO] (SDKD log:137) [125.63 INFO] (SDKD log:137) Unhandled Exception: Couchbase.ServerUnavailableException: Exception of type 'Couchbase.ServerUnavail ableException' was thrown. [169.41 INFO] (FailoverAction doNextAction:68) Readding nodes after failover [169.41 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/reAddNode [169.41 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/reAddNode [169.42 INFO] (FailoverAction doNextAction:85) Rebalancing nodes after failover [169.42 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools/nodes [169.43 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/rebalance [169.45 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools/default/rebalanceProgress [169.45 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0% [170.46 TRACE] (CouchbaseAdmin getResponseJson:167) GET .... [196.67 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools/default/rebalanceProgress [196.68 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 37% [197.59 INFO] (SDKD log:137) [Sdkd.ViewQuery|Error] ... System.NullReferenceException Object reference not set to an instance of a n object. at Sdkd.Views.ViewCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Views\ViewComman d.cs:line 268 [197.61 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [197.61 INFO] (SDKD log:137) at Couchbase.Configuration.ConfigContextBase.GetServer() in c:\jenkins\workspace\.net-sdkdclient-n g2-andrei\couchbase-net-client\Src\Couchbase\Configuration\ConfigContextBase.cs:line 210 at Couchbase.Core.Buckets.CouchbaseBucket.HandleIOError[T](IOperation`1 operation, IServer server) in c:\jenkins\workspace\.net -sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 194 at Couchbase.Core.Buckets.CouchbaseBucket.CanRetryOperation[T](IOperationResult`1 operationResult, IOperation`1 operation, ISer ver server) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs: line 179 at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2- andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 104 at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-c lient\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 888 at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net \src\Sdkd\Commands\GetCommand.cs:line 18 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:lin e 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) in c:\jenkins\workspace\.net-sdkdclient-ng2-andr ei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 295 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs :line 175 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boo lean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean pre serveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [197.64 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [197.66 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.73 [197.66 TRACE] (Handle sendMessageAsync:185) > {"Command":"CLOSEHANDLE","Handle":103,"ReqID":73,"CommandData":{}} [197.66 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] [197.68 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools/default/rebalanceProgress [197.83 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 39% [198.80 INFO] (BRun uploadFile:141) Uploaded RAW => http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-3.0.0-1174/Re Add2-HYBRID/08-26-14/019888/0dcd5a5bc61e625f06a757ab9dfa7db5.zip [198.83 TRACE] (CouchbaseAdmin getResponseJson:167) GET http://10.3.121.134:8091/pools/default/rebalanceProgress
    via by Andrei Baranouski,
  • http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2_win2012_64_andrei/23/consoleFull Running SvcRestart-HYBRID: 2014-09-11 23:57:30 service/restore_delay=5 workload=HybridWorkloadGroup service/name=SYSV_SERVICE service/action=kill service/count=3 testcase=ServiceFailureScenario Logging to c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-1208\SvcRestart-HYBRID\09-11-14\025050\880a91bc80225536124352f8115cbc71 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ --service-restore_delay 5 --workload HybridWorkloadGroup \ --service-name SYSV_SERVICE --service-action kill --service-count \ 3 --testcase ServiceFailureScenario -C share\rexec --rexec_path \ C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port 8675 \ --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase ..... [2157.71 INFO] (Scenario run:83) RAMP phase started. Waiting for 30 seconds [2157.71 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CB_VIEW_QUERY  [2157.71 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: { [2157.71 INFO] (SDKD log:137)  "DSType": "DSTYPE_SEEDED", [2157.71 INFO] (SDKD log:137)  "DS": {}, [2157.71 INFO] (SDKD log:137)  "ViewParameters": { [2157.71 INFO] (SDKD log:137)  "limit": 0 [2157.71 INFO] (SDKD log:137)  }, [2157.71 INFO] (SDKD log:137)  "DesignName": "test_design", [2157.71 INFO] (SDKD log:137)  "Options": { [2157.71 INFO] (SDKD log:137)  "DelayMax": 10, [2157.71 INFO] (SDKD log:137)  "DelayMin": 1, [2157.71 INFO] (SDKD log:137)  "IterWait": 1, [2157.71 INFO] (SDKD log:137)  "ViewQueryCount": -1, [2157.71 INFO] (SDKD log:137)  "ViewQueryDelay": 0, [2157.71 INFO] (SDKD log:137)  "TimeRes": 1 [2157.71 INFO] (SDKD log:137)  }, [2157.71 INFO] (SDKD log:137)  "ViewName": "test_view" [2157.71 INFO] (SDKD log:137) }  [2187.71 INFO] (Scenario run:86) Starting CHANGE phase [2187.72 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server stop on 10.3.121.135 [2190.35 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409  [2191.77 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@52d654 [2192.77 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server stop on 10.3.121.136 [2196.16 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@38c8c5 [2197.19 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server stop on 10.3.3.206 [2201.34 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@f522e8 [2202.34 INFO] (Scenario sleepAndDo:109) Sleeping 5 seconds [2207.38 INFO] (Scenario executeChange:134) Turning on services for nodes [2207.38 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start on 10.3.121.135 [2208.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@19c873d [2209.96 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start on 10.3.121.136 [2211.47 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@12a2259 [2212.47 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start on 10.3.3.206 [2214.05 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@fe0ce9 [2215.05 INFO] (Scenario run:97) CHANGE phase done [2215.05 INFO] (Scenario run:103) Starting REBOUND for 90 seconds [2223.95 INFO] (SDKD log:137)  [2223.95 INFO] (SDKD log:137)  [2224.03 INFO] (SDKD log:137) Unhandled Exception: Unhandled Exception: Unhandled Exception: Unhandled Exception: Unhandled Exception: Unhandled Exception: Unhandled Exception:  [2224.04 INFO] (SDKD log:137) Unhandled Exception: System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 1 [2224.10 INFO] (SDKD log:137)  at System.Threading.CancellationToken.ThrowOperationCanceledException() at System.Threading.ManualResetEventSlim.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.SpinThenBlockingWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.InternalWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(CancellationToken cancellationToken) at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](ViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 0 at Couchbase.Core.Buckets.CouchbaseBucket.Query[T](IViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 1128 at Sdkd.Views.ViewCommand.GetViewObject(CouchbaseBucket cli, Request req, ViewOptions vo) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 164 at Sdkd.Views.ViewCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 265 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 266 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 146 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 3 [2224.10 INFO] (SDKD log:137)  at System.Threading.CancellationToken.ThrowOperationCanceledException() at System.Threading.ManualResetEventSlim.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.SpinThenBlockingWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.InternalWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(CancellationToken cancellationToken) at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](ViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 1141 at Couchbase.Core.Buckets.CouchbaseBucket.Query[T](IViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 1128 at Sdkd.Views.ViewCommand.GetViewObject(CouchbaseBucket cli, Request req, ViewOptions vo) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 164 at Sdkd.Views.ViewCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 265 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 266 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 146 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (SDKD log:137) +++ Received exception of ID 2 [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (SDKD log:137) +++ Received exception of ID 2 [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (SDKD log:137) +++ Received exception of ID 2 [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (SDKD log:137) +++ Received exception of ID 2 [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2224.10 INFO] (SDKD log:137) +++ Received exception of ID 2 [2224.10 INFO] (SDKD log:137) System.OperationCanceledException: The operation was canceled. [2235.04 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [2235.04 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_16] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_16] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_16] [2235.04 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@278.598 [2235.04 INFO] (SDKD log:137)  at System.Threading.CancellationToken.ThrowOperationCanceledException() at System.Threading.ManualResetEventSlim.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.SpinThenBlockingWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.InternalWait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at System.Threading.Tasks.Task.Wait(CancellationToken cancellationToken) at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](ViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 1141 at Couchbase.Core.Buckets.CouchbaseBucket.Query[T](IViewQuery query) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 1128 at Sdkd.Views.ViewCommand.GetViewObject(CouchbaseBucket cli, Request req, ViewOptions vo) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 164 at Sdkd.Views.ViewCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line 265 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 266 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2_win2012_64_andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 146 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [2235.05 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_16] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_16] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_16] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_16] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_16] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_16] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_16] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_16] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_16] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] [2236.12 INFO] (BRun uploadFile:141) Uploaded RAW => http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-3.0.0-1208/SvcRestart-HYBRID/09-11-14/025050/880a91bc80225536124352f8115cbc71.zip the same test passed in previous runs http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/91/consoleFull
    via by Andrei Baranouski,
  • Unfortunately this run was without client logging because I was not planning to test client) will try to provide them later, if I will be able to reproduce it c:\jenkins\workspace-net2\sdkdclient-ng>call packages\sdkdclient\bin\brun.bat -I cluster_config.ini -I sdkd.args --variants HYBRID -d all:debug --no-upload [0,13 INFO] (BRun run:441) Initializing history database ============================================================ Running Rb2Out-HYBRID: 2014-09-06 12:43:12 rebalance/count=2 workload=HybridWorkloadGroup rebalance/mode=out testcase=RebalanceScenario Logging to c:\jenkins\workspace-net2\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-1208\Rb2Out-HYBRID\09-06-14\034992\74769ea477613d9a56c4eb5d41d6c987 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ \ --rebalance-count 2 --workload HybridWorkloadGroup \ --rebalance-mode out --testcase RebalanceScenario -C share\rexec \ --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port \ 8675 --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_useSSL=True --cluster_ssh-username=root --cluster_ssh-password=couchbase ..... [3870,95 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [3870,95 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 127 [3876,33 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@127.56 [3876,33 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@127.57 => {Options={DelayMin=1, TimeRes=1, ViewQueryCount=-1, IterWait=1, ViewQueryDelay=0, DelayMax=10}, ViewParameters={limit=0}, DesignName=test_design, DSType=DSTYPE_SEEDED, ViewName=t est_view, DS={}} [3876,34 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CB_VIEW_QUERY [3876,34 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@128.58 => {Options={OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]], Username=default, SSL=true, Password=}, Bucket=default, Port=8091, Hostname=10.3.121.134} [3876,34 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: { [3876,34 INFO] (SDKD log:137) "Options": { [3876,35 INFO] (SDKD log:137) "DelayMin": 1, [3876,35 INFO] (SDKD log:137) "TimeRes": 1, [3876,35 INFO] (SDKD log:137) "ViewQueryCount": -1, [3876,35 INFO] (SDKD log:137) "IterWait": 1, [3876,36 INFO] (SDKD log:137) "ViewQueryDelay": 0, [3876,36 INFO] (SDKD log:137) "DelayMax": 10 [3876,36 INFO] (SDKD log:137) }, [3876,36 INFO] (SDKD log:137) "ViewParameters": { [3876,37 INFO] (SDKD log:137) "limit": 0 [3876,37 INFO] (SDKD log:137) }, [3876,37 INFO] (SDKD log:137) "DesignName": "test_design", [3876,37 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED", [3876,38 INFO] (SDKD log:137) "ViewName": "test_view", [3876,38 INFO] (SDKD log:137) "DS": {} [3876,38 INFO] (SDKD log:137) } [3876,38 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [3876,39 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 128 [3892,59 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@128.58 [3892,59 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@128.59 => {Options={DelayMin=1, TimeRes=1, ViewQueryCount=-1, IterWait=1, ViewQueryDelay=0, DelayMax=10}, ViewParameters={limit=0}, DesignName=test_design, DSType=DSTYPE_SEEDED, ViewName=t est_view, DS={}} [3892,59 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CB_VIEW_QUERY [3892,59 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: { [3892,59 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@129.60 => {Options={OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]], Username=default, SSL=true, Password=}, Bucket=default, Port=8091, Hostname=10.3.121.134} [3892,59 INFO] (SDKD log:137) "Options": { [3892,59 INFO] (SDKD log:137) "DelayMin": 1, [3892,60 INFO] (SDKD log:137) "TimeRes": 1, [3892,60 INFO] (SDKD log:137) "ViewQueryCount": -1, [3892,60 INFO] (SDKD log:137) "IterWait": 1, [3892,60 INFO] (SDKD log:137) "ViewQueryDelay": 0, [3892,60 INFO] (SDKD log:137) "DelayMax": 10 [3892,60 INFO] (SDKD log:137) }, [3892,60 INFO] (SDKD log:137) "ViewParameters": { [3892,60 INFO] (SDKD log:137) "limit": 0 [3892,61 INFO] (SDKD log:137) }, [3892,61 INFO] (SDKD log:137) "DesignName": "test_design", [3892,61 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED", [3892,61 INFO] (SDKD log:137) "ViewName": "test_view", [3892,61 INFO] (SDKD log:137) "DS": {} [3892,62 INFO] (SDKD log:137) } [3892,62 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [3892,62 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 129 [3898,85 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@129.60 [3898,85 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@129.61 => {Options={DelayMin=0, TimeRes=0, IterWait=1, DelayMax=0}, Schema={InflateLevel=40, InflateContent=meh}, DSType=DSTYPE_SEEDED, DS={KSize=12, KSeed=ViewFillerSeed, VSize=512, VSeed= ViewFillerSeed, Continuous=false, Repeat=rep, Count=1000}} [3898,85 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CB_VIEW_LOAD [3898,86 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: { [3898,86 INFO] (SDKD log:137) "Options": { [3898,86 INFO] (SDKD log:137) "DelayMin": 0, [3898,86 INFO] (SDKD log:137) "TimeRes": 0, [3898,86 INFO] (SDKD log:137) "IterWait": 1, [3898,87 INFO] (SDKD log:137) "DelayMax": 0 [3898,87 INFO] (SDKD log:137) }, [3898,87 INFO] (SDKD log:137) "Schema": { [3898,87 INFO] (SDKD log:137) "InflateLevel": 40, [3898,88 INFO] (SDKD log:137) "InflateContent": "meh" [3898,88 INFO] (SDKD log:137) }, [3898,88 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED", [3898,88 INFO] (SDKD log:137) "DS": { [3898,88 INFO] (SDKD log:137) "KSize": 12, [3898,89 INFO] (SDKD log:137) "KSeed": "ViewFillerSeed", [3898,89 INFO] (SDKD log:137) "VSize": 512, [3898,89 INFO] (SDKD log:137) "VSeed": "ViewFillerSeed", [3898,89 INFO] (SDKD log:137) "Continuous": false, [3898,89 INFO] (SDKD log:137) "Repeat": "rep", [3898,89 INFO] (SDKD log:137) "Count": 1000 [3898,90 INFO] (SDKD log:137) } [3898,90 INFO] (SDKD log:137) } [4038,12 INFO] (SDKD log:137) [Sdkd.ViewLoader|Warn] there are no OK responses in ViewLoader [4038,12 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: { [4038,12 INFO] (SDKD log:137) "0": 579, [4038,12 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@129.61 => {[OK]: 579, [MEMD:GENERIC]: 421} [4038,12 INFO] (SDKD log:137) "264": 421 [4038,13 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@129.62 [4038,13 INFO] (SDKD log:137) } [4038,13 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@130.63 => {Options={OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]], Username=default, SSL=true, Password=}, Bucket=default, Port=8091, Hostname=10.3.121.134} [4038,13 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [4038,13 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CLOSEHANDLE [4038,14 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {} [4038,14 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Release CouchbaseBucket -436020959 [4038,14 INFO] (SDKD log:137) [Sdkd.Handle|Warn] DispatchCommand(req, SdkHandle) == false [4038,14 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 130 [4039,99 INFO] (SDKD log:137) [4040,07 INFO] (SDKD log:137) Unhandled Exception: System.ArgumentOutOfRangeException: Index and the counter should indicate the position at the buffer [4040,08 INFO] (SDKD log:137) prameter name: bytes [4040,08 INFO] (SDKD log:137) at System.Text.UTF8Encoding.GetString(Byte[] bytes, Int32 index, Int32 count) [4040,08 INFO] (SDKD log:137) at Couchbase.Core.Serializers.TypeSerializer.Deserialize(Byte[] buffer, Int32 offset, Int32 length) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\Serializers\TypeSerializer.cs:line 197 [4040,08 INFO] (SDKD log:137) at Couchbase.Core.Serializers.TypeSerializer.Deserialize[T](Byte[] buffer, Int32 offset, Int32 length) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\Serializers\TypeSerializer.cs:line 86 [4040,08 INFO] (SDKD log:137) at Couchbase.IO.Operations.OperationBase`1.GetValue() at d:\couchbase_src\couchbase-net-client\Src\Couchbase\IO\Operations\OperationBase'.cs:line 229 [4040,09 INFO] (SDKD log:137) at Couchbase.IO.Operations.OperationBase`1.GetResult() at d:\couchbase_src\couchbase-net-client\Src\Couchbase\IO\Operations\OperationBase'.cs:line 198 [4040,09 INFO] (SDKD log:137) at Couchbase.Core.Server.Send[T](IOperation`1 operation) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 91 [4040,09 INFO] (SDKD log:137) at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](IOperation`1 operation) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 98 [4040,09 INFO] (SDKD log:137) at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 894 [4040,09 INFO] (SDKD log:137) at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) at d:\couchbase_src\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 17 [4040,10 INFO] (SDKD log:137) at Sdkd.Commands.KVCommand.Run() at d:\couchbase_src\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 24 [4040,10 INFO] (SDKD log:137) at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) at d:\couchbase_src\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 266 [4040,10 INFO] (SDKD log:137) at SdkdConsole.Daemon.Handle.Run() at d:\couchbase_src\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 146 [4040,10 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart_Context(Object state) [4040,10 INFO] (SDKD log:137) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [4040,10 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [4040,11 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) [4040,11 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart() [4078,01 INFO] (SDKD log:137) [4078,01 INFO] (SDKD log:137) Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of the object. [4078,02 INFO] (SDKD log:137) at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 160 [4078,02 INFO] (SDKD log:137) at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) at d:\couchbase_src\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 84 [4078,02 INFO] (SDKD log:137) at SdkdConsole.Daemon.Handle.Run() at d:\couchbase_src\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 125 [4078,02 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart_Context(Object state) [4078,02 INFO] (SDKD log:137) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [4078,03 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [4078,03 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) [4078,03 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart() [4090,68 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.8.0_11] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.8.0_11] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.8.0_11] at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_11] [4090,70 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.64 [4090,71 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.8.0_11] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.8.0_11] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.8.0_11] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.8.0_11] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.8.0_11] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.8.0_11] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.8.0_11] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.8.0_11] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.8.0_11] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]
    via by Andrei Baranouski,
  • commit 300510ecde3 http://sdkbuilds.couchbase.com/job/win008-p0-net-client2/200/console [156.82 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 37% [157.14 INFO] (SDKD log:137)  [157.24 INFO] (SDKD log:137) Unhandled Exception: System.ObjectDisposedException: Cannot access a disposed object. [157.24 INFO] (SDKD log:137) Object name: 'System.Net.Sockets.Socket'. [157.84 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 37% [158.85 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 39% [159.86 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 39% [160.88 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 40% [161.90 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 41% [162.91 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 42% [163.96 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 43% [164.97 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 44% [165.98 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 45% [166.99 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 46% [168.01 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 47% [169.03 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 48% [170.04 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 48% [171.07 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 49% [172.08 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 50% [173.09 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 51% [174.11 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 52% [174.34 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 512  [174.45 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [174.45 INFO] (SDKD log:137)  at System.Net.Sockets.Socket.ReceiveAsync(SocketAsyncEventArgs e) at Couchbase.IO.Connection.Receive(Socket socket, SocketAsyncEventArgs e) in c:\jenkins\workspace\win008-p0-net-client2\couchbase-net-client\Src\Couchbase\IO\Connection.cs:line 153 at Couchbase.IO.Connection.OnCompleted(Object sender, SocketAsyncEventArgs e) in c:\jenkins\workspace\win008-p0-net-client2\couchbase-net-client\Src\Couchbase\IO\Connection.cs:line 95 at System.Net.Sockets.SocketAsyncEventArgs.OnCompleted(SocketAsyncEventArgs e) at System.Net.Sockets.SocketAsyncEventArgs.ExecutionCallback(Object ignored) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Net.Sockets.SocketAsyncEventArgs.FinishOperationSuccess(SocketError socketError, Int32 bytesTransferred, SocketFlags flags) at System.Net.Sockets.SocketAsyncEventArgs.CompletionPortCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nativeOverlapped) at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVERLAP) [174.47 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [174.47 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.73 [174.47 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] [175.11 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 52% [175.71 INFO] (BRun uploadFile:141) Uploaded RAW => http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-3.0.0-1209/Rb2OutEpt-HYBRID/01-05-15/066167/1960fd1aa849e76fa16054d791626bf5.zip there are no logs for now, tests are still running. will try to get logs separately for this test
    via by Andrei Baranouski,
  • commit 300510ecde3 http://sdkbuilds.couchbase.com/job/win008-p0-net-client2/200/consoleFull there are a lot tests that terminated at the beginning of rebalance/failover [353.11 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 34% [354.14 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 34% [354.68 INFO] (SDKD log:137)  [354.68 INFO] (SDKD log:137) Unhandled Exception: System.Net.Sockets.SocketException: An established connection was aborted by the software in your host machine [355.15 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 35% [356.16 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 35% [357.17 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 37% [358.17 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 37% [359.19 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 38% [360.20 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 39% [361.21 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 40% [362.22 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 41% [363.22 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 42% [364.23 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 42% [365.24 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 43% [366.24 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 44% [367.25 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 45% [368.26 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 46% [368.70 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 512  [368.95 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [368.95 INFO] (SDKD log:137)  at Couchbase.IO.Connection.Receive(Socket socket, SocketAsyncEventArgs e) in c:\jenkins\workspace\win008-p0-net-client2\couchbase-net-client\Src\Couchbase\IO\Connection.cs:line 168 at Couchbase.IO.Connection.OnCompleted(Object sender, SocketAsyncEventArgs e) in c:\jenkins\workspace\win008-p0-net-client2\couchbase-net-client\Src\Couchbase\IO\Connection.cs:line 95 at System.Net.Sockets.SocketAsyncEventArgs.OnCompleted(SocketAsyncEventArgs e) at System.Net.Sockets.SocketAsyncEventArgs.ExecutionCallback(Object ignored) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Net.Sockets.SocketAsyncEventArgs.FinishOperationSuccess(SocketError socketError, Int32 bytesTransferred, SocketFlags flags) at System.Net.Sockets.SocketAsyncEventArgs.CompletionPortCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nativeOverlapped) at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVERLAP) [368.95 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [368.95 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@138.147 [368.96 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na] [369.27 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 46% [369.88 INFO] (BRun uploadFile:141) Uploaded RAW => http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-3.0.0-1209/Rb2Out-HYBRID/01-05-15/066340/889ddbfb9e7c53db1b63c2b149856fd4.zip will try to get logs separately for this test
    via by Andrei Baranouski,
  • after some time the tests begin to fall with 2014-07-28 00:59:20,864 [27] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism. Running Rb2Out-HYBRID: 2014-07-28 00:05:18 rebalance/mode=out workload=HybridWorkloadGroup rebalance/count=2 testcase=RebalanceScenario Logging to c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-973\Rb2Out-HYBRID\07-28-14\025518\7d8cf558a26ca99fe4dc3028bc6b2ec0 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ --rebalance-mode out --workload HybridWorkloadGroup \ --rebalance-count 2 --testcase RebalanceScenario -C share\rexec \ --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port \ 8675 --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase ---------------------------------------->8 [1.47 WARN] (Drivers getDriver:76) 'rexec' is now mapped to *local* execution only. Use RemoteExecutingDriver for remote execution [1.87 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds. [1.88 INFO] (RunContext run:124) Starting cluster and driver [1.89 INFO] (CBCluster startCluster:360) Node http://10.3.121.134:8091 is master now [1.89 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe'  [1.89 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations.. [2.26 INFO] (SDKD log:137) --- Logging Self-Test --- [2.27 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message  [2.27 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message  [2.28 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675  [2.42 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0 [2.43 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [2.76 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":{"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true},"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.17929"}} [4.02 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.135:8091,ns_1@10.3.121.135> [4.06 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.136:8091,ns_1@10.3.121.136> [4.11 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.3.206:8091,ns_1@10.3.3.206> [4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [4.70 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.134:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.3.206:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.135:8091 [4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.136:8091 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.134 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.3.206 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.136 [4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.135 [4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@641a034d [4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@19c6866d [4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@51c293f8 [4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@5a9b8ff9 [4.95 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@6e0f0ad [18.52 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.135:8091 [26.45 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.136:8091 [30.42 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.3.206:8091 [35.78 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance [35.84 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0% [36.84 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete [36.85 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups [36.85 INFO] (CBCluster setupMainBucket:209) Creating bucket default [36.87 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted [42.18 INFO] (CBCluster waitForBucketReady:203) Bucket creation done [42.23 INFO] (RunContext run:143) Driver and cluster initialized [42.26 INFO] (RunContext call:167) Running scenario.. [42.26 INFO] (Scenario run:72) Starting RAMP phase [42.26 INFO] (Workload setupDesign:63) Creating design test_design [42.51 INFO] (Workload setupDesign:80) Design creation done [42.51 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [42.52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [42.53 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101  [42.54 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net  [42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e  [42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net  [42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821  [42.91 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@101.1 [42.91 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@101.2 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}} [43.02 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409  [43.39 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: { [43.39 INFO] (SDKD log:137)  "0": 44, [43.40 INFO] (SDKD log:137)  "264": 956 [43.40 INFO] (SDKD log:137) }  [43.40 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@101.2 => {[OK]: 44, [MEMD:GENERIC]: 956} [43.40 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.3 [43.40 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@102.4 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 102  [43.41 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.42 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@102.4 [43.42 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@102.5 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}} [43.82 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: { [43.82 INFO] (SDKD log:137)  "0": 39, [43.83 INFO] (SDKD log:137)  "264": 961 [43.83 INFO] (SDKD log:137) }  [43.83 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@102.5 => {[OK]: 39, [MEMD:GENERIC]: 961} [43.83 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.6 [43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@103.7 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 103  [43.83 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.85 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@103.7 [43.85 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@103.8 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.85 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@104.9 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.85 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.86 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 104  [43.86 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.87 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@104.9 [43.88 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@104.10 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.88 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@105.11 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 105  [43.88 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.90 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@105.11 [43.90 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@105.12 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.90 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.90 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@106.13 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.91 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 106  [43.91 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.92 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@106.13 [43.93 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@106.14 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.93 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.93 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@107.15 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 107  [43.94 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.97 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@107.15 [43.97 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@107.16 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view} [43.97 INFO] (Workload call:112) Preloading items into cluster before workload [43.97 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [43.97 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@108.17 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [43.98 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 108  [43.98 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [43.99 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@108.17 [43.99 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@108.18 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=false, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=0, DelayMin=0, IterWait=100, TimeRes=0}} [51.93 DEBUG] (Handle receiveMessage:158) < MC_DS_MUTATE_SET@108.18 => {[OK]: 364, [MEMD:GENERIC]: 14636} [51.93 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@108.19 [51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@111.22 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@112.23 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@115.26 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@116.27 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@110.21 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@109.20 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@114.25 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@113.24 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@117.28 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.95 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@118.29 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@111.22 [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.00 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@111.30 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 111  [52.00 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 110  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 115  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 109  [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 114  [52.01 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@119.31 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 116  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 117  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 118  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 112  [52.02 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 113  [52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.03 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@110.21 [52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 119  [52.03 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.03 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@110.32 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.04 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@120.33 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.04 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.05 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 120  [52.07 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.07 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@115.26 [52.07 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@115.34 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.08 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.08 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@121.35 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.09 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 121  [52.10 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.10 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@109.20 [52.10 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@109.36 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.11 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.11 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@122.37 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.12 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 122  [52.12 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.13 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@114.25 [52.13 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@114.38 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.13 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@123.39 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.13 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.14 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 123  [52.16 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.16 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@116.27 [52.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@116.40 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.17 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@124.41 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.17 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.18 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 124  [52.24 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.25 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@117.28 [52.25 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@117.42 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.26 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@125.43 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.26 INFO] (SDKD log:137)  [52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 125  [52.27 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.30 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.30 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@118.29 [52.31 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 1 [52.31 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@118.44 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.31 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40 at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82 at Couchbase.Core.Buckets.CouchbaseBucket.Upsert[T](String key, T value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 121 at Sdkd.Commands.SetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\SetCommand.cs:line 77 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [52.31 INFO] (SDKD log:137)  [52.32 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.32 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@126.45 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.32 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.33 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 126  [52.34 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.35 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@112.23 [52.35 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@112.46 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.37 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@127.47 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 127  [52.40 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@113.24 [52.40 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@113.48 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.40 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@128.49 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [52.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle  [52.42 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 128  [52.45 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.45 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@119.31 [52.46 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@119.50 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.52 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.53 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@120.33 [52.53 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@120.51 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.55 INFO] (SDKD log:137) +++ Received exception of ID 0 [52.55 INFO] (SDKD log:137)  [52.56 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default [52.63 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.63 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@121.35 [52.63 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@121.52 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.67 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.68 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@122.37 [52.68 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@122.53 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [52.76 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [52.77 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@123.39 [52.77 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@123.54 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.05 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [53.05 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@124.41 [53.05 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@124.55 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.15 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew  [53.15 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@125.43 [53.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@125.56 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}} [53.17 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 3 [53.18 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75 at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40 at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82 at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 282 at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 18 at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25 at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [53.18 INFO] (SDKD log:137)  [53.19 INFO] (SDKD log:137) Unhandled Exception: Couchbase.Configuration.ConfigException: Could not bootstrap default. See log for details. [65.28 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer [65.29 INFO] (SDKD log:137)  at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 210 at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 82 at Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 55 at Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 262 at SdkdConsole.Daemon.Handle.CreateHandle(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 84 at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 103 at System.Threading.ThreadHelper.ThreadStart_Context(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.ThreadHelper.ThreadStart() [65.30 ERROR] (BRun maybePropagate:243) Suppressing driver-related error com.couchbase.sdkdclient.context.HarnessException: Driver crashed at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27] at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27] [65.31 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.57 [65.31 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]
    via by Andrei Baranouski,
    • java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method)[na:1.6.0_16] at java.net.SocketOutputStream.socketWrite(Unknown Source)[na:1.6.0_16] at java.net.SocketOutputStream.write(Unknown Source)[na:1.6.0_16] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source)[na:1.6.0_16] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source)[na:1.6.0_16] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source)[na:1.6.0_16] at sun.nio.cs.StreamEncoder.flush(Unknown Source)[na:1.6.0_16] at java.io.OutputStreamWriter.flush(Unknown Source)[na:1.6.0_16] at java.io.BufferedWriter.flush(Unknown Source)[na:1.6.0_16] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478)[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510)[sdkdclient-1.0-SNAPSHOT.jar:na]

    Users with the same issue

    Unknown visitor
    Unknown visitor1 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    poroszdporoszd
    3 times, last one,
    Unknown visitor
    Unknown visitor1 times, last one,
    210 more bugmates