org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][13]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false}

Sakai JIRA | Stephen Marquard | 2 years ago
  1. 0

    elasticsearch configured in a cluster with elasticsearch.discovery.zen.ping.multicast.enabled=false elasticsearch.discovery.zen.ping.unicast.hosts=... Lots of errors like this, with the underlying cause appearing to be Caused by: java.lang.ClassNotFoundException: org.elasticsearch.transport.RemoteTransportException 2014-07-12 11:51:14,436 WARN elasticsearch[vula3b][generic][T#8] org.elasticsearch.cluster.action.shard - [vula3b] [sakai_index][7] sending failed shard for [sakai_index][7], node[mQMddOFLQgCQ68bBtNidqg], relocating [djVmgLkoSwu8WMm-onPrGg], [P], s[INITIALIZING], indexUUID [T_SE_DmMSDur85x_9naLDg], reason [Failed to start shard, message [RecoveryFailedException[[sakai_index][7]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false}]; nested: RemoteTransportException[Failed to deserialize exception response from stream]; nested: TransportSerializationException[Failed to deserialize exception response from stream]; nested: InvalidClassException[failed to read class descriptor]; nested: ClassNotFoundException[org.elasticsearch.transport.RemoteTransportException]; ]] 2014-07-12 11:51:14,464 WARN elasticsearch[vula3b][transport_client_worker][T#1]{New I/O worker #1} org.elasticsearch.transport.netty - [vula3b] Message not fully read (response) for [20961] handler future(org.elasticsearch.indices.recovery.RecoveryTarget$4@602b118f), error [true], resetting 2014-07-12 11:51:14,464 WARN elasticsearch[vula3b][generic][T#8] org.elasticsearch.indices.cluster - [vula3b] [sakai_index][13] failed to start shard org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][13]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false} at org.elasticsearch.indices.recovery.RecoveryTarget.doRecovery(RecoveryTarget.java:303) at org.elasticsearch.indices.recovery.RecoveryTarget.access$300(RecoveryTarget.java:65) at org.elasticsearch.indices.recovery.RecoveryTarget$2.run(RecoveryTarget.java:171) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.elasticsearch.transport.RemoteTransportException: Failed to deserialize exception response from stream Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize exception response from stream at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:169) at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:123) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.InvalidClassException: failed to read class descriptor at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1603) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:167) ... 23 more Caused by: java.lang.ClassNotFoundException: org.elasticsearch.transport.RemoteTransportException at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720) at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571) at org.elasticsearch.common.io.ThrowableObjectInputStream.loadClass(ThrowableObjectInputStream.java:93) at org.elasticsearch.common.io.ThrowableObjectInputStream.readClassDescriptor(ThrowableObjectInputStream.java:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) ... 28 more

    Sakai JIRA | 2 years ago | Stephen Marquard
    org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][13]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false}
  2. 0

    elasticsearch configured in a cluster with elasticsearch.discovery.zen.ping.multicast.enabled=false elasticsearch.discovery.zen.ping.unicast.hosts=... Lots of errors like this, with the underlying cause appearing to be Caused by: java.lang.ClassNotFoundException: org.elasticsearch.transport.RemoteTransportException 2014-07-12 11:51:14,436 WARN elasticsearch[vula3b][generic][T#8] org.elasticsearch.cluster.action.shard - [vula3b] [sakai_index][7] sending failed shard for [sakai_index][7], node[mQMddOFLQgCQ68bBtNidqg], relocating [djVmgLkoSwu8WMm-onPrGg], [P], s[INITIALIZING], indexUUID [T_SE_DmMSDur85x_9naLDg], reason [Failed to start shard, message [RecoveryFailedException[[sakai_index][7]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false}]; nested: RemoteTransportException[Failed to deserialize exception response from stream]; nested: TransportSerializationException[Failed to deserialize exception response from stream]; nested: InvalidClassException[failed to read class descriptor]; nested: ClassNotFoundException[org.elasticsearch.transport.RemoteTransportException]; ]] 2014-07-12 11:51:14,464 WARN elasticsearch[vula3b][transport_client_worker][T#1]{New I/O worker #1} org.elasticsearch.transport.netty - [vula3b] Message not fully read (response) for [20961] handler future(org.elasticsearch.indices.recovery.RecoveryTarget$4@602b118f), error [true], resetting 2014-07-12 11:51:14,464 WARN elasticsearch[vula3b][generic][T#8] org.elasticsearch.indices.cluster - [vula3b] [sakai_index][13] failed to start shard org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][13]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false} at org.elasticsearch.indices.recovery.RecoveryTarget.doRecovery(RecoveryTarget.java:303) at org.elasticsearch.indices.recovery.RecoveryTarget.access$300(RecoveryTarget.java:65) at org.elasticsearch.indices.recovery.RecoveryTarget$2.run(RecoveryTarget.java:171) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.elasticsearch.transport.RemoteTransportException: Failed to deserialize exception response from stream Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize exception response from stream at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:169) at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:123) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.InvalidClassException: failed to read class descriptor at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1603) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:167) ... 23 more Caused by: java.lang.ClassNotFoundException: org.elasticsearch.transport.RemoteTransportException at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720) at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571) at org.elasticsearch.common.io.ThrowableObjectInputStream.loadClass(ThrowableObjectInputStream.java:93) at org.elasticsearch.common.io.ThrowableObjectInputStream.readClassDescriptor(ThrowableObjectInputStream.java:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) ... 28 more

    Sakai JIRA | 2 years ago | Stephen Marquard
    org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][13]: Recovery failed from [vula2a][djVmgLkoSwu8WMm-onPrGg][inet[/137.158.155.9:9300]]{local=false} into [vula3b][mQMddOFLQgCQ68bBtNidqg][inet[/137.158.155.16:9301]]{local=false}
  3. 0

    Elasticsearch Users - java.lang.ClassNotFoundException: org.elasticsearch.transport.RemoteTransportException

    nabble.com | 1 year ago
    org.elasticsearch.indices.recovery.RecoveryFailedException: [sakai_index][0]: Recovery failed from [app01][0YtJIFeHSuehUfjjfMgv6A][ip-10-93-162-196][inet[/10.93.162.196:9300]]{local=false} into [app02][yshRulD0QjaNyu40Z6EGWQ][ip-10-7-174-145][inet[/10.7.174.145:9300]]{local=false}
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Unassigned replica shards after node startup

    GitHub | 2 years ago | binoyaf
    org.elasticsearch.indices.recovery.RecoveryFailedException: [data][0]: Recovery failed from [ca6450277735991d8085f84de36d6ecd][wfO9NNewTHuFdNRPhiE7og][MYHOST][inet[/10.225.115.166:9301]]{master=true} into [2763cc060c8d75d85dbb357f5e220d8c][agXTk8sKQKeMnHtspaWBNw][MYHOST][inet[/10.225.115.166:9300]]{master=true}
  6. 0

    javatalks.ru / Error creating bean with name 'entityManagerFactory' - только при первом старте!?

    javatalks.ru | 9 months ago
    org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactory' defined in class path resource [spring/applicationContext.xml]: Invocation of init method failed; nested exception is java.lang.NoClassDefFoundError: javax/persistence/Convert

  1. treefolk 1 times, last 2 weeks ago
  2. Tahir 2 times, last 2 months ago
  3. Piz 2027 times, last 4 months ago
  4. jedcua 1 times, last 4 months ago
  5. esaar 3 times, last 4 months ago
5 more registered users
90 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.ClassNotFoundException

    org.elasticsearch.transport.RemoteTransportException

    at org.apache.catalina.loader.WebappClassLoader.loadClass()
  2. Glassfish Core
    WebappClassLoader.loadClass
    1. org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
    2. org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
    2 frames
  3. ElasticSearch
    ThrowableObjectInputStream.readClassDescriptor
    1. org.elasticsearch.common.io.ThrowableObjectInputStream.loadClass(ThrowableObjectInputStream.java:93)
    2. org.elasticsearch.common.io.ThrowableObjectInputStream.readClassDescriptor(ThrowableObjectInputStream.java:67)
    2 frames
  4. Java RT
    ObjectInputStream.readObject
    1. java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601)
    2. java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517)
    3. java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771)
    4. java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
    5. java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
    5 frames
  5. ElasticSearch
    DeadLockProofWorker$1.run
    1. org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:167)
    2. org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:123)
    3. org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
    4. org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
    5. org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
    6. org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
    7. org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
    8. org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
    9. org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
    10. org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
    11. org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
    12. org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
    13. org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
    14. org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
    15. org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
    16. org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
    17. org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
    18. org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
    19. org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
    20. org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
    21. org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
    21 frames
  6. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    3. java.lang.Thread.run(Thread.java:745)
    3 frames