# Serialization issues on 0.90.3

**URL:** <https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236>\
**Category:** Elasticsearch\
**Created:** [August 16, 2013, 6:27am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236 "2013-08-16T06:27:57Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![robert\_3](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/robert_3/32/2132_2.png) [@robert\_3](https://discuss.elastic.co/u/robert_3)\
**Post date:** [August 16, 2013, 6:27am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/1 "2013-08-16T06:27:57Z")

</div>

Hi all,

I booted up a brand new cluster, all running the same version of  
elasticsearch, with no cruft around from any previous clusters or anything.  
I'm seeing a lot of the following in my logs, shortly before nodes start  
disconnecting.

[root@qtau ~] # java -version  
java version "1.7.0\_25"  
Java(TM) SE Runtime Environment (build 1.7.0\_25-b15)  
Java HotSpot(TM) Server VM (build 23.25-b01, mixed mode)  
[root@qtau ~] # /opt/elasticsearch/bin/elasticsearch -v  
Version: 0.90.3, Build: 5c38d60/2013-08-06T13:18:31Z, JVM: 1.7.0\_25  
[root@qtau ~] # uname -a  
SunOS [qtau.quizlet.com](http://qtau.quizlet.com) 5.11 joyent\_20130226T234312Z i86pc i386 i86pc Solaris

[2013-08-16 06:20:09,017][WARN][transport.netty] [qtau] Message  
not fully read (response) for [87] handler  
org.elasticsearch.action.support.nodes.TransportNodesOperationAction$AsyncAction$4@1b9865f9,  
error [false], resetting  
[2013-08-16 06:20:09,017][DEBUG][action.admin.cluster.node.info] [qtau]  
failed to execute on node [Ho3YGCj8RXqVypaVyw693w]  
org.elasticsearch.transport.RemoteTransportException: Failed to deserialize  
response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
Caused by: org.elasticsearch.transport.TransportSerializationException:  
Failed to deserialize response of type  
[org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
at  
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)  
at  
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
at  
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
at  
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
at  
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
at  
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
Source)  
at java.lang.Thread.run(Unknown Source)  
Caused by: java.io.IOException: Expected handle header, got [105]  
at  
org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
at  
org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
at  
org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
at  
org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
at  
org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
at  
org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)  
... 23 more  
[2013-08-16 06:20:09,014][DEBUG][action.admin.cluster.node.info] [qtau]  
failed to execute on node [GNcFyx5oQAS9gBPLXviJqw]  
org.elasticsearch.transport.RemoteTransportException: Failed to deserialize  
response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
Caused by: org.elasticsearch.transport.TransportSerializationException:  
Failed to deserialize response of type  
[org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
at  
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
at  
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)  
at  
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
at  
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
at  
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
at  
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
at  
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
at  
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
at  
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
at  
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
Source)  
at java.lang.Thread.run(Unknown Source)  
Caused by: java.io.IOException: Expected handle header, got [104]  
at  
org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
at  
org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
at  
org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
at  
org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
at  
org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
at  
org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)

## Thanks,

Robert Deaton

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [August 16, 2013, 6:32am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/2 "2013-08-16T06:32:05Z")

</div>

Just checking: are you also running exactly the same JVM version (1.7.0\_25) on all nodes?

--  
David Pilato | Technical Advocate | [Elasticsearch.com](http://Elasticsearch.com)  
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 16 août 2013 à 08:27, [robert@quizlet.com](mailto:robert@quizlet.com) a écrit :

> Hi all,
> 
> I booted up a brand new cluster, all running the same version of elasticsearch, with no cruft around from any previous clusters or anything. I'm seeing a lot of the following in my logs, shortly before nodes start disconnecting.
> 
> [root@qtau ~] # java -version  
> java version "1.7.0\_25"  
> Java(TM) SE Runtime Environment (build 1.7.0\_25-b15)  
> Java HotSpot(TM) Server VM (build 23.25-b01, mixed mode)  
> [root@qtau ~] # /opt/elasticsearch/bin/elasticsearch -v  
> Version: 0.90.3, Build: 5c38d60/2013-08-06T13:18:31Z, JVM: 1.7.0\_25  
> [root@qtau ~] # uname -a  
> SunOS [qtau.quizlet.com](http://qtau.quizlet.com) 5.11 joyent\_20130226T234312Z i86pc i386 i86pc Solaris
> 
> [2013-08-16 06:20:09,017][WARN][transport.netty] [qtau] Message not fully read (response) for [87] handler org.elasticsearch.action.support.nodes.TransportNodesOperationAction$AsyncAction$4@1b9865f9, error [false], resetting  
> [2013-08-16 06:20:09,017][DEBUG][action.admin.cluster.node.info] [qtau] failed to execute on node [Ho3YGCj8RXqVypaVyw693w]  
> org.elasticsearch.transport.RemoteTransportException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)  
> at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [105]  
> at org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)  
> ... 23 more  
> [2013-08-16 06:20:09,014][DEBUG][action.admin.cluster.node.info] [qtau] failed to execute on node [GNcFyx5oQAS9gBPLXviJqw]  
> org.elasticsearch.transport.RemoteTransportException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)  
> at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [104]  
> at org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)
> 
> ## Thanks,
> 
> Robert Deaton
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![robert\_3](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/robert_3/32/2132_2.png) [@robert\_3](https://discuss.elastic.co/u/robert_3)\
**Post date:** [August 16, 2013, 9:07am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/3 "2013-08-16T09:07:45Z")

</div>

Yes, they're all provisioned identically.

On Thursday, August 15, 2013 11:32:05 PM UTC-7, David Pilato wrote:

> Just checking: are you also running exactly the same JVM version  
> (1.7.0\_25) on all nodes?
> 
> --  
> _David Pilato_ | _Technical Advocate_ | _[Elasticsearch.com](http://Elasticsearch.com)_  
> @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr[https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr)  
> | @scrutmydocs [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs)
> 
> Le 16 août 2013 à 08:27, [rob...@quizlet.com](mailto:rob...@quizlet.com) \<javascript:\> a écrit :
> 
> Hi all,
> 
> I booted up a brand new cluster, all running the same version of  
> elasticsearch, with no cruft around from any previous clusters or anything.  
> I'm seeing a lot of the following in my logs, shortly before nodes start  
> disconnecting.
> 
> [root@qtau ~] # java -version  
> java version "1.7.0\_25"  
> Java(TM) SE Runtime Environment (build 1.7.0\_25-b15)  
> Java HotSpot(TM) Server VM (build 23.25-b01, mixed mode)  
> [root@qtau ~] # /opt/elasticsearch/bin/elasticsearch -v  
> Version: 0.90.3, Build: 5c38d60/2013-08-06T13:18:31Z, JVM: 1.7.0\_25  
> [root@qtau ~] # uname -a  
> SunOS [qtau.quizlet.com](http://qtau.quizlet.com) 5.11 joyent\_20130226T234312Z i86pc i386 i86pc  
> Solaris
> 
> [2013-08-16 06:20:09,017][WARN][transport.netty] [qtau] Message  
> not fully read (response) for [87] handler  
> org.elasticsearch.action.support.nodes.TransportNodesOperationAction$AsyncAction$4@1b9865f9,  
> error [false], resetting  
> [2013-08-16 06:20:09,017][DEBUG][action.admin.cluster.node.info] [qtau]  
> failed to execute on node [Ho3YGCj8RXqVypaVyw693w]  
> org.elasticsearch.transport.RemoteTransportException: Failed to  
> deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException:  
> Failed to deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at  
> org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at  
> org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown  
> Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
> Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [105]  
> at  
> org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at  
> org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at  
> org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at  
> org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)  
> ... 23 more  
> [2013-08-16 06:20:09,014][DEBUG][action.admin.cluster.node.info] [qtau]  
> failed to execute on node [GNcFyx5oQAS9gBPLXviJqw]  
> org.elasticsearch.transport.RemoteTransportException: Failed to  
> deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException:  
> Failed to deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at  
> org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at  
> org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown  
> Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
> Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [104]  
> at  
> org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at  
> org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at  
> org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at  
> org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)
> 
> ## Thanks,
> 
> Robert Deaton
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![search](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@search](https://discuss.elastic.co/u/search)\
**Post date:** [December 18, 2013, 10:53pm UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/4 "2013-12-18T22:53:43Z")

</div>

I see the same behavior on 0.90.7. Any hints from ES members on this?

Thanks.

On Friday, August 16, 2013 2:27:57 AM UTC-4, Robert Deaton wrote:

> Hi all,
> 
> I booted up a brand new cluster, all running the same version of  
> elasticsearch, with no cruft around from any previous clusters or anything.  
> I'm seeing a lot of the following in my logs, shortly before nodes start  
> disconnecting.
> 
> [root@qtau ~] # java -version  
> java version "1.7.0\_25"  
> Java(TM) SE Runtime Environment (build 1.7.0\_25-b15)  
> Java HotSpot(TM) Server VM (build 23.25-b01, mixed mode)  
> [root@qtau ~] # /opt/elasticsearch/bin/elasticsearch -v  
> Version: 0.90.3, Build: 5c38d60/2013-08-06T13:18:31Z, JVM: 1.7.0\_25  
> [root@qtau ~] # uname -a  
> SunOS [qtau.quizlet.com](http://qtau.quizlet.com) 5.11 joyent\_20130226T234312Z i86pc i386 i86pc  
> Solaris
> 
> [2013-08-16 06:20:09,017][WARN][transport.netty] [qtau] Message  
> not fully read (response) for [87] handler  
> org.elasticsearch.action.support.nodes.TransportNodesOperationAction$AsyncAction$4@1b9865f9,  
> error [false], resetting  
> [2013-08-16 06:20:09,017][DEBUG][action.admin.cluster.node.info] [qtau]  
> failed to execute on node [Ho3YGCj8RXqVypaVyw693w]  
> org.elasticsearch.transport.RemoteTransportException: Failed to  
> deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException:  
> Failed to deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at  
> org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at  
> org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown  
> Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
> Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [105]  
> at  
> org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at  
> org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at  
> org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at  
> org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)  
> ... 23 more  
> [2013-08-16 06:20:09,014][DEBUG][action.admin.cluster.node.info] [qtau]  
> failed to execute on node [GNcFyx5oQAS9gBPLXviJqw]  
> org.elasticsearch.transport.RemoteTransportException: Failed to  
> deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> Caused by: org.elasticsearch.transport.TransportSerializationException:  
> Failed to deserialize response of type  
> [org.elasticsearch.action.admin.cluster.node.info.NodeInfo]  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:147)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:124)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)  
> at  
> org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)  
> at  
> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)  
> at  
> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)  
> at  
> org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)  
> at  
> org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)  
> at  
> org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)  
> at  
> org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown  
> Source)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown  
> Source)  
> at java.lang.Thread.run(Unknown Source)  
> Caused by: java.io.IOException: Expected handle header, got [104]  
> at  
> org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)  
> at  
> org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:220)  
> at  
> org.elasticsearch.threadpool.ThreadPool$Info.readFrom(ThreadPool.java:737)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readFrom(ThreadPoolInfo.java:65)  
> at  
> org.elasticsearch.threadpool.ThreadPoolInfo.readThreadPoolInfo(ThreadPoolInfo.java:55)  
> at  
> org.elasticsearch.action.admin.cluster.node.info.NodeInfo.readFrom(NodeInfo.java:220)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:145)
> 
> ## Thanks,
> 
> Robert Deaton

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/db9ebb2e-60bc-43e2-83b7-fabd7b3ff213%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/db9ebb2e-60bc-43e2-83b7-fabd7b3ff213%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [December 19, 2013, 12:44am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/5 "2013-12-19T00:44:45Z")

</div>

Just for double check: are all ES servers and all client JVMs the same  
version? It is not enough to check all the cluster nodes. The client JVM is  
the one to check. The exception is quite clear, it stands for the  
InetAddress encoding/decoding issue because of different JVM versions...

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFtzH2Brsm%2BbA0sRwOhhjK6j4MoQ44C\_-U7zA5r51iX5w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFtzH2Brsm%2BbA0sRwOhhjK6j4MoQ44C_-U7zA5r51iX5w%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![search](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@search](https://discuss.elastic.co/u/search)\
**Post date:** [December 19, 2013, 3:22pm UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/6 "2013-12-19T15:22:39Z")

</div>

I am 100% positive that all my nodes have the same JVM and ES version. I  
downloaded it once and pushed to all my nodes. I also double checked by  
running 'java -version' and looking at the ES directories and comparing.

I don't see this message/exception all the time. I see it occasionally. My  
theory is due to some packet loss (some odd issue in the network), the  
message is not being deserialized properly. I may be wrong.

Thanks,

On Wednesday, December 18, 2013 7:44:45 PM UTC-5, Jörg Prante wrote:

> Just for double check: are all ES servers and all client JVMs the same  
> version? It is not enough to check all the cluster nodes. The client JVM is  
> the one to check. The exception is quite clear, it stands for the  
> InetAddress encoding/decoding issue because of different JVM versions...
> 
> Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ecc70bc8-23c1-43e5-9f9f-6342173d679c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecc70bc8-23c1-43e5-9f9f-6342173d679c%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![search](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@search](https://discuss.elastic.co/u/search)\
**Post date:** [December 19, 2013, 3:55pm UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/7 "2013-12-19T15:55:57Z")

</div>

_Another observation:_

When a heavy bulk indexing is going on, if I open bigdesk plugin in the  
browser and click on a node to see the stats/charts, I always see this  
exception.

Thanks.

On Thursday, December 19, 2013 10:22:39 AM UTC-5, Search User wrote:

> I am 100% positive that all my nodes have the same JVM and ES version. I  
> downloaded it once and pushed to all my nodes. I also double checked by  
> running 'java -version' and looking at the ES directories and comparing.
> 
> I don't see this message/exception all the time. I see it occasionally. My  
> theory is due to some packet loss (some odd issue in the network), the  
> message is not being deserialized properly. I may be wrong.
> 
> Thanks,
> 
> On Wednesday, December 18, 2013 7:44:45 PM UTC-5, Jörg Prante wrote:
> 
> > Just for double check: are all ES servers and all client JVMs the same  
> > version? It is not enough to check all the cluster nodes. The client JVM is  
> > the one to check. The exception is quite clear, it stands for the  
> > InetAddress encoding/decoding issue because of different JVM versions...
> > 
> > Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/3b4d5bd5-d1b2-4efb-a629-092141b2202a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/3b4d5bd5-d1b2-4efb-a629-092141b2202a%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [December 19, 2013, 4:00pm UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/8 "2013-12-19T16:00:19Z")

</div>

Hey,

you can execute  
[http://HOST:9200/\_nodes/stats?all&pretty](http://HOST:9200/_nodes/stats?all&pretty)  
[http://HOST:9200/\_cluster/nodes?all&pretty](http://HOST:9200/_cluster/nodes?all&pretty)

if it runs successfully (seems to work sometimes), you can at least compare  
java versions. I dont think it is a network problem, as you then should  
have a connection problem instead of having a problem when deserializing  
the message payload (which somehow implies that the message itself should  
have arrived, or?).

--Alex

On Thu, Dec 19, 2013 at 4:22 PM, Search User [feedworks@gmail.com](mailto:feedworks@gmail.com) wrote:

> I am 100% positive that all my nodes have the same JVM and ES version. I  
> downloaded it once and pushed to all my nodes. I also double checked by  
> running 'java -version' and looking at the ES directories and comparing.
> 
> I don't see this message/exception all the time. I see it occasionally. My  
> theory is due to some packet loss (some odd issue in the network), the  
> message is not being deserialized properly. I may be wrong.
> 
> Thanks,
> 
> On Wednesday, December 18, 2013 7:44:45 PM UTC-5, Jörg Prante wrote:
> 
> > Just for double check: are all ES servers and all client JVMs the same  
> > version? It is not enough to check all the cluster nodes. The client JVM is  
> > the one to check. The exception is quite clear, it stands for the  
> > InetAddress encoding/decoding issue because of different JVM versions...
> > 
> > Jörg
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/ecc70bc8-23c1-43e5-9f9f-6342173d679c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecc70bc8-23c1-43e5-9f9f-6342173d679c%40googlegroups.com)  
> > .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-kh0Kq2rgi0BkJbPjefxK29QGL0kv8Z8MH3thsj6h2GA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-kh0Kq2rgi0BkJbPjefxK29QGL0kv8Z8MH3thsj6h2GA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [December 19, 2013, 5:19pm UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/9 "2013-12-19T17:19:30Z")

</div>

Another thought: TransportSerializationException can also occur if a custom  
Java class is present that generates custom exceptions. Maybe you use  
plugins on the cluster nodes but not the same plugin code on the client? If  
so, the client can't deserialize the custom exception.

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHUdYEUP3Qft7B8pYsuz2dE13ib%3DPQ2nH5ZEVgwsBpB0A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHUdYEUP3Qft7B8pYsuz2dE13ib%3DPQ2nH5ZEVgwsBpB0A%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:00am UTC](https://discuss.elastic.co/t/serialization-issues-on-0-90-3/13236/10 "2017-07-06T02:00:09Z")

</div>