Upgrade to 0.11.0 -- major issues

Stephen_2 · September 30, 2010, 11:47am

Hey guys,

I just upgraded to 0.11.0 and modified my configs to use the new "zero
conf" local config (which meant I just removed all the gateway stuff
from my configuration files). I have two nodes and my Java app is
joining the cluster.

Here's one of my config files:

network :
host : 192.168.0.2

cluster :
name : starkey-dev

Whenever I start up my tomcat instance I get error messages like this
in my logs:

jvm 1 | 2010-09-30 06:41:26,066 WARN transport.netty - [New I/O
client worker #1-1] [Jacqueline Falsworth] Message not fully read
(response) for [0] handler
org.elasticsearch.transport.PlainTransportFuture@11a2576, error
[false], resetting
jvm 1 | 2010-09-30 06:41:26,070 WARN transport.netty - [New I/O
server worker #1-1] [Jacqueline Falsworth] Message not fully read
(request) for [2839] and action [discovery/zen/publish], resetting

Also, I am unable to rebuild indexes, getting these stack traces
everywhere whenever I write to the index. I haven't even started
integrating the new bulk indexing functionality...

jvm 1 | org.elasticsearch.transport.RemoteTransportException:
[Doctor Druid][inet[/192.168.0.2:9300]][indices/index/shard/index]
jvm 1 | Caused by: java.io.EOFException
jvm 1 | at
org.elasticsearch.transport.netty.ChannelBufferStreamInput.readByte(ChannelBufferStreamInput.java:
112)
jvm 1 | at
org.elasticsearch.common.io.stream.HandlesStreamInput.readByte(HandlesStreamInput.java:
80)
jvm 1 | at
org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:
199)
jvm 1 | at
org.elasticsearch.action.index.IndexRequest.readFrom(IndexRequest.java:
423)
jvm 1 | at
org.elasticsearch.transport.netty.MessageChannelHandler.handleRequest(MessageChannelHandler.java:
190)
jvm 1 | at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:
85)
jvm 1 | at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:
80)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline
$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:
754)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:
302)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:
317)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:
299)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:
216)
jvm 1 | at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:
80)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline
$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:
754)
jvm 1 | at
org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:
51)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:
540)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:
274)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:
261)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:
350)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:
281)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:
201)
jvm 1 | at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:
108)
jvm 1 | at
org.elasticsearch.common.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:
46)
jvm 1 | at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
jvm 1 | at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
jvm 1 | at java.lang.Thread.run(Thread.java:619)

Stephen_2 · September 30, 2010, 11:50am

Oops! Sorry guys. I solved the issue myself -- turns out you can't
connect to a 0.11.0 cluster with a 0.10.0 jar file.

My bad!

On Sep 30, 6:47 am, Stephen scstar...@gmail.com wrote:

Hey guys,

I just upgraded to 0.11.0 and modified my configs to use the new "zero
conf" local config (which meant I just removed all the gateway stuff
from my configuration files). I have two nodes and my Java app is
joining the cluster.

Here's one of my config files:

network :
host : 192.168.0.2

cluster :
name : starkey-dev

Whenever I start up my tomcat instance I get error messages like this
in my logs:

jvm 1 | 2010-09-30 06:41:26,066 WARN transport.netty - [New I/O
client worker #1-1] [Jacqueline Falsworth] Message not fully read
(response) for [0] handler
org.elasticsearch.transport.PlainTransportFuture@11a2576, error
[false], resetting
jvm 1 | 2010-09-30 06:41:26,070 WARN transport.netty - [New I/O
server worker #1-1] [Jacqueline Falsworth] Message not fully read
(request) for [2839] and action [discovery/zen/publish], resetting

Also, I am unable to rebuild indexes, getting these stack traces
everywhere whenever I write to the index. I haven't even started
integrating the new bulk indexing functionality...

jvm 1 | org.elasticsearch.transport.RemoteTransportException:
[Doctor Druid][inet[/192.168.0.2:9300]][indices/index/shard/index]
jvm 1 | Caused by: java.io.EOFException
jvm 1 | at
org.elasticsearch.transport.netty.ChannelBufferStreamInput.readByte(Channel BufferStreamInput.java:
112)
jvm 1 | at
org.elasticsearch.common.io.stream.HandlesStreamInput.readByte(HandlesStrea mInput.java:
80)
jvm 1 | at
org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java :
199)
jvm 1 | at
org.elasticsearch.action.index.IndexRequest.readFrom(IndexRequest.java:
423)
jvm 1 | at
org.elasticsearch.transport.netty.MessageChannelHandler.handleRequest(Messa geChannelHandler.java:
190)
jvm 1 | at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(Mes sageChannelHandler.java:
85)
jvm 1 | at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleU pstream(SimpleChannelUpstreamHandler.java:
80)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream( DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline
$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:
754)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channel s.java:
302)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFi reMessageReceived(FrameDecoder.java:
317)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode( FrameDecoder.java:
299)
jvm 1 | at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageRece ived(FrameDecoder.java:
216)
jvm 1 | at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleU pstream(SimpleChannelUpstreamHandler.java:
80)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream( DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline
$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:
754)
jvm 1 | at
org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChann elsHandler.java:
51)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream( DefaultChannelPipeline.java:
545)
jvm 1 | at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream( DefaultChannelPipeline.java:
540)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channel s.java:
274)
jvm 1 | at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channel s.java:
261)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker. java:
350)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.processSelected Keys(NioWorker.java:
281)
jvm 1 | at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.j ava:
201)
jvm 1 | at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenami ngRunnable.java:
108)
jvm 1 | at
org.elasticsearch.common.netty.util.internal.IoWorkerRunnable.run(IoWorkerR unnable.java:
46)
jvm 1 | at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
jvm 1 | at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
jvm 1 | at java.lang.Thread.run(Thread.java:619)

capta · August 8, 2011, 5:12pm

Hi all,
I have made the same mistake: using an old jar file (elasticsearch-0.16.2.jar) in a web application when connecting to elasticsearch 0.17.4 using a TransportClient. In my case the error looked like this:

java.io.IOException: Expected handle header, got [60]
	at org.elasticsearch.common.io.stream.HandlesStreamInput.readUTF(HandlesStreamInput.java:63)
	at org.elasticsearch.search.facet.terms.strings.InternalStringTermsFacet.readFrom(InternalStringTermsFacet.java:240)
	at org.elasticsearch.search.facet.terms.strings.InternalStringTermsFacet.readTermsFacet(InternalStringTermsFacet.java:227)
	at org.elasticsearch.search.facet.terms.strings.InternalStringTermsFacet$1.readFacet(InternalStringTermsFacet.java:54)
	at org.elasticsearch.search.facet.InternalFacets.readFrom(InternalFacets.java:137)
	at org.elasticsearch.search.facet.InternalFacets.readFacets(InternalFacets.java:124)
	at org.elasticsearch.search.internal.InternalSearchResponse.readFrom(InternalSearchResponse.java:84)
	at org.elasticsearch.search.internal.InternalSearchResponse.readInternalSearchResponse(InternalSearchResponse.java:77)
	at org.elasticsearch.action.search.SearchResponse.readFrom(SearchResponse.java:263)
	at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:122)
	at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:101)
	at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:80)
	at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:545)
	at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:754)
	at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:302)
	at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:317)
	at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:299)
	at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:214)
	at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:80)
	at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:545)
	at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:540)
	at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:274)
	at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:261)
	at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:349)
	at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:280)
	at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:200)
	at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
	at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
	at java.lang.Thread.run(Thread.java:636)