Hi,
in elasticsearch.log, there are exceptions:
[2013-08-29 16:52:29,789][WARN ][transport.netty ] [Union Jack]
exception caught on transport layer [[id: 0x4cb1ed1c,
/192.168.109.136:59970 => /192.168.109.135:9300]], closing connection
java.lang.OutOfMemoryError: Java heap space
[2013-08-29 16:52:35,857][WARN
][netty.channel.socket.nio.AbstractNioSelector] Unexpected exception in the
selector loop.
java.lang.OutOfMemoryError: Java heap space
[2013-08-29 16:52:35,857][WARN ][transport ] [Union Jack]
Received response for a request that has timed out, sent [569530ms] ago,
timed out [536626ms] ago, action [discovery/zen/fd/masterPing], node [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]], id [561292]
[2013-08-29 16:53:09,891][WARN ][transport ] [Union Jack]
Received response for a request that has timed out, sent [570660ms] ago,
timed out [515123ms] ago, action [discovery/zen/fd/masterPing], node [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]], id [561295]
[2013-08-29 16:53:18,303][WARN ][transport ] [Union Jack]
Received response for a request that has timed out, sent [519132ms] ago,
timed out [474922ms] ago, action [discovery/zen/fd/masterPing], node [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]], id [561296]
[2013-08-29 16:52:41,953][INFO ][cluster.service ] [Union Jack]
detected_master [Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]], added {[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]],}, reason:
zen-disco-receive(from master [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]])
[2013-08-29 16:57:22,362][WARN ][transport.netty ] [Union Jack]
exception caught on transport layer [[id: 0x5860f713,
/192.168.109.136:59972 => /192.168.109.135:9300]], closing connection
java.lang.OutOfMemoryError: Java heap space
[2013-08-29 16:57:31,177][WARN ][transport.netty ] [Union Jack]
exception caught on transport layer [[id: 0x4cb1ed1c,
/192.168.109.136:59970 :> /192.168.109.135:9300]], closing connection
java.io.StreamCorruptedException: invalid internal transport message format
at
org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27)
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425)
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Then I try to restart Elasticsearch, and after it starts the log prints
like this and the ES can not work:
[2013-08-29 17:05:47,369][WARN ][discovery.zen ] [Prodigy]
received a cluster state from [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]] and not part
of the cluster, should not happen
[2013-08-29 17:05:47,422][WARN ][discovery.zen ] [Prodigy]
received a cluster state from [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]] and not part
of the cluster, should not happen
[2013-08-29 17:05:47,474][WARN ][discovery.zen ] [Prodigy]
received a cluster state from [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]] and not part
of the cluster, should not happen
[2013-08-29 17:05:47,526][WARN ][discovery.zen ] [Prodigy]
received a cluster state from [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]] and not part
of the cluster, should not happen
[2013-08-29 17:05:47,574][WARN ][discovery.zen ] [Prodigy]
received a cluster state from [[Big
Bertha][9NffWsOjTVmseFsoh2VtTA][inet[/192.168.109.136:9300]]] and not part
of the cluster, should not happen
Why this happen and how to get back to normal?
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.