Replica Shard stuck in INITIALIZING state


(Peeyush Chandel) #1

Hi,

I stopped one of my elastic search node & as a normal behavior elastic
search started relocating my shard on that node to another node.

But even after 15 hours it is still stuck in INITIALIZING state. Also that
shard is fluctuating between two nodes,for some time it stays on one node
then automatically shift to another node & keep on doing that after every
few hours.

Main issue is it is still in INITIALIZING state after so many hours.

I am using version 1.2.1.

This shard which is stuck, it is a replica.

I am getting this error in logs:

[ERROR][index.engine.internal    ] [mynode] [myindex][3] failed to 

acquire searcher, source delete_by_query
java.lang.NullPointerException
[WARN ][index.engine.internal ] [mynode] [myindex][3] failed engine [
deleteByQuery/shard failed on replica]
[WARN ][cluster.action.shard ] [mynode] [myindex][3] sending failed
shard for [myindex][3], node[Sp3URfNVQlq2i4i3EjCakw], [R], s[INITIALIZING],
indexUUID [kTikCHshQMKEQ_jAuWWWnw], reason [engine failure, message [
deleteByQuery/shard failed on replica][EngineException[[myindex][3] failed
to acquire searcher, source delete_by_query]; nested: NullPointerException;
]]

Here is link

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/73eec403-4f1a-4671-b9a5-5efbcdf1c41f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Peeyush Chandel) #2

Only fix i got is:

I stopped deleteByQuery from my code.

Then i dropped all replicas & recreated them. Once all got stabilized.

I restarted deleteByQuery in my code.

That's how it worked for me & all back to normal.

On Thursday, 21 August 2014 09:54:39 UTC+5:30, Peeyush Chandel wrote:

Hi,

I stopped one of my elastic search node & as a normal behavior elastic
search started relocating my shard on that node to another node.

But even after 15 hours it is still stuck in INITIALIZING state. Also that
shard is fluctuating between two nodes,for some time it stays on one node
then automatically shift to another node & keep on doing that after every
few hours.

Main issue is it is still in INITIALIZING state after so many hours.

I am using version 1.2.1.

This shard which is stuck, it is a replica.

I am getting this error in logs:

[ERROR][index.engine.internal    ] [mynode] [myindex][3] failed to 

acquire searcher, source delete_by_query
java.lang.NullPointerException
[WARN ][index.engine.internal ] [mynode] [myindex][3] failed
engine [deleteByQuery/shard failed on replica]
[WARN ][cluster.action.shard ] [mynode] [myindex][3] sending
failed shard for [myindex][3], node[Sp3URfNVQlq2i4i3EjCakw], [R], s[
INITIALIZING], indexUUID [kTikCHshQMKEQ_jAuWWWnw], reason [engine failure,
message [deleteByQuery/shard failed on replica][EngineException[[myindex][
3] failed to acquire searcher, source delete_by_query]; nested:
NullPointerException; ]]

Here is link
http://stackoverflow.com/questions/25418094/elasticsearch-shard-stuck-in-initializing-state

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/fc824e03-337f-4e7e-97c9-c0624caf8b26%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3