# Problem after rebooting cluster

**URL:** <https://discuss.elastic.co/t/problem-after-rebooting-cluster/3871>\
**Category:** Elasticsearch\
**Created:** [February 3, 2011, 9:55am UTC](https://discuss.elastic.co/t/problem-after-rebooting-cluster/3871 "2011-02-03T09:55:46Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Barak\_Yaish](https://avatars.discourse-cdn.com/v4/letter/b/9de053/32.png) [@Barak\_Yaish](https://discuss.elastic.co/u/Barak_Yaish)\
**Post date:** [February 3, 2011, 9:55am UTC](https://discuss.elastic.co/t/problem-after-rebooting-cluster/3871/1 "2011-02-03T09:55:46Z")

</div>

Hello,

My ES cluster is composed of 2 machines. After indexing 100M docs, I  
took the cluster down (ctrl-c), and boot it up again. Seems like each  
machine recovered it indices:

[2011-02-03 11:36:43,233][DEBUG][index.shard.service] [Zarrko,  
the Tomorrow Man] [8][9] state: [CREATED]  
[2011-02-03 11:36:43,235][DEBUG][index.shard.service] [Zarrko,  
the Tomorrow Man] [8][8] state: [RECOVERING]-\>[STARTED], reason [post  
recovery]  
[2011-02-03 11:36:43,235][DEBUG][index.shard.service] [Zarrko,  
the Tomorrow Man] [8][8] Scheduling refresher every 1s  
[2011-02-03 11:36:43,235][DEBUG][index.gateway] [Zarrko,  
the Tomorrow Man] [8][8] recovery completed from local, took [21ms]  
index : files [0] with total\_size [0b], took[1ms]  
: recovered\_files [0] with total\_size [0b]  
: reusing\_files [0] with total\_size [0b]

But something is wrong. The 2 ES instances didn't join to each other:

[2011-02-03 11:32:34,764][WARN][discovery.zen.ping.multicast]  
[Moondark] received ping response with no matching id [1]  
[2011-02-03 11:32:34,764][WARN][discovery.zen.ping.multicast]  
[Moondark] received ping response with no matching id [1]

And when trying to query ES, only one server answered, the other is  
stuck:

[admin@dev3 ~]$ curl -XGET '[http://test1:9200/1/record/\_search](http://test1:9200/1/record/_search)?  
q=runId:uri\_69603537&pretty=true'  
{  
"took" : 1921,  
"timed\_out" : false,  
"\_shards" : {  
"total" : 10,  
"successful" : 10,  
"failed" : 0  
},  
"hits" : {  
"total" : 4,  
"max\_score" : 14.120542,...

}  
[admin@dev3 ~]$ curl -XGET '[http://dev1:9200/1/record/\_search](http://dev1:9200/1/record/_search)?  
q=runId:uri\_69603537&pretty=true''

jstack on that server does not indicate that something is doing work  
there.

Can you assist of debugging that? I tried few reboots, same behavior.

Thanks.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:12am UTC](https://discuss.elastic.co/t/problem-after-rebooting-cluster/3871/2 "2017-07-06T04:12:46Z")

</div>