# No document found after restart one node **URL:** \ **Category:** Elasticsearch\ **Created:** [April 26, 2017, 8:52am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666 "2017-04-26T08:52:54Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![immanens](https://avatars.discourse-cdn.com/v4/letter/i/7feea3/32.png) [@immanens](https://discuss.elastic.co/u/immanens)\ **Post date:** [April 26, 2017, 8:52am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/1 "2017-04-26T08:52:54Z")
Hi, For unknown reasons, one of node shows 0 document and 0 storage in elastichq plugin. root@esnode-2:~# curl 'localhost:9200/\_cat/indices?v' health status index pri rep docs.count docs.deleted store.size pri.store.size yellow open my-prod 5 1 18434228 4836235 584.7gb 584.7gb I got these logs: [2017-04-26 10:07:34,272][TRACE][discovery.zen.ping.unicast] [esnode2] [1] disconnecting from [#zen\_unicast\_1#][esnode-2][inet[/10.0.0.134:9300]] [2017-04-26 10:07:34,276][TRACE][discovery.zen] [esnode2] full ping responses: --\> ping\_response{node [[esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]]], id[60], master [[esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]]], hasJoinedOnce [true], cluster\_name[escluster1]} [2017-04-26 10:07:34,276][DEBUG][discovery.zen] [esnode2] filtered ping responses: (filter\_client[true], filter\_data[false]) --\> ping\_response{node [[esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]]], id[60], master [[esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]]], hasJoinedOnce [true], cluster\_name[escluster1]} [2017-04-26 10:07:34,284][TRACE][discovery.zen] [esnode2] joining master [esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]] [2017-04-26 10:07:34,302][DEBUG][discovery.zen.publish] [esnode2] received cluster state version 23002 [2017-04-26 10:07:34,303][DEBUG][discovery.zen.fd] [esnode2] [master] restarting fault detection against master [[esnode1][3nl5AzuAQQ2BPHnqZrTmwg][esnode-1][inet[/10.0.0.134:9300]]], reason [new cluster state received and we are monitoring the wrong master [null]] [2017-04-26 10:07:34,304][DEBUG][discovery.zen] [esnode2] got first state from fresh master [3nl5AzuAQQ2BPHnqZrTmwg] [2017-04-26 10:07:34,304][TRACE][discovery.zen] [esnode2] updated cluster join cluster to [1] this line is bizarre : new cluster state received and we are monitoring the wrong master and here's esnode config: [cluster.name](http://cluster.name): escluster1 [node.name](http://node.name): "esnode1" path.data: /var/data/elasticsearch path.logs: /var/log/elasticsearch bootstrap.mlockall: true gateway.recover\_after\_nodes: 1 gateway.recover\_after\_time: 5m gateway.expected\_nodes: 2 discovery.zen.ping.multicast.enabled: false discovery.zen.ping.unicast.hosts: ["10.0.0.13:9300"] threadpool.bulk.type: fixed threadpool.bulk.queue\_size: 1200 [cluster.name](http://cluster.name): escluster1 [node.name](http://node.name): "esnode2" path.data: /var/data/elasticsearch path.logs: /var/log/elasticsearch bootstrap.mlockall: true gateway.recover\_after\_nodes: 1 gateway.recover\_after\_time: 5m gateway.expected\_nodes: 2 discovery.zen.ping.multicast.enabled: false discovery.zen.ping.unicast.hosts: ["10.0.0.134:9300"] threadpool.bulk.type: fixed threadpool.bulk.queue\_size: 1200 tcpdump shows that zen ping is passing between both nodes. all physical files are present on the second node : esnode-2, but it seems ignore it 🙂 Indices Documents: 0 Documents Deleted: 0 Store Size: 0.0 Index Req Total: 0 Delete Req Total: 0 Get Req Total: 0 Get(Exists) Total: 0 Get(Missing) Total: 0 Query Total: 0 curl 'localhost:9200/\_cluster/health?level=indices&pretty' { "cluster\_name" : "escluster1", "status" : "yellow", "timed\_out" : false, "number\_of\_nodes" : 2, "number\_of\_data\_nodes" : 2, "active\_primary\_shards" : 5, "active\_shards" : 5, "relocating\_shards" : 0, "initializing\_shards" : 0, "unassigned\_shards" : 5, "number\_of\_pending\_tasks" : 0, "indices" : { "retronews-prod" : { "status" : "yellow", "number\_of\_shards" : 5, "number\_of\_replicas" : 1, "active\_primary\_shards" : 5, "active\_shards" : 5, "relocating\_shards" : 0, "initializing\_shards" : 0, "unassigned\_shards" : 5 } } } I restarted it, and node 2 discovered 2 of 5 shades , slooooooooowwwwly , so I added some memory and reboot the server, after 15hours, it shows 0 documents and "unassigned\_shards" : 5 thanks for your helps: regards ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 26, 2017, 9:20am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/2 "2017-04-26T09:20:14Z")
What version are you on? ---
**Author:** ![immanens](https://avatars.discourse-cdn.com/v4/letter/i/7feea3/32.png) [@immanens](https://discuss.elastic.co/u/immanens)\ **Post date:** [April 26, 2017, 9:34am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/3 "2017-04-26T09:34:45Z")
ii elasticsearch 1.5.2 all ---
**Author:** ![immanens](https://avatars.discourse-cdn.com/v4/letter/i/7feea3/32.png) [@immanens](https://discuss.elastic.co/u/immanens)\ **Post date:** [April 27, 2017, 9:20am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/4 "2017-04-27T09:20:49Z")
i got this curl -s 'localhost:9200/\_cat/allocation?v' shards disk.used disk.avail disk.total disk.percent host ip node 0 5.1tb 755.1gb 5.9tb 87 esnode-2 10.0.0.13 esnode2 5 5.1tb 755.1gb 5.9tb 87 esnode-1 74.247.236.178 esnode1 5 UNASSIGNED esnode1 do not have right IP. this is an old IP. I don't known why this IP is here, and how to change it. ---
**Author:** ![immanens](https://avatars.discourse-cdn.com/v4/letter/i/7feea3/32.png) [@immanens](https://discuss.elastic.co/u/immanens)\ **Post date:** [April 27, 2017, 9:23am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/5 "2017-04-27T09:23:16Z")
By the way, 87% used disk space, can it be a problem? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [May 25, 2017, 9:32am UTC](https://discuss.elastic.co/t/no-document-found-after-restart-one-node/83666/6 "2017-05-25T09:32:04Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.