# Elasticsearch cluster occasional shutdown by itself

**URL:** https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643
**Category:** Elasticsearch
**Created:** [December 21, 2016, 7:58am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643 "2016-12-21T07:58:58Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![tfasun](https://avatars.discourse-cdn.com/v4/letter/t/f475e1/32.png) [@tfasun](https://discuss.elastic.co/u/tfasun)
#### Post date: [December 21, 2016, 7:58am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643/1 "2016-12-21T07:58:58Z")

</div>

Usually in the morning my elasticsearch cluster shutdown by itself. My elasticsearch log is below.  
Why Korvus node shutdown?  
After I restart my cluster .it [work.My](http://work.My) new node name is Master Khan

-21 06:41:57,889][INFO][discovery.zen] [Korvus] master\_left [{Korvus}{iMJI5jdDRvG3\_W6NDU1Jzg}{127.0.0.1}{127.0.0.1:9300}], reason [transport disconnected]  
[2016-12-21 06:41:57,900][WARN][discovery.zen] [Korvus] master left (reason = transport disconnected), current nodes: {{Korvus}{prsC2OwYThS1pqFwpyYNzA}{127.0.0.1}{127.0.0.1:9301},}  
[2016-12-21 06:41:57,901][INFO][cluster.service] [Korvus] removed {{Korvus}{iMJI5jdDRvG3\_W6NDU1Jzg}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-master\_failed ({Korvus}{iMJI5jdDRvG3\_W6NDU1Jzg}{127.0.0.1}{127.0.0.1:9300})  
[2016-12-21 06:42:00,971][INFO][cluster.routing.allocation] [Korvus] Cluster health status changed from [GREEN] to [RED] (reason: [nodes joined]).  
[2016-12-21 06:42:00,972][INFO][cluster.service] [Korvus] new\_master {Korvus}{prsC2OwYThS1pqFwpyYNzA}{127.0.0.1}{127.0.0.1:9301}, reason: zen-disco-join(elected\_as\_master, [0] joins received)  
[2016-12-21 06:47:38,987][INFO][node] [Master Khan] version[2.3.1], pid[31686], build[bd98092/2016-04-04T12:25:05Z]  
[2016-12-21 06:47:38,987][INFO][node] [Master Khan] initializing ...  
[2016-12-21 06:47:40,626][INFO][plugins] [Master Khan] modules [lang-groovy, reindex, lang-expression], plugins [cloud-aws, head], sites [head]  
[2016-12-21 06:47:40,670][INFO][env] [Master Khan] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable\_space [17gb], net total\_space [19.5gb], spins? [no], types [ext4]  
[2016-12-21 06:47:40,670][INFO][env] [Master Khan] heap size [1.9gb], compressed ordinary object pointers [true]  
[2016-12-21 06:47:43,831][INFO][node] [Master Khan] initialized  
[2016-12-21 06:47:43,831][INFO][node] [Master Khan] starting ...  
[2016-12-21 06:47:43,997][INFO][transport] [Master Khan] publish\_address {127.0.0.1:9300}, bound\_addresses {[::]:9300}  
[2016-12-21 06:47:44,004][INFO][discovery] [Master Khan] elasticsearch/Ma7OSi1BRXKeCRTst7mv-Q  
[2016-12-21 06:47:47,119][INFO][cluster.service] [Master Khan] detected\_master {Master Khan}{LE3\_4tKVTzuYRSKnH0T9Xg}{127.0.0.1}{127.0.0.1:9301}, added {{Master Khan}{LE3\_4tKVTzuYRSKnH0T9Xg}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [{Master Khan}{LE3\_4tKVTzuYRSKnH0T9Xg}{127.0.0.1}{127.0.0.1:9301}])  
[2016-12-21 06:47:47,135][INFO][http] [Master Khan] publish\_address {127.0.0.1:9200}, bound\_addresses {[::]:9200}  
[2016-12-21 06:47:47,135][INFO][node] [Master Khan] started

---

<div class="post-metadata">

### Author: ![jasontedor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jasontedor/32/66992_2.png) [@jasontedor](https://discuss.elastic.co/u/jasontedor)
#### Post date: [December 22, 2016, 5:55am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643/2 "2016-12-22T05:55:45Z")

</div>

Since there is nothing in the logs indicating a clean shutdown, I suspect something like either a JVM crash or the OS OOM killer. For the former, check the working directory for Elasticsearch for the presence of an `hs_err_<pid>.log` file. For the latter, check your OS logs like `/var/log/messages` and other similar infrastructure.

---

<div class="post-metadata">

### Author: ![tfasun](https://avatars.discourse-cdn.com/v4/letter/t/f475e1/32.png) [@tfasun](https://discuss.elastic.co/u/tfasun)
#### Post date: [December 26, 2016, 9:01am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643/3 "2016-12-26T09:01:22Z")

</div>

Thank you very much.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 23, 2017, 9:01am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-occasional-shutdown-by-itself/69643/4 "2017-01-23T09:01:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
