# Would a node failure take down the cluster?

**URL:** <https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513>\
**Category:** Elasticsearch\
**Created:** [October 8, 2020, 11:53pm UTC](https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513 "2020-10-08T23:53:16Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jtomage](https://avatars.discourse-cdn.com/v4/letter/j/e5b9ba/32.png) [@Jtomage](https://discuss.elastic.co/u/Jtomage)\
**Post date:** [October 8, 2020, 11:53pm UTC](https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513/1 "2020-10-08T23:53:16Z")

</div>

Trying to troubleshoot why a 3 Node Master-data cluster would go down. Mainly looking for direction on where to look for issues and any possible solutions

Currently running version 7.0.1  
Indices - 19  
Max Memory - 38.8 GB  
Total Shards - 38  
Documents - 8,136,787  
Data Size - 507.2 GB

Going through the logs, I found a lot of the following exceptions that seem to chain together.

- CircuitBreakingException: Data too large, data for [\<transport\_request\>]
- Cluster health status changed from [GREEN] to [YELLOW] failed to list shard for shard\_store on node
- AlreadyClosedException engine is closed

Thank you

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [October 9, 2020, 9:12am UTC](https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513/2 "2020-10-09T09:12:49Z")

</div>

The 7.0.x series is pretty old and passes the [end of its supported life](https://www.elastic.co/support/eol) tomorrow. There have been a good number of resiliency improvements since its release. Before digging deeper I suggest you upgrade to the latest version.

---

<div class="post-metadata">

**Author:** ![Jtomage](https://avatars.discourse-cdn.com/v4/letter/j/e5b9ba/32.png) [@Jtomage](https://discuss.elastic.co/u/Jtomage)\
**Post date:** [October 9, 2020, 3:57pm UTC](https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513/3 "2020-10-09T15:57:33Z")

</div>

Thanks, will recommend upgrading. Going to see if I can get a server to test upgrading.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 6, 2020, 3:57pm UTC](https://discuss.elastic.co/t/would-a-node-failure-take-down-the-cluster/251513/4 "2020-11-06T15:57:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.