# Test the fault tolerant mechanism for ES cluster nodes

**URL:** https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160
**Category:** Elasticsearch
**Created:** [January 8, 2020, 6:25am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160 "2020-01-08T06:25:40Z")
**Posts on this page:** 17
**Page:** 1

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 6:25am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/1 "2020-01-08T06:25:40Z")

</div>

Hello,

I have configured 3 node ES cluster.  
All 3 nodes are master eligible. So if one goes down other should be eligible to elect itself as a master node and will form a 2 node cluster.  
How i can check this with my cluster?  
Can anyone guide me on this more?

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 6:45am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/2 "2020-01-08T06:45:20Z")

</div>

This is correct.just kill one the master node and you'll see that happening.

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 6:58am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/3 "2020-01-08T06:58:38Z")

</div>

Hello @dadoonet,

And where i can see exactly this means one master is down and other node elect itself as master node and remaining 2 nodes are communicating with each other.  
How i can check this is happening? like any UI is there?

will kibana help me in this?

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 7:36am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/4 "2020-01-08T07:36:08Z")

</div>

```
GET /_cat/nodes?v
```

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 9:18am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/5 "2020-01-08T09:18:39Z")

</div>

Hello @dadoonet,

I have tried mentioned command.  
First i have killed one master node. and after that ran this command.  
I can see only 2 nodes after that.

How to check in that 2 nodes which one is master node?  
and how to confirm that those remaining 2 nodes are serving queries for us?

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 10:08am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/6 "2020-01-08T10:08:55Z")

</div>

The command I shared gives you that information. What is its output?

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 10:22am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/7 "2020-01-08T10:22:51Z")

</div>

Hello @dadoonet,

That command showing remaining 2 nodes names and some values for heap.percent, ram.percent, cpu ,load\_1m, load\_5m, load\_15m ,node.role.

Not able to identify which node is master node.

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)
#### Post date: [January 8, 2020, 10:25am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/8 "2020-01-08T10:25:53Z")

</div>

The identity of the master node is not relevant. It may change at any time. It is sufficient to check that `GET _cluster/health` reports `green` (or `yellow`).

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 11:04am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/9 "2020-01-08T11:04:46Z")

</div>

If you had share the full output, I could have tell.

Anyway, look at `node.role`.

---

<div class="post-metadata">

### Author: ![The-oo](https://avatars.discourse-cdn.com/v4/letter/t/a6a055/32.png) [@The-oo](https://discuss.elastic.co/u/The-oo)
#### Post date: [January 8, 2020, 11:08am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/10 "2020-01-08T11:08:53Z")

</div>

Strangely i got an issue with this. If i kill my current master node the role does not get switch and my cluster become unavailable while having 3 master eligible node on my cluster

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 11:20am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/11 "2020-01-08T11:20:20Z")

</div>

Hello @dadoonet,

Please find below output:  
ip master name : \* data node 1  
heap.percent:16  
ram.percent:27  
cpu:5  
load\_1m: null  
load\_5m: null  
load\_15\_m: null  
node.master: dilm

ip master name : - data node 2  
heap.percent:21  
ram.percent:53  
cpu:2  
load\_1m: null  
load\_5m: null  
load\_15\_m: null  
node.master: dilm

master is denoted by \* and data node with -.  
I can see the difference. but node.master is showing dilm. what is that?

Reagrds,  
Priyanka

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 11:20am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/12 "2020-01-08T11:20:25Z")

</div>

I believe you are talking about [Master role does not switch automaticaly](https://discuss.elastic.co/t/master-role-does-not-switch-automaticaly/214213). Let's keep your question there.

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 11:23am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/13 "2020-01-08T11:23:00Z")

</div>

Please don't post images of text as they are hard to read, may not display correctly for everyone, and are not searchable.

Instead, paste the text and format it with `</>` icon or pairs of triple backticks (```), and check the preview window to make sure it's properly formatted before posting it. This makes it more likely that your question will receive a useful answer.

It would be great if you could update your post to solve this.

Here is what I can see on my side:

```auto
ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role master name
172.23.0.2 8 94 2 0.16 0.07 0.06 dilm * c4c5acf93d1e

```

As you can see there is a `master` field with a `*` for the current master node.  
That's what you're looking for I think.

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 11:29am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/14 "2020-01-08T11:29:35Z")

</div>

Hello @dadoonet,

I do not want to display ip addresses as company policy. so that is why i was updating it in excel.  
Now i have edited the post.  
Yes i can find now which is the master node by symbol \*.  
In node.master, i can see dilm is mentioned.  
what does that mean?

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [January 8, 2020, 11:49am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/15 "2020-01-08T11:49:08Z")

</div>

It's documented here: [https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-nodes.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-nodes.html)

---

<div class="post-metadata">

### Author: ![pyerunka](https://avatars.discourse-cdn.com/v4/letter/p/d6d6ee/32.png) [@pyerunka](https://discuss.elastic.co/u/pyerunka)
#### Post date: [January 8, 2020, 11:51am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/16 "2020-01-08T11:51:14Z")

</div>

Hello @dadoonet,

Thanks for help!!  
I got it now.

Regards,  
Priyanka

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 5, 2020, 11:51am UTC](https://discuss.elastic.co/t/test-the-fault-tolerant-mechanism-for-es-cluster-nodes/214160/17 "2020-02-05T11:51:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
