# ElasticSearch 3 node fail over not working

**URL:** <https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952>\
**Category:** Elasticsearch\
**Created:** [January 10, 2018, 8:16pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952 "2018-01-10T20:16:56Z")\
**Posts on this page:** 19\
**Page:** 1

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 8:16pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/1 "2018-01-10T20:16:56Z")

</div>

I have 3 node and config setup as shown below in all 3 es server. If anyone has similar fail over issue, please let me how did you resolved. I am implementing first time in Oracle PeopleSoft application.

elasticsearch.yml

server1  
discovery.zen.minimum\_master\_nodes: 1  
node.master: true  
node.data: true

server2  
discovery.zen.minimum\_master\_nodes: 1  
node.master: true  
node.data: true

server3  
discovery.zen.minimum\_master\_nodes: 1  
node.master: true  
node.data: true

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 10, 2018, 8:32pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/2 "2018-01-10T20:32:14Z")

</div>

Moved to #elasticsearch

What does not work?

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 8:37pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/3 "2018-01-10T20:37:08Z")

</div>

The fail over not working. When I shut down server1 (Node1) the ES does not switch automatically to either of the 2 additional node in cluster.

Thanks  
Qamar

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 10, 2018, 8:58pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/4 "2018-01-10T20:58:56Z")

</div>

Which client does not switch?

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 9:01pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/5 "2018-01-10T21:01:22Z")

</div>

We have 2 server lets d01, d02 and d03. When I shutdown d01 search client not fail over to d2.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 10, 2018, 9:16pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/6 "2018-01-10T21:16:07Z")

</div>

What kind of client it is?

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 9:16pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/7 "2018-01-10T21:16:48Z")

</div>

Peoplesoft ERP.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 10, 2018, 9:17pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/8 "2018-01-10T21:17:53Z")

</div>

I don't know what kind of Elasticsearch Client they are using.  
Do you?

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 9:25pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/9 "2018-01-10T21:25:44Z")

</div>

We are using ElasticSearch es2.3.2

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 10, 2018, 9:42pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/10 "2018-01-10T21:42:07Z")

</div>

That does not answer my question.  
What is the elasticsearch client or library which is used by Peoplesoft to connect to elasticsearch cluster?

Anyway, here is what you can do:

- Ask Peoplesoft support
- Add a Load Balancer (LB) in front of elasticsearch nodes but if the LB fails you will have the same issue
- Add a coordinating only node (master and data: false) and connect Peoplosoft to this node. But same as previous, if it fails, you will have the same issue.

Most of elasticsearch clients are supporting using multiple nodes, like the Java REST Client, Logstash or Beats.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [January 10, 2018, 9:48pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/11 "2018-01-10T21:48:00Z")

</div>

> [@qamarjrk](#):
>
> discovery.zen.minimum\_master\_nodes: 1

If you have 3 master eligible nodes in the cluster, you need to set `discovery.zen.minimum_master_nodes` to 2 in order to avoid split-brain scenarios and data loss. Please see [the documentation](https://www.elastic.co/guide/en/elasticsearch/reference/6.1/modules-node.html#split-brain) for further details.

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 10:00pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/12 "2018-01-10T22:00:38Z")

</div>

Client info - PeopleSoft Integration Broker client. Please see url link below.

[https://portal.pttmor.org/PSIGW/RESTListeningConnector/LUDNOD\_PA](https://portal.pttmor.org/PSIGW/RESTListeningConnector/LUDNOD_PA)

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 10:05pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/13 "2018-01-10T22:05:32Z")

</div>

Cluster status shows this.

[http://portal.pttmor.org:9200/\_cluster/state?pretty](http://portal.pttmor.org:9200/_cluster/state?pretty)

{  
"cluster\_name" : "ESCLUSTER",  
"version" : 18,  
"state\_uuid" : "CYJlsergQdyeV5cjf4N3zQ",  
"master\_node" : "bvloXYVFQySNaA58pV8q-g",  
"blocks" : { },  
"nodes" : {  
"bvloXYVFQySNaA58pV8q-g" : {  
"name" : "node-1",  
"transport\_address" : "[portal.pttmor.org/10.119.56.102:9300](http://portal.pttmor.org/10.119.56.102:9300)",  
"attributes" : {  
"rack" : "r1"  
}  
}  
},  
"metadata" : {  
"cluster\_uuid" : "q5ArCX4PR7K\_VCAa68Qiow",  
"templates" : { },  
"indices" : {  
"ptportalregistry\_hcmtst" : {  
"state" : "open",  
"settings" : {  
"index" : {  
"creation\_date" : "1515271526955",  
"analysis" : {  
"filter" : {  
"orcl\_es\_greek\_lowercase" : {  
"type" : "lowercase",  
"language" : "greek"  
},  
"orcl\_es\_turkish\_lowercase" : {  
"type" : "lowercase",  
"language" : "turkish"  
},  
"orcl\_es\_english\_possessive\_stemmer" : {  
"type" : "stemmer",  
"language" : "possessive\_english"  
},  
"orcl\_es\_phonetic" : {  
"replace" : "true",  
"type" : "phonetic",  
"encoder" : "double\_metaphone"  
},  
"orcl\_es\_cjk\_bigrams\_filter" : {  
"output\_unigrams" : "true",  
"type" : "cjk\_bigram"  
},  
"orcl\_es\_italian\_elision" : {  
"type" : "elision",  
"articles" : ["c", "l", "all", "dall", "dell", "nell", "sull", "coll", "pell", "gl", "agl", "dagl", "degl", "negl", "sugl", "un", "m", "t", "s", "v", "d"]  
},  
"orcl\_es\_stemmer\_eng" : {  
"type" : "stemmer",  
"language" : "english"  
},  
"orcl\_es\_french\_elision" : {  
"type" : "elision",  
"articles" : ["l", "m", "t", "qu", "n", "s", "j", "d", "c", "jusqu", "quoiqu", "lorsqu", "puisqu"],  
"articles\_case" : "true"  
},  
"orcl\_es\_synonym" : {  
"type" : "synonym",  
"synonyms\_path" : "analysis/synonym\_grammer.txt"  
}  
},  
"analyzer" : {  
"orcl\_es\_custom\_eng\_stop" : {  
"filter" : ["standard", "lowercase", "orcl\_es\_synonym", "orcl\_es\_stemmer\_eng"],  
"type" : "custom",  
"stopwords" : "_english_",  
"tokenizer" : "standard"  
},  
"orcl\_es\_custom\_keyword" : {  
"filter" : ["lowercase"],  
"type" : "custom",  
"tokenizer" : "keyword"  
},  
"orcl\_es\_custom\_lowercase" : {  
"filter" : ["lowercase"],  
"type" : "custom",  
"tokenizer" : "standard"  
},  
"orcl\_es\_path\_hierarchy" : {  
"type" : "custom",  
"tokenizer" : "path-tokenizer"  
},  
"orcl\_es\_phonetic\_analyzer" : {  
"filter" : "orcl\_es\_phonetic",  
"tokenizer" : "standard"  
},  
"orcl\_es\_custom\_eng" : {  
"filter" : ["orcl\_es\_english\_possessive\_stemmer", "standard", "lowercase", "orcl\_es\_synonym", "orcl\_es\_stemmer\_eng"],  
"type" : "custom",  
"stopwords" : "_none_",  
"tokenizer" : "standard"  
}  
},

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 10, 2018, 10:23pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/14 "2018-01-10T22:23:49Z")

</div>

I have setup as as you mention earlier.

discovery.zen.ping.unicast.hosts: ["[server1.pttmor.org](http://server1.pttmor.org)", "[server2.pttmor.org](http://server2.pttmor.org)", "[server3.pttmor.org](http://server3.pttmor.org)"]  
discovery.zen.minimum\_master\_nodes: 2

My question is do I need to keep same in all 3 server?

Thanks for you all help.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 11, 2018, 7:15am UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/15 "2018-01-11T07:15:38Z")

</div>

You did that in the server. Not on the client side.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 11, 2018, 8:38am UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/16 "2018-01-11T08:38:09Z")

</div>

I can't access to your private network I think. But I guess you are using that: [https://blogs.oracle.com/peopletools/elasticsearch-for-peoplesoft-now-available](https://blogs.oracle.com/peopletools/elasticsearch-for-peoplesoft-now-available)

May be it's better to ask Oracle about how to configure this tool?

---

<div class="post-metadata">

**Author:** ![qamarjrk](https://avatars.discourse-cdn.com/v4/letter/q/8c91f0/32.png) [@qamarjrk](https://discuss.elastic.co/u/qamarjrk)\
**Post date:** [January 22, 2018, 10:37pm UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/18 "2018-01-22T22:37:45Z")

</div>

This is my current setup, but when i shut down server 1 search did not work. Seems like cluster not working.

# Server1

# node.master: true

# node.data: true

# Server2

node.master: true

# node.data: true

# Server3

node.master: true

# node.data: true

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 23, 2018, 4:27am UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/19 "2018-01-23T04:27:56Z")

</div>

Please format your code using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

Please edit your post and share the logs of the 3 nodes.  
What gives `GET _cat/nodes?v` on one of the nodes which is still running?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 20, 2018, 4:28am UTC](https://discuss.elastic.co/t/elasticsearch-3-node-fail-over-not-working/114952/20 "2018-02-20T04:28:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
