Gateway.recover_after_nodes & minimum_master_nodes in a distributed environment?


(Chris Neal) #1

Hello all,

Question
about gateway.recover_after_nodes and discovery.zen.minimum_master_nodes in
a distributed ES cluster. By "distributed" I mean I have:

2 nodes that are data only:
'node.data' => 'true',
'node.master' => 'false',
'http.enabled' => 'false',

1 node that is a master/search only node:
'node.master' => 'true',
'node.data' => 'false',
'http.enabled' => 'true',

When setting discovery.zen.minimum_master_nodes, is the (n / 2) + 1 formula
including all nodes of all types in the cluster, or just those who can be
masters?

Similarly, when setting gateway.recover_after_nodes, is this value the
number of all nodes of all types in the cluster, or just those that are
data nodes?

Thank you very much for your time!
Chris

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAND3DphDg41GUrj-YLfU7W0_L6veTXMJjJPJ7Wfu6V9VsvdKHw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

Only master eligible for discovery.zen.minimum_master_nodes, so in your
case it is 1. And that's bad as you can end up with a split brain
situation. You should, if you can, make all three nodes master eligible.

gateway.recover_after_nodes is all nodes, as per
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-gateway.html#recover-after

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 26 August 2014 23:37, Chris Neal chris.neal@derbysoft.net wrote:

Hello all,

Question
about gateway.recover_after_nodes and discovery.zen.minimum_master_nodes in
a distributed ES cluster. By "distributed" I mean I have:

2 nodes that are data only:
'node.data' => 'true',
'node.master' => 'false',
'http.enabled' => 'false',

1 node that is a master/search only node:
'node.master' => 'true',
'node.data' => 'false',
'http.enabled' => 'true',

When setting discovery.zen.minimum_master_nodes, is the (n / 2) + 1
formula including all nodes of all types in the cluster, or just
those who can be masters?

Similarly, when setting gateway.recover_after_nodes, is this value the
number of all nodes of all types in the cluster, or just those that are
data nodes?

Thank you very much for your time!
Chris

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAND3DphDg41GUrj-YLfU7W0_L6veTXMJjJPJ7Wfu6V9VsvdKHw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAND3DphDg41GUrj-YLfU7W0_L6veTXMJjJPJ7Wfu6V9VsvdKHw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624biBGL9O7zaT%3Dfm3%2BfNRCMoDrQDR_CRCV%3DhM9FZCAqOpw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Chris Neal) #3

Thank you Mark. Makes perfect sense.

Chris

On Tue, Aug 26, 2014 at 6:25 PM, Mark Walkom markw@campaignmonitor.com
wrote:

Only master eligible for discovery.zen.minimum_master_nodes, so in your
case it is 1. And that's bad as you can end up with a split brain
situation. You should, if you can, make all three nodes master eligible.

gateway.recover_after_nodes is all nodes, as per
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-gateway.html#recover-after

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 26 August 2014 23:37, Chris Neal chris.neal@derbysoft.net wrote:

Hello all,

Question
about gateway.recover_after_nodes and discovery.zen.minimum_master_nodes in
a distributed ES cluster. By "distributed" I mean I have:

2 nodes that are data only:
'node.data' => 'true',
'node.master' => 'false',
'http.enabled' => 'false',

1 node that is a master/search only node:
'node.master' => 'true',
'node.data' => 'false',
'http.enabled' => 'true',

When setting discovery.zen.minimum_master_nodes, is the (n / 2) + 1
formula including all nodes of all types in the cluster, or just
those who can be masters?

Similarly, when setting gateway.recover_after_nodes, is this value the
number of all nodes of all types in the cluster, or just those that are
data nodes?

Thank you very much for your time!
Chris

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAND3DphDg41GUrj-YLfU7W0_L6veTXMJjJPJ7Wfu6V9VsvdKHw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAND3DphDg41GUrj-YLfU7W0_L6veTXMJjJPJ7Wfu6V9VsvdKHw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624biBGL9O7zaT%3Dfm3%2BfNRCMoDrQDR_CRCV%3DhM9FZCAqOpw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624biBGL9O7zaT%3Dfm3%2BfNRCMoDrQDR_CRCV%3DhM9FZCAqOpw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAND3Dpg8z92md3%3D-njUj4Zb%2BXu7Z65XOzDK4hw%2B6XjKv2pGSzA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #4