Sizing master nodes

Elastic Stack Elasticsearch
1

Hi I read bunch of things on master nodes etc...

So I have some decent machines 4x 32core 128GB RAM and 6x960GB SSDS (RAID 5
so 4.3 TB)

So all 4 machines will be data nodes configured to 32GB.

I was also thinking of running the master nodes on same machines on
separate JVM using N/2+1. But how much RAM do master nodes need to be etc?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

For a master only nodes on a small cluster (I mean small number of nodes/indices/mappings), you can probably set HEAP to 1gb. (512 Mb should work as well probably)

My 2 cents

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs

Le 3 févr. 2015 à 16:09, John Smith java.dev.mtl@gmail.com a écrit :

Hi I read bunch of things on master nodes etc...

So I have some decent machines 4x 32core 128GB RAM and 6x960GB SSDS (RAID 5 so 4.3 TB)

So all 4 machines will be data nodes configured to 32GB.

I was also thinking of running the master nodes on same machines on separate JVM using N/2+1. But how much RAM do master nodes need to be etc?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2F9F1907-0E42-42C7-BA9E-8963F63C21D6%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

3

Eh well I have 128GB

32GB for ES data
32GB for the OS for file caching?

And then there another 64GB to play with I supose 4GB for master node is ok.

But is it ok to deploy the master node on same box as data node on separate
JVM process since I have the horse power?

On Tuesday, 3 February 2015 10:48:10 UTC-5, David Pilato wrote:

For a master only nodes on a small cluster (I mean small number of
nodes/indices/mappings), you can probably set HEAP to 1gb. (512 Mb should
work as well probably)

My 2 cents

--
David Pilato | Technical Advocate | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr | @scrutmydocs
https://twitter.com/scrutmydocs

Le 3 févr. 2015 à 16:09, John Smith <java.d...@gmail.com <javascript:>> a
écrit :

Hi I read bunch of things on master nodes etc...

So I have some decent machines 4x 32core 128GB RAM and 6x960GB SSDS (RAID
5 so 4.3 TB)

So all 4 machines will be data nodes configured to 32GB.

I was also thinking of running the master nodes on same machines on
separate JVM using N/2+1. But how much RAM do master nodes need to be etc?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8df1f13d-eab4-4694-9ddc-87bb0c393c3a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

4

And right i don't envision more than 10-12 node cluster

On Tuesday, 3 February 2015 16:45:01 UTC-5, John Smith wrote:

Eh well I have 128GB

32GB for ES data
32GB for the OS for file caching?

And then there another 64GB to play with I supose 4GB for master node is
ok.

But is it ok to deploy the master node on same box as data node on
separate JVM process since I have the horse power?

On Tuesday, 3 February 2015 10:48:10 UTC-5, David Pilato wrote:

For a master only nodes on a small cluster (I mean small number of
nodes/indices/mappings), you can probably set HEAP to 1gb. (512 Mb should
work as well probably)

My 2 cents

--
David Pilato | Technical Advocate | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr | @scrutmydocs
https://twitter.com/scrutmydocs

Le 3 févr. 2015 à 16:09, John Smith java.d...@gmail.com a écrit :

Hi I read bunch of things on master nodes etc...

So I have some decent machines 4x 32core 128GB RAM and 6x960GB SSDS (RAID
5 so 4.3 TB)

So all 4 machines will be data nodes configured to 32GB.

I was also thinking of running the master nodes on same machines on
separate JVM using N/2+1. But how much RAM do master nodes need to be etc?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/a6443665-2999-4e66-938e-8b5ac49dbd59%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e99beb41-88cd-4bab-a9b1-bb620979ee03%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

5

It is fine to give 2-4 GB (though 4 is on higher side) to your masters as
they are not doing anything really heavy, all they do is exchange cluster
state/routing table etc.
Spinning off the masters on the same host (box) as data node can
potentially cause some issues (e.g. High CPU resulting in overall slowness
and master becoming unresponsive or host restart resulting in master as
well as data node loss). We have exactly same setup (infact we have even
beefy machines and during our topology design we kept masters on separate
hardware which can be commodity hardware)

If you can't have more hardware, then spreading master across multiple
hosts will mitigate the split brain to a great extent.

On Tuesday, 3 February 2015 07:09:44 UTC-8, John Smith wrote:

Hi I read bunch of things on master nodes etc...

So I have some decent machines 4x 32core 128GB RAM and 6x960GB SSDS (RAID
5 so 4.3 TB)

So all 4 machines will be data nodes configured to 32GB.

I was also thinking of running the master nodes on same machines on
separate JVM using N/2+1. But how much RAM do master nodes need to be etc?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4ee68071-731b-492d-80fd-782b35c05c99%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

6

Yeah I have four boxes now. So I can at least put master nodes on same physical boxes in separate jam instances at least.

So 4 data nodes and 3 master nodes.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/dd37815f-308e-47bd-a252-513caa11a103%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.