Currently in our ElasticSearch cluster we have one dedicated master node
(master: true, data: false) and it's also the nodes that receives all
requests. This is bad and we want to change it.
Here's some questions:
Is it a good idea to merge dedicated master nodes with client nodes?
Say in the cluster, we have 3 machines at dedicated master nodes and we do
some kind of round robin DNS on these 3 for incoming requests.
If we opt for separated, dedicated master, could we use smaller
instances? Say 3 machines of m3.medium.
In general, what's the general suggestion for a cluster setup? We are
currently talking about: 5 data nodes, 3 dedicated master node and 2 client
nodes.
That is ok, but just make sure you size the heap to account for large
queries (ie aggs) or your master could still OOM (which is bad). You may
find as your cluster grows it'll make sense to split the masters and
clients.
Should be ok, the master doesn't need much heap. But you don't want
to go smaller than that.
Depends. Unless those nodes are massive and you are doing a lot of
heavy queries then I (personally) wouldn't bother with masters or clients,
and just round robin with your existing nodes.
If you are combining master+data+client nodes, then make sure you monitor
them for heap use
Currently in our Elasticsearch cluster we have one dedicated master node
(master: true, data: false) and it's also the nodes that receives all
requests. This is bad and we want to change it.
Here's some questions:
Is it a good idea to merge dedicated master nodes with client nodes?
Say in the cluster, we have 3 machines at dedicated master nodes and we do
some kind of round robin DNS on these 3 for incoming requests.
If we opt for separated, dedicated master, could we use smaller
instances? Say 3 machines of m3.medium.
In general, what's the general suggestion for a cluster setup? We are
currently talking about: 5 data nodes, 3 dedicated master node and 2 client
nodes.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.