Looking for some advice on rejigging my elastic cluster.
Currently have 7 nodes with 3 set to masters & data nodes & 5 set to just Data nodes.
The cluster is used for monitoing of applications so very much log entry orrianted along with holding metricbeat data
I'm using ILM so
3 nodes are set to Hot to contain the most recent docs (these are set to Master nodes)
3 nodes set to Warm for mid term logs
1 node set to cold for anything old that is rarely accessed.
Reading up on scaling out the cluster it seems I might not have the cluster setup correctly so looking for a bit of advice on how i could restructure
from what i've read I could do with having 3 dedicated master only nodes? & then introducing a coordiantiong node or two to handle the Kibana traffic ?
for which i have capacity availible to do.
if that is the case then
whats the best way to migrate the 3 master data nodes to data only & introduce the new masters. Is it just a case of starting up the 3 new master elaigable nodes & then 1 by 1 restarting the old 3 master nodes after setting masternode setting to false?
would this need a full cluster restart or could i manage with rolling restarts (may have answered that one above)
Currently in my es.yml I have cluster bootstrapping set to the 3 current master nodes, from reading up on this setting it's only used for the very first time, i take it i dont need this anymore even if onbaording brand new masters?