hello, I've got 2 clusters one is nice and fast with SSD storage, lean indexes (although many of them) and if I cycle a node in that cluster it will recover from yellow back to green in about 30 mins. The other uses spindles, the data is unrefined it's cluncky the shard to node ratio is way out but it runs, if I were to cycle a node though I would be looking at between 12-24 hours for the system to go green again.
The hardware in the larger capacity cluster is not great but it's being given a refresh. I've got a replacement bank of servers coming and I'm going to be doing a rolling decomission of the nodes. There are plans to also update the hardwareon the faster cluster but the new hardware for those will go into the slower cluster and the data will be reindexed across.
The plan will then be to have the slower nodes as cold nodes and the faster ones as hot nodes. I have done some reading and see that I can set this in the elasticserach.yml file but what I'm wondering is if there will be any issues with having a cluster made up of nothing but cold nodes? Given the time it takes to cycle them I'd rather set them up with th e roll now and till I remove the last node that has no state set it may not be an issue, but once I have a cluster made up of nothing but cold nodes will I have problems?
is it more a pirority system so if all that is avaliable is low priority then low is what will be used or is it more data goes into a hot and then gets moved to cold when it's not being used any more so you need to have a hot node there to take stuff and I should leave setting this till those are in place?
Any assistance and guidance much appreceated.