I have like say 10 nodes and one index per day.
Lets say one index has 10 shards and there could be 10 index any given time.
I want the hottest index or the latest index to be widespread across as much nodes as possible.
The reason being that this index is the only index being written to.
And I want maximum hardware to be thrown to it.
I have noticed that sometimes all the shards of the write index gets accumulated in the same node.
This results in heap error as all the writes goes to that node and that node run our of memory.
So a better strategy would be to spread out the shards of this write or latest index across all 10 nodes and utilise all of them of writes.
Kindly advice on what to be needed.