So in my cluster, i have 3 nodes, with 70%, 88% and 65% disk space usage.
As you might expect, my autobalancer is not working despite my configuration being set as 'enabled:all'.
Afraid that my 2nd node would 'burst', I am currently exploring some alternate options to balance it myself.
I have two solutions thus far:
(1) Manual Rebalancing (Cluster Reroute API)
(2) Exclude shards allocation (cluster.routing.allocation.exclude._ip)
Can anyone advise for manual rebalancing -> if i simply move my shards from one node to another, will it impact my elastic search indexes in anyway (e.g. if i can see one document on ES head, and its origin is node 2, and it moves to node 1, would i still be able to see that document) like data loss.
Please advise for 'excluding' -> from what i read from the documentation, it is commonly used to 'shutdown node' but I don't intend to shut it down. By excluding, am i effectively shutting down the node? If I have 1 cluster with only 2 nodes and i run the exclude functionality, will everything in that cluster break?