I am having cluster which has three data nodes, which are having a single master. We found that due to some hardware failure, one of the data noes got stuck and shut down. We restarted that nodes and it joined back successfully.
But while checking shard allocation, I have found that that node was having 90% of space utilised even though it has low number of shards compared to other two.
As node 1 and 3 are showing 200GB spared for each and node 2 was shown less than 80GB. Even though node 1 and 3 are showing more allocated shards compared to node 2.
One dedicated master node.
the others are data only and master eligible.
My one of the data node got down and problem starts. Now, that node allocated more space by elasticsearch and the other two nodes are healthy. I got certain watermarks.
Strange thing is that, the node which has space issues, has low number of shards.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.