I have a cluster of over 25 nodes and the indices are balanced on all the nodes except for one node. Let's call the node as problematic node. The problematic node has less indices and shards when compared to other nodes in the cluster. And there are no unassigned shards on the cluster
I have checked
Node settings, same as other nodes
Settings and mappings on the indices that are missing on the problematic node, its ip is no excluded
ES logs don't have anything relevant to find out the cause
Tried to get allocation explain (GET /_cluster/allocation/explain) seems like it works when we have unassigned shards.
I also observed there is constant shard relocation on the problematic node. The shard count is keep fluctuating.
I don't see a reason why shardallocator has to put fewer shards on this node. Can someone please throw some light here?