Elasticsearch automatic rebalancing process

Hi,

We are running two (almost) identical Elasticsearch clusters v8.7.0, one of them works perfectly fine and in the second one we have shard balancing issues:

is there a way to see why the automatic rebalancing process doesn't try to balance the shards across all nodes?

  • all nodes are identical, same resources, disk size etc.

additionally, we have different sizes of shards, from few killo bytes up to 30GB shards.