Uneven Shard Distribution

Elastic Stack Elasticsearch
1

Hi,need some help with uneven shard distribution.

I have 5 data nodes and one node have 1 TB more than the rest. It has fever shards but more data?

shards disk.indices disk.used disk.avail disk.total disk.percent host ip node
215 2.2tb 2.4tb 1.8tb 4.2tb 56 Nodenames
163 3.5tb 3.7tb 515.6gb 4.2tb 88 Nodenames
214 1.9tb 2.2tb 2tb 4.2tb 51 Nodenames
215 2.2tb 2.4tb 1.8tb 4.2tb 56 Nodenames
215 2.2tb 2.4tb 1.8tb 4.2tb 57 Nodenames

Is this normal behavior or do we need to tune shard allocation?

Regards
Alexander Schou

2

Balancing shards that have different sizes is not an easy problem: should Elasticsearch optimize for even number of shards or even disk usage?

You can use the cluster allocation explain API to understand why things are not moving https://www.elastic.co/guide/en/elasticsearch/reference/master/cluster-allocation-explain.html.

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.