Data distribute in large cluster with many indices

(Sun Chanras) #1

I have a cluster with 30 nodes and a lot of indices with small number of primary shards . Let's say 800 indices . most indices only have 1 or 2 primary shards.
I want to know how elasticsearch cluster distribute data across the cluster such a lot of small indices?
Does all nodes in cluster receive data evenly ? or near evenly ?
Sun Chanras

(Mark Walkom) #2

It does it based on shard count per node, so that each node has a similar/same number of shards.
It doesn't look at the shard size, but does take the node's disk space into account.

(Sun Chanras) #3

Thank you @warkolm .
The shards going to re-balance automatically if I add more nodes in the future ?

(Mark Walkom) #4

Yes they will.

(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.