Data distribute in large cluster with many indices


(Sun Chanras) #1

Hi,
I have a cluster with 30 nodes and a lot of indices with small number of primary shards . Let's say 800 indices . most indices only have 1 or 2 primary shards.
I want to know how elasticsearch cluster distribute data across the cluster such a lot of small indices?
Does all nodes in cluster receive data evenly ? or near evenly ?
Thanks,
Sun Chanras


(Mark Walkom) #2

It does it based on shard count per node, so that each node has a similar/same number of shards.
It doesn't look at the shard size, but does take the node's disk space into account.


(Sun Chanras) #3

Thank you @warkolm .
The shards going to re-balance automatically if I add more nodes in the future ?


(Mark Walkom) #4

Yes they will.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.