Unequal shard allocaiton

Elastic Stack Elasticsearch
1

i have 8 data node elk and metricbeat configured with shard 2 replica 1. most of the times all of the shard is maximum spread in 3 node . in order to max performance i trying to create index with 5 shard replica 1 and doing a reindex . but i see all primary , replica created in just 3 nodes instead of using all nodes . 1st node has 4 shard , 2nd node 5 and 3rd node 1.

question is how can i ensure all my primary to be in different node so that my performance is better?
out of 8 nodes 4 nodes have disk size 50% of remaining nodes . i.e 4 nodes have 1.5 tb and others have 3tb . is there problem on performance and unequal allocation

2

What is the output of GET /_cat/nodes?v&h=id,ip,du,dup,v,r,m?

3

id ip du dup v r
PoPi 10.38.1.22 908.8gb 90.18 6.5.2 mdi
XX1O 10.38.1.24 689.8gb 68.45 6.5.2 mdi
OUcj 10.38.1.21 928.9gb 92.17 6.5.2 mdi
bNap 10.38.0.35 2.1gb 0.72 6.5.2 i
6aBT 10.38.0.37 67gb 67.11 6.5.2 i
oQ96 10.38.0.33 1.9tb 99.09 6.5.2 mdi
z-Mm 10.38.1.25 948.4gb 94.11 6.5.2 mdi
6QD- 10.38.0.36 2.9gb 0.97 6.5.2 i
wHZ5 10.38.0.32 1.8tb 92.04 6.5.2 mdi
dq5d 10.38.0.34 1.8tb 91.96 6.5.2 mdi
ixvx 10.38.1.23 804.6gb 79.85 6.5.2 mdi

4

What is the shard count per node? Do you have shards of very different sizes? How large is the largest shard?

5

we have 15 metric indexes each 550-600gb with 2 shards 1 replica and 6 rollup indexes less than 110gb same shard/replica set up

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.