Max number of shards per elastic data node

Elastic Stack Elasticsearch
1

Hi!
I've found out that the recommended number of shards per elasticsearch data node is
20 * GB heap memory. Ex. if I got a node with 16GB java heap, it can handle 20*16=320 shards.
Is this rule of thumb for open indices or closed indices?
We use ES 5.5.2

BR Andreas

2

This is for open indices.

1 Like
3

That is a rule of thumb for the maximum number of shards as we see a lot of clusters that vare massively oversharded. I would recommend having fewer than this if possible. Although closed indices do not use any heap, they do increase the size of the cluster state, so are not completely free either.

1 Like
4

Hi @dadoonet and @Christian_Dahlqvist !
Thank you for your answers, we will try to keep the shards as few as possible.
Regarding memory use, if I have 5p and 1r = total 10 open shards per index, I assume that both primary and replica shards will be using memory?
BR Andreas

5

Yes.

1 Like
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.