Calculating Number of Data nodes

Elastic Stack Elasticsearch
1

Hi,

I was going through one of the webinars by elastic.In the webinar,I came across a formula to calculate data nodes as below:

Data Nodes: ROUNDUP(Total Storage(GB) / Memory per data node / Memory:data ratio) + 1 Data node for failover capacity

My requirement is as below:

  • Total Storage: 10,080 GB
  • Memory per node: 64 GB
  • Memory:data ratio: 1:30

But when I use above formula(assuming it mentions dividing total storage by memory per data node and then by ratio), my final value for number of data nodes comes out to be 5251 nodes.
Data Nodes: ROUNDUP(10080/64/(1:30))+ 1

I want to know whether I am calculating this correctly or is there any problem with the formula?

Thanks,
Nikhil

2

10,080 / (64 * 30) = 6 (5.25)

The 1:30 ratio just means that you have 30 times larger storage on the node than you have RAM.

3 Likes
3

Thank you @Christian_Dahlqvist

4

@Nikhil04 curious how you came up with the total storage does that include a primary plus one replica of your data or just the primary if so you need to double the total storage so that you can have one primary copy plus one replica copy in order to have HA... l.e. so a loss of a data node does not equal loss of data or make the cluster unusable

5

Hi @stephenb,

Yes, Total storage also includes replica.

We have calculated it based on the size of incoming data per day and retention period.

Thanks,
Nikhil

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.