How hot node differ from warm node

Elastic Stack Elasticsearch
1

Total index=25
Logs/day=50gbx2(copies)=100gb
Shards/day=25x2=50 shards
Log retention 60 days
Logs for 60 days=100x60=6Tb
Shards for 60 days=50x60=3000

So we are planning to use 3 master node with 8gb heap 6 hot data node each with 1tb ssd and 64gb ram and 2 client node with 8gb heap size
In hot node we keep data of 60 days.
My question is if we want this data (60 days data) in warm node does it also need 6tb storage and same heap size for retaining 60 days data.

2

Why 50 shards for 100gb data? That sounds excessive.

3

We have 25 index and the 25 index size is 50gb including replica 100gb

4

@Christian_Dahlqvist is this is good?

5

That is a quite small average shard size. I would recommend you try getting to an average shard size above 10GB.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.