Hi Team,
We have a 3 master and 10 data nodes. This is designed to hold 1TB data of a year.
Which is 3 months hot data which would be 300 GB apporx, that means 6 shards. Six months warm data which is 600 GB comes to 12 shards and rest 300 GB 6 shards for cold data.
So altogether 24 shards (6 Hot 12 Warm 6 Cold).
So my case is with 10 data nodes how would I allocate 6 data nodes for Hot Data and 3 nodes for Warm and single node for 6 shards for cold data.
According to recommended max shard size is 40-50GB.
Any input would be really great.