Hi is there any guide line for above topic, I've read many posts and people are saying different thing.
some says each shard size is better not to exceed heap size which is around 30 to 32gb and
some says not to exceed 50GB per shard
if that is the case, if my daily injection for index A is 600GB (currently i configure to use 4 shards), based on above guideline, i will need to use 12 to 20 shards per index!! but I only have 4 nodes in my cluster. will that be too much for a 4 node cluster?
how can I achieve a good balance among the number of node, shard count and shard size to maximize my elk cluster performance?