We're currently in process of choosing new hardware for our elasticsearch cluster.
Our current cluster consists of 32 nodes and holds 42TB of data across 2000 indices.
We're choosing hardware from the specs our provider has.
One of options we're considering is the one that has 256GB RAM and 4x2TB NVMe SSD.
We're planning to join those in RAID0 which would get us 8TB NVMe SSD per node.
My questing is is it maybe a bit too much since some of our shards are pretty small and we may cross
20 shards or fewer per GB of heap memory boundary.
And seeing is this node has too much RAM as well (although it can be used as cache) we were considering splitting those nodes into 4 LXC containers 64GB RAM and 2TB each. Which option would be preferable from elasticsearch perspective?