Currently I have a 3 nodes cluster with the following spec:
Every server has 12 cores, 32gb of memory and 3 TB of NVME disks.
I have total of 6.5TB of data, spreaded on 30 daily indices and another four indices with 10-200 million of documents.
Every day I bulk between 200-350GB of data.
Every daily index have 3 primary shards with no replicas.
Im having heap issues due to the amount of indexing we are doing, and overall slowness, therefore I order another 2 servers, with the same spec.
Now, I have some options regarding the amount of master nodes:
- 5 nodes that are both master and data nodes
- 3 master+data nodes and 2 data nodes
My main goal is to have a faster cluster (bulks are taking 1-15 seconds per bulk) and to have a stable cluster (my cluster is getting freezed every week due to OOM)