Hey gus, hope everybody is doing good!
I'm having a problem to upgrade my ES cluster and i'm really lost on how many nodes do i need, their role, their hardware. Right now, i have 2 nodes which one of them is Master Data and Ingestion and the other one is only Data. Each machine has a total of 500 GB of disk, 32 GB of RAM and 16 GB o heap size.
The help that i'm need for is how to upgrade it, because i'm using graylog and storing 1 month of logs in total (using 18 index with 2 shards each and no replicas) consuming 600 GB of disk space with 1,200,000,000 logs in total.
What i need is to know how many nodes should i have so i can expand this one moth of logs to 6 months, i was thinking about 3 master nodes, 3 ingestions nodes and 6 data nodes, but i have no idea of the hardware they would need and if this is the really corretc choice for number of nodes