Hello everybody,
It's the first time that I am going to run a cluster for a production POC and I need some help in the way that I size my machines.
Knowing that I am going to have like 15Go of data per day, and knowing that I have a hypervisor with the characteristic bellow :
| Hyperviseur | |||
|---|---|---|---|
| CPU | RAM | Disk HDD | Disk SSD |
| 30 Go | 64 Go | 5400 Go | 1780 Go |
I have made the sizing:
| CPU | RAM | Disk HDD | DIsk SSD | |
|---|---|---|---|---|
| MASTER 1 | 2 Go | 4 Go | 100 Go | 0 |
| MASTER 2 | 2 Go | 4 Go | 100 Go | 0 |
| MASTER 3 | 2 Go | 4 Go | 100 Go | 0 |
| DATA 01 (HOT) | 6 Go | 8 Go | 0 | 400 Go |
| DATA 02 (HOT) | 6 Go | 8 Go | 0 | 400 Go |
| DATA 03 (WARM) | 6 Go | 6 Go | 3000 Go | 0 |
| LOGSTASH / Kibana | 4 Go | 8Go | 60 Go | 0 |
| Machine Learning | 6 Go | 8 Go | 200 Go | 0 |
NB: I am going to configure the data retention for 6 months, (1 month in a HOT node and 5 months in Warm node with 1 shard and 1 replica)
I would like to know if this sizing is good, and if not, what should I change ?
Thanks for your help : )