I would like to setup my Elasticsearch cluster with the hardware specification and condition as below:
Hardware for each node
16 Gb ram
8 virtual cores
Starts with 10Tb disk space in total
Data storage increase 1Tb per day
One single index contains daily data around 100Gb
Can anyone suggest the architecture that is optimum or good to start with, for example:
- index slicing (is the size of 100Gb per index good to support daily data?)
- number of shards ?
- number of cores ?
- are 10gb a suitable size to start with ?
Thanks in advance