Hi,
I'm running a setup with Elasticsearch, Fluentd and Kibana where a single central aggregator receives data from multiple clients and stores it into elasticsearch, running in a docker compose.
I receive about 22GB of data per day. Currently, I'm having some issues with clients disconnecting and I'm not sure exactly what the cause is.
So I'm wondering if it could be a hardware limitation and also how much more data I could store and index with this setup as demand grows.
Basically, the settings are:
1 index, 1 shard, 1 replica
16GB RAM, with JVM heap size set to 10GB
4 core/4 thread Intel Xeon Platinum 8171M CPU @ 2.60GHz
HDD
Thanks in advance