Hi All...
I have a cluster of 10 data/master eligible nodes, each node has 64GB of Memory and 3TB of disk.
I am going to index 40GB of data daily and I have separate logstash instances of 16GB of Memory to index the data.
Now I am referring to, two types of architectures and please suggest me the best one.
In the first architecture, I will point all 10 data/master eligible nodes in logstash output elasticsearch hosts tag for load balancing.
In the Second architecture, I will add two additional coordinating nodes and pointing them in logstash output elasticsearch hosts tag for load balancing. Also, I would like to add these 2 coordinating nodes to, two separate kibana instances, In order to achive high availablity and load balance for kibana as well.
Please suggest me the best approach.
Thank you