We are currently receiving about 200 gb of information per day. Distributed in approximately two million logs.
We need to increase the capacity of our cluster in order to generate some reports in less time than now.
What would you recommend? how many nodes should i add? Should I increase the memory of the current ones?
My cluster:
3 data node 36 gb 16 cores
4 master 16gb 16 cores
logstash 16gb 16 cores
kibana 32gb 16 core
Thank you for your contributions.