Would like to know the number of logstash nodes to process 8 billion log events/day, 5TB of total size/day and having average size of log event around 1KB.
It will depend a lot on the type of processing you are doing, so I would recommend setting up a node and test it to see what throughput your configuration gives you. Also remember that Logstash can only process as fast as the slowest downstream system can accept the data, so make sure that your Elasticsearch cluster is not a bottleneck.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.