Sizing logstash servers


(MJay) #1

Would like to know the number of logstash nodes to process 8 billion log events/day, 5TB of total size/day and having average size of log event around 1KB.


(Christian Dahlqvist) #2

It will depend a lot on the type of processing you are doing, so I would recommend setting up a node and test it to see what throughput your configuration gives you. Also remember that Logstash can only process as fast as the slowest downstream system can accept the data, so make sure that your Elasticsearch cluster is not a bottleneck.