How to make Filebeat send events to multiple logstash in roundrobin

(Omar Al Zabir) #1

I have a server which produces 1500 req/sec. Filebeat is processing the logs and sending to a logstash. However, it sends all the events to one logstash. How do I get it to send to multiple logstash servers in order to distribute the load.

Similarly I need to get the logstash to distribute the events to multiple elasticsearch nodes, not just one, for events coming from the same filebeat client.

(Steffen Siering) #2

in beats you can configure multiple hosts and set loadbalance=true to get load-balancing.

See logstash elasticsearch output plugin documentation. The output plugin supports multiple hosts + plus number of output workers can be set.

(Omar Al Zabir) #3

This is very helpful. Thank you very much!

(system) #4