Libbeat kafka output


(Matt Weber) #1

Any plans for a kafka output? Looking to send beat events directly to Kafka which can then be consumed by (multiple) Logstash instances using the Kafka input.


(ruflin) #2

@mattweber It is best to have a look at the discussion here: https://github.com/elastic/libbeat/pull/21

Libbeat already allows to send data directly to multiple logstash instances and do some basic load balancing.


(Matt Weber) #3

Thanks that will work! It could get tedious as I add more and more beats since I would need to update each config as I add more logstash instances. At any rate, I'm not at that point yet and using the current load balance functionality will be just fine.

Thanks!


(ruflin) #4

This could help here (still in the concept phase): https://github.com/elastic/libbeat/issues/200


(system) #5