Any plans for a kafka output? Looking to send beat events directly to Kafka which can then be consumed by (multiple) Logstash instances using the Kafka input.
@mattweber It is best to have a look at the discussion here: https://github.com/elastic/libbeat/pull/21
Libbeat already allows to send data directly to multiple logstash instances and do some basic load balancing.
Thanks that will work! It could get tedious as I add more and more beats since I would need to update each config as I add more logstash instances. At any rate, I'm not at that point yet and using the current load balance functionality will be just fine.
Thanks!
This could help here (still in the concept phase): https://github.com/elastic/libbeat/issues/200