The Architecture of entperise log management system based on Elastic Stack 5.0.1 and Kafka 0.10.1.0

Elastic Stack Logstash
1

In blog "Just Enough Kafka for the Elastic Stack（https://www.elastic.co/blog/just-enough-kafka-for-the-elastic-stack-part1）, Logstash takes the role of Shipper.

But Filebeat 5.0.1 can support Kafka Output Configuration(https://www.elastic.co/guide/en/beats/filebeat/current/kafka-output.html). So can LogstashShipper been removed and Filebeat send the data directly to Kafka?

Thanks.

Michael

2

Yes, that'll work.

3

Hi Magnus, Thanks for your quick help.

If we choose Elastic Stack 5.0.1, filebeat send the log to kafka directly is a recommended solution for enterprise log management deployment? Just want to get the confirmation.

Thank you very much.

Michael

4

I haven't tried any of the solutions myself but given Logstash's larger footprint I'd prefer using Filebeat if possible.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.