The Architecture of entperise log management system based on Elastic Stack 5.0.1 and Kafka 0.10.1.0


(Obsicn) #1

In blog "Just Enough Kafka for the Elastic Stack(https://www.elastic.co/blog/just-enough-kafka-for-the-elastic-stack-part1), Logstash takes the role of Shipper.

But Filebeat 5.0.1 can support Kafka Output Configuration(https://www.elastic.co/guide/en/beats/filebeat/current/kafka-output.html). So can LogstashShipper been removed and Filebeat send the data directly to Kafka?

Thanks.

Michael


(Magnus Bäck) #2

Yes, that'll work.


(Obsicn) #3

Hi Magnus, Thanks for your quick help.

If we choose Elastic Stack 5.0.1, filebeat send the log to kafka directly is a recommended solution for enterprise log management deployment? Just want to get the confirmation.

Thank you very much.

Michael


(Magnus Bäck) #4

I haven't tried any of the solutions myself but given Logstash's larger footprint I'd prefer using Filebeat if possible.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.