Filebeat kafka logstash configuration

Ferdous_Shibly · October 26, 2017, 5:27pm

Hi,

I am trying to configure ELK cluster with kafka. I am using filebeat to ship the logs to kafka and logstash to grep the logs from kafka, process the logs and send it to elasticsearch. I need to find out a way to persist time from filebeat to elasticsearch and check the lagging between kafka and logstash. How can I find out the lagging and preserve the time?

Cheers
Ferdous Shibly

system · November 23, 2017, 5:27pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Filebeat to lagstash to kafka or Filebeat to kafka for >= 10,000 servers Beats filebeat	3	819	July 7, 2017
Elasticsearch Integration with Kafka, Zookeeper using filebeat Beats filebeat	2	2473	March 9, 2017
ELK workflow with Filebeat - could you explain in detail? Beats filebeat	6	941	October 28, 2019
Filebeat is unable to send logs into kafka Beats filebeat	5	2104	November 9, 2020
Can filebeat monitoring send data to Kafka? Beats filebeat	8	675	October 26, 2019

Filebeat kafka logstash configuration

Related Topics