App for monitoring Kafka consumer lag


(John_06) #1

I am wondering if there is an alternative to Kafkabeat app to perform Kafka consumer lag monitoring.
It looks like Metricbeat doesn't collect related metrics.


(Steffen Siering) #2

metricbeat supports kafka, but can not capture consumer lag due to this bug: https://github.com/elastic/beats/issues/4285


(John_06) #3

Could you please tell me what is the Metricbeat metric name for consumer lag?

It looks like consumer lag can be calculated as difference between kafka.partition.offset.newest and kafka.consumergroup.offset metrics.


(ruflin) #4

Partition and consumergroup are currently the two available metricsets: https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-kafka.html


(John_06) #5

I see. Curious if there is the same bug in version 5.4.0


(ruflin) #6

Yes, the same problem that Steffen linked is also in 5.4.


(John_06) #7

Just curious if Metricbeat team is going to fix that bug? I can see it was opened 23 days ago.


(system) #8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.