App for monitoring Kafka consumer lag

(John_06) #1

I am wondering if there is an alternative to Kafkabeat app to perform Kafka consumer lag monitoring.
It looks like Metricbeat doesn't collect related metrics.

(Steffen Siering) #2

metricbeat supports kafka, but can not capture consumer lag due to this bug:

(John_06) #3

Could you please tell me what is the Metricbeat metric name for consumer lag?

It looks like consumer lag can be calculated as difference between kafka.partition.offset.newest and kafka.consumergroup.offset metrics.

(ruflin) #4

Partition and consumergroup are currently the two available metricsets:

(John_06) #5

I see. Curious if there is the same bug in version 5.4.0

(ruflin) #6

Yes, the same problem that Steffen linked is also in 5.4.

(John_06) #7

Just curious if Metricbeat team is going to fix that bug? I can see it was opened 23 days ago.

(system) #8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.