I am wondering if there is an alternative to Kafkabeat app to perform Kafka consumer lag monitoring.
It looks like Metricbeat doesn't collect related metrics.
metricbeat supports kafka, but can not capture consumer lag due to this bug: https://github.com/elastic/beats/issues/4285
Could you please tell me what is the Metricbeat metric name for consumer lag?
It looks like consumer lag can be calculated as difference between kafka.partition.offset.newest and kafka.consumergroup.offset metrics.
Partition and consumergroup are currently the two available metricsets: https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-kafka.html
I see. Curious if there is the same bug in version 5.4.0
Yes, the same problem that Steffen linked is also in 5.4.
Just curious if Metricbeat team is going to fix that bug? I can see it was opened 23 days ago.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.