# App for monitoring Kafka consumer lag

**URL:** https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311
**Category:** Beats
**Tags:** metricbeat
**Created:** [May 18, 2017, 5:35pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311 "2017-05-18T17:35:03Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![John\_06](https://avatars.discourse-cdn.com/v4/letter/j/7c8e57/32.png) [@John\_06](https://discuss.elastic.co/u/John_06)
#### Post date: [May 18, 2017, 5:35pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/1 "2017-05-18T17:35:03Z")

</div>

I am wondering if there is an alternative to Kafkabeat app to perform Kafka consumer lag monitoring.  
It looks like Metricbeat doesn't collect related metrics.

---

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [May 19, 2017, 10:56am UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/2 "2017-05-19T10:56:28Z")

</div>

metricbeat supports kafka, but can not capture consumer lag due to this bug: [https://github.com/elastic/beats/issues/4285](https://github.com/elastic/beats/issues/4285)

---

<div class="post-metadata">

### Author: ![John\_06](https://avatars.discourse-cdn.com/v4/letter/j/7c8e57/32.png) [@John\_06](https://discuss.elastic.co/u/John_06)
#### Post date: [May 20, 2017, 7:44pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/3 "2017-05-20T19:44:15Z")

</div>

Could you please tell me what is the Metricbeat metric name for consumer lag?

It looks like consumer lag can be calculated as difference between `kafka.partition.offset.newest` and `kafka.consumergroup.offset` metrics.

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [May 22, 2017, 1:06pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/4 "2017-05-22T13:06:33Z")

</div>

Partition and consumergroup are currently the two available metricsets: [https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-kafka.html](https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-kafka.html)

---

<div class="post-metadata">

### Author: ![John\_06](https://avatars.discourse-cdn.com/v4/letter/j/7c8e57/32.png) [@John\_06](https://discuss.elastic.co/u/John_06)
#### Post date: [May 22, 2017, 3:43pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/5 "2017-05-22T15:43:39Z")

</div>

I see. Curious if there is the same bug in version 5.4.0

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [May 23, 2017, 1:04pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/6 "2017-05-23T13:04:21Z")

</div>

Yes, the same problem that Steffen linked is also in 5.4.

---

<div class="post-metadata">

### Author: ![John\_06](https://avatars.discourse-cdn.com/v4/letter/j/7c8e57/32.png) [@John\_06](https://discuss.elastic.co/u/John_06)
#### Post date: [June 2, 2017, 3:54pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/7 "2017-06-02T15:54:22Z")

</div>

Just curious if Metricbeat team is going to fix that bug? I can see it was opened 23 days ago.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 30, 2017, 3:54pm UTC](https://discuss.elastic.co/t/app-for-monitoring-kafka-consumer-lag/86311/8 "2017-06-30T15:54:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
