# Metricbeat kafka module - consumergroup metric set does not report metrics
**URL:** https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623
**Category:** Beats
**Tags:** metricbeat
**Created:** [April 25, 2017, 11:19pm UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623 "2017-04-25T23:19:08Z")
**Posts on this page:** 6
**Page:** 2
### Author:  [@Rahul\_Joshi](https://discuss.elastic.co/u/Rahul_Joshi)
#### Post date: [May 5, 2017, 5:26pm UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/21 "2017-05-05T17:26:48Z")
Bdeus,
I wonder if the consumergroup metrics dont work if there are multiple kafka nodes. Glad to hear that someone else is having the same issue.
Steffen,
Any chance this is a bug that come into play when multiple kafka nodes are being used?
---
### Author:  [@Rahul\_Joshi](https://discuss.elastic.co/u/Rahul_Joshi)
#### Post date: [May 9, 2017, 12:44am UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/24 "2017-05-09T00:44:31Z")
Ok I have confirmed that this works on my local machine with SSL turned on. My test setup is as follows:
-kafka single node with SSL turned on
-Logstash (Same configuration as posted by @steffens ) but with SSL configurations
-metric beats with kafka module with appropriate SSL configs
Result: I am able to get events for both partition and consumergroup
Conclusion: Since this works on my local box and does not in our cluster setup I conclude that kafka module for metric beats does not work for the `consumergroup` metricset in a clustered kafka configuration. Shall i submit a bug report for this?
---
### Author:  [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [May 10, 2017, 10:47am UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/25 "2017-05-10T10:47:05Z")
Yeah, please open an issue on github.
Doing some testing myself and having had a look at the code I think I have an idea what happening. The thing in kafka is a partitions, consumer groups and also consumer group offsets are all handled by different brokers all the time. The problem is, the code neglects the consumer group offsets being handled by another broker, then the consumer group itself.
---
### Author:  [@Rahul\_Joshi](https://discuss.elastic.co/u/Rahul_Joshi)
#### Post date: [May 10, 2017, 9:51pm UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/26 "2017-05-10T21:51:47Z")
thankyou @steffens !
I have opened a ticket:
>
---
### Author:  [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [May 11, 2017, 10:24am UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/27 "2017-05-11T10:24:32Z")
Thanks for your patience and all the testing. I will have to reconsider some decisions/structuring on the kafka module. Eventually we will get the required fields for lag computations + lag itself right from metricbeat, without having to apply to much magic in Kibana.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 8, 2017, 10:37am UTC](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623/28 "2017-06-08T10:37:12Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
[Previous page](https://discuss.elastic.co/t/metricbeat-kafka-module-consumergroup-metric-set-does-not-report-metrics/83623.md?page=1)