# Does Kafka Module support the metrics here?

**URL:** <https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979>\
**Category:** Beats\
**Tags:** metricbeat\
**Created:** [June 19, 2017, 5:59pm UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979 "2017-06-19T17:59:57Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![mr\_chang7](https://avatars.discourse-cdn.com/v4/letter/m/cc9497/32.png) [@mr\_chang7](https://discuss.elastic.co/u/mr_chang7)\
**Post date:** [June 19, 2017, 5:59pm UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/1 "2017-06-19T17:59:57Z")

</div>

Hi guys,

I'm checking the current Kafka module can support most of the metrics listed here?  
[https://blog.serverdensity.com/how-to-monitor-kafka/](https://blog.serverdensity.com/how-to-monitor-kafka/)

I'm asking this in the elastic web site I cannot see those in the Exported fields pages.

Thanks!

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [June 20, 2017, 9:27am UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/2 "2017-06-20T09:27:33Z")

</div>

For monitoring kafka, one can use logs, the Kafka APIs to get metadata like topics/partitions/offsets and JMX. The kafka module in metricbeat uses the Kafka API, but the metrics listed here are exported via JMX. Metricbeat has generic collectors via JMX (via Jolokia), HTTP and Prometheus endpoints. By running kafka with the Jolokia or Prometheus agent, you can configure metricbeat to also collect these stats.

---

<div class="post-metadata">

**Author:** ![mr\_chang7](https://avatars.discourse-cdn.com/v4/letter/m/cc9497/32.png) [@mr\_chang7](https://discuss.elastic.co/u/mr_chang7)\
**Post date:** [June 23, 2017, 6:10pm UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/3 "2017-06-23T18:10:45Z")

</div>

I'm testing if we can use Jolokia for the kafka metrics.

I an find the kafka mbeans from here: [https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/](https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/)  
but wondering what to set for the att and fied in the metricbeat for jmx.

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [June 26, 2017, 11:03am UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/4 "2017-06-26T11:03:03Z")

</div>

Did you have a look at the modules documentation: [https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-jolokia-jmx.html](https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-jolokia-jmx.html)

In `jmx.mappings` setting you configure a list of MBeans you want to poll.

---

<div class="post-metadata">

**Author:** ![mr\_chang7](https://avatars.discourse-cdn.com/v4/letter/m/cc9497/32.png) [@mr\_chang7](https://discuss.elastic.co/u/mr_chang7)\
**Post date:** [June 26, 2017, 12:52pm UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/5 "2017-06-26T12:52:35Z")

</div>

I just wanted know how to configure the attribute/field for the list of mbeans. I could found them by jconsole.  
Now I can get those metrics as you suggested using metricbeat via jolokia jmx. Many thanks!

I think it would be nicer if I could simply list up all the mbeans to get all metrics defined in them, rather than indicating each individual att/fields.

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [June 27, 2017, 8:21am UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/6 "2017-06-27T08:21:06Z")

</div>

> I think it would be nicer if I could simply list up all the mbeans to get all metrics defined in them, rather than indicating each individual att/fields.

Feel free to open an [enhancement request](https://github.com/elastic/beats/issues).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 25, 2017, 8:21am UTC](https://discuss.elastic.co/t/does-kafka-module-support-the-metrics-here/89979/7 "2017-07-25T08:21:07Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
