# Metricbeat to collect metrics from Kerberised Kafka + SSLCa configuration

**URL:** https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491
**Category:** Beats
**Tags:** packetbeat
**Created:** [January 9, 2020, 9:03pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491 "2020-01-09T21:03:50Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![lskaa](https://avatars.discourse-cdn.com/v4/letter/l/ad7895/32.png) [@lskaa](https://discuss.elastic.co/u/lskaa)
#### Post date: [January 9, 2020, 9:03pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/1 "2020-01-09T21:03:50Z")

</div>

Hi All,

May I know if anyone has experience to configure Metricbeat to collect metrics from Kerberised Kafka?

Here is my kafka.yml. I also add Read and Describe operations to my Kafka instances for a user stats.

- module: kafka  
metricsets:
  - partition
  - consumergroup  
period: 10s  
hosts:
  - broker1:9092
  - broker2:9092
  - broker3:9092  
client\_id: stats

According to the log, it connected to the brokers seemingly.

2020-01-10T09:28:57.157+1300 INFO kafka/log.go:53 Connected to broker at broker1:9092 (unregistered)  
2020-01-10T09:28:57.390+1300 INFO kafka/log.go:53 Closed connection to broker broker1:9092

However, it failed to fetch data for the partition and the consumergroup.

2020-01-10T09:28:57.672+1300 INFO module/wrapper.go:252 Error fetching data for metricset kafka.partition: error in connect: failed to query metadata: EOF  
2020-01-10T09:28:57.672+1300 INFO module/wrapper.go:252 Error fetching data for metricset kafka.consumergroup: error in connect: failed to query metadata: EOF

Thank you

---

<div class="post-metadata">

### Author: ![olorasde](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/olorasde/32/40103_2.png) [@olorasde](https://discuss.elastic.co/u/olorasde)
#### Post date: [January 10, 2020, 12:20pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/2 "2020-01-10T12:20:35Z")

</div>

Hi! I'm trying to configure metricbeat with kafka and i have exactly the same error than you.

I'm using kafka 2.1.1 and metricbeat 7.4.2. I suspect that the problem maybe is related to version og metricbeat.

Now im trying to deploy 7.5.0 version and check.

I'll write the results here.

---

<div class="post-metadata">

### Author: ![olorasde](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/olorasde/32/40103_2.png) [@olorasde](https://discuss.elastic.co/u/olorasde)
#### Post date: [January 10, 2020, 12:28pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/3 "2020-01-10T12:28:18Z")

</div>

seem that metricbeat 7.5.1 has a bug trying to activate kafka module.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/a/3/a3d5a6e51acfb0932abfc537b4dd48bfbfad8f23.png)

Its possible?

---

<div class="post-metadata">

### Author: ![lskaa](https://avatars.discourse-cdn.com/v4/letter/l/ad7895/32.png) [@lskaa](https://discuss.elastic.co/u/lskaa)
#### Post date: [January 12, 2020, 7:29pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/4 "2020-01-12T19:29:29Z")

</div>

It seems to me not the issue of the module. It looks to me that the issue of Metricbeat collecting metrics from Kerberised Kafka as I've found from other post.

> <https://github.com/elastic/beats/issues/11420>
>
> Issue: Metric beat is not to collect metrics from Kerberized Kafka.
> It works well with non-kerberized Kafka
> MetricBeat Version: 6.6.2
> Operating System: CentOs 7.4.x
> logs...

Seemingly, there is not much update.

---

<div class="post-metadata">

### Author: ![olorasde](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/olorasde/32/40103_2.png) [@olorasde](https://discuss.elastic.co/u/olorasde)
#### Post date: [January 13, 2020, 8:48am UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/5 "2020-01-13T08:48:10Z")

</div>

If i undertand correcty, this seems that kafka securized cant allow be monitorizet by metricbeat? its a kafka issue?

---

<div class="post-metadata">

### Author: ![lskaa](https://avatars.discourse-cdn.com/v4/letter/l/ad7895/32.png) [@lskaa](https://discuss.elastic.co/u/lskaa)
#### Post date: [January 13, 2020, 9:07pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/6 "2020-01-13T21:07:40Z")

</div>

I can query the metadata via the scripts from Kafka using the same client id as in the kafka.yml file of metricbeat. However, metricbeat complained query metadata issue. So it seems to me it's more on metricbeat issue rather than the Kerberised Kafka.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 10, 2020, 9:08pm UTC](https://discuss.elastic.co/t/metricbeat-to-collect-metrics-from-kerberised-kafka-sslca-configuration/214491/7 "2020-02-10T21:08:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
