# Disappearing kafka prometheus metricbeat data

**URL:** <https://discuss.elastic.co/t/disappearing-kafka-prometheus-metricbeat-data/366921>\
**Category:** Beats\
**Tags:** metricbeat\
**Created:** [September 22, 2024, 4:04pm UTC](https://discuss.elastic.co/t/disappearing-kafka-prometheus-metricbeat-data/366921 "2024-09-22T16:04:07Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Frynaruto](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/frynaruto/32/137695_2.png) [@Frynaruto](https://discuss.elastic.co/u/Frynaruto)\
**Post date:** [September 22, 2024, 4:04pm UTC](https://discuss.elastic.co/t/disappearing-kafka-prometheus-metricbeat-data/366921/1 "2024-09-22T16:04:07Z")

</div>

Hi im setting up an ELK monitoring for my kafka cluster of 5 broker/controller and prometheus.

I have this issue where the active controller will report as per usual with the other brokers however after some time, some data will be missing from kibana/elasticsearch from the active controller. When i search via the prometheus endpoint for that controller(which is what my metric beat is configured to) i can see the metric. I can see it in the metric beat logs in debug mode as well.

Im looking for prometheus.metrics.kafka\_controller\_kafkacontroller\_activecontrollercount which should be 1 when controller is active. However it disappears after an inconsistent amount of time. Some other metrics disappear as well. Anyone has any idea why?