# Filebeat not getting Kafka logs

**URL:** <https://discuss.elastic.co/t/filebeat-not-getting-kafka-logs/365256>\
**Category:** Beats\
**Tags:** elastic-stack-monitoring, docker, filebeat\
**Created:** [August 21, 2024, 8:09am UTC](https://discuss.elastic.co/t/filebeat-not-getting-kafka-logs/365256 "2024-08-21T08:09:05Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Elgis\_Migle](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/elgis_migle/32/122166_2.png) [@Elgis\_Migle](https://discuss.elastic.co/u/Elgis_Migle)\
**Post date:** [August 21, 2024, 8:09am UTC](https://discuss.elastic.co/t/filebeat-not-getting-kafka-logs/365256/1 "2024-08-21T08:09:05Z")

</div>

Hello all,

I'm trying to set up monitoring for my Kafka setup. I'm using

> image: confluentinc/cp-server:7.6.0

and ELK stack with version 7.14. The following is my filebeat.yml

> kafka.home: /opt/kafka
> 
> filebeat.config.modules:  
> path: /usr/share/filebeat/modules.d/\*.yml
> 
> filebeat.inputs:
> 
> - input\_type: log  
> paths:  
> - ${kafka.home}/logs/controller.log\*  
> - ${kafka.home}/logs/server.log\*  
> - ${kafka.home}/logs/state-change.log\*  
> - ${kafka.home}/logs/kafka-_.log_
> 
> multiline.pattern: '^['  
> multiline.negate: true  
> multiline.match: after
> 
> fields.pipeline: kafka-logs
> 
> - input\_type: log  
> paths:  
> - ${kafka.home}/logs/kafkaServer-gc.log
> 
> multiline.pattern: '^\s'  
> multiline.negate: false  
> multiline.match: after
> 
> include\_lines: ['GC pause']
> 
> fields.pipeline: kafka-gc-logs
> 
> output.elasticsearch:  
> hosts: ["elasticsearch:9200"]  
> index: 'kafkalogs-%{+yyyy.MM.dd}'  
> pipeline: '%{[fields.pipeline]}'
> 
> username: "elastic"  
> password: "changeme"
> 
> setup.kibana:  
> host: "[http://kibana:5601](http://kibana:5601)"
> 
> setup.template.name: "desktop"  
> setup.template.pattern: "desktop-\*"

and kafka.yml

> - module: kafka  
> log:  
> enabled: true  
> var.paths:  
> - "/logs/\*.log"

after enabling the module and executing the setup I see no logs in my kibana. When doing "docker logs broker" I can see some WARN logs being generated though and I feel like those should now also show up in my kibana.  
I feel like either the confluent Kafka image has its Kafka not in /opt/ or I have some other path set up wrongly.

Any advice would be greatly appreciated 🙂