# Issue with Kafka Module
**URL:** https://discuss.elastic.co/t/issue-with-kafka-module/124356
**Category:** Beats
**Tags:** filebeat
**Created:** [March 16, 2018, 6:44pm UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356 "2018-03-16T18:44:41Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@ryan.dyer](https://discuss.elastic.co/u/ryan.dyer)
#### Post date: [March 16, 2018, 6:44pm UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356/1 "2018-03-16T18:44:41Z")
I am having an issue with the kafka module not appear to process the lines properly. I have enabled debugging of filebeat and see the following:
`2018-03-16T18:36:54Z DBG [publish] Publish event: { "@timestamp": "2018-03-16T18:36:54.052Z", "@metadata": { "beat": "filebeat", "type": "doc", "version": "6.1.2", "pipeline": "filebeat-6.1.2-kafka-log-pipeline" }, "source": "/var/log/kafka/controller.log", "offset": 84336, "message": "[2018-03-16 18:36:45,144] DEBUG [Controller 2]: topics not in preferred replica Map() (kafka.controller.KafkaController)", "fileset": { "name": "log", "module": "kafka" }, "prospector": { "type": "log" }, "beat": { "name": "eventing2030-ct-kafka-2", "hostname": "eventing2030-ct-kafka-2", "version": "6.1.2" } }`
The line appears to match what the module shows so I'm not sure why its not being processed. The syslog module on the other hand is working fine.
Any assistance would be appreciated.
Thanks
---
### Author:  [@ryan.dyer](https://discuss.elastic.co/u/ryan.dyer)
#### Post date: [March 19, 2018, 6:18pm UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356/2 "2018-03-19T18:18:52Z")
Anyone have any ideas on this?
---
### Author:  [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [March 21, 2018, 7:05am UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356/3 "2018-03-21T07:05:23Z")
Can you share what you mean by not processed? The processing of the log lines happens in the Ingest Pipeline in Elasticsearch and not on the Filebeat side. So it is expected that the published event above is not processed yet.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [April 18, 2018, 7:05am UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356/4 "2018-04-18T07:05:39Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.