# Unable to push filebeat published messages to kafka output

**URL:** https://discuss.elastic.co/t/unable-to-push-filebeat-published-messages-to-kafka-output/152170
**Category:** Beats
**Tags:** filebeat
**Created:** [October 12, 2018, 6:48am UTC](https://discuss.elastic.co/t/unable-to-push-filebeat-published-messages-to-kafka-output/152170 "2018-10-12T06:48:06Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Nithani25](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nithani25/32/33457_2.png) [@Nithani25](https://discuss.elastic.co/u/Nithani25)
#### Post date: [October 12, 2018, 6:48am UTC](https://discuss.elastic.co/t/unable-to-push-filebeat-published-messages-to-kafka-output/152170/1 "2018-10-12T06:48:06Z")

</div>

Hi Team,  
I am working on a setup where i am trying to push my filebeat read messages to kafka output. though i could see filebeat publishing messages, i couldn't recieve anything in kafka topic. Below is my filebeat.yml file, please review them and mention if i am missing any key field in there.

* * *

filebeat.prospectors:

- type: log

#============================= Filebeat modules ===============================

filebeat.config.modules:

# Glob pattern for configuration loading

path: ${path.config}/modules.d/\*.yml

# Set to true to enable config reloading

reload.enabled: false

# Period on which files under path should be checked for changes

#reload.period: 10s

#================================ Outputs ======================================

# Configure what output to use when sending the data collected by the beat.

#------------------------------- Kafka output ----------------------------------  
output.kafka:

# Boolean flag to enable or disable the output module.

enabled: true

# The list of Kafka broker addresses from where to fetch the cluster metadata.

# The cluster metadata contain the actual Kafka brokers events are published

# to.

hosts: ["localhost:9092"]

# The Kafka topic used for produced events. The setting can be a format string

# using any event field. To set the topic from document type use `%{[type]}`.

topic: '%{[apache\_stov\_topic]}'  
partition.round\_robin:  
reachable\_only: false

# Sets the output compression codec. Must be one of none, snappy and gzip. The

# default is gzip.

compression: gzip

# The maximum permitted size of JSON-encoded messages. Bigger messages will be

# dropped. The default value is 1000000 (bytes). This value should be equal to

# or less than the broker's message.max.bytes.

max\_message\_bytes: 1000000

---

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [October 16, 2018, 8:44pm UTC](https://discuss.elastic.co/t/unable-to-push-filebeat-published-messages-to-kafka-output/152170/2 "2018-10-16T20:44:22Z")

</div>

Any error messages in the filebeat or kafka log?

Please use the `</>` Button in the editor to format configuration files and logs. Filebeat configuration is sensitive to formatting. Without proper formatting it's very difficult to read configs.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 13, 2018, 8:44pm UTC](https://discuss.elastic.co/t/unable-to-push-filebeat-published-messages-to-kafka-output/152170/3 "2018-11-13T20:44:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.