# \[Solved\] Using the Kafka output the Development Build of Filebeat **URL:** \ **Category:** Beats\ **Tags:** filebeat\ **Created:** [February 25, 2016, 4:38pm UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742 "2016-02-25T16:38:44Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Bibeleuh](https://avatars.discourse-cdn.com/v4/letter/b/ec9cab/32.png) [@Bibeleuh](https://discuss.elastic.co/u/Bibeleuh)\ **Post date:** [February 25, 2016, 4:38pm UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/1 "2016-02-25T16:38:44Z")
Hello, I have problems to communicate with my broker as output. My actually working configuration is : Filebeat -\> Logstash 1 -\> RabbitMQ -\> Logstash 2 -\> Elasticsearch Logstash1 is only an intermediate between FB and the broker (since Filebeat doesn't support RabbitMQ as output) Logstash2 is the worker which transform the data Now , i tried to remove Logstash1 to use only one broker : Filebeat -\> Kafka -\> Logstash -\> Elasticsearch But it doesn't seems to work 😓 , her is my filebeat.yml ``` filebeat: prospectors: - paths: - C://filebeat-1.1.1-windows//logs//*.log* input_type: log output: kafka: host: "localhost:9092" topic: "test" use_type: true client_id: "beats" worker: 1 max_retries: 0 shipper: logging: files: rotateeverybytes: 10485760 # = 1MB ``` My message error : > Error Initialising publiser: No outputs are defined. Please define one under the output section. As i said it works with logtsash or console as output. My configuration : **Filebeat** : filebeat-1.1.1-windows **Kafka** : kafka\_2.11-0.9.0.1 **Java version** : 1.7.0\_45 **Windows** : 8.1Entreprise 64bits Thanks for helping 😉 ---
**Author:** ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)\ **Post date:** [February 25, 2016, 11:16pm UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/2 "2016-02-25T23:16:17Z")
I see a few issues: - Filebeat 1.1.1. does not support Kafka as an output. This will be included in the next major release. You can test the development version if you would like. You can download it here: [https://beats-nightlies.s3.amazonaws.com/filebeat/filebeat-1.2.0-nightlylatest-windows.zip](https://beats-nightlies.s3.amazonaws.com/filebeat/filebeat-1.2.0-nightlylatest-windows.zip) - The indentation of the `kafka` output option is wrong. - `host` is not a valid option, uses `hosts`. See the reference documentation here: [https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html](https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html) Try this with the development binary: ```auto output: kafka: hosts: ["localhost:9092"] ... ``` ---
**Author:** ![Bibeleuh](https://avatars.discourse-cdn.com/v4/letter/b/ec9cab/32.png) [@Bibeleuh](https://discuss.elastic.co/u/Bibeleuh)\ **Post date:** [February 26, 2016, 10:43am UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/3 "2016-02-26T10:43:01Z")
Thanks a lot, both solutions are working with this new version 1.2.0 🙂 For information my configs files are : filebeat\_kafka.yml ``` filebeat: prospectors: - paths: - C://filebeat//logs//*.log* input_type: log output: kafka: hosts: ["localhost:9092"] topic: "test" use_type: true client_id: "beats" worker: 1 max_retries: 0 console: pretty: true shipper: logging: files: rotateeverybytes: 10485760 # = 1MB ``` filebeat\_redis.yml ``` filebeat: prospectors: - paths: - C://filebeat//logs//*.log* input_type: log output: redis: host: "localhost" port: 6379 save_topology: false index: "filebeat" db: 99 db_topology: 1 timeout: 5 reconnect_interval: 1 console: pretty: true shipper: logging: files: rotateeverybytes: 10485760 # = 1MB ``` ---
**Author:** ![escvr](https://avatars.discourse-cdn.com/v4/letter/e/77aa72/32.png) [@escvr](https://discuss.elastic.co/u/escvr)\ **Post date:** [June 22, 2016, 10:56am UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/4 "2016-06-22T10:56:12Z")
Hi, I am using filebeat1.2.3 to push logs to kafka. From the above kafka configuration due to console: pretty: true, the logs are displying on console but not pushing to kafka topic. If i remove console: pretty: true and run, getting below is message and exited. filebeat-1.2.3-darwin$ sudo ./filebeat -e -c filebeat-kafka.yml -d "publish" 2016/06/22 10:21:59.311855 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths 2016/06/22 10:21:59.312381 publish.go:269: INFO No outputs are defined. Please define one under the output section. Error Initialising publisher: No outputs are defined. Please define one under the output section. 2016/06/22 10:21:59.312394 beat.go:140: CRIT No outputs are defined. Please define one under the output section. **Filebeat** : filebeat-1.1.1-windows **Kafka** : kafka\_2.11-0.9.0.1 **Java version** : 1.8.0\_71 **MAC** Thanks in advance. 🙂 ---
**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\ **Post date:** [June 22, 2016, 3:53pm UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/5 "2016-06-22T15:53:53Z")
kafka output will be shipped with 5.0 release. You can get current 5.0.0-alpha3 from [filebeat download page](https://www.elastic.co/downloads/beats/filebeat). ---
**Author:** ![escvr](https://avatars.discourse-cdn.com/v4/letter/e/77aa72/32.png) [@escvr](https://discuss.elastic.co/u/escvr)\ **Post date:** [June 24, 2016, 3:47am UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/6 "2016-06-24T03:47:35Z")
Yes Steffens, tried with 5.0 release. Its woking. Thanks for the reply. ---
**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\ **Post date:** [June 24, 2016, 11:40am UTC](https://discuss.elastic.co/t/solved-using-the-kafka-output-the-development-build-of-filebeat/42742/7 "2016-06-24T11:40:01Z")