Filebeat to connect kafka

Elastic Stack Beats
1

hi team ; i am getiing below error while logshishiping from filebeat to kafka; below are details. and exception , please help.

filebeat : filebeat-1.3.1-5.el7.x86_64
Kafka : confluent kafka 5.0

Filebeat config:

[root@sd-e7ff-b05f system]# cat /etc/filebeat/filebeat.yml

filebeat.prospectors:

  • input_type: log
    paths:
    • /var/log/message1/*
      registry_file: /etc/filebeat/.filebeat.registry
      logging.files.keepfiles: 2
      logging.files.name: filebeat.log
      logging.files.path: /var/log/filebeat
      logging.level: debug
      logging.to_files: true
      logging.to_syslog: false
      output:
      kafka:
      enabled: true
      hosts: ["localhost:9092"]
      max_message_bytes: 1000000
      partition.round_robin:
      reachable_only: false
      required_acks: -1
      topic: santhi

Exception :
[root@XXXXXXXXsystem]# /usr/bin/filebeat -c /etc/filebeat/filebeat.yml -e -v -d "*"
2018/09/24 15:38:22.824848 beat.go:156: DBG Initializing output plugins
2018/09/24 15:38:22.824888 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths
2018/09/24 15:38:22.824914 publish.go:269: INFO No outputs are defined. Please define one under the output section.
Error Initialising publisher: No outputs are defined. Please define one under the output section.
2018/09/24 15:38:22.824933 beat.go:161: CRIT No outputs are defined. Please define one under the output section.

Please help on this issue.

2

Can you try to format your config above? I assume there is an error somewhere in the yaml file.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.