Filebeat kafka output with SCRAM authentication

Elastic Stack Beats
1

Hi People,

I'm trying to configure a Kafka output for filebeat. The kafka broker is configure to listend on TLS and supports SCRAM authentication. I configured Kafka output successfully. However Published goes in retry indefinitly. As per the documentation, username and password configuration is supported only on SASL/PLAIN mechanism. Also while validating output configuration I'm getting a warning saying TLS... WARN Kafka output doesn't support TLS testing

can anybody confirm if filebeat supports the Kafka broker configuration I have. Also posting below output.kafka configuration

# ----------------------------- Kafka Output ----------------------------------
output.kafka:
  hosts: ["broker1:9094", "broker2:9094", "broker3:9094"]
  topic: "mytopic"
  compression: gzip
  username: "user"
  password: "password"
  ssl.certificate_authorities: ["/path/to/ca.crt"]

Filebeat test output

> ./filebeat test config -c ./filebeat.yml
Config OK

> ./filebeat test output -c  ./filebeat.yml
TLS... WARN Kafka output doesn't support TLS testing
Kafka: broker1:9094...
  parse host... OK
  dns lookup... OK
  addresses: broker1
  dial up... OK
Kafka: broker2:9094...
  parse host... OK
  dns lookup... OK
  addresses: broker2
  dial up... OK
Kafka: broker3:9094...
  parse host... OK
  dns lookup... OK
  addresses:  broker3
  dial up... OK

Thanks,
Darshan

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.