Filebeat ssl kafka

[ajayrc (ajaykumar)]

How to make file beat to send data to kafka via ssl ?

Setting Filebeat 5 with Kafka 0.10 over TLS

When I tried the bash script you provided, which I see just follows the directions on Kafka docs, I got the same error in filebeat. Exiting: error initializing publisher: crypto/tls: failed to parse private key Looking into it I noticed that the script generated DSA keys for the server and client rather than RSA keys. The generated key worked okay from openssl but failed from filebeat. From my tests it looks like filebeat does not support DSA keys and will fail if one is used in either the …

am using the approach told here by anefassa but am getting error
pipeline/output.go:74 kafka/client.go:69 Kafka connect fails with: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2018-04-05T18:01:25.265+0530 ERROR pipeline/output.go:74 Failed to connect: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)

[steffens (Steffen Siering)]

To me the log message indicates that you haven't setup kafka correctly. The log should contain some messages (much earlier in the log), why the beat could not connect. But most likely it is your kafka server configuration not correctly configuring the listeners.