Filebeat Input X kafka topics

Elastic Stack Elasticsearch
1

Is it possible to consume all topics of a kafka cluster through filebeat input?
ex:

  • type: kafka
    hosts:
    - ${KAFKA_BROKERCONNECT}
    topics: ["*"]. --------> It doesn't work, I've tried several regex =/
    group_id: "kafka-consumer-filebeat"
    ssl.enabled: yes
    username:
    password:
2

It doesn't seem to be possible, the documentation doesn't mention it and looking at the code it expects an array of topics.

You will need to specify each topic or use Logstash, where you can specify a topic pattern.

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.