Filebeat Kafka output message compression

Would like to know whether filebeat compresses the log events before sending to Kafka.

Hi @mruthyu,

Yes, Kafka output uses compression. Default codec is gzip, and it can be changed with the compression setting.

Thanks. So whether the gzip format message is stored in Kafka? And when logstash reads from the kafka input whether it will decompress it?

Yes, the message is stored as sent by the producer and decompressed if needed by the consumer, logstash in this case.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.