Filebeat Kafka output message compression

(MJay) #1

Would like to know whether filebeat compresses the log events before sending to Kafka.

(Jaime Soriano) #2

Hi @mruthyu,

Yes, Kafka output uses compression. Default codec is gzip, and it can be changed with the compression setting.

(MJay) #3

Thanks. So whether the gzip format message is stored in Kafka? And when logstash reads from the kafka input whether it will decompress it?

(Jaime Soriano) #4

Yes, the message is stored as sent by the producer and decompressed if needed by the consumer, logstash in this case.

(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.