Logstash file output. gzip performance

Hi,

I have a logstash instance ingesting large amount of log files data from Kafka. I write them back to disk using the file output plugin.
From a performance point of view, is it better to get logstash to zip on the fly (gzip => "true") or write the files uncompressed and run external gzip commands to zip the files?

Thanks,

I suggest you try both methods and measure the resources consumed.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.