Reading compressed files with Logstash


(Simon Risberg) #1

Hello!

I'm wondering if it's possible in anyway to read compressed files with logstash. Because the log files I'm trying to read are about 24GB per file. This takes up to much space.

Best regards!


(Magnus B├Ąck) #2

This isn't possible with Logstash's file input (see github.com/elastic/logstash issue #1817). You could however pipe the output of gunzip to Logstash if you use the stdin input but if either program shuts down prematurely you won't be able to resume.


(system) #3