Unexpected end of ZLIB input stream on parsing gzip files

Elastic Stack Logstash
1

hello ,

I have a few MBs of gzip files ,which logstash fails to parse for some reason . I have 3 configs set up in pipelines.yml and 1 succeeds first and the other 2 fail the same error .

[2021-09-30T14:29:47,055][ERROR][logstash.javapipeline    ][ghost.ddc.log-f_line][b41d55c3a261826c36458dc72b175b81056f633b31b684bf27b79a1ef0e4e0b0] A plugin had an unrecoverable error. Will restart this plugin.
  Pipeline_id:ghost.ddc.log-f_line
  Plugin: <LogStash::Inputs::File mode=>"read", path=>["/app/input/*_ghost.ddc*.*"], id=>"b41d55c3a261826c36458dc72b175b81056f633b31b684bf27b79a1ef0e4e0b0", file_completed_action=>"log", file_completed_log_path=>"/app/processed/output.txt", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_785fd360-d091-4bb1-b0ff-8a6f14f9eadf", enable_metric=>true, charset=>"UTF-8">, stat_interval=>1.0, discover_interval=>15, sincedb_write_interval=>15.0, start_position=>"end", delimiter=>"\n", close_older=>3600.0, sincedb_clean_after=>1209600.0, file_chunk_size=>32768, file_chunk_count=>140737488355327, file_sort_by=>"last_modified", file_sort_direction=>"asc", exit_after_read=>false, check_archive_validity=>false>
  Error: Unexpected end of ZLIB input stream
  Exception: Java::JavaIo::EOFException
  Stack: java.util.zip.InflaterInputStream.fill(java/util/zip/InflaterInputStream.java:24

here's the input code

input {
file  {
path => "/app/input/*_ghost*.*"
mode => "read"
file_completed_action => "log"
file_completed_log_path => "/app/processed/output.txt"
}
     }
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.