Error on parsing gzip files "Unexpected end of ZLIB input stream"

Elastic Stack Logstash
1

I have a gzip file about ~600MB that seems to be running into a plugin error mentioned below .

[2021-07-15T13:00:29,121][ERROR][logstash.javapipeline    ][main][4ea2794871220248b7ea22dd607e71d79bddbc1bff243a66da02aa3b2f2d0b38] A plugin had an unrecoverable error. Will restart this plugin.
  Pipeline_id:main
  Plugin: <LogStash::Inputs::File mode=>"read", path=>["/app/input/ghost*.gz"], exit_after_read=>true, id=>"4ea2794871220248b7ea22dd607e71d79bddbc1bff243a66da02aa3b2f2d0b38", file_completed_action=>"log", file_completed_log_path=>"/app/processed/output.txt", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_4dac9672-4b05-4dc1-bf65-e95fab80debd", enable_metric=>true, charset=>"UTF-8">, stat_interval=>1.0, discover_interval=>15, sincedb_write_interval=>15.0, start_position=>"end", delimiter=>"\n", close_older=>3600.0, sincedb_clean_after=>1209600.0, file_chunk_size=>32768, file_chunk_count=>140737488355327, file_sort_by=>"last_modified", file_sort_direction=>"asc", check_archive_validity=>false>
  Error: Unexpected end of ZLIB input stream
  Exception: Java::JavaIo::EOFException

From what i can guess from my limited knowledge of ELK stack , the error seems to be in the input section .


input {
file  {

path => "/app/input/ghost.*.gz"
mode => "read"
file_completed_action => "log"
file_completed_log_path => "/app/processed/output.txt"

}

Can someone help with this error ?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.