I am using logstash 5.5. I am using gzip_lines plugin to parse the archived files. As , this plugin expects a text file having archived file with absolute path line by line. If this text file is static , i.e. if I write path for all the archived files in it and run logstash it works fine.
BUT , when I write this text file at the run time every minute with the new path of archived file, logstash does not process the latest file being written in the .txt file. I tried with start_position="end" but that did not help. If I use start_position="beginning", it re-process all the files written in the txt file and that I don't want.
I just want to process latest file being written in the txt file. Is there any way to achieve this?