Hello, my pipeline is stuck due to this error:
Reached open files limit: 4095, set by the 'max_open_files' option or default, files yet to open: 66922
From the documentation, especially this interesting blog post: https://www.elastic.co/blog/the-evolving-story-about-the-logstash-file-input
I undestand that these parameters, like max_open_files, are customizable.
However, my guess is that Logstash is never closing the files.
Could the reason be the fact that the files do not have the end of line (\n) at the end?
Update:
I tried to add some end of lines to some files with echo "" >> filename
However the files yet to open counter in the Logstash pipeline doesn't change at all.