Logstash Hangs when filecount above 35K


(Caz Du Bruyn) #1

Good day

This is my first post so apologies if the standard is not followed.

I ran into a strange problem when using logstash. I have noticed that my logstash seems to not process any files when the total count of files in the path exceeds 35k. When I move some the files out of the path and restart Logstash the processing resumes as normal.

The files being ingested range in size betweekn 1.2k and 8k.

I am more than willing to share any configuration that might need be be provided

Elasticsearch , Logstash and Kibana all run on the same server all running version 6.4


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.