Problem : Initially the time taken between posting a new file and picking up by the filebeat harvester was fast (seconds). After a week I realized that filebeat speed of picking up got reduced (minutes / hours) and few files got ignored in this process because of "ignore_older". Please suggest wha…

Filebeat is taking too long to pick up new files

steffens (Steffen Siering) January 30, 2018, 2:16pm 2

Can you share your complete filebeat configuration?

Are files rotated?

How do you determine when filebeat is picking up files?

Topic		Replies	Views
Maybe I missed something: FIlebeat prospectors seems to randomly stop harvesting 'some' files Beats filebeat	7	4077	July 5, 2017
Filebeat do not see file updates after a while Beats filebeat	33	10480	July 5, 2017
Filebeat skipping files Beats filebeat	7	1464	September 15, 2019
Filebeat not working on a particular path Beats filebeat	4	612	May 20, 2021
Filebeat harvesters don't restart after stopping due to ignore_older Beats filebeat	5	5132	July 5, 2017