I am using filebeat to forward logs from a pair of Varnish servers, and these produce a fairly large amount of data pretty quickly. Because we don't want to keep this stuff, I've set up a one-hour log-rotation schedule for the file, so I end up with a bunch of files like: -rw-r--r-- 1 root root 25…

Cylindric (Mark Hanford) December 3, 2015, 3:33pm 6

That fixed it, thanks @ruflin. Apologies for the excitement

Topic		Replies	Views
Filebeat is not sending logs due to ignore_older Beats filebeat	7	3032	August 16, 2019
[SOLVED] Filebeat keeps open files forever Beats filebeat	23	22143	July 5, 2017
Having trouble with filebeat not releasing rotated file Beats filebeat	4	1994	July 5, 2017
FileBeat file is falling under ignore older Beats filebeat	30	14184	July 5, 2017
Filebeat harvesters don't restart after stopping due to ignore_older Beats filebeat	5	5132	July 5, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Dealing with frequent logrotation - ignore_older seems to be ignored

Related topics