Hi Can You explain why I have a so much difference in count of particular daily file in sincedb and file_complete_log_path. It seems that sincedb does not reflect the actual number of reprocessed files, hence there are no entries of these files in the records of the sincedb file, and every day it du…

Count of files in sincedb and file_completed_log_path

Badger October 5, 2022, 6:50pm 2

Could be inode reuse. See this thread. There is no good solution.

Topic		Replies	Views
Logstash sincedb file issue Logstash	1	486	September 17, 2020
Logstash Sincedb duplicate entries Logstash	2	182	November 29, 2023
Logstash re-processes files, incorrectly updates sincedb Logstash	7	230	May 3, 2024
Logstash sending the complete file when new data is added to the log file Logstash	7	2950	July 6, 2017
Restarting logstash container sends events again to elastic, despite sincedb Logstash docker	8	642	March 14, 2023

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Count of files in sincedb and file_completed_log_path

Related Topics