Hi, I tried with both start_position as beginning and end. Both behave in the same way. Only difference is, if there are existing logs and start_position is set as end - logstash won't raise event until a new line gets appended to log. But once that happens, log file is read from beginning. Is ther…

If it is re-reading the file that suggests that when it gets "appended" to the inode is changing. Can you check that using "ls -li" before and after?

suresh_bahuguna (Suresh Bahuguna) August 3, 2018, 2:57pm 3

It's Linux (2.6.32-696.18.7.el6.x86_64).

Topic		Replies	Views
Logstash is re-importing entire logfile instead of just new records Logstash	6	1480	July 6, 2017
How To Make File Input Read Entire File Every Time? Logstash	5	4931	July 6, 2017
File input processing question Logstash	3	1108	July 6, 2017
I have a problem inputing file on logstash Logstash	3	409	November 7, 2019
Logstash file read basic question Logstash	3	756	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Logstash input file plugin reprocesses file from beginning whenever new line gets appended to log

Related topics