Hello guys! I'm experiencing a problem with logstash 7.1.1 running as a deamon on debian with multiple pipelines.
Despite the fact that record_last_run is true and last_run_metadata_path is specified, no file is saved.
The file is not even found in the home folder of root/logstash user.
I tried to change location and extend permissions but with no luck.
I was searching for this file because I would like to delete this file in order to force logstash to reload an index from scratch. I couldn't find it and therefore I deleted the index on elasticsearch. After a while I found that the entire index was populated again.
I wonder... If logstash is not tracking the last run, does this means that every minute it's going to load all the docs into ElasticSearch?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.