Hi, I have a question about what happens when you restart Logstash with ES input. It will read from the beginning of the index or it will continue from where it was?.
Regards
Hi, I have a question about what happens when you restart Logstash with ES input. It will read from the beginning of the index or it will continue from where it was?.
Regards
Depends, are you using scan/scroll or just a query?
I'm using scroll, like this:
elasticsearch {
hosts => "es.production.mysite.org"
index => "mydata-2018.09.*"
size => 500
scroll => "5m"
}
I don't believe we keep the scroll ID anywhere persistent, so it'd start from the beginning again.
That are bad news.
Thanks
Is there any other way that we can force logstash to start it from failed position . Is it possible by using query in ES input?
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.