Watcher and potential for missed results

Elastic Stack Elasticsearch
1

Hi all searchers,

I have a bunch of data I'm indexing, and I want to be able to write a Watcher watch that gives me the new data at regular intervals. I will likely construct my query to check that my date field is > execution time - interval. Is there going to be a problem for data that's contributed between the index refresh and watch execution? Is there a way to ask a search to wait for a refresh? Is this already taken care of by Watcher cunningly synchronising with index refreshes?

Thanks!
Dan.

2

Hey,

watcher does not take care of any refresh before executing queries, you need to do that yourself. You could do a refresh before executing a search, using a chained input with a http input. However this obviously implies you never index data with older timestamps as you would not hit it... if you are sure about that, you could go with that approach.

--Alex