Search latencies improve progressively each request after index refreshes

Elastic Stack Elasticsearch
1

I am running a single local instance of elasticsearch. I noticed after indexing is done, when I run a few of the same exact search queries, they get progressively faster. The first one is 80ms, the second 40ms, the third 30ms, the fourth 25ms, and the fifth 25ms.

Why does this happen?

Is there some caching going on that progressively warms up in increments? I tried turning on/off index.store.preload for nvd/dvd, but that doesn't seem to make a difference.

2

The OS starts caching files in memory most likely.

3

Any other ways to try to load it into memory or filesystem caches?

4

You can run some queries before serving requests to the user so it will "warm" your index.

5

Do you suppose that we would need to replicate the entire search query/phrase space (relatively large for us) or just a single wildcard query that would pull the entire document index out? Both could be done before serving live requests.

Thanks, David!

6

I believe that a query which would load all segments (basically all terms) would be ok.
I think that you might need to visit all the fields that will be used in a search then.

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.