So I need to understand exactly, because I feel like the more I read, the more I don’t understand. If I ingest, let’s say just during nighttime, but I have my refresh_interval set to 60s, during the day, when normal user use the app, the refresh was made at least once, are search queries going to be slower because the refresh_interval is so big? I am sorry if I repeat the question, but I really don’t get it.
I would think you’d be fine with a refresh interval of 60 seconds. The only reason to have smaller refresh intervals is if you’re frequently indexing content and want to make it immediately available for searching.
If you only perform batch indexing overnight, you could also disable refreshing, and only refresh when indexing has completed. This could also help improve indexing time as you’re simply indexing and not constantly refreshing the content.
But to answer your original query, yes, constant refresh intervals can potentially impact performance, but based on the information you’ve given I wouldn’t be concerned about its impact on search performance.
Hope that helps!
First of all, welcome to the forum!
Things are often a little complex, a general understanding is usually sufficient. Dont set the bar too high at the beginning of your journey, it may over complicate things.
Some of your post is confusing, e.g. I would not consider a refresh interval of 60s to necesserily “so big”, though noting OOTB default is 1s. But I have no idea at all about your data, indexing, or query volumes/patterns.
You mention “during nighttime” and “during the day”, without describing differences in usage patterns. You imply that there are more queries during the day, but is there more data ingested also?
Do queries always need the freshest, maybe just a few seconds old, data? if yes, 60s IS too high. If all the data for a specific day is ingested overnight, within a specific time window, then you can argue that a higher refresh_interval helps ingesting speed, but tbh this adds a bit of complexity that you may not need, if that bulk ingest were a few % faster, would anyone really notice?
1 Like