I'm having an issue with 7.7.0 where when I search an index that does NOT have refresh_interval set, I don't get all the results back I'm expecting. If I do the query over and over by the 6th time it will work and have all the data. I assume I'm hitting the newish feature where it won't background refresh things if no searches. In prior elasticsearch versions I think the query would just wait until the refresh happen. At least that is how I read https://www.elastic.co/guide/en/elasticsearch/reference/7.8/index-modules.html#dynamic-index-settings "Searches that hit an idle shard where a refresh is pending will wait for the next background refresh (within 1s)." Did something change between previous 7.x versions and 7.7.0 or is this a bug?
Note this did work with 7.6.2 and all previous versions of 1.x-7.x we've used, so something changed. I also reproduced on several different clusters.
_settings on the index
{
"dstats_v4" : {
"settings" : {
"index" : {
"number_of_shards" : "2",
"auto_expand_replicas" : "0-3",
"provided_name" : "dstats_v4",
"creation_date" : "1565358628829",
"priority" : "50",
"number_of_replicas" : "3",
"uuid" : "muB0pZV4SYywXmxBcJEEGA",
"version" : {
"created" : "6080299",
"upgraded" : "7040299"
}
}
}
}
}