Possible 7.7.0 bug with searching idle shards

I'm having an issue with 7.7.0 where when I search an index that does NOT have refresh_interval set, I don't get all the results back I'm expecting. If I do the query over and over by the 6th time it will work and have all the data. I assume I'm hitting the newish feature where it won't background refresh things if no searches. In prior elasticsearch versions I think the query would just wait until the refresh happen. At least that is how I read https://www.elastic.co/guide/en/elasticsearch/reference/7.8/index-modules.html#dynamic-index-settings "Searches that hit an idle shard where a refresh is pending will wait for the next background refresh (within 1s)." Did something change between previous 7.x versions and 7.7.0 or is this a bug?

Note this did work with 7.6.2 and all previous versions of 1.x-7.x we've used, so something changed. I also reproduced on several different clusters.

_settings on the index

      "dstats_v4" : {
        "settings" : {
          "index" : {
            "number_of_shards" : "2",
            "auto_expand_replicas" : "0-3",
            "provided_name" : "dstats_v4",
            "creation_date" : "1565358628829",
            "priority" : "50",
            "number_of_replicas" : "3",
            "uuid" : "muB0pZV4SYywXmxBcJEEGA",
            "version" : {
              "created" : "6080299",
              "upgraded" : "7040299"
1 Like

Will be fixed in 7.7.1 https://github.com/elastic/elasticsearch/issues/57006

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.