How it's posiible for query cache to be bigger than total heap?

[lifer (Oleksii Samodid)]

Hello!

Our setup: ES 8.8.2, 6 nodes, self-hosted on AWS.

I've noticed something strange in our kibana "stack monitoring" metrics for one of data nodes:

query cache goes up to 14 GB:

but total heap is set to 8GB:

and we haven't touched the "indices.queries.cache.size" setting:

GET /_cluster/settings?include_defaults=true
...
      "queries": {
        "cache": {
          "count": "10000",
          "size": "10%",
          "all_segments": "false"
        }
      },
...

How it's possible?