Disabling fielddata on the cluster/index level

Elastic Stack Elasticsearch
1

I've suddenly noticed that fielddata cache for the _id field is taking 14GB of RAM on my cluster, and I'm not sure where that came from (probably some query I'm not aware of). I've cleared it manually, but I'm worried it might return. Is there a way to disable fielddata cache for the entire index, or even better - the entire cluster?
(I'm using ES 6.6)

Thanks

2

Hi @doron,

Looks like some query might have caused it, though we do not recommend using _id for sorting, aggregations etc.
In case you do want to use it then it is recommended to duplicate into another field.

it is advised to duplicate the content of the _id field in another field that has doc_values enabled.

Refer: _id field | Elasticsearch Guide [8.11] | Elastic

Maybe the limiting the field data cache size as mentioned in Field data cache settings | Elasticsearch Guide [8.11] | Elastic and using circuit breaker appropriately would help.

Some helpful nuggets: Support in the Wild: My Biggest Elasticsearch Problem at Scale | Elastic Blog

Hope this helps.

Thanks and Regards,
Yogesh Gaikwad

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.