About the 7.x version of the search.max_buckets parameter

liwanjie · January 8, 2021, 8:23am

I would like to ask if the check_buckets_step_size parameter is added in 7.7.0. Has the max_bucketsparameter been repealed in subsequent releases (including the latest 7.10.0)? If not repealed, are there any defaults?

myspacebarisbroken · January 9, 2021, 7:40am

According to github/changelogs, check_buckets_step_size was included in 7.7.0.

github.com/elastic/elasticsearch

Bucket aggregation circuit breaker optimization.

elastic:master ← TencentCloudES:optimize_breaker

opened 02:53PM - 16 Sep 19 UTC

howardhuanghua

+84 -25

Bucket aggregation will consume a lot of memory on coordinate node if it has a h…uge number of resulting buckets. _search.max_buckets_ setting could limit maximum number of buckets allowed in a single response. Sometimes user may increase this setting to get more buckets, but it also increases the risk of OOM. It's hard to evaluate a suitable value for _max_buckets_. With this PR, we introduced search.check_buckets_step_size setting. Whenever allocating _search.check_buckets_step_size_ new buckets, we do a parent circuit breaker checking. Based on this setting, user could control aggregation memory with a certain step size. We are also considering whether we could deprecate _search.max_buckets_ in the future.

It has not been repealed. Bucket aggregations | Elasticsearch Guide [8.11] | Elastic

It defaults to 65,535.

liwanjie · January 11, 2021, 7:04am

Thank you very much for your reply

system · February 8, 2021, 7:05am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.