Unable to set mustache.max_output_size_bytes in elasticsearch.yml version 7.17.25

ManojKumarM · December 26, 2024, 12:36pm

Hi,

We have recently upgraded to 7.17.25 and trying to set the below configuration in elasticsearch.yml as recommended in the release notes

mustache.max_output_size_bytes: 10485760

however we see that configuration is not picked up by elatsicsearch at startup and throwing the Exception as below

java.lang.IllegalArgumentException: failed to parse setting [mustache.max_output_size_bytes] with value [10485760] as a size in bytes: unit is missing or unrecognized

stephenb · December 26, 2024, 3:34pm

Try looks like the setting needs units

mustache.max_output_size_bytes: 1mb

So 2mb would be

mustache.max_output_size_bytes: 2mb

See

github.com

elastic/elasticsearch/blob/c2187fb89d283d7a18fb3d16b18cfec72ba5478b/modules/lang-mustache/src/main/java/org/elasticsearch/script/mustache/MustacheScriptEngine.java#L57


      
          */
          public final class MustacheScriptEngine implements ScriptEngine {
             /**
              * Compiler option to enable detection of missing parameters.
              */
             public static final String DETECT_MISSING_PARAMS_OPTION = "detect_missing_params";
             private static final Logger logger = LogManager.getLogger(MustacheScriptEngine.class);
          
             public static final String NAME = "mustache";
          
             public static final Setting<ByteSizeValue> MUSTACHE_RESULT_SIZE_LIMIT = new Setting<>(
                 "mustache.max_output_size_bytes",
                 s -> "1mb",
                 s -> MemorySizeValue.parseBytesSizeValueOrHeapRatio(s, "mustache.max_output_size_bytes"),
                 Setting.Property.NodeScope
             );
          
             private final int sizeLimit;
          
             public MustacheScriptEngine(Settings settings) {
                 sizeLimit = (int) MUSTACHE_RESULT_SIZE_LIMIT.get(settings).getBytes();

praveen4bv · December 26, 2024, 3:47pm

Thanks Stephen.

I have set the value as recommended but now i am seeing a different exception at the start up. Look like the setting itself is not recognized. Am i missing anything?

org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown setting [mustache.max_output_size_bytes] please check that any required plugins are installed, or check the breaking changes documentation for removed settings

stephenb · December 26, 2024, 4:06pm

Hmmm I am seeing the same things... I will try to check internally... Its US / UK holiday... so you may not get an answer right away

praveen4bv · December 26, 2024, 4:10pm

I understand. Will wait for your response. I tried this configuration in both 7.17.25 and 7.17.26. Both versions are giving the same exception.

stephenb · December 26, 2024, 4:20pm

TO be clear the new default is 1mb do you need more than that... that is quite a long script...

praveen4bv · December 26, 2024, 4:38pm

Unfortunately, yes, we need more than 1mb until we find a way to optimize.
These are existing scripts which were running fine on 7.17.11 until we upgrade to 7.17.25 last week.

stephenb · December 26, 2024, 4:50pm

There is a bug... thee setting was not properly "registered" so it can not be set at this time...

There is going to be a PR opened when it does I will paste it here for you to track.

Here is the PR

praveen4bv · December 26, 2024, 5:43pm

Thanks Stephen. I know it is a bit early to ask, do you have any timeline on when this will be fixed?

stephenb · December 26, 2024, 5:47pm

No and I do not control that, and Elastic does not announce release dates ahead of time.

I would suggest to follow the PR it is already in the process of being merged....

It is tagged for

Keep an eye out for the 7.17.27 release...

Topic		Replies	Views
Size_limit_exceeded_exception Elasticsearch	1	33	December 26, 2024
Elastic search Java client ver 2.3.1: How to set size while using setTemplate in searchRequestbuilder Elasticsearch	1	845	December 5, 2016
Adding script.max_size_in_bytes: 10000000 is not considered in elastisearch Elasticsearch	1	718	February 4, 2019
Failed to find action [org.elasticsearch.script.mustache.SearchTemplateAction@76440dba] to execute Elasticsearch	7	430	December 17, 2020
Possible problem in yml config file Elasticsearch	3	1489	July 6, 2017

Unable to set mustache.max_output_size_bytes in elasticsearch.yml version 7.17.25

Related topics