Exporting large number of objects from Kibana - errors

Elastic Stack Kibana
1

Hi there, We have v7.5 Elasticsearch/Kibana. Trying to export Saved Objects in prod (~12,000 objects). But it's erroring with this reason in Kibana with this error: Unable to generate export.
Here are the Kibana logs at the time of error:

Caused by: java.lang.IllegalArgumentException: Result window is too large, from + size must be less than or equal to: [10000] but was [11000]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.

I see that we could increase the scroll size to a higher value using this command:

curl -XPUT "http://localhost:9200/my_index/_settings" -H 'Content-Type: application/json' -d '{ "index" : { "max_result_window" : 500000 } }'

Before I do that, got a couple of questions:

  1. Which index should I be updating this setting for? We have over 100 unique indices and so should we be updating for them all?
  2. Is there a different cluster wide setting that might help?
  3. Is there a performance impact due to increasing this value?

Also - I would be interested to know if anyone automated exporting objects from one instance of Kibana to the other. When I tried to do in non-prod, I ran into several conflict errors and so would like to know if others had tried to resolve the problem.

Thanks for your time!

2

The Saved Objects are in the .kibana index, so that is the index you should make the change to. Would also recommend changing it back after you are finished exporting.

3

Thanks Corey!

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.