I would like to ask for your support as I am currently failing to find a solution for storing scripted fields in Elastic Stack.
The setup is plain Elastic Search and Kibana (without Logstash).
My use case is as follows:
- I have got a few million datasets of several fields, of which one field contains article names as a String
- Using scripted fields I check the article name and if it contains a certain prefix, I will split it into its components (attribute 1, attribute 2, ...)
- Those attributes will then be used in Visualizations
Unfortunately, Kibana seems to recalculate all the scripted fields with each change in the Visualization.
E.g. changing the filter will take some time to display the new results.
Considering that the dataset does not change, I would assume that the scripted fields' values don't change either and would only need to be calculated once.
However, I am at a loss regarding how to buffer / cache those values and can't find a method to write them back into Elastic Search.
I would like to avoid any changes to my ingest workflow.
Based on Scripted field with stored script I would assume that there is some way to add scripted fields in Elastic Search or write the results of scripted fields back into Elastic Search's index.
So far, my research into how to accomplish this has come up empty regarding.
Thank you very much for any insight