I'm importing two csv files into two different indexes in elastic.
One of them is business data and the other are config parameters.
When importing the business data csv in elastic, I need that index to have added a new field dynamically which is a number calculated between some of its data with values that are in the other index (the config params one).
In addition to that, the config params index can change its values from time to time (gets overwriten) and I need the business data index to get updated (retroactively) when the parameters index get updated.
So I thought I could do "re-importing data" from elastic to elastic to be re-processed in logstash frequently, or may I use scripted fields on kibana for that…
but i'm still too new and I wonder what's the best way to approach this neither if that's possible at all.
I'd also like to know your opinion about whether it makes sense to do this on logstash/kibana or it should be done somehow before the data get inserted.
Can the Elasticsearch input plugin help on this situation? like importing through a query that contains data from different indexes and using the result in the output?
I'd appreciate any help
Thanks a lot!