I have an Elastic Search cluster with one index per day.
I need to be able to query all the historical data, but storing it requires lots of space.
Thus I'd like to aggregate old indices by some dimensions into time buckets (e.g. 10 mins).
In this query the minimal query resolution would equal to time bucket size, but that's fine for me.
I would also like to do that without loading the data out of Elastic Search.
There's a possibility to do this in Druid time series DB by making reindex call with rollup.
As far as I know, reindex in Elastic Search does not support aggregation queries (or at least I was unable to do that).
Does anyone know if there is and what is the way to do that in Elastic Search?
There already exists a topic with a similar title on a forum (https://discuss.elastic.co/t/historical-data-rollup/25512) but the issue there seems completely different to me.