I'm trying to achieve the following:
reindex 3000 indices (between 100 mb to 5gb), which contains data for the years 2019-2021, into a shared stream.
Ideally the target stream needs to be sorted by date, so the ILM will rollover the backend indices correctly by size+age
The reindex api, has a deprecated sort param, and rather than that, I'm getting different errors when trying to use it , and I think that 3000 indices are maybe too much for a single call.
I wrote a script that runs a reindex hour by hour for each client (not too fast), and I wonder if there is a better option
p.s can the index sorting help in this case?