I would like to periodically generate an index whose data will come from the outcome of a SQL query.
Even though I'm aware it is not the traditional use case as the data are not logs nor accumulative, LogStash gives me a good starting point: it makes it very easy to run the query via JDBC and map the data to the index.
Ideally the flow would be something like:
- Index-A-Yesterday already exists and ES alias for Index-A points to that index
- Call LogStash to create Index-A-Today
- Warm-up Index-A-Today (optional step)
- Call ES API to switch Index-A alias to point towards Index-A-Today
- Delete Index-A-Yesterday
Is there a way via LogStash to this? I can't find it ...
I've seen this topic already asked here without a satisfactory answer and since it is closed I try again, worst case I will get an official "not possible".