Is there a way to somehow persist the transaction log to be "replayed"
at a later times?
I think that in many situations when re-indexing is required (as a
result of some catastrophe) it would be nice to be able to replay the
transaction log (maybe from the last X hours).
A more specific example: I use elastic search to index some content in
the database. I have triggers that fire an index request when
something is updated in the database (it's important for me to have
the data in ES reflect the database as closely as possible).
To support disaster recovery I backup the database and snapshot the ES
gateway files every once in a while.
When I want to recover, I restore the database and the gateway.
The problem is that the database backup and gateway snapshot have not
been created at the exact same time so there may be some missing data
What I do to solve this is to re-index (from the database) the last X
hours to make sure ES and the database are in sync.
After this long story... I was thinking that it would be nicer if I
could somehow replay a persistent transaction log instead of hitting
the database to get the data.
Is this somehow possible?