Asking the wisdom of the crowds here. Are there a tools available to keep data within a MySQL database in sync with Elasticsearch.
I am currently using an asynchronous queue and batching system within Python but feel it's missing features to be a complete solution.
Namely:
- Being platform agnostic
- Some form of polling to determine sync lag has occurred.
- A way to ensure the queue will finish processing in the event the Elasticsearch is unavailable temporarily for X seconds.
This conversation was spawned when I observed a non seamless failover with Elastic Cloud and found it worthy to start considering changing my syncing solution that can account for that.