I would like to copy indices/data between 2 clusters.
For example, copy every 1/2/15 minutes the data from the index in cluster1 to cluster2.
I would like the data to be live or near live in cluster2.
So if a document is created now in cluster1, I would like to see it in cluster2 immediately, or within a couple of minutes.
What is the best approach?
Is using the the search API best solution?
Also, how can I validate I am not querying duplicate documents?
Maybe something like saving the last timestamp queried and use it in the next query?!