Copy live data between clusters

Elastic Stack Elasticsearch
1

Hi,
I would like to copy indices/data between 2 clusters.
For example, copy every 1/2/15 minutes the data from the index in cluster1 to cluster2.
I would like the data to be live or near live in cluster2.
So if a document is created now in cluster1, I would like to see it in cluster2 immediately, or within a couple of minutes.
What is the best approach?
Is using the the search API best solution?
e.g.

GET /<index>/_search

Also, how can I validate I am not querying duplicate documents?
Maybe something like saving the last timestamp queried and use it in the next query?!

Thanks!

2

Have you seen https://www.elastic.co/guide/en/elasticsearch/reference/current/xpack-ccr.html?

3

Thank you!
I was not aware of this functionality.
I will go over the documentation.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.