Data migration between elastic clusters

Elastic Stack Elasticsearch
1

We have two es clusters, one running on premise and another one on the cloud.
The one premise one can't store data for more than a week.
The cloud cluster retains the data for a longer duration (a few months).
So the indexed documents need to be moved to the cloud with in an hour.
The size of the data for an hour is a few Mbs.

What would the best approach to move the data to the cloud ?
I went through CCR - but doesn't look like a good candidate for this use case.
Thanks

2

Welcome to our community! :smiley:

Why is that?

3

Thanks @warkolm

AFAIK, with CCR, data will be deleted from the follower when the data is deleted in the leader. I need to keep data in the leader for say 1 week where as in the follower for say 1 month.

In shorts, I just need to replicate writes - or skip deletes. I don't think CCR allows that.

4

Ok, then look at running a remote reindex, or snapshot and restore.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.