Write the same data to two S3 repositories?

Elastic Stack Elasticsearch
1

Hi Guys,

Is it possible to create 2 x S3 repositories, and join or link both repositories as my frozen tier?.
We have two local 2 DCs with S3 object storage in each DC. - So I would like to have my frozen-tier represented as a bucket from each system.. in case of a DC outage, I was hoping elastic could then reach its data in the bucket still online... This would require me to make sure elastic writes the data twice.. so was hoping it was possible :slight_smile:

Thanks for the input.

2

Welcome!

You can create 2 repositories and start 2 snapshots in parallel but I don't think you can "link" them.

You can mount only one repository for a given index. So in case of "failure", you would need to manually mount the other repo.

Or you can mount both repositories using a renamed index. In which case you will have to switch the index name in case of failure.

3

Hi David,

Thanks a lot - that path should get me what I want to achieve.

And we will save a loadbalancer, in the process as well - as we can now handle it all from elastic.

Just 1 follow up question, when we write in parallel, and mount both repositories with the renamed index approach as you explained, does elastic support the clean up of both mounted repositories if a retention is set at 180 days. After that I need to make sure the aged snapshots are gone.

Thanks,

Br
Jeppe

4

Each repository will need its own cleanup jobs. That means one SLM policy per repository.

5

Thanks David :slight_smile:

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.