# Elastic Clusters across Datacenters

**URL:** <https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567>\
**Category:** Elasticsearch\
**Created:** [February 20, 2018, 7:03am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567 "2018-02-20T07:03:36Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Cen\_giz](https://avatars.discourse-cdn.com/v4/letter/c/839c29/32.png) [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Post date:** [February 20, 2018, 7:03am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/1 "2018-02-20T07:03:37Z")

</div>

Dear All,

We are having 2 separate clusters in 2 different data centers and currently they are active-active.  
After Elastic 6.0, synchronization will be in place.

So if data ingestion is enabled for one Elastic Cluster/Data Center with syncing to the other Data Center (from A to B) is enabled, Can I run from one Data Center and stop maintaining two distinct-parallel Clusters? At the time of the switch over, the sync process will be enabled from B to A. (making sure first A to B sync first is completed)

is this the right approach? Does anyone tried this and what were the caveats?

Thanks.  
Cengiz

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 20, 2018, 7:35am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/2 "2018-02-20T07:35:22Z")

</div>

> [@Cen\_giz](#):
>
> After Elastic 6.0, synchronization will be in place.

How are you going to synchronise? How far apart are the data centres?

---

<div class="post-metadata">

**Author:** ![Cen\_giz](https://avatars.discourse-cdn.com/v4/letter/c/839c29/32.png) [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Post date:** [February 20, 2018, 7:48am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/3 "2018-02-20T07:48:12Z")

</div>

They are only 2 different buildings in the same city (on-premise Data Centers of an enterprise with good enough link/bandwidth between the two. I was thinking to use ES features to keep any 2 cluster in synch? !!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 20, 2018, 8:00am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/4 "2018-02-20T08:00:09Z")

</div>

OK, so you are going to set up a single cluster that spans the 2 data centres and use shard allocation filtering to ensure shards are distributed correctly?

---

<div class="post-metadata">

**Author:** ![Cen\_giz](https://avatars.discourse-cdn.com/v4/letter/c/839c29/32.png) [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Post date:** [February 20, 2018, 8:06am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/5 "2018-02-20T08:06:22Z")

</div>

Yes. Would that be proposed to do, assuming only one ES Cluster will be in use (accept ingestion)? Any issues during swithovers?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 20, 2018, 8:21am UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/6 "2018-02-20T08:21:21Z")

</div>

In this scenario all indexing requests will go to both data centres as they both should hold a copy of every shard, so it may have an impact on performance and lead to increased traffic between the data centres. Queries will also be executed across both data centres. Depending on your data and query volumes, I would recommend benchmarking this to make sure the connection between the data centres is fast enough and have sufficient bandwidth.

Given that you have 2 data centres, it is also very difficult, if not impossible, to make this highly available with respect to a full data centre failing. The reason for this is that it is impossible to evenly distribute and odd number of master eligible nodes across the 2 data centres.

This is therefore something we generally do not recommend nor support. If you are looking for a DR setup, the architecture you currently have in place is in my opinion better.

> [@Cen\_giz](#):
>
> Any issues during swithovers?

I am not sure I understand what you mean by switchover. Could you please explain?

---

<div class="post-metadata">

**Author:** ![Cen\_giz](https://avatars.discourse-cdn.com/v4/letter/c/839c29/32.png) [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Post date:** [February 20, 2018, 12:46pm UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/7 "2018-02-20T12:46:01Z")

</div>

Thanks Christian. My understanding is that even if ES 6.0 has Synch feature, it should not be used unless the other Data Center is DR. So we will need to continue maintaining 2 separate ES Clusters ingesting the same data separately. Thx...

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 20, 2018, 12:51pm UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/8 "2018-02-20T12:51:36Z")

</div>

I am not sure what sync feature you are referring to. [Sequence IDs were introduced in Elasticsearch 6.0](https://www.elastic.co/blog/elasticsearch-sequence-ids-6-0), and this is the foundation for building cross-datacenter replication, but such feature is not yet available.

---

<div class="post-metadata">

**Author:** ![Cen\_giz](https://avatars.discourse-cdn.com/v4/letter/c/839c29/32.png) [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Post date:** [February 20, 2018, 1:08pm UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/9 "2018-02-20T13:08:16Z")

</div>

Yes, that is what I meant "Sequence IDs were introduced in Elasticsearch 6.0, "

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 20, 2018, 1:08pm UTC](https://discuss.elastic.co/t/elastic-clusters-across-datacenters/120567/10 "2018-03-20T13:08:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
