# Can ES keep separate clusters in the same state? **URL:** \ **Category:** Elasticsearch\ **Created:** [April 24, 2013, 7:29pm UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686 "2013-04-24T19:29:35Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Tiglath](https://avatars.discourse-cdn.com/v4/letter/t/df705f/32.png) [@Tiglath](https://discuss.elastic.co/u/Tiglath)\ **Post date:** [April 24, 2013, 7:29pm UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686/1 "2013-04-24T19:29:35Z")
Is there any ES configuration that would amount to having separate clusters being an exact replica of each other? The goal is that if we have exact clusters in the US, Australia and Europe, indexing and searches in Europe never have to go to other continents, yet they they contain the same exact data. Perhaps ES can achieve effectively that, operationally, with still just one cluster, using rack ids, but I am not sure. Many thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![drewr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/drewr/32/7803_2.png) [@drewr](https://discuss.elastic.co/u/drewr)\ **Post date:** [April 25, 2013, 1:12pm UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686/2 "2013-04-25T13:12:30Z")
Tiglath wrote: > Is there any ES configuration that would amount to having > separate > clusters being an exact replica of each other? Cross-cluster replication is not yet built-in. We are planning this feature but have no timeline. > The goal is that if we have exact clusters in the US, Australia > and > Europe, indexing and searches in Europe never have to go to > other > continents, yet they they contain the same exact data. > > Perhaps ES can achieve effectively that, operationally, with > still > just one cluster, using rack ids, but I am not sure. You could technically make this work with location-aware indices and tagged nodes using the allocation API, but you would have a similar issue with keeping the indices in sync. It can also be problematic to introduce a lot of latency between clustered nodes. If availability and stability is important, I would need to test this configuration quite a while to understand its behavior and failure modes. If you're generating ephemeral data and outages can be tolerated, it may be sufficient. Drew -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Tiglath](https://avatars.discourse-cdn.com/v4/letter/t/df705f/32.png) [@Tiglath](https://discuss.elastic.co/u/Tiglath)\ **Post date:** [April 25, 2013, 6:39pm UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686/3 "2013-04-25T18:39:49Z")
Thank you for your reply. I thought that if each primary shards and replicas are located so that every geographical location has the entire index either in primary or replica shards this would effectively act nearly as an independent cluster since indexing and searches would preferably use the local shards and use remote ones only if unable to use local ones. So the vast majority of operations would be at the local level only, thus achieving the main goal of having completely independent clusters. Am I right? Cheers Joseph On Apr 25, 9:12 am, Drew Raines [aarai...@gmail.com](mailto:aarai...@gmail.com) wrote: > Tiglath wrote: > > > Is there any ES configuration that would amount to having > > separate > > clusters being an exact replica of each other? > > Cross-cluster replication is not yet built-in. We are planning > this feature but have no timeline. > > > The goal is that if we have exact clusters in the US, Australia > > and > > Europe, indexing and searches in Europe never have to go to > > other > > continents, yet they they contain the same exact data. > > > Perhaps ES can achieve effectively that, operationally, with > > still > > just one cluster, using rack ids, but I am not sure. > > You could technically make this work with location-aware indices > and tagged nodes using the allocation API, but you would have a > similar issue with keeping the indices in sync. > > It can also be problematic to introduce a lot of latency between > clustered nodes. If availability and stability is important, I > would need to test this configuration quite a while to understand > its behavior and failure modes. If you're generating ephemeral > data and outages can be tolerated, it may be sufficient. > > Drew -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![drewr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/drewr/32/7803_2.png) [@drewr](https://discuss.elastic.co/u/drewr)\ **Post date:** [April 26, 2013, 12:34pm UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686/4 "2013-04-26T12:34:52Z")
Tiglath wrote: > I thought that if each primary shards and replicas are located > so that > every geographical location has the entire index either in > primary or > replica shards this would effectively act nearly as an > independent > cluster since indexing and searches would preferably use the > local > shards and use remote ones only if unable to use local ones. > So the > vast majority of operations would be at the local level only, > thus > achieving the main goal of having completely independent > clusters. > Am I right? To achieve this kind of search locality you'd have to partition your indices appropriately. In this case, it's better to maintain isolated clusters that can each function with high availability and index into them as you need. Drew -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:39am UTC](https://discuss.elastic.co/t/can-es-keep-separate-clusters-in-the-same-state/11686/5 "2017-07-06T02:39:31Z")