Multimaster over wan


(MatthewParrott) #1

Hi,

I'm wondering if ES supports a multi-master configuration over WAN. Let's
say I have node A and node B and they're in different parts of the world.
Can I write to the instance closest to my location and have the data
automatically replicated to the other?

Reading through the cluster configuration docs, it wasn't quite clear if
this was possible.

Thanks,
Matthew

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d62d143e-5405-4f6f-8a3e-722f473832ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

It's possible but not recommended due to the latency in timings, this has
negative impacts on the cluster state and can exacerbate split brain
potentials.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 31 March 2014 07:54, Matthew Parrott matthewatabet@gmail.com wrote:

Hi,

I'm wondering if ES supports a multi-master configuration over WAN. Let's
say I have node A and node B and they're in different parts of the world.
Can I write to the instance closest to my location and have the data
automatically replicated to the other?

Reading through the cluster configuration docs, it wasn't quite clear if
this was possible.

Thanks,
Matthew

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/d62d143e-5405-4f6f-8a3e-722f473832ec%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/d62d143e-5405-4f6f-8a3e-722f473832ec%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624b%3DqV3Go3ZvdAHFnb24x2Cu7qqco%2Bnv-1M13tp4P2-eGg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


#3

Matthew,

Multi-master over WAN is not supported. Typically in this case you would modify your ingestion pipeline to double write to both clusters. If you want to query across both clusters simultaneously take a look at the tribe node [1].

Note that if all you want is to have the data available as a backup, you can use snapshot/restore to an S3 bucket [2].

Cheers.

[1] http://www.elasticsearch.org/blog/tribe-node/
[2] http://www.elasticsearch.org/blog/introducing-snapshot-restore/

On Mar 30, 2014, at 1:54 PM, Matthew Parrott matthewatabet@gmail.com wrote:

Hi,

I'm wondering if ES supports a multi-master configuration over WAN. Let's say I have node A and node B and they're in different parts of the world. Can I write to the instance closest to my location and have the data automatically replicated to the other?

Reading through the cluster configuration docs, it wasn't quite clear if this was possible.

Thanks,
Matthew

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d62d143e-5405-4f6f-8a3e-722f473832ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0C3A8E88-91A4-419B-92C6-21C0FDA78318%40elasticsearch.com.
For more options, visit https://groups.google.com/d/optout.


(system) #4