Data loss after network failure

Hi all,

We noticed unwanted synchronisation behaviour using two nodes with
elasticsearch-1.3.4. The nodes got disconnected from each other after a
network failure and both started running their own cluster. One node got
new data pushed to it, the other didn't. After restarting the node that got
the most recent data, it joined up with the other one. This resulted in the
loss of all the new data from the master node since the network failure.

Is this expected behaviour? If so, how can we prevent this scenario from
occurring again?

Thanks,

Frank

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3bd69bfd-001c-4c62-bfde-616c1f1695c8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

With two nodes, you are exposed to split brain issues, as long as you do
not set minimum_master_nodes = 2.

It is recommended to use an odd number of nodes and at least 3 nodes with
minimum_master_nodes = 2 to avoid split brain.

Jörg

On Tue, Oct 28, 2014 at 12:24 PM, Frank Evers frankevers@voormedia.com
wrote:

Hi all,

We noticed unwanted synchronisation behaviour using two nodes with
elasticsearch-1.3.4. The nodes got disconnected from each other after a
network failure and both started running their own cluster. One node got
new data pushed to it, the other didn't. After restarting the node that got
the most recent data, it joined up with the other one. This resulted in the
loss of all the new data from the master node since the network failure.

Is this expected behaviour? If so, how can we prevent this scenario from
occurring again?

Thanks,

Frank

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3bd69bfd-001c-4c62-bfde-616c1f1695c8%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3bd69bfd-001c-4c62-bfde-616c1f1695c8%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEDS%3DZzerCHoLU%3DcsadamujEQtutcL4rd7d6t%3DR-vUOvg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.