Rebuilding master node caused data loss

Elastic Stack Elasticsearch
1

I have a cluster with 5 data nodes, and 1 master node. I decided to test a
master node failure, and clearly I miss understood exactly what is stored
on the master. I turned down the VM running the master node, and built a
new one from scratch. I then added it to the cluster as a master. When
this came online, I lost all my data that was in cluster previously and it
started making new indexes clean again. Now this isn't critical data, this
is my test setup, but it still confused me.

I have looked into this and it would seem there is a deafult setting for gateway.local.auto_import_dangled.
As I understand it, this was put in place for people like me who didn't
understand whta would happen if you lost a master node, and should by
default have imported the old data from each data node. If this was
defaulted to no, and just deleted the data, I would know exactly what
happened. I have looked at my configurations and I haven't set this to no,
and yet the data was deleted.

Can someone clarify if this setting is no longer valid, or if the default
hsa been changd and not documented?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bbfc97a6-a775-41f4-b34c-e38d7c2c515d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Default is still yes.

What happened in the logs on the data nodes?

On 22 April 2015 at 00:23, Brian brian.sanders@gmail.com wrote:

I have a cluster with 5 data nodes, and 1 master node. I decided to test
a master node failure, and clearly I miss understood exactly what is stored
on the master. I turned down the VM running the master node, and built a
new one from scratch. I then added it to the cluster as a master. When
this came online, I lost all my data that was in cluster previously and it
started making new indexes clean again. Now this isn't critical data, this
is my test setup, but it still confused me.

I have looked into this and it would seem there is a deafult setting for gateway.local.auto_import_dangled.
As I understand it, this was put in place for people like me who didn't
understand whta would happen if you lost a master node, and should by
default have imported the old data from each data node. If this was
defaulted to no, and just deleted the data, I would know exactly what
happened. I have looked at my configurations and I haven't set this to no,
and yet the data was deleted.

Can someone clarify if this setting is no longer valid, or if the default
hsa been changd and not documented?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/bbfc97a6-a775-41f4-b34c-e38d7c2c515d%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/bbfc97a6-a775-41f4-b34c-e38d7c2c515d%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-EOhDGhU%3DHxWxWjOsPSTWu0YTRyyeK1CaGcMd4C0xsOg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.