Removing data upon node failure

Elastic Stack Elasticsearch
1

Hi all,
We have a cluster of 4 nodes, and we constantly add new indexes and remove
old ones in a daily basis operation. We had a node down for 3 days, and
when starting it again it just added the indexes it had. The thing is that
the name of the new indexes we create everyday depend on the date (ex:
my_index_name_20141203), so when this node started again it just didn´t
find any inconsistence within its indexes (already deleted in the cluster)
and it added them again.
So the question is: Is there any way to remove the data when a given node
fails? so it starts as if a new empty node has been added to the cluster.

Regards,

Ernesto

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9e7d381f-7936-4b48-a0fe-7e3414160438%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

That's dangling index recovery -

You can disable it (per that link).

On 3 December 2014 at 20:20, Ernesto Reig ernirulez@gmail.com wrote:

Hi all,
We have a cluster of 4 nodes, and we constantly add new indexes and remove
old ones in a daily basis operation. We had a node down for 3 days, and
when starting it again it just added the indexes it had. The thing is that
the name of the new indexes we create everyday depend on the date (ex:
my_index_name_20141203), so when this node started again it just didn´t
find any inconsistence within its indexes (already deleted in the cluster)
and it added them again.
So the question is: Is there any way to remove the data when a given node
fails? so it starts as if a new empty node has been added to the cluster.

Regards,

Ernesto

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9e7d381f-7936-4b48-a0fe-7e3414160438%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9e7d381f-7936-4b48-a0fe-7e3414160438%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_S15WqJiya0uireYuGUL_iCAQG9b2m9wQDCn021-eTGw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Thank you very much. That´s exactly what we were looking for :slight_smile:

On 3 December 2014 at 11:04, Mark Walkom markwalkom@gmail.com wrote:

That's dangling index recovery -
Elasticsearch Platform — Find real-time answers at scale | Elastic

You can disable it (per that link).

On 3 December 2014 at 20:20, Ernesto Reig ernirulez@gmail.com wrote:

Hi all,
We have a cluster of 4 nodes, and we constantly add new indexes and
remove old ones in a daily basis operation. We had a node down for 3 days,
and when starting it again it just added the indexes it had. The thing is
that the name of the new indexes we create everyday depend on the date (ex:
my_index_name_20141203), so when this node started again it just didn´t
find any inconsistence within its indexes (already deleted in the cluster)
and it added them again.
So the question is: Is there any way to remove the data when a given node
fails? so it starts as if a new empty node has been added to the cluster.

Regards,

Ernesto

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9e7d381f-7936-4b48-a0fe-7e3414160438%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9e7d381f-7936-4b48-a0fe-7e3414160438%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/038xmo5V2jQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_S15WqJiya0uireYuGUL_iCAQG9b2m9wQDCn021-eTGw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_S15WqJiya0uireYuGUL_iCAQG9b2m9wQDCn021-eTGw%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJg-YDLq5c%2BCAx%3Dkz_iaSJ0VoD4G6kttpOiRK8rs8ncib-W3Dg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.