ES data loss on index deletion

Hi,

I had around 70G of data across 40 indices in ES, I delete 36 of these
indices using REST api (curl call). after that the 2 node cluster died and
I was not able to restart the cluster. I had to delete the data directory.

Is this is a common scenario? Am I missing something or there is any
specific way to delete multiple indices in quick succession.

Thanks,
Anand

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hey,

do you have any more information than "the cluster died"? Have you checked
your logfile and looked out for the exceptions? What happened on restarting
when you increased the log level for more information?
Did you simply delete the index, or did a delete-by-query which is going to
cause a lot of IO and may render your system unresponsive (thus leading to
dead cluster). Any more information would really help us a lot! Thanks!

--Alex

On Wed, Jun 12, 2013 at 6:14 PM, anand nalya anand.nalya@gmail.com wrote:

Hi,

I had around 70G of data across 40 indices in ES, I delete 36 of these
indices using REST api (curl call). after that the 2 node cluster died and
I was not able to restart the cluster. I had to delete the data directory.

Is this is a common scenario? Am I missing something or there is any
specific way to delete multiple indices in quick succession.

Thanks,
Anand

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hi Alex,

I deleted the complete mapping using the REST interface and not used a
delete by query. Also, There was no time gap between these mapping deletion
and I fired them one after another.

I haven't captured the log after the node failure but on restarting the
cluster in foreground, it was printing some log messages regarding trying
to recove index_name

I know this is partial information, but still any help would be
appreciated.

Also, what is that ideal way of deleting a lot of mappings from ES without
running into IO issues?

Thanks,
Anand

On Sunday, 16 June 2013 23:10:29 UTC+5:30, Alexander Reelsen wrote:

Hey,

do you have any more information than "the cluster died"? Have you checked
your logfile and looked out for the exceptions? What happened on restarting
when you increased the log level for more information?
Did you simply delete the index, or did a delete-by-query which is going
to cause a lot of IO and may render your system unresponsive (thus leading
to dead cluster). Any more information would really help us a lot! Thanks!

--Alex

On Wed, Jun 12, 2013 at 6:14 PM, anand nalya <anand...@gmail.com<javascript:>

wrote:

Hi,

I had around 70G of data across 40 indices in ES, I delete 36 of these
indices using REST api (curl call). after that the 2 node cluster died and
I was not able to restart the cluster. I had to delete the data directory.

Is this is a common scenario? Am I missing something or there is any
specific way to delete multiple indices in quick succession.

Thanks,
Anand

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Also, what is that ideal way of deleting a lot of mappings from ES without running into IO issues?

Delete the full index if you can. It is really really faster than deleting a mapping (means deleting all docs for this type). Basically, it's a rm -rf on each node which is extremly fast and frees your disk space immediatly.

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 17 juin 2013 à 07:37, anand nalya anand.nalya@gmail.com a écrit :

Hi Alex,

I deleted the complete mapping using the REST interface and not used a delete by query. Also, There was no time gap between these mapping deletion and I fired them one after another.

I haven't captured the log after the node failure but on restarting the cluster in foreground, it was printing some log messages regarding trying to recove index_name

I know this is partial information, but still any help would be appreciated.

Also, what is that ideal way of deleting a lot of mappings from ES without running into IO issues?

Thanks,
Anand

On Sunday, 16 June 2013 23:10:29 UTC+5:30, Alexander Reelsen wrote:

Hey,

do you have any more information than "the cluster died"? Have you checked your logfile and looked out for the exceptions? What happened on restarting when you increased the log level for more information?
Did you simply delete the index, or did a delete-by-query which is going to cause a lot of IO and may render your system unresponsive (thus leading to dead cluster). Any more information would really help us a lot! Thanks!

--Alex

On Wed, Jun 12, 2013 at 6:14 PM, anand nalya anand...@gmail.com wrote:

Hi,

I had around 70G of data across 40 indices in ES, I delete 36 of these indices using REST api (curl call). after that the 2 node cluster died and I was not able to restart the cluster. I had to delete the data directory.

Is this is a common scenario? Am I missing something or there is any specific way to delete multiple indices in quick succession.

Thanks,
Anand

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.