Managing Snapshot Files from Outside ES

Elastic Stack Elasticsearch
1

I'm currently carrying out snapshots to S3 via the cloud-aws plugin under
ES 1.2. I'd like to use Amazon's lifecycle policies to at least send older
snapshot files to Glacier (saving money) and ideally delete snapshot files
over a certain period. Is managing snapshot files outside of the ES API
supported (or advisable)?

Thanks for the help,

David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/789e51ab-4c3f-4d0b-a2bf-fd7ea90d33f6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Hi,

I believe once you take a snapshot, it's up to you what you do with them...
if I understood your question correctly.

What you describe - sending old snapshots to Glacier, deletion of old
snapshot files sounds interesting. Would be interesting to see info about
how to do this published somewhere.

Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

On Tuesday, May 27, 2014 11:01:12 PM UTC-4, David Severski wrote:

I'm currently carrying out snapshots to S3 via the cloud-aws plugin under
ES 1.2. I'd like to use Amazon's lifecycle policies to at least send older
snapshot files to Glacier (saving money) and ideally delete snapshot files
over a certain period. Is managing snapshot files outside of the ES API
supported (or advisable)?

Thanks for the help,

David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1fd6d40a-23e1-4d72-9e3b-5ee21c33700e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

3

Thanks for this, Otis. For the archives, it looks like the indices
subdirectory at the snapshot repo can be managed outside of ES, while the
files at the top level of your repo (including the index and various
metadata files) need to be left as is. If you move those top level files to
Glacier, snapshot tracking from within ES breaks.

David

On Thu, May 29, 2014 at 10:12 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:

Hi,

I believe once you take a snapshot, it's up to you what you do with
them... if I understood your question correctly.

What you describe - sending old snapshots to Glacier, deletion of old
snapshot files sounds interesting. Would be interesting to see info about
how to do this published somewhere.

Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

On Tuesday, May 27, 2014 11:01:12 PM UTC-4, David Severski wrote:

I'm currently carrying out snapshots to S3 via the cloud-aws plugin under
ES 1.2. I'd like to use Amazon's lifecycle policies to at least send older
snapshot files to Glacier (saving money) and ideally delete snapshot files
over a certain period. Is managing snapshot files outside of the ES API
supported (or advisable)?

Thanks for the help,

David

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/psztUc92dJ4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1fd6d40a-23e1-4d72-9e3b-5ee21c33700e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/1fd6d40a-23e1-4d72-9e3b-5ee21c33700e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJgUOA4QvXzZ3VRoVaDDwBHTT1f%3DFQJtNyF7p3jn%2BDcdVqHx2g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.