Offline storage to keep data for several months, how?

Elastic Stack Elasticsearch
1

I'm still pretty new to this stack, looking for pointers. We have a
production 8 node cluster which is keeping 14 days worth of indices open.
Keeping open more indices seems to require more memory than we have
available, we use the elasticsearch-curator script to close indices
older than 14 days.

People are looking to be able to search (via Kibana) data from several
months back, I've read about snapshots and was thinking
I'd like to start moving snapshots to Amazon/S3 storage and then spin up a
Kibana/Elasticsearch pointing to the data living there.
Is this a good methodology? What exactly is the procedure for doing this?
Can Elasticsearch read snapshots directly?

Thanks.
Eric

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/304db535-782e-4b5c-9e30-4b96a99abc21%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

You cannot read data that is stored in a snapshot.

If you want the data available then you will need another node(s), you can
get something smaller and with a lot of
disk and move the indices there and then close them, or you will have to
snapshot and then restore when required.

On 7 March 2015 at 01:31, Eric Fontana eric@fontanas.net wrote:

I'm still pretty new to this stack, looking for pointers. We have a
production 8 node cluster which is keeping 14 days worth of indices open.
Keeping open more indices seems to require more memory than we have
available, we use the elasticsearch-curator script to close indices
older than 14 days.

People are looking to be able to search (via Kibana) data from several
months back, I've read about snapshots and was thinking
I'd like to start moving snapshots to Amazon/S3 storage and then spin up a
Kibana/Elasticsearch pointing to the data living there.
Is this a good methodology? What exactly is the procedure for doing this?
Can Elasticsearch read snapshots directly?

Thanks.
Eric

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/304db535-782e-4b5c-9e30-4b96a99abc21%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/304db535-782e-4b5c-9e30-4b96a99abc21%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X98kDrdyBEiCm71mou23EYzAw58VRJ_mMgpgxRG%2B18K_A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.