# EC2 cluster storage question
**URL:** https://discuss.elastic.co/t/ec2-cluster-storage-question/22358
**Category:** Elasticsearch
**Created:** [February 24, 2015, 3:27pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358 "2015-02-24T15:27:16Z")
**Posts on this page:** 9
**Page:** 1
### Author:  [@Paul\_Sanwald\_2](https://discuss.elastic.co/u/Paul_Sanwald_2)
#### Post date: [February 24, 2015, 3:27pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/1 "2015-02-24T15:27:16Z")
More detail below, but the the crux of my question is: What's the best way
to spin up/down "on demand" an ES cluster on EC2 that uses ephermal local
storage? Essentially, I want to run the cluster during the week and spin
down over the weekend. Other than brute force snapshot/restore, is there
any more creative way to do this, like mirroring local storage to EBS or
similar?
Some more background:
We run multiple ES clusters on ec2 (we use opsworks for deployment
automation). We started out several years back using EBS because we didn't
know any better, and have switched over to using SSD based local storage.
The performance improvements have been unbelievable.
Obviously, using ephermal local storage comes at a cost: we use
replication, take frequent snapshots, and store all source data to mitigate
the risk of data loss. the other thing that local storage means is that our
cluster essentially needs to be up and running 24/7, which I think is a
fairly normal.
I'm investigating some ways to save on cost for a large-ish cluster, and
one of the things is that we don't need it to necessarily run 24/7;
specifically, we want to turn the cluster off over the weekend. That said,
restoring terabytes from snapshot doesn't seem like a very efficient way to
do this, so I want to consider options, and was hoping the community could
help me in identifying options that I am missing.
thanks in advance for any thoughts you may have.
--paul
--
_Important Notice:_ The information contained in or attached to this email
message is confidential and proprietary information of RedOwl Analytics,
Inc., and by opening this email or any attachment the recipient agrees to
keep such information strictly confidential and not to use or disclose the
information other than as expressly authorized by RedOwl Analytics, Inc.
If you are not the intended recipient, please be aware that any use,
printing, copying, disclosure, dissemination, or the taking of any act in
reliance on this communication or the information contained herein is
strictly prohibited. If you think that you have received this email message
in error, please delete it and notify the sender.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/588e485c-6029-4ded-a3ce-a8dd01213510%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/588e485c-6029-4ded-a3ce-a8dd01213510%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [February 25, 2015, 5:58am UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/2 "2015-02-25T05:58:18Z")
Why not just shut the cluster down, disable allocation first and then just
gracefully power things off?
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@Norberto\_Meijome](https://discuss.elastic.co/u/Norberto_Meijome)
#### Post date: [February 25, 2015, 7:14am UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/3 "2015-02-25T07:14:52Z")
OP points out he is using ephemeral storage...hence shutdown will destroy
the data...but it can be rsynced to EBS as part of the shutdown
process...and then repeat in reverse when starting things up again...
Though I guess you could let ES take care of it by tagging nodes
accordingly and updating the index settings .....(hope it makes sense...)
On 25/02/2015 4:58 pm, "Mark Walkom" [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
> Why not just shut the cluster down, disable allocation first and then just
> gracefully power things off?
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com)
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com?utm_medium=email&utm_source=footer)
> .
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [February 25, 2015, 10:30am UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/4 "2015-02-25T10:30:40Z")
Fair point. The rsync option could work, but then why not just use EBS and
then shut the nodes down to save the rsync work?
Tagging nodes probably won't help in this instance.
Basically if you want to shut everything down you need to go through
recovery, and depending on how long that takes it may not be worth the
cost. This is something you need to test.
On 25 February 2015 at 18:14, Norberto Meijome [numard@gmail.com](mailto:numard@gmail.com) wrote:
> OP points out he is using ephemeral storage...hence shutdown will destroy
> the data...but it can be rsynced to EBS as part of the shutdown
> process...and then repeat in reverse when starting things up again...
>
> Though I guess you could let ES take care of it by tagging nodes
> accordingly and updating the index settings .....(hope it makes sense...)
> On 25/02/2015 4:58 pm, "Mark Walkom" [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
>
> > Why not just shut the cluster down, disable allocation first and then
> > just gracefully power things off?
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "elasticsearch" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > To view this discussion on the web visit
> > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com)
> > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > .
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com)
> [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm_medium=email&utm_source=footer)
> .
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy\_rJBf4PSi3AjgbDE\_BtBwLP9Xt\_w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy_rJBf4PSi3AjgbDE_BtBwLP9Xt_w%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@crimondi](https://discuss.elastic.co/u/crimondi)
#### Post date: [February 25, 2015, 1:23pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/5 "2015-02-25T13:23:38Z")
The 'i' and 'h' series are attractive because of the disk performance. We
considered using them but it was just not feasible given the volatility of
ephemeral storage.
On Wed, Feb 25, 2015 at 5:30 AM, Mark Walkom [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
> Fair point. The rsync option could work, but then why not just use EBS and
> then shut the nodes down to save the rsync work?
> Tagging nodes probably won't help in this instance.
>
> Basically if you want to shut everything down you need to go through
> recovery, and depending on how long that takes it may not be worth the
> cost. This is something you need to test.
>
> On 25 February 2015 at 18:14, Norberto Meijome [numard@gmail.com](mailto:numard@gmail.com) wrote:
>
> > OP points out he is using ephemeral storage...hence shutdown will destroy
> > the data...but it can be rsynced to EBS as part of the shutdown
> > process...and then repeat in reverse when starting things up again...
> >
> > Though I guess you could let ES take care of it by tagging nodes
> > accordingly and updating the index settings .....(hope it makes sense...)
> > On 25/02/2015 4:58 pm, "Mark Walkom" [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
> >
> > > Why not just shut the cluster down, disable allocation first and then
> > > just gracefully power things off?
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> > > Groups "elasticsearch" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > > To view this discussion on the web visit
> > > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com)
> > > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > > .
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "elasticsearch" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > To view this discussion on the web visit
> > [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com)
> > [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > .
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy\_rJBf4PSi3AjgbDE\_BtBwLP9Xt\_w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy_rJBf4PSi3AjgbDE_BtBwLP9Xt_w%40mail.gmail.com)
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy\_rJBf4PSi3AjgbDE\_BtBwLP9Xt\_w%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy_rJBf4PSi3AjgbDE_BtBwLP9Xt_w%40mail.gmail.com?utm_medium=email&utm_source=footer)
> .
>
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
Chris Rimondi | [http://twitter.com/crimondi](http://twitter.com/crimondi) | [securitygrit.com](http://securitygrit.com)
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CA%2BqatLjGbssnPA-S%3D0dRQsWjmRyd2XdqzvSu6Tc3%3D42UGNYXog%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2BqatLjGbssnPA-S%3D0dRQsWjmRyd2XdqzvSu6Tc3%3D42UGNYXog%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@Paul\_Sanwald\_2](https://discuss.elastic.co/u/Paul_Sanwald_2)
#### Post date: [February 25, 2015, 2:43pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/6 "2015-02-25T14:43:11Z")
Thanks, the rsync to EBS is what I was rolling around in my head, but
wasn't sure if it was a dumb idea.
We used to use Elastic Block Store, but have gotten incredible performance
gains from moving to SSD local storage. The ES team doesn't recommend any
kind of NAS
[http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/hardware.html](http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/hardware.html),
and they re-iterated in their recent webinar that they couldn't really
recommend EBS. This was exactly in line with our experience: it will work,
but performance is less predictable and certainly degraded from ephermal
storage.
Sounds like I have two options:
1 - shutdown and just restore from snapshot when we start back up.
2 - sync local storage to EBS when we shutdown, and the reverse when we
start up.
Not sure if the juice is going to be worth the squeeze for either of these
options, but I appreciate everyone's thoughts.
Thanks!
--paul
On Wednesday, February 25, 2015 at 2:15:01 AM UTC-5, Norberto Meijome wrote:
> OP points out he is using ephemeral storage...hence shutdown will destroy
> the data...but it can be rsynced to EBS as part of the shutdown
> process...and then repeat in reverse when starting things up again...
>
> Though I guess you could let ES take care of it by tagging nodes
> accordingly and updating the index settings .....(hope it makes sense...)
> On 25/02/2015 4:58 pm, "Mark Walkom" \<[markw...@gmail.com](mailto:markw...@gmail.com) \\>
> wrote:
>
> > Why not just shut the cluster down, disable allocation first and then
> > just gracefully power things off?
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "elasticsearch" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \.
> > To view this discussion on the web visit
> > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com)
> > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > .
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
_Important Notice:_ The information contained in or attached to this email
message is confidential and proprietary information of RedOwl Analytics,
Inc., and by opening this email or any attachment the recipient agrees to
keep such information strictly confidential and not to use or disclose the
information other than as expressly authorized by RedOwl Analytics, Inc.
If you are not the intended recipient, please be aware that any use,
printing, copying, disclosure, dissemination, or the taking of any act in
reliance on this communication or the information contained herein is
strictly prohibited. If you think that you have received this email message
in error, please delete it and notify the sender.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8f970a6d-806a-4290-9cb8-1f54217a8ed8%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8f970a6d-806a-4290-9cb8-1f54217a8ed8%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@Norberto\_Meijome](https://discuss.elastic.co/u/Norberto_Meijome)
#### Post date: [February 25, 2015, 10:26pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/7 "2015-02-25T22:26:28Z")
Yes, of course EBS all the time would help for storage, but it can't
compete with local ssd in speed.
On 25/02/2015 9:31 pm, "Mark Walkom" [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
> Fair point. The rsync option could work, but then why not just use EBS and
> then shut the nodes down to save the rsync work?
> Tagging nodes probably won't help in this instance.
>
> Basically if you want to shut everything down you need to go through
> recovery, and depending on how long that takes it may not be worth the
> cost. This is something you need to test.
>
> On 25 February 2015 at 18:14, Norberto Meijome [numard@gmail.com](mailto:numard@gmail.com) wrote:
>
> > OP points out he is using ephemeral storage...hence shutdown will destroy
> > the data...but it can be rsynced to EBS as part of the shutdown
> > process...and then repeat in reverse when starting things up again...
> >
> > Though I guess you could let ES take care of it by tagging nodes
> > accordingly and updating the index settings .....(hope it makes sense...)
> > On 25/02/2015 4:58 pm, "Mark Walkom" [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote:
> >
> > > Why not just shut the cluster down, disable allocation first and then
> > > just gracefully power things off?
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> > > Groups "elasticsearch" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > > To view this discussion on the web visit
> > > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com)
> > > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5\_tu4\_ZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D15Aq62TzhbTN8kWKDPGpsuoYP2e2RJta9N5_tu4_ZA%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > > .
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "elasticsearch" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > To view this discussion on the web visit
> > [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com)
> > [https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CACj2-4Jafq4Fqf2GOsdK5OCcmdk3AtW3B2%3DjJYHTgCjyUzOQWg%40mail.gmail.com?utm_medium=email&utm_source=footer)
> > .
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy\_rJBf4PSi3AjgbDE\_BtBwLP9Xt\_w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy_rJBf4PSi3AjgbDE_BtBwLP9Xt_w%40mail.gmail.com)
> [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy\_rJBf4PSi3AjgbDE\_BtBwLP9Xt\_w%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-oqv%3DFHF3%3DoULiWy_rJBf4PSi3AjgbDE_BtBwLP9Xt_w%40mail.gmail.com?utm_medium=email&utm_source=footer)
> .
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CACj2-4K2q1h3roWtrMxAGfxZoUGCBZfq5RH52Mh\_UPkxSEzTzg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACj2-4K2q1h3roWtrMxAGfxZoUGCBZfq5RH52Mh_UPkxSEzTzg%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@Chris\_Pall](https://discuss.elastic.co/u/Chris_Pall)
#### Post date: [February 25, 2015, 11:39pm UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/8 "2015-02-25T23:39:24Z")
Supposedly doing RAID0 EBS volumes helps to mitigate some I/O issues. You
could go that route and avoid having to refresh, assuming the performance
would be acceptable.
On Tuesday, February 24, 2015 at 10:27:16 AM UTC-5, Paul Sanwald wrote:
> More detail below, but the the crux of my question is: What's the best way
> to spin up/down "on demand" an ES cluster on EC2 that uses ephermal local
> storage? Essentially, I want to run the cluster during the week and spin
> down over the weekend. Other than brute force snapshot/restore, is there
> any more creative way to do this, like mirroring local storage to EBS or
> similar?
>
> Some more background:
> We run multiple ES clusters on ec2 (we use opsworks for deployment
> automation). We started out several years back using EBS because we didn't
> know any better, and have switched over to using SSD based local storage.
> The performance improvements have been unbelievable.
>
> Obviously, using ephermal local storage comes at a cost: we use
> replication, take frequent snapshots, and store all source data to mitigate
> the risk of data loss. the other thing that local storage means is that our
> cluster essentially needs to be up and running 24/7, which I think is a
> fairly normal.
>
> I'm investigating some ways to save on cost for a large-ish cluster, and
> one of the things is that we don't need it to necessarily run 24/7;
> specifically, we want to turn the cluster off over the weekend. That said,
> restoring terabytes from snapshot doesn't seem like a very efficient way to
> do this, so I want to consider options, and was hoping the community could
> help me in identifying options that I am missing.
>
> thanks in advance for any thoughts you may have.
>
> --paul
>
> _Important Notice:_ The information contained in or attached to this
> email message is confidential and proprietary information of RedOwl
> Analytics, Inc., and by opening this email or any attachment the recipient
> agrees to keep such information strictly confidential and not to use or
> disclose the information other than as expressly authorized by RedOwl
> Analytics, Inc. If you are not the intended recipient, please be aware
> that any use, printing, copying, disclosure, dissemination, or the taking
> of any act in reliance on this communication or the information contained
> herein is strictly prohibited. If you think that you have received this
> email message in error, please delete it and notify the sender.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6513247e-5c4e-4fd6-9486-ba8b2245c575%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6513247e-5c4e-4fd6-9486-ba8b2245c575%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 12:30am UTC](https://discuss.elastic.co/t/ec2-cluster-storage-question/22358/9 "2017-07-06T00:30:02Z")