# Elastic search for durable data

**URL:** <https://discuss.elastic.co/t/elastic-search-for-durable-data/16793>\
**Category:** Elasticsearch\
**Created:** [April 3, 2014, 3:34pm UTC](https://discuss.elastic.co/t/elastic-search-for-durable-data/16793 "2014-04-03T15:34:59Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![badcase](https://avatars.discourse-cdn.com/v4/letter/b/9fc29f/32.png) [@badcase](https://discuss.elastic.co/u/badcase)\
**Post date:** [April 3, 2014, 3:34pm UTC](https://discuss.elastic.co/t/elastic-search-for-durable-data/16793/1 "2014-04-03T15:34:59Z")

</div>

Hi

If I have data (that needs indexing) that I cannot lose, would it advisable  
to store it only in Elastic Search as the source of truth with 3 copies (2  
replicas) ? Reading a little about index corruption and such, my gut  
feeling is no, but I was wondering if people had any experience with it.

Thanks  
Anand

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [April 3, 2014, 9:19pm UTC](https://discuss.elastic.co/t/elastic-search-for-durable-data/16793/2 "2014-04-03T21:19:57Z")

</div>

Data can be corrupted irrespective of its store.  
What's probably more important is the processes and procedures around  
writing and reading the data.

But, being able to easily increase and scale replication is definitely a  
positive.

Regards,  
Mark Walkom

Infrastructure Engineer  
Campaign Monitor  
email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
web: [www.campaignmonitor.com](http://www.campaignmonitor.com)

On 4 April 2014 02:34, Anand Somani [meatforums@gmail.com](mailto:meatforums@gmail.com) wrote:

> Hi
> 
> If I have data (that needs indexing) that I cannot lose, would it  
> advisable to store it only in Elastic Search as the source of truth with 3  
> copies (2 replicas) ? Reading a little about index corruption and such, my  
> gut feeling is no, but I was wondering if people had any experience with  
> it.
> 
> Thanks  
> Anand
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624Z\_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624Z_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Itamar\_Syn\_Hershko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itamar_syn_hershko/32/725_2.png) [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)\
**Post date:** [April 3, 2014, 9:23pm UTC](https://discuss.elastic.co/t/elastic-search-for-durable-data/16793/3 "2014-04-03T21:23:57Z")

</div>

FWIW, in addition to replicas, there's an upcoming change to Lucene that  
will have checksums on index segments and minimize the chances of  
corruption in clusters

--

Itamar Syn-Hershko  
[http://code972.com](http://code972.com) | @synhershko [https://twitter.com/synhershko](https://twitter.com/synhershko)  
Freelance Developer & Consultant  
Author of RavenDB in Action [http://manning.com/synhershko/](http://manning.com/synhershko/)

On Fri, Apr 4, 2014 at 12:19 AM, Mark Walkom [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)wrote:

> Data can be corrupted irrespective of its store.  
> What's probably more important is the processes and procedures around  
> writing and reading the data.
> 
> But, being able to easily increase and scale replication is definitely a  
> positive.
> 
> Regards,  
> Mark Walkom
> 
> Infrastructure Engineer  
> Campaign Monitor  
> email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
> web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> 
> On 4 April 2014 02:34, Anand Somani [meatforums@gmail.com](mailto:meatforums@gmail.com) wrote:
> 
> > Hi
> > 
> > If I have data (that needs indexing) that I cannot lose, would it  
> > advisable to store it only in Elastic Search as the source of truth with 3  
> > copies (2 replicas) ? Reading a little about index corruption and such, my  
> > gut feeling is no, but I was wondering if people had any experience with  
> > it.
> > 
> > Thanks  
> > Anand
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CANN9sNrVjG70inBwQZrq%2BXQOMivERE8eZekOD-6Co3RJDE8v5A%40mail.gmail.com?utm_medium=email&utm_source=footer)  
> > .  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CAEM624Z\_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624Z_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAEM624Z\_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEM624Z_x9CVN2GRtiVWxhUNcQFs%2Bi%3DovHM5kJbOq-dRJsFS1A%40mail.gmail.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHTr4ZuPAw6rnsoW%3DcifPt9M62c%3DTtt2z\_TesG\_gLkQB10xphA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHTr4ZuPAw6rnsoW%3DcifPt9M62c%3DTtt2z_TesG_gLkQB10xphA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:38am UTC](https://discuss.elastic.co/t/elastic-search-for-durable-data/16793/4 "2017-07-06T01:38:25Z")

</div>


