# Is the snapshot incremental?

**URL:** https://discuss.elastic.co/t/is-the-snapshot-incremental/19121
**Category:** Elasticsearch
**Created:** [August 6, 2014, 4:36pm UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121 "2014-08-06T16:36:14Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![IronMike](https://avatars.discourse-cdn.com/v4/letter/i/e9a140/32.png) [@IronMike](https://discuss.elastic.co/u/IronMike)
#### Post date: [August 6, 2014, 4:36pm UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121/1 "2014-08-06T16:36:14Z")

</div>

curl -XPUT [http://localhost:9200/](http://localhost:9200/)_snapshot/myRepository/myIndex_`date "+%Y-%m-%d"`?wait\_for\_completion=true

This cron job runs daily which backs up my index to AWS S3, each day the  
snapshot has a different name.

I want to make sure that I am not duplicating a 10GB index for example  
everyday in S3? Does it look at my index from yesterday and only index the  
changes? What if there were no changes, What does it mean for todays  
snapshot vs yesterday's snapshot (Is there a duplicate?)

Thanks

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [August 6, 2014, 5:29pm UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121/2 "2014-08-06T17:29:16Z")

</div>

Well. It is incremental.

But let's say you have saved old Lucene segments and that old segments has been merged in the meantime to a new bigger one, the next snapshot will copy the new BIG segment and remove the old ones.

It means that old data will be copied twice in this scenario.

Makes sense?

--  
David 😉  
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

> Le 6 août 2014 à 18:36, IronMike [sabdalla80@gmail.com](mailto:sabdalla80@gmail.com) a écrit :
> 
> curl -XPUT [http://localhost:9200/\_snapshot/myRepository/myIndex\_`date](http://localhost:9200/_snapshot/myRepository/myIndex_%60date) "+%Y-%m-%d"`?wait\_for\_completion=true
> 
> This cron job runs daily which backs up my index to AWS S3, each day the snapshot has a different name.
> 
> I want to make sure that I am not duplicating a 10GB index for example everyday in S3? Does it look at my index from yesterday and only index the changes? What if there were no changes, What does it mean for todays snapshot vs yesterday's snapshot (Is there a duplicate?)
> 
> Thanks
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/C085A7A2-984D-4707-8892-B97FD9243AFD%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/C085A7A2-984D-4707-8892-B97FD9243AFD%40pilato.fr).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![IronMike](https://avatars.discourse-cdn.com/v4/letter/i/e9a140/32.png) [@IronMike](https://discuss.elastic.co/u/IronMike)
#### Post date: [August 6, 2014, 6:04pm UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121/3 "2014-08-06T18:04:39Z")

</div>

Thanks, it makes sense in this case. I don't think I can prevent something  
like that from happening?

On Wednesday, August 6, 2014 1:29:40 PM UTC-4, David Pilato wrote:

> Well. It is incremental.
> 
> But let's say you have saved old Lucene segments and that old segments has  
> been merged in the meantime to a new bigger one, the next snapshot will  
> copy the new BIG segment and remove the old ones.
> 
> It means that old data will be copied twice in this scenario.
> 
> Makes sense?
> 
> --  
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> 
> Le 6 août 2014 à 18:36, IronMike \<[sabda...@gmail.com](mailto:sabda...@gmail.com) \<javascript:\>\> a  
> écrit :
> 
> curl -XPUT [http://localhost:9200/\_snapshot/myRepository/myIndex\_`date](http://localhost:9200/_snapshot/myRepository/myIndex_%60date)  
> "+%Y-%m-%d"`?wait\_for\_completion=true
> 
> This cron job runs daily which backs up my index to AWS S3, each day the  
> snapshot has a different name.
> 
> I want to make sure that I am not duplicating a 10GB index for example  
> everyday in S3? Does it look at my index from yesterday and only index the  
> changes? What if there were no changes, What does it mean for todays  
> snapshot vs yesterday's snapshot (Is there a duplicate?)
> 
> Thanks
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/afc9e207-5dca-47b7-a8d6-147ba0d0423b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/afc9e207-5dca-47b7-a8d6-147ba0d0423b%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [August 6, 2014, 6:36pm UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121/4 "2014-08-06T18:36:03Z")

</div>

No. I don't think so.

--  
David 😉  
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 6 août 2014 à 20:04, IronMike [sabdalla80@gmail.com](mailto:sabdalla80@gmail.com) a écrit :

Thanks, it makes sense in this case. I don't think I can prevent something like that from happening?

> On Wednesday, August 6, 2014 1:29:40 PM UTC-4, David Pilato wrote:  
> Well. It is incremental.
> 
> But let's say you have saved old Lucene segments and that old segments has been merged in the meantime to a new bigger one, the next snapshot will copy the new BIG segment and remove the old ones.
> 
> It means that old data will be copied twice in this scenario.
> 
> Makes sense?
> 
> --  
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> 
> > Le 6 août 2014 à 18:36, IronMike [sabda...@gmail.com](mailto:sabda...@gmail.com) a écrit :
> > 
> > curl -XPUT [http://localhost:9200/\_snapshot/myRepository/myIndex\_`date](http://localhost:9200/_snapshot/myRepository/myIndex_%60date) "+%Y-%m-%d"`?wait\_for\_completion=true
> > 
> > This cron job runs daily which backs up my index to AWS S3, each day the snapshot has a different name.
> > 
> > I want to make sure that I am not duplicating a 10GB index for example everyday in S3? Does it look at my index from yesterday and only index the changes? What if there were no changes, What does it mean for todays snapshot vs yesterday's snapshot (Is there a duplicate?)
> > 
> > Thanks
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).  
> > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/28ea0ac8-03c2-44f4-82ca-00ac288b45e6%40googlegroups.com).  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/afc9e207-5dca-47b7-a8d6-147ba0d0423b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/afc9e207-5dca-47b7-a8d6-147ba0d0423b%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/A2EAD035-26F2-474D-AEB9-822792B55808%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/A2EAD035-26F2-474D-AEB9-822792B55808%40pilato.fr).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:10am UTC](https://discuss.elastic.co/t/is-the-snapshot-incremental/19121/5 "2017-07-06T01:10:22Z")

</div>


