# S3 update perid **URL:** \ **Category:** Elasticsearch\ **Created:** [January 30, 2011, 3:12pm UTC](https://discuss.elastic.co/t/s3-update-perid/3840 "2011-01-30T15:12:26Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![sirmak](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@sirmak](https://discuss.elastic.co/u/sirmak)\ **Post date:** [January 30, 2011, 3:12pm UTC](https://discuss.elastic.co/t/s3-update-perid/3840/1 "2011-01-30T15:12:26Z")
Hi, what is the time period to update aws s3 data, and is it a static period or configurable or based on activity... my second question is, if I have a replication factor 2 (and no need to shard, sharding factor 1), how should I set my s3 configuration. do I need to write both ec2 instance data to s3 in seperate paths, or in the same path. are they written as seperate files or both use the same file chunks. my last question is what is the recommended way of backup. eg: copying s3 chunks daily to a backup folder ? my best Serdar ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [January 30, 2011, 7:50pm UTC](https://discuss.elastic.co/t/s3-update-perid/3840/2 "2011-01-30T19:50:57Z")
If you are using s3, then you can control the snapshotting interval (defaults to 10 seconds). The setting for that is: index.gateway.snapshot\_interval. There is also a snapshot API for that. Note, a snapshot operation only snapshots delta changes, and not the whole data every time. Setting it up just requires setting the s3 gateway parameters on all nodes. A cluster uses a single bucket (and inner path) for it. The local data stored on the ec2 instances are stored under the data location. Finally, consider using local gateway with AWS, and depending on your availability requirements, you can either store them locally, or on EBS. On Sunday, January 30, 2011 at 5:12 PM, si wrote: > Hi, > > what is the time period to update aws s3 data, and is it a static > period or configurable or based on activity... > my second question is, if I have a replication factor 2 (and no need > to shard, sharding factor 1), how should I set my s3 configuration. do > I need to write both ec2 instance data to s3 in seperate paths, or in > the same path. are they written as seperate files or both use the same > file chunks. my last question is what is the recommended way of > backup. eg: copying s3 chunks daily to a backup folder ? > > my best > Serdar ---
**Author:** ![sirmak](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@sirmak](https://discuss.elastic.co/u/sirmak)\ **Post date:** [January 30, 2011, 8:38pm UTC](https://discuss.elastic.co/t/s3-update-perid/3840/3 "2011-01-30T20:38:55Z")
thanks Shay, elasticsearch is very intelligently designed, using ec2 local instance storage and snapshotting with some periods only delta to s3 is very cost saving and rock solid when used with replicas and also LB & HA ability, perfect... On Jan 30, 9:50 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote: > If you are using s3, then you can control the snapshotting interval (defaults to 10 seconds). The setting for that is: index.gateway.snapshot\_interval. There is also a snapshot API for that. > > Note, a snapshot operation only snapshots delta changes, and not the whole data every time. > > Setting it up just requires setting the s3 gateway parameters on all nodes. A cluster uses a single bucket (and inner path) for it. The local data stored on the ec2 instances are stored under the data location. > > Finally, consider using local gateway with AWS, and depending on your availability requirements, you can either store them locally, or on EBS. > > On Sunday, January 30, 2011 at 5:12 PM, si wrote: > > > Hi, > > > what is the time period to update aws s3 data, and is it a static > > period or configurable or based on activity... > > my second question is, if I have a replication factor 2 (and no need > > to shard, sharding factor 1), how should I set my s3 configuration. do > > I need to write both ec2 instance data to s3 in seperate paths, or in > > the same path. are they written as seperate files or both use the same > > file chunks. my last question is what is the recommended way of > > backup. eg: copying s3 chunks daily to a backup folder ? > > > my best > > Serdar ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:13am UTC](https://discuss.elastic.co/t/s3-update-perid/3840/4 "2017-07-06T04:13:08Z")
Closed on July 6, 2017, 4:13am UTC