# AWS S3 snapshot copy

**URL:** https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232
**Category:** Elasticsearch
**Created:** [December 23, 2011, 8:46pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232 "2011-12-23T20:46:50Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Eugene\_Strokin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eugene_strokin/32/1238_2.png) [@Eugene\_Strokin](https://discuss.elastic.co/u/Eugene_Strokin)
#### Post date: [December 23, 2011, 8:46pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232/1 "2011-12-23T20:46:50Z")

</div>

## Hello, sometimes I want to grab index from production and run it locally. On production it uses S3 Gateway. So, I wrote a little program which copy all the files from production bucket to backup bucket, and download the files from there to my local machine. Copying from one bucket to another takes not much time. But once I put those files under my local instance of ES it just doesn't recover.

## [2011-12-23 15:13:18,288][INFO][cluster.service] [Red Ronin] new\_master [Red Ronin][UbdeFcwVTG2beuTt-inuVw][i net[/192.168.0.4:9300]], reason: zen-disco-join (elected\_as\_master) [2011-12-23 15:13:18,387][INFO][discovery] [Red Ronin] my-es-cluster/UbdeFcwVTG2beuTt-inuVw [2011-12-23 15:13:18,414][INFO][gateway] [Red Ronin] recovered [0] indices into cluster\_state

May be there is some official way to copy snapshots to run them  
locally? Maybe I should just do something special do make it run?

Thanks in advance, any help is appreciated.

---

<div class="post-metadata">

### Author: ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [December 25, 2011, 4:32pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232/2 "2011-12-25T16:32:35Z")

</div>

There isn't a way to copy the S3 data and place it into a "local" gateway  
node(s).

On Fri, Dec 23, 2011 at 10:46 PM, Eugene Strokin [eugene@strokin.info](mailto:eugene@strokin.info)wrote:

> ## Hello, sometimes I want to grab index from production and run it locally. On production it uses S3 Gateway. So, I wrote a little program which copy all the files from production bucket to backup bucket, and download the files from there to my local machine. Copying from one bucket to another takes not much time. But once I put those files under my local instance of ES it just doesn't recover.
> 
> ## [2011-12-23 15:13:18,288][INFO][cluster.service] [Red Ronin] new\_master [Red Ronin][UbdeFcwVTG2beuTt-inuVw][i net[/192.168.0.4:9300]], reason: zen-disco-join (elected\_as\_master) [2011-12-23 15:13:18,387][INFO][discovery] [Red Ronin] my-es-cluster/UbdeFcwVTG2beuTt-inuVw [2011-12-23 15:13:18,414][INFO][gateway] [Red Ronin] recovered [0] indices into cluster\_state
> 
> May be there is some official way to copy snapshots to run them  
> locally? Maybe I should just do something special do make it run?
> 
> Thanks in advance, any help is appreciated.

---

<div class="post-metadata">

### Author: ![Eugene\_Strokin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eugene_strokin/32/1238_2.png) [@Eugene\_Strokin](https://discuss.elastic.co/u/Eugene_Strokin)
#### Post date: [December 26, 2011, 5:03am UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232/3 "2011-12-26T05:03:34Z")

</div>

Oh, I c, what would be the recommended way to get a snapshot from AWS  
EC/S3 Elasticsearch server?  
Also, I just wander, if I want to make a daily backup of the index  
files, would it be enough to just copy the bucket and restore it if  
something went wrong?  
But the real problem, is to get a data from the server, and use it  
somewhere else  
Thank u

On Dec 25, 11:32 am, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:

> There isn't a way to copy the S3 data and place it into a "local" gateway  
> node(s).
> 
> On Fri, Dec 23, 2011 at 10:46 PM, Eugene Strokin [eug...@strokin.info](mailto:eug...@strokin.info)wrote:
> 
> > ## Hello, sometimes I want to grab index from production and run it locally. On production it uses S3 Gateway. So, I wrote a little program which copy all the files from production bucket to backup bucket, and download the files from there to my local machine. Copying from one bucket to another takes not much time. But once I put those files under my local instance of ES it just doesn't recover.
> > 
> > ## [2011-12-23 15:13:18,288][INFO][cluster.service] [Red Ronin] new\_master [Red Ronin][UbdeFcwVTG2beuTt-inuVw][i net[/192.168.0.4:9300]], reason: zen-disco-join (elected\_as\_master) [2011-12-23 15:13:18,387][INFO][discovery] [Red Ronin] my-es-cluster/UbdeFcwVTG2beuTt-inuVw [2011-12-23 15:13:18,414][INFO][gateway] [Red Ronin] recovered [0] indices into cluster\_state
> > 
> > May be there is some official way to copy snapshots to run them  
> > locally? Maybe I should just do something special do make it run?
> 
> > Thanks in advance, any help is appreciated.

---

<div class="post-metadata">

### Author: ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [December 26, 2011, 2:35pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232/4 "2011-12-26T14:35:16Z")

</div>

You can start the other cluster on the other servers using s3 gateway as  
well, pointing to the copy you made of your s3 data.

On Mon, Dec 26, 2011 at 7:03 AM, Eugene Strokin [eugene@strokin.info](mailto:eugene@strokin.info) wrote:

> Oh, I c, what would be the recommended way to get a snapshot from AWS  
> EC/S3 Elasticsearch server?  
> Also, I just wander, if I want to make a daily backup of the index  
> files, would it be enough to just copy the bucket and restore it if  
> something went wrong?  
> But the real problem, is to get a data from the server, and use it  
> somewhere else  
> Thank u
> 
> On Dec 25, 11:32 am, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > There isn't a way to copy the S3 data and place it into a "local" gateway  
> > node(s).
> > 
> > On Fri, Dec 23, 2011 at 10:46 PM, Eugene Strokin \<eug...@strokin.info  
> > wrote:
> > 
> > > ## Hello, sometimes I want to grab index from production and run it locally. On production it uses S3 Gateway. So, I wrote a little program which copy all the files from production bucket to backup bucket, and download the files from there to my local machine. Copying from one bucket to another takes not much time. But once I put those files under my local instance of ES it just doesn't recover.
> > > 
> > > ## [2011-12-23 15:13:18,288][INFO][cluster.service] [Red Ronin] new\_master [Red Ronin][UbdeFcwVTG2beuTt-inuVw][i net[/192.168.0.4:9300]], reason: zen-disco-join (elected\_as\_master) [2011-12-23 15:13:18,387][INFO][discovery] [Red Ronin] my-es-cluster/UbdeFcwVTG2beuTt-inuVw [2011-12-23 15:13:18,414][INFO][gateway] [Red Ronin] recovered [0] indices into cluster\_state
> > > 
> > > May be there is some official way to copy snapshots to run them  
> > > locally? Maybe I should just do something special do make it run?
> > 
> > > Thanks in advance, any help is appreciated.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 3:44am UTC](https://discuss.elastic.co/t/aws-s3-snapshot-copy/6232/5 "2017-07-06T03:44:22Z")

</div>


