BackUp and restore


(Ankur Goel) #1

Hi All,

We have been using an elastic search cluster with 3 nodes , running on aws
machines , we have been using EBS for work and data directory of
elasticsearch . I was experimenting with backup using EBS snapshots , here
is what I did

1.) created a snapshot of one ebs volume (say, alpha)
2.) deleted the index
3.) shutdown the cluster
4.) unmounted the ebs volume on alpha (say /mnt/data )
5.) created a new volume from snapshot and mounted on alpha in the same
location (/mnt/data)
6.) restarted elastic search on one node only
cluster went to red state , all shards in unassigned
state
7.) restarted another node with blank data (/mnt/data ) directory
cluster went to yellow state , all shards STILL in
UNASSIGNED STATE
8.) manually allocated shards to node
recovered no documents , few kbs of data got restored
:frowning:

can anyone please help me debug this , what am I doing wrong , is there a
better way to do this ??

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/6381f2e3-706d-4bc8-86f5-283396e37560%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#2

Hi,

The recommend way to do this is to use ES's built-in snapshot/restore feature [1]. You would probably want to store your backups in S3 rather than EBS.

Also note that EBS does not always provide an acceptable level of performance for low-latency queries. If you use EBS you most likely will want to use provisioned IOPS.

Andrew

  1. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html#_snapshot

On May 6, 2014, at 4:50 AM, Ankur Goel ankrugold@gmail.com wrote:

Hi All,

We have been using an elastic search cluster with 3 nodes , running on aws machines , we have been using EBS for work and data directory of elasticsearch . I was experimenting with backup using EBS snapshots , here is what I did

1.) created a snapshot of one ebs volume (say, alpha)
2.) deleted the index
3.) shutdown the cluster
4.) unmounted the ebs volume on alpha (say /mnt/data )
5.) created a new volume from snapshot and mounted on alpha in the same location (/mnt/data)
6.) restarted elastic search on one node only
cluster went to red state , all shards in unassigned state
7.) restarted another node with blank data (/mnt/data ) directory
cluster went to yellow state , all shards STILL in UNASSIGNED STATE
8.) manually allocated shards to node
recovered no documents , few kbs of data got restored :frowning:

can anyone please help me debug this , what am I doing wrong , is there a better way to do this ??

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/6381f2e3-706d-4bc8-86f5-283396e37560%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1E2194BC-5D83-4117-8A26-14676D4E2A38%40elasticsearch.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3