Snapshot not listed after nodes are restarted


(Hasitha) #1

Hi

I've a 5 node cluster ( all master and data). I took a snaphot with 9GB
worth of data. I had to restart all the nodes due to a few issues.
I'm now trying to restore data from that snapshot after restarting all
nodes but the snapshots are not listed in the curl command although I see
the physical files on the file server.

Note: At the time of snapshot, node1 was the elected master. After
restarting, Node 3 is the elected master.

Before restarting the nodes:
curl -XGET 'http://localhost:9200/_snapshot/_all?pretty'
{
"device_bkp" : {
"type" : "fs",
"settings" : {
"compress" : "true",
"location" : "/var/lib/elasticsearch/backups/device_bkp"
}
}
}

curl -XGET "localhost:9200/_snapshot/device_bkp/_all?pretty"
{
"snapshots" : [ {
"snapshot" : "snapshot_9g",
"indices" : [ "device" ],
"state" : "SUCCESS",
"start_time" : "2014-04-28T15:37:17.112Z",
"start_time_in_millis" : 1398699437112,
"end_time" : "2014-04-28T15:39:05.964Z",
"end_time_in_millis" : 1398699545964,
"duration_in_millis" : 108852,
"failures" : [ ],
"shards" : {
"total" : 5,
"failed" : 0,
"successful" : 5
}
} ]
}

After restarting the nodes :
curl -XGET 'http://localhost:9200/_snapshot/_all?pretty'
{
"device_bkp" : {
"type" : "fs",
"settings" : {
"compress" : "true",
"location" : "/var/lib/elasticsearch/backups/device_bkp"
}
}
}

curl -XGET "localhost:9200/_snapshot/device_bkp/_all?pretty"
{
"snapshots" : [ ]
}

As you can see above, the snapshots are not listed in the second curl
command. I then restarted the nodes until node1 becomes the elected master
and the snapshots are recognized.
Unless Node 1 becomes the elected master, the snapshots are not recognized.
Is this expected? Am I missing something here?

Thanks,
Hasitha,.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/72ca2546-c459-42fd-b46f-db95e81d7cc3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Alexander Reelsen) #2

Hey,

did you make sure, that every node has access to that directory specified
in the repository settings. This has to be a network share, where every
node in your running cluster is allowed to write to.

--Alex

On Mon, Apr 28, 2014 at 6:03 PM, Hasitha hasitha.rg@gmail.com wrote:

Hi

I've a 5 node cluster ( all master and data). I took a snaphot with 9GB
worth of data. I had to restart all the nodes due to a few issues.
I'm now trying to restore data from that snapshot after restarting all
nodes but the snapshots are not listed in the curl command although I see
the physical files on the file server.

Note: At the time of snapshot, node1 was the elected master. After
restarting, Node 3 is the elected master.

Before restarting the nodes:
curl -XGET 'http://localhost:9200/_snapshot/_all?pretty'
{
"device_bkp" : {
"type" : "fs",
"settings" : {
"compress" : "true",
"location" : "/var/lib/elasticsearch/backups/device_bkp"
}
}
}

curl -XGET "localhost:9200/_snapshot/device_bkp/_all?pretty"
{
"snapshots" : [ {
"snapshot" : "snapshot_9g",
"indices" : [ "device" ],
"state" : "SUCCESS",
"start_time" : "2014-04-28T15:37:17.112Z",
"start_time_in_millis" : 1398699437112,
"end_time" : "2014-04-28T15:39:05.964Z",
"end_time_in_millis" : 1398699545964,
"duration_in_millis" : 108852,
"failures" : [ ],
"shards" : {
"total" : 5,
"failed" : 0,
"successful" : 5
}
} ]
}

After restarting the nodes :
curl -XGET 'http://localhost:9200/_snapshot/_all?pretty'
{
"device_bkp" : {
"type" : "fs",
"settings" : {
"compress" : "true",
"location" : "/var/lib/elasticsearch/backups/device_bkp"
}
}
}

curl -XGET "localhost:9200/_snapshot/device_bkp/_all?pretty"
{
"snapshots" : [ ]
}

As you can see above, the snapshots are not listed in the second curl
command. I then restarted the nodes until node1 becomes the elected master
and the snapshots are recognized.
Unless Node 1 becomes the elected master, the snapshots are not
recognized. Is this expected? Am I missing something here?

Thanks,
Hasitha,.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/72ca2546-c459-42fd-b46f-db95e81d7cc3%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/72ca2546-c459-42fd-b46f-db95e81d7cc3%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGCwEM8VCpPUCdNpe38VePKbgJtg0kzMQtR3hb2EY0AVSneoDg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3