Hello,
I'm using Elastic (6.2.2) Stack w/ Google Cloud Storage Repository Plugin | Elasticsearch Plugins and Integrations.
I keep getting "PARTIAL" instead of "SUCCESS" state of my snapshot:
# time curl --silent --header 'Content-Type: application/json' --request PUT "$ELASTICSEARCH_URI/_snapshot/repository-gcs/X?wait_for_completion=true&pretty" --data '{"indices":"X"}'
{
"snapshot" : {
"snapshot" : "X",
"uuid" : "NuP6yLBYQoq0ZsChRBS04g",
"version_id" : 6020299,
"version" : "6.2.2",
"indices" : [
"X"
],
"include_global_state" : true,
"state" : "PARTIAL",
"start_time" : "2018-04-08T19:02:59.717Z",
"start_time_in_millis" : 1523214179717,
"end_time" : "2018-04-08T19:03:01.184Z",
"end_time_in_millis" : 1523214181184,
"duration_in_millis" : 1467,
"failures" : [
{
"index" : "X",
"index_uuid" : "X",
"shard_id" : 3,
"reason" : "RepositoryMissingException[[repository-gcs] missing]",
"node_id" : "LPVtuXogTkiB7sk8ibnI0w",
"status" : "INTERNAL_SERVER_ERROR"
}
],
"shards" : {
"total" : 5,
"failed" : 1,
"successful" : 4
}
}
}
real 0m3.194s
user 0m0.004s
sys 0m0.004s
#
elasticsearch log (master):
esm1 | [2018-04-08T19:03:00,391][INFO ][o.e.s.SnapshotsService ] [esm1] snapshot [repository-gcs:X/NuP6yLBYQoq0ZsChRBS04g] started
esm1 | [2018-04-08T19:03:02,606][INFO ][o.e.s.SnapshotsService ] [esm1] snapshot [repository-gcs:X/NuP6yLBYQoq0ZsChRBS04g] completed with state [PARTIAL]
elasticsearch log (data):
esd2 | [2018-04-08T19:03:00,413][WARN ][o.e.s.SnapshotShardsService] [esd2] [[X][3]][repository-gcs:X/NuP6yLBYQoq0ZsChRBS04g] failed to snapshot shard
esd2 | org.elasticsearch.repositories.RepositoryMissingException: [repository-gcs] missing
esd2 | at org.elasticsearch.repositories.RepositoriesService.repository(RepositoriesService.java:335) ~[elasticsearch-6.2.2.jar:6.2.2]
esd2 | at org.elasticsearch.snapshots.SnapshotShardsService.snapshot(SnapshotShardsService.java:408) ~[elasticsearch-6.2.2.jar:6.2.2]
esd2 | at org.elasticsearch.snapshots.SnapshotShardsService.access$200(SnapshotShardsService.java:98) ~[elasticsearch-6.2.2.jar:6.2.2]
esd2 | at org.elasticsearch.snapshots.SnapshotShardsService$1.doRun(SnapshotShardsService.java:355) [elasticsearch-6.2.2.jar:6.2.2]
esd2 | at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:672) [elasticsearch-6.2.2.jar:6.2.2]
esd2 | at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.2.2.jar:6.2.2]
esd2 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161]
esd2 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161]
esd2 | at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
it works for some, however not for all(
Please advise.