Snapshot restore failure elasticsearch 6.8.7

Elastic Stack Elasticsearch
1

hello everyone,
I'm using elasticsearch 6.8.7. with 3 node.

I want to backup my indices, that's ok. it's done now.
But when i want to restore this snapshot on another cluster with same parameter, there is an error on node-0:

[2020-03-16T16:48:42,462][WARN ][o.e.c.r.a.AllocationService] [elaastelk-2] failing shard [failed shard, shard [validation_field_v7][2], node[wMupW_J4QbeZZOgv_suUoQ], [P], recovery_source[snapshot recovery [n9wyGApCR6GDV7IUAjJItQ] from svg:snapshot_1/VwV5KsUBToSXoo5x6I_faA], s[INITIALIZING], a[id=X0erzy2HSeaS7UhP5RCFzA], unassigned_info[[reason=NEW_INDEX_RESTORED], at[2020-03-16T16:48:41.969Z], delayed=false, details[restore_source[svg/snapshot_1]], allocation_status[fetching_shard_data]], message [failed recovery], failure [RecoveryFailedException[[validation_field_v7][2]: Recovery failed on {elaastelk-0}{wMupW_J4QbeZZOgv_suUoQ}{NMpv46OkTXe3zr9ebPHgVA}{172.17.20.28}{172.17.20.28:9300}{xpack.installed=true, update_domain=0, fault_domain=0}]; nested: IndexShardRecoveryException[failed recovery]; nested: IndexShardRestoreFailedException[restore failed]; nested: IndexShardRestoreFailedException[failed to restore snapshot [snapshot_1/VwV5KsUBToSXoo5x6I_faA]]; nested: IndexShardRestoreFailedException[Failed to recover index]; nested: CorruptIndexException[checksum failed (hardware problem?) : expected=cl0llo actual=409cg1 (resource=name [_2c_Lucene50_0.tim], length [3534773], checksum [cl0llo], writtenBy [7.7.2]) (resource=VerifyingIndexOutput(_2c_Lucene50_0.tim))]; ], markAsStale [true]]
org.elasticsearch.indices.recovery.RecoveryFailedException: [validation_field_v7][2]: Recovery failed on {elaastelk-0}{wMupW_J4QbeZZOgv_suUoQ}{NMpv46OkTXe3zr9ebPHgVA}{172.17.20.28}{172.17.20.28:9300}{xpack.installed=true, update_domain=0, fault_domain=0}
       at org.elasticsearch.index.shard.IndexShard.lambda$startRecovery$10(IndexShard.java:2421) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) ~[elasticsearch-6.8.7.jar:6.8.7]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
        at java.lang.Thread.run(Thread.java:834) [?:?]

I have the same error on the other 2 nodes.

Can you help me please ?
Thank you

2

This snapshot has been modified since Elasticsearch wrote it to the repository and is no longer valid. Often this is a hardware issue.

3

Hi David,
and thanks for answers.

the snapshot is executed on a NFS volume on my 3 nodes. Same mistake.
I also tried with an Azure storage account mounted on the 3 nodes.

everything is hosted on azure.

Thanks

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.