Elasticsearch 7.4.2 Snapshot and restore

Elastic Stack Elasticsearch
1

I am using Elasticsearch 7.4.2 and some clarification and help on snapshot and restore.
There is nothing like full snapshot or partial snapshot. Each snapshot is a complete snapshot.

As I know each snapshot is incremental and it is point of time for index when snapshot taken.

Regarding restore of an index (say kb-stest1):

  • Following is my snapshot history:
GET _cat/snapshots/es-ir?h=id,status,i,dur,i,`r

 snap-2020.07.02-7lhvlftarb2uq8jtc7uomw      SUCCESS 23 36.2s
 snap-2020.07.02-dcqzttnrqles3btrgfs9sw      SUCCESS 24  9.4s
 snap-2020.07.03-bnrozqossjiwtry6czg2qa      SUCCESS 25   17s
 snap-2020.07.04-jin6qtmqtzgfsblzyhwqyg      SUCCESS 28   18s
 snap-2020.07.05-yotsdhjwrdsb2mzswh4xeq      SUCCESS 30   20s
 snap-2020.07.06-4sjkhullt72ft2fnvfaejg      SUCCESS 32 15.6s
 snap-2020.07.07-ghnh9r3hsz-4tbml9rgxkw      SUCCESS 34   25s
 snap-2020.07.08-5l1qrwfqskshosg8-a5efg      SUCCESS 36   14s
 snap-2020.07.09-qsacncwbta6kuynhv_gtcw      SUCCESS 34 13.8s
 snap-2020.07.10-cwxlit9xskmdoh3ljpcxng      SUCCESS 35 10.6s
 full-snap-2020.07.10-5gd_xipgtd2lhctno_dfva SUCCESS 35  7.2s
 snap-2020.07.11-gplkmw7as3ev9gj9g2l7uw      SUCCESS 34  6.4s
 full-snap-2020.07.11-m0h1rcs4r_szlpg4xi3fcw SUCCESS 34  5.8s
 snap-2020.07.12-sf8kzesqrkodzu_lxoldmw      SUCCESS 34    9s
 full-snap-2020.07.12-roiwrk-lsys0gsz93wpreg SUCCESS 34  5.2s
  • Index for the snapshot, say like to restore kb-stest1 index and in 3 snapshots mention below
 GET /_snapshot/es-ir/snap- 2020.07.02 -7lhvlftarb2uq8jtc7uomw
 contain index: kb-stest1-1591134776395
 GET /_snapshot/es-ir/snap-2020.07.14-mvnsbhfirbojhfo6lhdimq
 contain index: kb-stest1-1594676482430
 GET /_snapshot/es-ir/snap-2020.07.24-rak1t3dtty-tydputzuchg
 contain: kb-epsoneu-1594676482430
  • Let us say need arise to restore full kb-stest1 index from snapshot created 2020-07-24 from the snapshot - snap-2020.07.24-rak1t3dtty-tydputzuchg, once we restore from the snapshot - snap-2020.07.24-rak1t3dtty-tydputzuchg is enough or we have to restore from the back snapshot (say snapshot of 2020-07-23, 22, 21....)as well.
2

What is your question? Elasticsearch snaps are 'full' snapshots, data-wise, but actually are incremental on disk, because segments are immutable - but inside ES when you look at lists, they'll look full to you, and you can delete any you like and it'll still keep full snaps on disk. Very nice system.

Here is a recent blog I wrote on how it works:

3

Thank you for reply Steve and link to blog.
My question was as mention below my index kb-stest1-<epoch_time> are in 3 snapshot.
Like to restore full kb-stest1 index from snapshot created 2020-07-24 from the snapshot - snap-2020.07.24-rak1t3dtty-tydputzuchg, once we restore from the snapshot - snap-2020.07.24-rak1t3dtty-tydputzuchg is enough or worrey

GET /_snapshot/es-ir/snap- 2020.07.02 -7lhvlftarb2uq8jtc7uomw
 contain index: kb-stest1-1591134776395
 GET /_snapshot/es-ir/snap-2020.07.14-mvnsbhfirbojhfo6lhdimq
 contain index: kb-stest1-1594676482430
 GET /_snapshot/es-ir/snap-2020.07.24-rak1t3dtty-tydputzuchg
 contain: kb-epsoneu-1594676482430
4

Not sure I understand but generally you restore from the latest snapshot - several may 'contain' the index, but at different points in time (assuming it's changing in that time; if not, then you don't care which).

5

Thank you, Steve.
I understand clearly

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.