ELK Snaspshots are not getting listed

Elastic Stack Elasticsearch
1

I am using the below approach to backup/restore elasticsearch data

  1. Snapshot the data to Shared File system Repo.
  2. Before copying the contents, I made the repository read only , so no more data will be written to it.
  3. Copy the data to Tape Storage
  4. Later when the File system is full delete the contents of snapshot ( as it is already backed up in tape) and unregister the repo.

Now when I try to restore the the content from tape,

  1. I copy the contents of snapshot to a folder called say restore to the shared file system (say /my/repo is the path I registered in elasticsearch.yml as snapshot folder, I copy to the path /my/repo/restore)
  2. After copying when I try to register the repository (/my/repo/restore)
  3. The repository is getting registered, however the snapshots are not getting listed in Kibana UI or API
2

What do you mean by "when the File system is full". Do you mean that you are getting an error in logs saying the volume is full? Or something else?

What is your Elastic version?

3

It sounds like you are trying to restore a repository backup, but you are not precisely following the documented process for doing so. If you don't follow this exact process you will encounter problems. In particular,

When restoring a repository from a backup, you must not register the repository with Elasticsearch until the repository contents are fully restored. If you alter the contents of a repository while it is registered with Elasticsearch then the repository may become unreadable or may silently lose some of its contents.

4

Hi, with full what I meant is I keep the snapshot in the NAS storage till I reach a scenario where I don't have enough storage to back up other data and decide to delete it (as I already have the backup in tape) which I can use to restore when I need it. Now when I try to restore from tape ( I follow the same procedure as in I ve to move data from one cluster to another) but it is not working. I couldnt figure out why

5

I am registering the repository only after all the data is copied .

6

If so, the usual explanation is that you are not restoring the repository to the exact state it was in when you took the snapshot. You must for instance delete any files that have been created since.