How to backup/restore?

Elastic Orchestration Elastic Cloud on Kubernetes (ECK)
1

I installed the elasticsearch operator using the quickstart guide and have a 3 node cluster running. I can't find any documentation on how to schedule regular snapshots of the ES cluster or how to restore from snapshot.

Can someone point me to a doc or guide for backup/restore?

2

https://www.elastic.co/guide/en/cloud-on-k8s/0.9/k8s-snapshot.html

3

Thank you! Loving the ECK operator so far!

2 Likes
4

Did this go away in 1.1? I don't see the documentation.

5

And do you know where there is documentation for setting up a vanilla Kubernetes pvc as the backup volume?

6

We restructured the docs slightly it is now here: https://www.elastic.co/guide/en/cloud-on-k8s/1.2/k8s-snapshots.html

7

I am not sure what you mean by "vanilla Kubernetes pvc". If you are referring to running on vanilla Kubernetes i.e. not on one of the hosted k8s offerings, then you still have multiple options to choose from:

  • you could use shared filesystem as mentioned here Register a snapshot repository | Elasticsearch Guide [8.11] | Elastic for that you would need a persistent volume of a storage class that supports ReadWriteMany access type, e.g. NFS or some other network attached storage that supports that access mode and can be mounted into all of your Elasticsearch Pods. The important point here is that it is mounted to all your ES pods so that every ES node can write its part of the snapshot that excludes any local volumes types as an option.
  • ignoring the PVC part for a moment you could also use the S3 Repository Plugin either against Amazon S3 or something that implements the S3 API like Minio for example which is typically easier than using a shared filesystem.
8

Yes a pvc in a vanilla Kubernetes. I'm mounting a pvc for backup and I get errors in the logs: 'elastic operator security index is unavailable short circuiting retrieval of user elastic'.
I don't get this error when I don't add the volume and volumeMount for the snapshot.
So I was looking to see if there was some documentation of the proper way to do this. I saw before 1.0 of ECK you had to supply some labels. Is there anything like that for versions ECK 1.1+?

I'm very familiar with all the settings - something's not right with the ECK operator. When I don't include the volume and volumeMount in spec everything is ok. When I do include it I get errors saying the .security index wasn't able to be created. The elastic cluster is green and I can query it - just no indexes are created.

9

My mistake. I have some other problem unrelated to pvcs. Thanks for responding.