S3 snapshot repository

[rpendela (Ramesh Pendela)]

Hello Community,

I am trying to take the snapshots of indices and send them to S3, I installed S3 plugin and Curator.

I am running ELK stack using docker compose, trying to create S3 as a repository but getting this error.

I tried with API keys and IAM role,

I don't know what I am missing, why it is saying insecure and where to change the property "allow_insecure_settings" and obviously it is not secure i think.

[dadoonet (David Pilato)]

Please don't post images of text as they are hardly readable and not searchable.

Instead paste the text and format it with </> icon. Check the preview window.

Did you read https://www.elastic.co/guide/en/elasticsearch/plugins/current/repository-s3-client.html ?

[rpendela (Ramesh Pendela)]

Ok somehow I am able to create the repository and take the backup to S3. I created the snapshot with with below curator_cli command

curator_cli --http_auth user:pass --host ip address --port 9200 snapshot --repository --name elk-%Y%m%d%H

but in S3 i got the files like this
Indices (it is a folder and inside it has individual folders for each index)
Incompatible snapshots
index-0
index.latest
meta-T2h7-iGxRRib8hpQhaGwnA.dat
snap-T2h7-iGxRRib8hpQhaGwnA.dat

how can I get the folder name as "elk-date" instead of indices and index name like "paloalto-20170105"
inside the "elk-data" folder.

2. Also, I am testing restore snapshot option, I deleted the snapshot and trying to restore but getting the error as snapshot_missing (is that mean I can only restore indices in snapshot but not snapshot if I delete that?)
   I followed the document https://www.elastic.co/guide/en/elasticsearch/reference/6.0/modules-snapshots.html

[dadoonet (David Pilato)]

how can I get the folder name as "elk-date" instead of indices and index name like "paloalto-20170105" inside the "elk-data" folder.

Why do you want to do that? I mean that snapshots are only meant to be read by the restore API. You should not try to do anything manually.

I deleted the snapshot and trying to restore

You can't restore something you deleted. It's unclear to me what you are trying to do here.

Anyway, if you have questions like this, please provide all the commands you sent to elasticsearch so it's easier to follow what you are doing.