Snapshot on s3 compatible cloud object storage

Elastic Stack Elasticsearch
1 
receiving error : 
{
    "error": {
        "root_cause": [
            {
                "type": "repository_verification_exception",
                "reason": "[es_repo] path  is not accessible on master node"
            }
        ],
        "type": "repository_verification_exception",
        "reason": "[es_repo] path  is not accessible on master node",
        "caused_by": {
            "type": "i_o_exception",
            "reason": "Unable to upload object [tests-jA7yKHu-Szm4iSAFznKUCQ/master.dat] using a single upload",
            "caused_by": {
                "type": "sdk_client_exception",
                "reason": "Unable to execute HTTP request: bucket.mydomain.test.com",
                "caused_by": {
                    "type": "unknown_host_exception",
                    "reason": "bucket.mydomain.test.com"
                }
            }
        }
    },
    "status": 500
}



we added access and secrets key to key store using volume mount and I can see value using show

bin/elasticsearch-keystore show s3.client.default.secret_key
bin/elasticsearch-keystore show s3.client.default.access_key

below is the command use to create repository

**actual values are replaced

curl -u "username:password" -X PUT "https://elasticsearch-test-es-http:9200/_snapshot/es_repo" -d '{
      "type": "s3",
      "settings": {
        "bucket": "bucket",
        "region": "us-east-1",
        "endpoint": "mydomain.test.com",
        "protocol": "https"
      }
    }' -H 'Content-Type: application/json' -k

can you please advise what else we need to configure
we are using cloud object store for bucket.
Elasticsearch version: 8.17
2

Are your ES hosts able to resolve the hostname bucket.mydomain.test.com (well, your equivalent) to an IP address ?

3

Host domain is reachable from ES host but when it tries to connect to bucketname.endpoint, it fails to connect. why ES is looking for bucket.endpoint?

can you provide me steps to check the repository configuration on elasticsearch, are the step I provided earlier are correct?

4

Well, I am wondering what "s3 compatible cloud object storage" means?

You are not using Amazon's S3 ?

There's an Elastic video on how to use S3 at:

as well as steps within the official elasticsearch documentation.

5

How did you configured the snapshot repository?

Please share the configurations.

Also, what is the the s3 compatible service you are using? MinIO?

6

Hi @ragc007 Welcome to the community

What exact cloud storage are you using?

Don't forget to run the repository analysis API to check compatiabiltiy... if it does not pass it will not work. We have a very strict reliance on S3 Compatibility... many "S3 compatible" options are just "sort a" S3 compliant

7

we are using openstack cloud object storage compatible with s3

8

we are not able to create repository itself so can't analyze it.

9

we are not able to configure the repository, we are getting error as mentioned in issue description. steps are mention how we are trying to create repository adding access and secret key to key store and using curl command to create repo

10

Just to confirm, you already created the bucket in your S3 compatible tool, right?

11

yes we already created bucket.

12

seems a related thread/topic.

I note in that thread path_style_access was set to true there, and its default is false according to the docs, so maybe try adding that?

2 Likes
13

This worked, thank you,

14

Lucky guess.

Good luck with your project.