Exception while retrieving instance list from AWS API: Unable to execute HTTP request: us-west-2

[klahnakoski (Kyle Lahnakoski)]

I hope someone can help point out where I got my config file wrong. Thank you!

I am using ESv6.1.2

Here is part of my config file:

discovery:
    ec2:
        endpoint: us-west-2
        protocol: https

discovery.zen.hosts_provider: ec2
discovery.zen.minimum_master_nodes: 1

Here is the result

[2018-01-23T23:45:26,372][WARN ][o.e.d.z.ZenDiscovery     ] [spot_54.187.177.79] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2018-01-23T23:45:26,373][INFO ][o.e.d.e.AwsEc2UnicastHostsProvider] [spot_54.187.177.79] Exception while retrieving instance list from AWS API: Unable to execute HTTP request: us-west-2

The AWS region is correct. I am able to describe instances just fine:

aws ec2 describe-instances

"Discovery" works fine if I provide an IP, but this is a poor long term solution:

discovery:
    ec2:
        endpoint: us-west-2
        protocol: https
        groups: sg-c69186bb

discovery.zen.minimum_master_nodes: 1
discovery.zen.ping.unicast.hosts: 172.31.1.240

[dadoonet (David Pilato)]

The endpoint is incorrect. See https://www.elastic.co/guide/en/elasticsearch/plugins/current/_settings.html

In your case, I think it should be set to ec2.us-west-2.amazonaws.com.

[klahnakoski (Kyle Lahnakoski)]

Thank you for an example of an "endpoint"!

I was using the documentation you linked to, but it is only useful if you already know that an endpoint is a dot-delimited host name.

[dadoonet (David Pilato)]

But in the documentation there is a link specifically to the list of the endpoints you can define (link to AWS website).

I'm curious why you did not see it or click on it or understand it.

As you are not the first one, I guess it needs some improvement (example probably) but I'm curious to hear your thoughts.

Thanks