I have a couple of cases logged in with elasticsearch. This one was created recently (00390065) but still ties into the other ticket I have logged and we don't seem to be reaching anywhere. I'm not sure if you can dig into to look at the tickets but I will explain the issue here.
We are trying to do a POC for Elasticsearch on AWS ECS. For the POC-- 2 EC2 instances with 2 Elasticsearch nodes, one on each instance.
I have a custom yml file (pasted below). I have installed ec2-discovery and s3-discovery plugin in the docker image. Initially I had dynamic port mapping on the host with application load balancer and then I tried static port mapping with 9200 and 9300 on host because I thought maybe because of dynamic port mapping the containers are not able to go across the EC2 instances, but both methods didn't work to form a cluster. For both the methods the elastic load balancer is registering targets as healthy. I can use load balancer url to reach the container but when I query for the nodes or health I only see 1 node in the cluster.
Here is the elasticsearch.yml file:
As you can see in the yml file, I'm using ElasticSearch=nonprod tag to identify the EC2 instances and i confirm the underlying EC2 instances are tagged with that value. I have also tried it without the load balancer.
Any ideas what I might be doing wrong?