I am trying to create an ElasticSearch cluster with 2 coordinating nodes and 3 master/data nodes.
I am seeing errors related to failed to send ping.
ex:
[2018-03-19T23:59:57,298][WARN ][o.e.d.z.UnicastZenPing ] [vsyslog-ops2-az1-esdata3-syslog-elastic.cse.lab.sprint.com] failed to send ping to [{vsyslog-ops2-az1-esdata1-syslog-elastic.cse.lab.sprint.com}{Aop3TF19TH2dp4gRiST92g}{9UCF2AT_Se2NhT6OmNnUIQ}{172.31.44.79}{172.31.44.79:9300}]
This is occurring on every node in the cluster - and the ping destination failing covers all nodes in the cluster. I have explicitly set network.host, transport.bind_host and discovery.zen.ping.unicast.hosts in the /etc/elasticsearch/elasticsearch.yml file.
any recommendations on how to troubleshoot this? I can telnet to port 9300 on each server...