Nodes leaves cluster and rejoin after sometime

Elastic Stack Elasticsearch
1

Hi Every one . we have two clusters . with 7 nodes in each . both of them has same config. ES 5.3.3. and ports are 9201 and 9301
one cluster is working fine. We are facing issue with another cluster.
now days Nodes leaves the cluster since they don't get any response from master for 90 seconds and rejoin it once they get response from master node. in logs it says

failed to send join request to master [{XXXXXX-08}{XXXXX}{XXXXX08}{XXXXXX:9301}], reason [RemoteTransportException[[XXXXXX][173.36.33.126:9301][internal:discovery/zen/join]];sted: ConnectTransportException[[XXXXX04][XXXXXXX:9301] connect_timeout[30s]]; nested: IOException[connection timed out: XXXXX-04/XXXXXXXX:9301];

but after sometime

[INFO ][o.e.c.s.ClusterService ] [xxxxxxx04] detected_master {xxxxxxx-08}{xxxxx}{xxxx}{xxxxxx-08}{xxxxxx:9301}, reason: zen-disco-receive(from master [master {xxxxxxx-08}{xxxx}{xxxxx}{xxxxx08}{xxxxx:9301} committed version [1229]])

i had words with my network team but they are saying there is no problem with from N/W side . we have installed ES 5.3.3 on VMs

2

Are you on the same LAN?

3

What is the topology of the cluster and the specification of the VMs? Is there anything in the logs on the master node, e.g. long GC?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.