Elasticsearch cross cluster does not work as expected


I have two ES clusters of significant sizes of 4 master nodes per cluster. I have another cluster which is configured as cross between the two clusters. Everything works fine when the ES instances are started afresh. However after sometime my second cluster stops showing results from when queried via the cross cluster. Sometimes it works and quite a few times I get the below error:

$ curl -v -XGET

  • About to connect() to port 9400 (#0)
  • Trying
  • Connected to ( port 9400 (#0)

GET /_remote/info?pretty HTTP/1.1
User-Agent: curl/7.29.0
Accept: /

< HTTP/1.1 500 Internal Server Error
< content-type: application/json; charset=UTF-8
< content-length: 360
"error" : {
"root_cause" : [
"type" : "node_disconnected_exception",
"reason" : "[node-es1-1][][cluster:monitor/nodes/info] disconnected"
"type" : "node_disconnected_exception",
"reason" : "[node-es1-1][][cluster:monitor/nodes/info] disconnected"
"status" : 500

  • Connection #0 to host left intact

The instance is running perfectly fine and I can do a telnet 9300 , which shows connected from the same machine I ran the curl command from.

$ telnet 9300
Connected to
Escape character is '^]'.

Is this a bug?

I have also opened an issue for this at: https://github.com/elastic/elasticsearch/issues/30247

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.