Elastic request timeout after disconnecting half cluster

Hello guys,

I have 16 data nodes in Elastic Stack cluster divided to 2 datacenters, all indices have one replica (2 copies in each DC). If I disconnect all nodes from one DC, Elastic is unavailable for a while, Kibana cannot reach it for a few minutes (screenshot incl.).

ElasticSearch conf:
cluster.name: "es-prod"

node.name: "xxx-elastic-master-01.xxx.xx"
path.data: "/var/lib/elasticsearch"
path.logs: "/var/log/elasticsearch"
network.host: 0.0.0.0
http.port: 9200
transport.tcp.port: 9300
node.attr.datacenter: dc1
node.attr.region: default
node.master: false
node.data: true
node.ingest: false
cluster.routing.allocation.awareness.attributes: datacenter,region
discovery.zen.ping.unicast.hosts: [ master-01, master-02, master-03 ]
discovery.zen.minimum_master_nodes: 2
xpack.monitoring.enabled: true
xpack.monitoring.elasticsearch.collection.enabled: true
xpack.monitoring.collection.enabled: true

Kibana is connected to two coordinates nodes (each in one DC).

Kibana

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.