# Elasticsearch cluster is down **URL:** \ **Category:** Elasticsearch\ **Created:** [November 14, 2019, 2:59pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917 "2019-11-14T14:59:45Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![yaminisridaran](https://avatars.discourse-cdn.com/v4/letter/y/ecccb3/32.png) [@yaminisridaran](https://discuss.elastic.co/u/yaminisridaran)\ **Post date:** [November 14, 2019, 2:59pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/1 "2019-11-14T14:59:45Z")
We have deployed elasticsearch cluster on kubernetes cluster. We have deployed 3 master nodes, 3 client nodes and 5 data nodes. We are able to ping the endpoint ips mentioned in the logs from the master,client and data nodes, but the logs are showing connection issue (manual ping works inside the containers). Master node logs: [2019-11-14T12:40:57,348][WARN][o.e.c.NodeConnectionsService] [master-fed-elastic-0] failed to connect to node {client-fed-elastic-1}{X3EsRyYLScSEaumLVWGlDQ}{sXzX4oU\_TzCaJPRnkUEnTg}{192.168.186.209}{192.168.186.209:9300} (tried [1] times) Client node logs: 2019-11-14T12:36:00,265][WARN][o.e.c.NodeConnectionsService] [client-fed-elastic-0] failed to connect to node {client-fed-elastic-1} {X3EsRyYLScSEaumLVWGlDQ} {9uHMXe8lTrqsICoT4HyIPQ} {192.168.186.209} {192.168.186.209:9300} (tried [1] times) [2019-11-14T12:37:28,771][ERROR][c.f.s.s.t.SearchGuardSSLNettyTransport] [client-fed-elastic-0] SSL Problem Received close\_notify during handshake javax.net.ssl.SSLException: Received close\_notify during handshake Data node logs: [2019-11-14T12:40:45,109][WARN][c.f.s.s.t.SearchGuardSSLNettyTransport] [data-fed-elastic-0] send message failed [channel: NettyTcpChannel {localAddress=0.0.0.0/0.0.0.0:9300, remoteAddress=/192.168.124.43:42068} ] Can you please help us? ---
**Author:** ![A\_B](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/a_b/32/17104_2.png) [@A\_B](https://discuss.elastic.co/u/A_B)\ **Post date:** [November 14, 2019, 4:02pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/2 "2019-11-14T16:02:15Z")
Hi @yaminisridaran, could you share your Elasticsearch config? Please share as _Preformated text_, then it is much easier to read 🙂 ---
**Author:** ![yaminisridaran](https://avatars.discourse-cdn.com/v4/letter/y/ecccb3/32.png) [@yaminisridaran](https://discuss.elastic.co/u/yaminisridaran)\ **Post date:** [November 15, 2019, 8:49am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/3 "2019-11-15T08:49:01Z")
My Elasticsearch cluster config: **Master node config:** ```auto bootstrap: memory_lock: false cluster: name: ${CLUSTER_NAME} discovery: zen: minimum_master_nodes: ${NUMBER_OF_MASTERS} ping.unicast.hosts: ${DISCOVERY_SERVICE} http: compression: true cors: allow-credentials: true allow-headers: X-Requested-With, Content-Type, Content-Length, Authorization allow-origin: ${HTTP_CORS_ALLOW_ORIGIN} enabled: ${HTTP_CORS_ENABLE} enabled: ${HTTP_ENABLE} network.host: 0.0.0.0 node: data: ${NODE_DATA} ingest: ${NODE_INGEST} master: ${NODE_MASTER} name: ${NODE_NAME} path: data: /data/data logs: /data/log searchguard.authcz.admin_dn: - CN=sgadmin,O=Elasticsearch Operator searchguard.disabled: ${SEARCHGUARD_DISABLED:false} searchguard.enterprise_modules_enabled: false searchguard.restapi.roles_enabled: - sg_all_access - sg_kibana_user searchguard.ssl.http.enabled: ${SSL_ENABLE} searchguard.ssl.http.keystore_filepath: certs/client.jks searchguard.ssl.http.keystore_password: ${KEY_PASS} searchguard.ssl.http.truststore_filepath: certs/root.jks searchguard.ssl.http.truststore_password: ${KEY_PASS} searchguard.ssl.transport.enforce_hostname_verification: false searchguard.ssl.transport.keystore_filepath: certs/node.jks searchguard.ssl.transport.keystore_password: ${KEY_PASS} searchguard.ssl.transport.truststore_filepath: certs/root.jks searchguard.ssl.transport.truststore_password: ${KEY_PASS} thread_pool: bulk: queue_size: 10000 ``` **Client node config:** ```auto bootstrap: memory_lock: false cluster: name: ${CLUSTER_NAME} discovery: zen: minimum_master_nodes: ${NUMBER_OF_MASTERS} ping.unicast.hosts: ${DISCOVERY_SERVICE} http: compression: true cors: allow-credentials: true allow-headers: X-Requested-With, Content-Type, Content-Length, Authorization allow-origin: ${HTTP_CORS_ALLOW_ORIGIN} enabled: ${HTTP_CORS_ENABLE} enabled: ${HTTP_ENABLE} network.host: 0.0.0.0 node: data: ${NODE_DATA} ingest: ${NODE_INGEST} master: ${NODE_MASTER} name: ${NODE_NAME} path: data: /data/data logs: /data/log searchguard.authcz.admin_dn: - CN=sgadmin,O=Elasticsearch Operator searchguard.disabled: ${SEARCHGUARD_DISABLED:false} searchguard.enterprise_modules_enabled: false searchguard.restapi.roles_enabled: - sg_all_access - sg_kibana_user searchguard.ssl.http.enabled: ${SSL_ENABLE} searchguard.ssl.http.keystore_filepath: certs/client.jks searchguard.ssl.http.keystore_password: ${KEY_PASS} searchguard.ssl.http.truststore_filepath: certs/root.jks searchguard.ssl.http.truststore_password: ${KEY_PASS} searchguard.ssl.transport.enforce_hostname_verification: false searchguard.ssl.transport.keystore_filepath: certs/node.jks searchguard.ssl.transport.keystore_password: ${KEY_PASS} searchguard.ssl.transport.truststore_filepath: certs/root.jks searchguard.ssl.transport.truststore_password: ${KEY_PASS} thread_pool: bulk: queue_size: 10000 ``` **Data node config:** ```auto bootstrap: memory_lock: false cluster: name: ${CLUSTER_NAME} discovery: zen: minimum_master_nodes: ${NUMBER_OF_MASTERS} ping.unicast.hosts: ${DISCOVERY_SERVICE} http: compression: true cors: allow-credentials: true allow-headers: X-Requested-With, Content-Type, Content-Length, Authorization allow-origin: ${HTTP_CORS_ALLOW_ORIGIN} enabled: ${HTTP_CORS_ENABLE} enabled: ${HTTP_ENABLE} network.host: 0.0.0.0 node: data: ${NODE_DATA} ingest: ${NODE_INGEST} master: ${NODE_MASTER} name: ${NODE_NAME} path: data: /data/data logs: /data/log searchguard.authcz.admin_dn: - CN=sgadmin,O=Elasticsearch Operator searchguard.disabled: ${SEARCHGUARD_DISABLED:false} searchguard.enterprise_modules_enabled: false searchguard.restapi.roles_enabled: - sg_all_access - sg_kibana_user searchguard.ssl.http.enabled: ${SSL_ENABLE} searchguard.ssl.http.keystore_filepath: certs/client.jks searchguard.ssl.http.keystore_password: ${KEY_PASS} searchguard.ssl.http.truststore_filepath: certs/root.jks searchguard.ssl.http.truststore_password: ${KEY_PASS} searchguard.ssl.transport.enforce_hostname_verification: false searchguard.ssl.transport.keystore_filepath: certs/node.jks searchguard.ssl.transport.keystore_password: ${KEY_PASS} searchguard.ssl.transport.truststore_filepath: certs/root.jks searchguard.ssl.transport.truststore_password: ${KEY_PASS} thread_pool: bulk: queue_size: 10000 ``` ---
**Author:** ![ikakavas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ikakavas/32/34430_2.png) [@ikakavas](https://discuss.elastic.co/u/ikakavas)\ **Post date:** [November 15, 2019, 9:07am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/4 "2019-11-15T09:07:05Z")
Please don't post unformatted code, logs, or configuration as it's very hard to read. Instead, paste the text and format it with \ icon or pairs of triple backticks (```), and check the preview window to make sure it's properly formatted before posting it. This makes it more likely that your question will receive a useful answer. It would be great if you could update your post to solve this. ---
**Author:** ![yaminisridaran](https://avatars.discourse-cdn.com/v4/letter/y/ecccb3/32.png) [@yaminisridaran](https://discuss.elastic.co/u/yaminisridaran)\ **Post date:** [November 15, 2019, 4:04pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/5 "2019-11-15T16:04:50Z")
@ikakavas, I have fixed the formatting and update the post. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 13, 2019, 4:04pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-down/207917/6 "2019-12-13T16:04:50Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.