# Nodes being dropped from cluster **URL:** \ **Category:** Elasticsearch\ **Created:** [February 3, 2021, 6:34pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161 "2021-02-03T18:34:33Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![khuang](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@khuang](https://discuss.elastic.co/u/khuang)\ **Post date:** [February 3, 2021, 6:34pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/1 "2021-02-03T18:34:33Z")
I am currently trying to set up a 17 node cluster. 3 master nodes - 4 vCPU, 12 GB RAM, 7 GB Heap 10 data nodes - 15 vCPU, 116 GB RAM, 32 GB Heap 3 ingest nodes - 7 vCPU, 8 GB RAM, 2 GB Heap (Is this enough?) 1 coordinator - 15 vCPU, 56 GB RAM, 32 GB Heap This is running on Kubernetes via ECK. I am ingesting about 2.5 TB a day into two day based indexes, totally around 4.5B documents. 1 index with 60 shards and another one with 15 shards. I'm only running test loads right now, but it seems that one or more of my nodes are constantly dropping during what looks to be the cluster state publishing process? I am not sure if it's an inter-pod connectivity issue. Here are my logs: > **[extract-2021-02-03\_09-02-46.csv](https://www.dropbox.com/s/000stsv6vunbhnm/extract-2021-02-03_09-02-46.csv?dl=0)** > > Shared with Dropbox The role of the pod outputting the log line is in the second column. This log shows the node `boba-es-data-1` being removed from all nodes but it's not limited to just the data nodes. Thanks ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [February 3, 2021, 7:45pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/2 "2021-02-03T19:45:32Z")
You only shared a tiny fraction of logs, but they contain this: `2021-02-03T17:09:18.626Z,elasticsearch,boba-es-master-1,"node-left[{boba-es-data-1}{ymsWmXsvRgyw2DsExL8hfw}{f_d7tzEIRtqbeROpC5tbHA}{172.20.120.3}{172.20.120.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--a0fccf4d-3q3m, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 8050, delta: removed {{boba-es-data-1}{ymsWmXsvRgyw2DsExL8hfw}{f_d7tzEIRtqbeROpC5tbHA}{172.20.120.3}{172.20.120.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--a0fccf4d-3q3m, xpack.installed=true, transform.node=false}}"` In particular `reason: disconnected` indicates a connection between nodes was closed by an external force. We'd need to see logs covering a longer timescale to be sure. I'd also recommend against such verbose logging, the verbosity can itself cause issues, and the information needed is logged at `INFO` anyway. ---
**Author:** ![khuang](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@khuang](https://discuss.elastic.co/u/khuang)\ **Post date:** [February 3, 2021, 11:17pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/3 "2021-02-03T23:17:53Z")
Thanks for the response @DavidTurner . Here's roughly a 2 hour span of logs without trace. > **[es-logs.csv](https://www.dropbox.com/s/q3ivmgqc2avf1qr/es-logs.csv?dl=0)** > > Shared with Dropbox There's a lot of these `reason: disconnected` messages. I'm wondering if it's something within my cluster that's throttling them. ---
**Author:** ![khuang](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@khuang](https://discuss.elastic.co/u/khuang)\ **Post date:** [February 4, 2021, 12:40am UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/4 "2021-02-04T00:40:55Z")
Is it normal for this to be happening at the same minute every hour? ``` date,Host,Service,message 2021-02-04T00:11:52.393Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 11089, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T23:11:49.567Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 10538, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T22:11:46.769Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 10176, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T21:11:43.878Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 9748, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T21:11:43.877Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T20:11:40.911Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 9372, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T20:11:40.910Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T19:11:37.735Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 8931, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T19:11:37.735Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T18:11:34.546Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 8566, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T18:11:34.546Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T17:11:31.774Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 8093, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T17:11:31.774Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T16:11:28.643Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 7737, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T16:11:28.642Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T15:11:25.135Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 7326, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T15:11:25.135Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T14:11:21.969Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 6890, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T14:11:21.968Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T08:11:03.750Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 4452, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T08:11:03.750Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T07:11:02.453Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 4080, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" 2021-02-03T07:11:02.452Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"will process [node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected]]" 2021-02-03T06:11:01.200Z,gke-cx-production-boba-elasticsearch--35ca4ce8-mtm4.c.cxa-prod.internal,elasticsearch,"node-left[{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false} reason: disconnected], term: 3, version: 3681, delta: removed {{boba-es-data-0}{R_hzHKf0T5OqmCUwY59r1w}{rV6CW0BoQeKQCKdsqt2QPA}{172.20.121.3}{172.20.121.3:9300}{d}{k8s_node_name=gke-cx-production-boba-elasticsearch--fa6c311f-pmmk, xpack.installed=true, transform.node=false}}" ``` ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [February 4, 2021, 8:22am UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/5 "2021-02-04T08:22:48Z")
> [@khuang](#): > > I'm wondering if it's something within my cluster that's throttling them. No, Elasticsearch doesn't drop TCP connections like that, the cause is external to the cluster. > [@khuang](#): > > Is it normal for this to be happening at the same minute every hour? This suggests something on your network has a 1-hour timeout. Quoting [the docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-transport.html#long-lived-connections) (emphasis mine): > A transport connection between two nodes is made up of a number of long-lived TCP connections, some of which may be idle for an extended period of time. Nonetheless, Elasticsearch requires these connections to remain open, and **it can disrupt the operation of your cluster if any inter-node connections are closed by an external influence** such as a firewall. It is important to **configure your network to preserve long-lived idle connections between Elasticsearch nodes** , for instance by leaving `tcp.keep_alive` enabled and ensuring that the keepalive interval is shorter than any timeout that might cause idle connections to be closed, or by setting `transport.ping_schedule` if keepalives cannot be configured. **Devices which drop connections when they reach a certain age are a common source of problems to Elasticsearch clusters, and must not be used.** ---
**Author:** ![khuang](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@khuang](https://discuss.elastic.co/u/khuang)\ **Post date:** [February 5, 2021, 6:29pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/6 "2021-02-05T18:29:37Z")
Thanks @DavidTurner . I found out that our Istio mesh is set to time out long running connections after a hour. Keep-alives don't seem to be effective but after adding the `ping_schedule` setting, it stopped disconnecting. Thanks ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [February 5, 2021, 6:36pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/7 "2021-02-05T18:36:07Z")
I wouldn't recommend running Elasticsearch in a service mesh like Istio. There's no need, Elasticsearch handles its own clustering and intra-cluster routing, so it will only cause you problems like this. `ping_schedule` is much weaker than TCP keepalives. ---
**Author:** ![khuang](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@khuang](https://discuss.elastic.co/u/khuang)\ **Post date:** [February 5, 2021, 7:20pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/8 "2021-02-05T19:20:04Z")
Thanks, I'll keep that in mind. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [March 5, 2021, 7:20pm UTC](https://discuss.elastic.co/t/nodes-being-dropped-from-cluster/263161/9 "2021-03-05T19:20:48Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.