# Data Node disconnects randomly from cluster

**URL:** <https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396>\
**Category:** Elasticsearch\
**Created:** [May 23, 2022, 12:13pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396 "2022-05-23T12:13:56Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Siva\_Karan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/siva_karan/32/54688_2.png) [@Siva\_Karan](https://discuss.elastic.co/u/Siva_Karan)\
**Post date:** [May 23, 2022, 12:13pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396/1 "2022-05-23T12:13:56Z")

</div>

Hi Team,

Data node from the cluster some times automatically removed without any high heap usage.

with in sometime it joins automatically.

Please help me to sort it out.

Elasticsearch version :7.3.2  
OS:ubunutu

2022-05-22T09:34:04,053][INFO][o.e.c.s.MasterService] [master1] node-left[{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true} followers check retry count exceeded], term: 16, version: 385126, reason: removed {{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true},}  
[2022-05-22T09:34:04,237][INFO][o.e.c.s.ClusterApplierService] [master1] removed {{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true},}, term: 16, version: 385126, reason: Publication{term=16, version=385126}  
[2022-05-22T09:34:04,255][INFO][o.e.c.r.DelayedAllocationService] [master1] scheduling reroute for delayed shards in [59.7s] (21 delayed shards)  
[2022-05-22T09:34:04,259][WARN][o.e.c.r.a.AllocationService] [master1] [1][4] marking unavailable shards as stale: [0os98SECRnaYlfMr8DKTEA]  
[2022-05-22T09:36:07,507][WARN][o.e.c.r.a.AllocationService] [master1] [1][1] marking unavailable shards as stale: [yQj9BTm2TRKM8DfiOd5INw]  
[2022-05-22T09:42:17,214][INFO][o.e.c.s.MasterService] [master1] node-join[{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true} join existing leader, {data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true} join existing leader], term: 16, version: 385146, reason: added {{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true},}  
[2022-05-22T09:42:17,531][INFO][o.e.c.s.ClusterApplierService] [master1] added {{data3}{N002utNPTYKE1G0NiuEmmQ}{SpuwRpCQSX6gkDvs8T1\_MA}{ip}{ip:port}{d}{xpack.installed=true},}, term: 16, version: 385146, reason: Publication{term=16, version=385146}  
[2022-05-22T09:51:07,253][WARN][o.e.c.r.a.AllocationService] [master1] [1][2] marking unavailable shards as stale: [CpjBmzAMQSmLZEufTQIqVQ]  
[2022-05-22T10:06:58,624][INFO][o.e.c.r.a.AllocationService] [master1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[1][4]] ...]).

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [May 23, 2022, 12:58pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396/2 "2022-05-23T12:58:47Z")

</div>

> [@Siva\_Karan](#):
>
> Elasticsearch version :7.3.2

This version went [EOL](https://www.elastic.co/support/eol) well over a year ago, you should upgrade as a matter of urgency. Newer versions have significant improvements in stability and performance.

Newer versions also include documentation about diagnosing this kind of problem [here in the reference manual](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-fault-detection.html#cluster-fault-detection-troubleshooting). Some of that information applies to older versions too, but for the best troubleshooting experience you should upgrade.

---

<div class="post-metadata">

**Author:** ![Siva\_Karan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/siva_karan/32/54688_2.png) [@Siva\_Karan](https://discuss.elastic.co/u/Siva_Karan)\
**Post date:** [May 23, 2022, 3:12pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396/3 "2022-05-23T15:12:05Z")

</div>

Thanks for the information.

we have configured the clusters in GCP vm and Our seperate Datacenter.

our data center clusters are using same version,but they are stable cluster.

GCP clusters alone we are facing these kind of issue.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 20, 2022, 3:12pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396/4 "2022-06-20T15:12:27Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.