# Heartbeat is crashing due to High Availability Cluster Communication

**URL:** https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588
**Category:** Beats
**Created:** [May 17, 2019, 11:55am UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588 "2019-05-17T11:55:14Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![iamyogesh](https://avatars.discourse-cdn.com/v4/letter/i/e47c2d/32.png) [@iamyogesh](https://discuss.elastic.co/u/iamyogesh)
#### Post date: [May 17, 2019, 11:55am UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588/1 "2019-05-17T11:55:14Z")

</div>

For confirmed bugs, please report:

- Version: heartbeat 5.4.3, elasticsearch 4 node cluster with version 6.3.2
- Operating System: heartbeat installed on ubuntu 18.04, elasticsearch cluster centos 7
- Discuss Forum URL:

heartbeat in runing in ubuntu machine to check the ip status using following configuration

# Configure monitors

heartbeat.monitors:

- type: icmp

# Configure task schedule

schedule: '\*/10 \* \* \* \*'  
hosts: ["192.168.11.76"]

pushing data to elastic search , it crashes after 2 days on continues run of heartbeat service

- Steps to Reproduce:  
systemctl status heartbeat

● heartbeat.service - Heartbeat High Availability Cluster Communication and Membership  
Loaded: loaded (/lib/systemd/system/heartbeat.service; enabled; vendor preset: enabled)  
Active: failed (Result: exit-code) since Thu 2019-05-16 10:15:10 IST; 1h 53min ago  
Process: 929 ExecStart=/usr/lib/heartbeat/heartbeat -f (code=exited, status=6)  
Main PID: 929 (code=exited, status=6)

May 16 10:15:10 adumaster systemd[1]: Started Heartbeat High Availability Cluster Communication and Memb  
May 16 10:15:10 adumaster heartbeat[929]: May 16 10:15:10 adumaster heartbeat: [929]: ERROR: Cannot open  
May 16 10:15:10 adumaster heartbeat[929]: May 16 10:15:10 adumaster heartbeat: [929]: info: An annotated  
May 16 10:15:10 adumaster heartbeat[929]: May 16 10:15:10 adumaster heartbeat: [929]: info: Please copy  
May 16 10:15:10 adumaster heartbeat[929]: May 16 10:15:10 adumaster heartbeat: [929]: ERROR: Heartbeat n  
May 16 10:15:10 adumaster heartbeat[929]: May 16 10:15:10 adumaster heartbeat: [929]: ERROR: Configurati  
May 16 10:15:10 adumaster systemd[1]: heartbeat.service: Main process exited, code=exited, status=6/NOTC  
May 16 10:15:10 adumaster systemd[1]: heartbeat.service: Failed with result 'exit-code'.

check the error log message  
/var/log/heartbeat/heartbeat

019-05-17T14:21:22+05:30 INFO No non-zero metrics in the last 30s  
2019-05-17T14:21:30+05:30 ERR Failed to perform any bulk index operations: Post [http://ip](http://ip):port/\_bulk: net/http: request canceled (Client.Timeout exceeded while awaiting headers)  
2019-05-17T14:21:30+05:30 INFO Error publishing events (retrying): Post [http://ip](http://ip):port/\_bulk: net/http: request canceled (Client.Timeout exceeded while awaiting headers)  
2019-05-17T14:21:31+05:30 ERR Connecting error publishing events (retrying): Get [http://ip:port](http://ip:port/): EOF

---

<div class="post-metadata">

### Author: ![martinr\_ubi](https://avatars.discourse-cdn.com/v4/letter/m/b5e925/32.png) [@martinr\_ubi](https://discuss.elastic.co/u/martinr_ubi)
#### Post date: [May 17, 2019, 1:19pm UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588/2 "2019-05-17T13:19:49Z")

</div>

> [@iamyogesh](#):
>
> systemctl status heartbeat

It’s heartbeat-elastic not heartbeat for the service name. your systemctl command is for another software called heartbeat that has nothing to do with Elastic.

---

<div class="post-metadata">

### Author: ![iamyogesh](https://avatars.discourse-cdn.com/v4/letter/i/e47c2d/32.png) [@iamyogesh](https://discuss.elastic.co/u/iamyogesh)
#### Post date: [May 20, 2019, 6:53am UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588/3 "2019-05-20T06:53:46Z")

</div>

for hearneat 5.4 version we have to use systemctl status heartbeat.  
for heartbeat 6.5 heartbeat-elastic

---

<div class="post-metadata">

### Author: ![martinr\_ubi](https://avatars.discourse-cdn.com/v4/letter/m/b5e925/32.png) [@martinr\_ubi](https://discuss.elastic.co/u/martinr_ubi)
#### Post date: [May 20, 2019, 7:33am UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588/4 "2019-05-20T07:33:40Z")

</div>

True, my bad. The package and service name was renamed in \>=6.0.

So I guess you'll need to follow the doc here:  
[https://www.elastic.co/guide/en/beats/heartbeat/5.6/setup-repositories.html](https://www.elastic.co/guide/en/beats/heartbeat/5.6/setup-repositories.html)

But in addition since you already have the conflicting software called "Heartbeat High Availability Cluster Communication and Membership" which currently uses the service name "heartbeat" in your system, you'll have to either remove the conflicting software or rename one of the 2 services so they stop conflicting.

I would guess that your are not using the old software that is conflicting, so the easiest fix is probably to remove it and make sure your system has only one thing called "heartbeat". Remove the conflicting software then reinstall heartbeat, did you try that? If you are using it, then you need to rename one of the 2 services so they stop conflicting.

Does that help?  
You're suffering from:

> <https://github.com/elastic/beats/issues/3765>

  
Which was fix in heartbeat \>=6.0 by renaming the package and service to "heartbeat-elastic".

If the goal of your post was to discuss the error you have in your Elastic heartbeat logs, then the message seems to indicate heartbeat cannot connect to your Elasticsearch  
server. It crashes after 2 days of runtime? But from your logs, heartbeat says it cannot connect to elasticsearch, so while it was running for 2 days, was it shipping events into elasticsearch?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 17, 2019, 9:33am UTC](https://discuss.elastic.co/t/heartbeat-is-crashing-due-to-high-availability-cluster-communication/181588/5 "2019-06-17T09:33:45Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
