Heartbeat-Elastic unable to get data

Hi I have upgraded my Heartbeat-elastic to 7.9.1. But later on all the data are not coming in.

Below are the ELSK version I am having:

Kibana - 7.7.0
Filebeat - 7.7.0
Logstash - 7.9.1

Please advise how can I debug and resolve this issue. Thanks

What do your Heartbeat logs show?
Does Heartbeat send to Logstash, or directly to Elasticsearch?
Are you going to upgrade the rest of your stack?

Hi some of the log:

2020-11-25T16:34:02.530+0800    ERROR   [publisher_pipeline_output]     pipeline/output.go:154  Failed to connect to backoff(elasticsearch(http://10.0.106.144:9200)): 401 Unauthorized: {"error":{"root_cause":[{"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}}],"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}},"status":401}
2020-11-25T16:34:34.173+0800    ERROR   [publisher_pipeline_output]     pipeline/output.go:154  Failed to connect to backoff(elasticsearch(http://10.0.106.144:9200)): 401 Unauthorized: {"error":{"root_cause":[{"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}}],"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}},"status":401}
2020-11-25T16:35:34.107+0800    ERROR   [publisher_pipeline_output]     pipeline/output.go:154  Failed to connect to backoff(elasticsearch(http://10.0.106.144:9200)): 401 Unauthorized: {"error":{"root_cause":[{"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}}],"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}},"status":401}
2020-11-25T16:36:20.746+0800    ERROR   [publisher_pipeline_output]     pipeline/output.go:154  Failed to connect to backoff(elasticsearch(http://10.0.106.144:9200)): 401 Unauthorized: {"error":{"root_cause":[{"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}}],"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}},"status":401}
2020-11-25T16:36:51.896+0800    ERROR   [publisher_pipeline_output]     pipeline/output.go:154  Failed to connect to backoff(elasticsearch(http://10.0.106.144:9200)): 401 Unauthorized: {"error":{"root_cause":[{"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}}],"type":"security_exception","reason":"failed to authenticate user [elastic]","header":{"WWW-Authenticate":"Basic realm=\"security\" charset=\"UTF-8\""}},"status":401}

Directly to Elasticsearch. and I am trying not to upgrade the ELKS if possible

That's pretty relevant, have you checked that?

I notice when I curl the ES it got error. May I know why?

Is there any place I need to enter the user credentials? Its already in the kibana.yml. I notice this password keep disappearing.

Hi I need some help to start my Elasticsearch. It says I have some missing plugins.

My question also is why the plugins will be removed?

Did you fix the auth issue?

What are the errors you are seeing?

Can you assist and guide me to do the ES upgrade?

I just tried to upgrade, but using Sudo, it causing the directory to have 2 different users (Root & Elasticsearch) how can I correct this? Installing ES shouldn't I use the root account?

It's going to be hard if you only ask questions and don't provide some clear indications of your issues unfortunately. You've gone from an auth error, to a missing plugin one, to an upgrade one, and it's not clear what you are doing or what your problems are.

Hi Warkolm,

I have manage to upgrade the ES to 7.10 and its running now. Now I need to try to get data from heartbeat-elastic. Now I am checking why is it not receiving.

Currently my versions for the component are as below:

  • Filebeat 7.7
  • Heartbeat 7.1

What do your configs look like?
What do the logs contain?

Hi may I know filebeat needs the rights "root:filebeat" in order to work?


Its empty. cant get log. But there might be lot causes. How can i debug?

Hi all, now i am getting data, but the uptime does not show the detail table below. May I know how can I debug?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.