All nodes except Master show as “Offline” Monitoring Cluster 7.8.0

[vijay.sangha (Vijay Kumar)]

I have configured a single node dedicated Monitoring Cluster with Elastic Latest version 7.8.0. Trying to send Data from all my 9 Nodes ( 3 Master, 2 Coordinating, 4 Data Nodes), but in the Monitoring Cluster Kibana-->Stack Monitoring I see only Master Node appears to show Data and no other Node Appears. I have the same Metric Beat Configuration pushed to all the nodes and same X-Pack monitoring configured for all Elastic Nodes. Does anyone have any idea what could be happeniing here?

Elastic Node X-Pack Monitoring Configuration on Elastic Cluster Nodes :- 

#---------------------- X-Pack Monitoring ---------------------------------#
xpack.monitoring.collection.enabled: true
xpack.monitoring.elasticsearch.collection.enabled: false

MetricBeat Collection Modulemo Configuration (elasticsearch-xpack.yml) : -

#---------------------- MetricBeat elasticsearch-xpack.yml Module ---------------------------------#
 # Module: elasticsearch
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.8/metricbeat-module-elasticsearch.html

- module: elasticsearch
  metricsets:
    - ccr
    - cluster_stats
    - index
    - index_recovery
    - index_summary
    - ml_job
    - node_stats
    - shard
    - enrich
  xpack.enabled: true
  period: 10s
  hosts: ["https://10.254.XXX.XXX:4101","https://10.254.XXX.XXX:4102"]
  username: "remote_monitoring_user"
  password: "seseme.web"
  ssl.certificate_authorities: ["/apps/t360/configuration/elastic/metricbeat/certs/ca.pem"]
 

In Kibana I see only the Master Node, even though I have another Coordinating node on the same VM as configured in the above module-configuration : -

[elasticforme (Sachin)]

I think you have to disable xpack.monitoring.collection.enabled: true line as you want metricbeat to monitor this.

https://www.elastic.co/guide/en/elasticsearch/reference/current/configuring-metricbeat.html

[vijay.sangha (Vijay Kumar)]

Hi Sachin,

Thanks for replying. Per the documentation you shared they say to set it to true.

But I will give it a try as you suggested and update the results here.

Thanks,
Vijay Kumar

[vijay.sangha (Vijay Kumar)]

I tried disabling the setting xpack.monitoring.collection.enabled: false in elasticsearch.ymlas well as using the endpoint

PUT _cluster/settings
{
  "persistent": {
    "xpack.monitoring.collection.enabled": false
  }
}

Restarted everything but the results are still the same.