Cluster_stats not sent to monitoring cluster

[souravsahoo (Sourav Sekhar Sahoo)]

Hi all,

I am facing an issue, where the production cluster/sending cluster is sending the monitoring data to the monitoring cluster. However, I am not able to view it on the stack monitoring page. On further analysis, I found out that, the monitoring data on the monitoring cluster is only having node_stats metricset and no other metricset, even though the sending cluster is sending those data.

Below Is the monitoring data in the monitoring cluster

{
  "took" : 377,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 10000,
      "relation" : "gte"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "clusters" : {
      "doc_count_error_upper_bound" : 0,
      "sum_other_doc_count" : 0,
      "buckets" : [
        {
          "key" : "95QSL0hRSnqNA3RMKl0Y3g",
          "doc_count" : 42946,
          "types" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [
              {
                "key" : "node_stats",
                "doc_count" : 42946,
                "last_seen" : {
                  "value" : 1.596227081693E12,
                  "value_as_string" : "2020-07-31T20:24:41.693Z"
                }
              }
            ]
          }
        }
      ]
    }
  }
}

Could any please help here? I can share the monitoring configurations for both sending and monitoring cluster, if required.

NOTE: I am using metricbeat 7.7.1 to ship monitoring data to elasticsearch cluster versioned 7.7.0

[chrisronline (Chris Roberson)]

Hi @souravsahoo,

Can you share the following configs:

metricbeat.yml
elasticsearch-xpack.yml

Can you also check the Metricbeat log file and return the most recent log line that looks like: INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring":?