Metricbeat is not sending cluster_stats for elasticsearch module

[Cousin_John]

I am having the same issue as this closed post:

Metricbeat is not sending cluster_stats for elasticsearch module

Hello, I am trying to monitor our elastic search cluster 2.x with metricbeat 7.7.1. Metricbeat is sending over the data for shards, indicex, node, node_stats but for some reason its not sending over cluster_stats metric set. configurations for elasticsearch module. # Module: elasticsearch # Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.2/metricbeat-module-elasticsearch.html - module: elasticsearch metricsets: - node - node_stats - shard - cluster_stats …

I am trying to monitor our Elasticsearch cluster 2.x with metricbeat 7.7.1. Metricbeat is sending over the data for node, node_stats but for some reason it's not sending over cluster_stats metric set.

So I tried what was suggested in the last post ./metricbeat -e -d "*"

My logs don't show anything failing so I'm not sure where the issues is.

2021-05-28T22:14:20.651+0200	DEBUG	[cfgfile]	cfgfile/reload.go:194	Scan for new config files
2021-05-28T22:14:20.665+0200	DEBUG	[elasticsearch.cluster_stats]	elasticsearch/metricset.go:132	trying to fetch cluster_stats stats from a non-master node
2021-05-28T22:14:30.651+0200	DEBUG	[cfgfile]	cfgfile/reload.go:194	Scan for new config files
2021-05-28T22:14:30.664+0200	DEBUG	[elasticsearch.cluster_stats]	elasticsearch/metricset.go:132	trying to fetch cluster_stats stats from a non-master node
2021-05-28T22:14:40.647+0200	INFO	[monitoring]	log/log.go:144	Non-zero metrics in the last 30s	{"monitoring": ... }

I am able to manually curl for the data. I do understand the response JSON shape has changed over versions but I have not seen anything saying metricbeats can't handle that.

Any insights would be greatly appreciated.