I am having the same issue as this closed post:
I am trying to monitor our Elasticsearch cluster 2.x with metricbeat 7.7.1. Metricbeat is sending over the data for node, node_stats but for some reason it's not sending over cluster_stats metric set.
So I tried what was suggested in the last post ./metricbeat -e -d "*"
My logs don't show anything failing so I'm not sure where the issues is.
2021-05-28T22:14:20.651+0200 DEBUG [cfgfile] cfgfile/reload.go:194 Scan for new config files
2021-05-28T22:14:20.665+0200 DEBUG [elasticsearch.cluster_stats] elasticsearch/metricset.go:132 trying to fetch cluster_stats stats from a non-master node
2021-05-28T22:14:30.651+0200 DEBUG [cfgfile] cfgfile/reload.go:194 Scan for new config files
2021-05-28T22:14:30.664+0200 DEBUG [elasticsearch.cluster_stats] elasticsearch/metricset.go:132 trying to fetch cluster_stats stats from a non-master node
2021-05-28T22:14:40.647+0200 INFO [monitoring] log/log.go:144 Non-zero metrics in the last 30s {"monitoring": ... }
I am able to manually curl for the data. I do understand the response JSON shape has changed over versions but I have not seen anything saying metricbeats can't handle that.
Any insights would be greatly appreciated.