[QUESTION/HELP] Metricbeat kubernetes state_node labels

rayanebel · October 30, 2020, 8:42am

Hello,

I'm using metricbeat (7.x) and the kubernetes module to fetch kubernetes metrics from api-server and kube-state-metrics. I have a question about the metricset state_node. This metricset will fetch the metrics related to the kubernetes nodes. In the code base of the module I see all the metric name that will be fetch from kube-state-metrics and my question is: Do you include the prometheus labels for each metric ? For example, the module try to get the kube_node_info metricset from kube-state-metric and in this metric I have some relevant labels like the kubelet_version that I can't retrieve in elasticsearch.

kube_node_info{container_runtime_version="docker://1.11.1",kernel_version="4.7.2",kubelet_version="v1.5.3",kubeproxy_version="v1.5.3",node="minikube",os_image="Buildroot 2016.08"} 1

github.com

elastic/beats/blob/1575e67cbe7ce1109f3762daa6c2516797b6ccfa/metricbeat/module/kubernetes/state_node/state_node.go#L58


			"kube_node_status_capacity_cpu_cores":       p.Metric("cpu.capacity.cores"),
			"kube_node_status_allocatable_cpu_cores":    p.Metric("cpu.allocatable.cores"),
			"kube_node_spec_unschedulable":              p.BooleanMetric("status.unschedulable"),
			"kube_node_status_ready":                    p.LabelMetric("status.ready", "condition"),
			"kube_node_status_condition": p.LabelMetric("status.ready", "status",
				p.OpFilter(map[string]string{
					"condition": "Ready",
				})),
		},

		Labels: map[string]p.LabelMap{
			"node": p.KeyLabel("name"),
		},
	}
)

// init registers the MetricSet with the central registry.
// The New method will be called after the setup of the module and before starting to fetch data
func init() {
	if err := mb.Registry.AddMetricSet("kubernetes", "state_node", New, hostParser); err != nil {
		panic(err)

How can we have those labels ? The only way that I found is to add a new prometheus module which point to kube-state-metrics and I fetch again the kube_node_info metric.

Thanks.

ChrsMark · October 30, 2020, 10:05am

Hi!

Your assumption is correct. You can use prometheus module to scrape the metrics along with all the labels.

I guess that state-node metricset does not add all of them for storage efficiency. If you consider adding this specific label could be of benefit in general you can open a Github issue proposing this change, why it is important and your usecase and let the team decide if it can be added.

Thanks!

system · November 27, 2020, 12:06pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.