# Metricbeat kubernetes module state\_node metricset failed to parse node labels **URL:** \ **Category:** Beats\ **Tags:** metricbeat\ **Created:** [November 12, 2018, 10:02am UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-module-state-node-metricset-failed-to-parse-node-labels/156269 "2018-11-12T10:02:10Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Jun\_Zhang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jun_zhang/32/25863_2.png) [@Jun\_Zhang](https://discuss.elastic.co/u/Jun_Zhang)\ **Post date:** [November 12, 2018, 10:02am UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-module-state-node-metricset-failed-to-parse-node-labels/156269/1 "2018-11-12T10:02:10Z")
metricbeat logļ¼š 2018-11-12T17:54:45.479+0800 WARN elasticsearch/client.go:520 Cannot index event publisher.Event{Content:beat.Event{Timestamp:time.Time{wall:0xbef27156c82fe362, ext:1463147003462, loc:(\*time.Location)(0x37e0b20)}, Meta:common.MapStr(nil), Fields:common.MapStr{"metricset":common.MapStr{"host":"172.27.128.71:8794", "rtt":9019564, "namespace":"kubernetes. node", "name":"state\_node", "module":"kubernetes"}, "kubernetes":common.MapStr{"labels":common.MapStr{"ip-masq-fix":"true", "node":common.MapStr{"alpha":common.MapStr{"4pd":common.MapStr{"io/group-group1112":"true"}}}, "beta":common.MapStr{"kubernetes":common.MapStr{"io/os":"linux", "io/arch":"amd64"}}, "kubernetes":common.MapStr{"io/hostname":"m7-devops-128054" }, "prophet":common.MapStr{"4paradigm":common.MapStr{"com/offline":"true", "com/app":"true", "com/elasticsearch":"true", "com/online":"true", "com/system":"true", "com/addon":"true"}, "value":"true"}, "es-data":"true"}, "node":common.MapStr{"pod":common.MapStr{"capacity":common.MapStr{"total":220}, "allocatable":common.MapStr{"total":220}}, "status":common.MapSt r{"unschedulable":false, "ready":"true"}, "memory":common.MapStr{"allocatable":common.MapStr{"bytes":2.70272487424e+11}, "capacity":common.MapStr{"bytes":2.70377345024e+11}}, "cpu":common.MapStr{"allocatable":common.MapStr{"cores":40}, "capacity":common.MapStr{"cores":40}}, "name":"m7-devops-128054"}}, "beat":common.MapStr{"name":"metricbeat-128071-bin", "hostna me":"m7-devops-128071", "version":"6.4.3"}, "host":common.MapStr{"name":"m7-devops-128071", "id":"61432cc588f747f4aec71029ea9e9408", "containerized":true, "architecture":"x86\_64", "os":common.MapStr{"platform":"centos", "version":"7 (Core)", "family":"redhat", "codename":"Core"}}}, Private:interface {}(nil)}, Flags:0x0} (status=400): {"type":"mapper\_parsing\_exce ption","reason":"failed to parse [kubernetes.labels.node]","caused\_by":{"type":"illegal\_state\_exception","reason":"Can't get text on a START\_OBJECT at 1:222"}} # kubectl get node m7-devops-128054 --show-labels NAME STATUS ROLES AGE VERSION LABELS m7-devops-128054 Ready 67d v1.8.15 [beta.kubernetes.io/arch=amd64,beta.kubernetes.io/os=linux,es-data=true,ip-masq-fix=true,kubernetes.io/hostname=m7-devops-128054,node.alpha.4pd.io/group-group1112=true,prophet.4paradigm.com/addon=true,prophet.4paradigm.com/app=true,prophet.4paradigm.com/elasticsearch=true,prophet.4paradigm.com/offline=true,prophet.4paradigm.com/online=true,prophet.4paradigm.com/system=true,prophet=true](http://beta.kubernetes.io/arch=amd64,beta.kubernetes.io/os=linux,es-data=true,ip-masq-fix=true,kubernetes.io/hostname=m7-devops-128054,node.alpha.4pd.io/group-group1112=true,prophet.4paradigm.com/addon=true,prophet.4paradigm.com/app=true,prophet.4paradigm.com/elasticsearch=true,prophet.4paradigm.com/offline=true,prophet.4paradigm.com/online=true,prophet.4paradigm.com/system=true,prophet=true) ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/7/078946d2742eb5184f123415b44e9b6beb2f7090.png) ---
**Author:** ![jsoriano](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jsoriano/32/27920_2.png) [@jsoriano](https://discuss.elastic.co/u/jsoriano)\ **Post date:** [November 12, 2018, 12:21pm UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-module-state-node-metricset-failed-to-parse-node-labels/156269/2 "2018-11-12T12:21:44Z")
Hi @Jun_Zhang, It seems that elasticsearch is not being able to parse `kubernetes.labels.node` according to the types it has in the index mapping. This can be caused by having fields with different types in different events, e.g if `kubernetes.labels.node` is a string in some events and an object containing more fields in other events. To confirm that this is the problem you can try to drop the conflicting fields adding a drop\_field processor to filebeat, something like: ```auto processors: - drop_fields: fields: - "kubernetes.labels.node" ``` Then you should be able to see events, but without these labels. Of course this is not optimal because these labels are lost, we are evaluating possible solutions to these conflicts for future versions. In the meantime, as a workaround, you can try to use the [`rename`](https://www.elastic.co/guide/en/beats/filebeat/6.4/rename-fields.html) processor to change the field name of labels you are interested, and [`drop_fields`](https://www.elastic.co/guide/en/beats/filebeat/6.4/drop-fields.html) to drop the conflicting ones. ---
**Author:** ![Jun\_Zhang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jun_zhang/32/25863_2.png) [@Jun\_Zhang](https://discuss.elastic.co/u/Jun_Zhang)\ **Post date:** [November 13, 2018, 11:32am UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-module-state-node-metricset-failed-to-parse-node-labels/156269/3 "2018-11-13T11:32:17Z")
Got. Thanks! ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 11, 2018, 11:32am UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-module-state-node-metricset-failed-to-parse-node-labels/156269/4 "2018-12-11T11:32:18Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.