Fields are unknown in de discovery tab kibana and unable to make visualization of field

[gregorysanders]

HI everyone,

I am unable to make visualizations of certain fields in my index.
In the discovery tab, some fields are unknown. I already tried to refresh the index pattern multiple times but this does not solve the problem.

[matw (Matthias Wilhelm)]

Hi and welcome to our commuinity.
Could you provide the mapping of your index in Elasticsearch, or just the part that contains the field you're missing?
Thx & Best,
Matthias

[gregorysanders]

Thank you for helping me out.

Here is a part of the mapping with e.g. the fields that I am missing.

{
"candidates-v2" : {
"mappings" : {
"properties" : {
"certificates" : {
"type" : "nested",
"include_in_parent" : true,
"properties" : {
"code" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"date_till" : {
"type" : "date",
"format" : "date_time_no_millis"
},
"fr" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"id" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"label" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"nl" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"parent_id" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"rank" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
},
"value" : {
"type" : "text",
"fields" : {
"keyword" : {
"type" : "keyword",
"ignore_above" : 256
}
}
}
}
}
}
}
}
}

[matw (Matthias Wilhelm)]

About certificates, this is a nested field, and the support of nested fields in Kibana is limited, so aggregations are currently not supported ([Meta] Kibana support for ES aggregations · Issue #58628 · elastic/kibana · GitHub)

About educations, this doesn't seem to be in your mappings, which makes me wonder, is your mapping dynamic? dynamic | Elasticsearch Guide [7.13] | Elastic