I've recently upgraded to ELK stack (Kibana) 7.9.2 from 7.8.0. I am facing a weird issue which was not in the older version. The filter doesn't populate all the values of a field in discover or dashboards.
Let say a field (datatype keyword) has value1, value2, value3, value4, value5 and value6 when I select this field as a filter in discover or any dashboard. I only get four suggested values out of 6. I checked the values in index and it's all there but the Kibana suggestion API returning fewer values.
NOTE: This is only happening in the case of filebeat. I've checked this in metricbeat and heartbeat indexes and it's working there.
Please suggest if there is a workaround or configuration to make it right. Any help would be highly appreciated.