Exploring and understanding your data with Kibana Discover is an important first step to taking insightful, relevant actions. The Data Visualizer inside the Machine Learning app enables you to analyze the shape of the fields in your data, and for 8.0.0, we have now brought this functionality inside Discover.
The new Field statistics view in Discover provides a powerful way to analyze not only the shape of the content but also the contextual view surrounding each record. For example: What does the latency look like when one of the containers is down on a Sunday? What’s the weather like when there are flight delays? How many of the fields in my index are empty and redundant? Is the field type and format specified in the data view appropriate for the data and its cardinality? The new view enables you to answer all those questions.
At a glance, the table provides summarized information and statistics for the data content along with how the field is populated. For example, the percentage of documents in which the field is populated, as well as the cardinality. To analyze even further, expand the row to get the full statistics.
The new field statistics table is well integrated with the rest of Kibana. Seamlessly visualize multiple geo fields on the maps right on the same page. Or navigate to Lens in one click to have endless possibilities for visualizing relevant data.
Enabling the view also means that the field statistics work seamlessly in Dashboards for even better drill-down capabilities. Apply filters or queries directly from the table to quickly interact with the rest of the visualizations. To add the field statistics to a dashboard, simply switch the view mode to use the field statistics and save the search.
To enable field statistics, which is currently in beta, head over to Kibana’s advanced settings and enable
Show field statistics. It’s important to note that currently, the table samples 5000 documents per shard from the included indices to perform the aggregations.