I have setup Metricbeat(System module) -> Kafka -> Logstash -> Elasticsearch -> Kibana on our Linux local environment. I can see from the Discovery tab in Kibana that there is a lot of hits coming from Metricbeat, but once I loaded the generated Kibana dashboard for Metricbeat system module there are no data being loaded. Is there any additional config for this dashboard? Btw, my index is metricbeat-*
Thanks, that's useful. It tells us that for some reason the Metricbeat index templates did not get created. As a result, the Metricbeat data is being indexed in with default mappings as it comes in to Elasticsearch. These mappings are not what the dashboards expect, which would explain why they are blank.
This is probably why the Metricbeat templates didn't get loaded automatically. Whenever Metricbeat sends it's data to Elasticsearch indirectly — as is the case with your setup — Metricbeat doesn't have a direct connection to Elasticsearch. As such it cannot automatically load the index templates into Elasticsearch at startup. To account for such setups, Metricbeat has a setup command that must be run prior to starting Metricbeat for ingesting data. You can learn more about this over here: Load the Elasticsearch index template | Metricbeat Reference [8.11] | Elastic.
I see, I was thinking if I should have connected Metricbeat directly to Elasticsearch first on the initial setup so that the templates will be loaded first. Then change it to my intended setup. Anyway, I will check first the link you provided.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.