Everything works fine and I was able to see Metricbeat docs being received at another ELK stack instance. The confusion I had was the documents seem to be too many --- after the first night, there has been already over 2 million metric docs which takes nearly 1Gb storage... i wondered whether that's an expected behavior but I couldn't find any posts / official documentation -mentioning how frequent the Metricbeat sends metrics....
Thanks for replying! This is my K8S YAML created following the tutorial, with some minor modification to fit my deployment needs. I am running a cluster of 6 nodes on Azure cloud, and 34 pods in total (excluding metricbeat pods)
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.