Although Kibana monitoring is superb for visualization of current ELK stats. What we need is a nice way of aggregating these numbers so that we can get early alerts of critical disk space, memory, cpu for each of the cluster nodes. Are there any tools available that will deliver these stats? or is there some way of developing some custom queries/scripts?
X-Pack includes an alerting feature, that can notify people and other systems when specific conditions in Elasticsearch are fulfilled. Since the monitoring data are stored as Elasticsearch documents, they can be used as a basis for alerts too. Currently this requires manual creation of the appropriate alerts, but providing more convenient user interfaces for creating alerts based on monitoring data is something we are working on. There are also 3rd-party solutions for alerting based on Elasticsearch (e.g. https://github.com/Yelp/elastalert), which require running additional services in the infrastructure.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.