Dear All, I'm wondering what are the best practices to monitor my Elastic Stack (beat, redis, logstash, Elasticsearch) health and activity. Therefore, I would be happy to hear your experience on this topic.
So far, I'm planning to monitor the hosts and services (linux) with centreon; the elasticsearch health and activity with Marvel Plugin; but for the beats and logstash (filter) I don't have a clue about what is the best solution to monitor the "Flow Activity".
Thansk in advance for you replies.
Monitor ElasticSearch cluster and Activity:
Use Marvel PLugin
scheduled task to run Elasticsearch queries periodically and take action based on the result.
Monitor Logstash Activity:
monitor messages consumption (filtering, sending)
what about: "logstash pulse": https://www.elastic.co/blog/how-to-check-logstashs-pulse , https://github.com/logstash-plugins/logstash-input-heartbeat
Monitor Beats Activity:
Monitor Redis Activiy:
monitor messages consumption
what about: "redisbeat" : https://www.elastic.co/blog/weekly-beats-redisbeat-community