I have a separate watcher server which hosts all of my watchers. My watchers monitor my ES cluster which consists of multiple nodes. My watchers use 'HTTP requests' inputs.
One of my uses for watchers is to monitor the health of my ES cluster (https://www.elastic.co/guide/en/watcher/current/watch-cluster-status.html). So far it has been working great as an early warning mechanism. However, one flaw that I've recently observed is that if the 'host' node being queried is the one that fails, no notification gets sent out.
Now I'm wondering if there is a way for the watcher to query multiple hosts as a backup in the case the original host node fails.