I am looking for ideas on how to send an automated UUID through the ELK stack and make sure it arrives in the elasticsearch cluster.
Basically some sort of elasticsearch process that generates the UUID inserts a record for it, then another external process possibly from Rundeck grabs that record and flips a switch saying it's active. That Rundeck job then logs into a server and uses the Linux 'logger' command to generate a syslog message with that UUID.
Once the switch is flipped elasticsearch starts some sort of timer, if that timer expires before that UUID makes its way back through the ELK stack an alert is generated.
Sort of like a bullet or echo ping being sent waiting for a response.
This tests multiple points of failure at one time.
Suggestions? Does anyone know of something similar to this already out there?