I want to create a visualization, which shows us the occurrence of drops in our incoming message workflow.
Our application is writing a metrics log, which is showing us how many messages are incoming per second.
I would like to detect the red marked drop. I would not like to get see the the positive spikes, because they are not the issue what i am looking for.
What is the best way to do so?
We are using basic license. So machine learning, etc. is not an option.
Target is to see, how often this issue occurred within the last month for example.
I need to detect issues, wich may be only 1 or 2 minutes long.
Our metric data is written once a minute.
Desired output is a bar graph and a table which lists all occurrences of the issue.
So when kibana is increasing the time range of a bucket, this might be problematic.
The workaround option I have in mind would be, fire a script against ES which calculates the difference of m1(now) - m1(now-1min). If result is negative, insert into ES, where I can visualize and list it.
But it would be nice to find a solution inside of kibana without the need of external jobs.