Xpack machine learning boundary

machine-learning

(prem kumar) #1

We have tested our system metrics (CPU, Memory,Disk IO........etc) with the new version of elasticsearch machine learning system(Version-6.2.3)

As per your documentation we understood that the boundary conditions are calculated dynamically it will be wider in the beginning and get refined as more data comes in.

we would like to know the details on the following,

  1. Is it is possible to have a static threshold limit set as lower and upper boundary limit values? we want to apply this logic for some of our system metrics.

  2. Is it possible to have a feedback mechanism incorporated into ES Anomaly system?. User will provide the feedback on the anomalies detected by ES is actually an anomaly or not. the ES machine should take this feedback input into consideration while predicting the future anomalies.

Thanks in advance.


(Mark Walkom) #2

1 is better handled with Alerting as it can do static thresholds.
2 should be available very soon, but maybe someone with more knowledge can comment.


(Hendrik Muhs) #3

Regarding 2:

We do not have a feedback-loop system yet. There are thoughts around this, but note that this is far from trivial, if you want to do it right, especially when it comes to combining user feedback into the ML models.

Having that said: For special events that are known upfront, be it the Black Friday or a planned outage due to scheduled maintenance, we build special API's to suspend modeling for this periods:


(Mark Walkom) #4

That's what I was thinking ok, thanks :slight_smile:


(Mark Walkom) #5