I will also add that, although Dima covers all functionality built in for this, we are actively considering something closer to what you request.
There are two main ways we might proceed. With supervised learning features in the stack we can train, for example, a classifier of important (groups of) anomalies based on user feedback. (At a push, this is something one can develop already independently: for example see this excellent talk by Bell.) In the nearer term, we may provide a sensitivity control which allows one to adjust the tradeoff between FP and FN for anomaly detection in a less granular fashion.
There are some hard aspects of getting a supervised approach to work for this problem if you want to make a very shrink wrapped user experience:
- You may not get a lot of rather imbalanced training data,
- You need to find features which will generally be effective at learning the right things from user feedback,
- You want retraining with small amounts of additional data to be stable so adding a small amount of feedback doesn't significantly alter predictions.
Regarding point 3, we are currently working on incremental training which addresses this for our stack based supervised ML. When this work is nearer to completion we will likely revisit creating a more streamlined process for users feeding back on specific anomalies.