In 5.5, we released the watch creation UI in the Machine Learning job workflow as shown below so that it's easier for you to get alerted when critical anomalies were detected. Once you choose the time interval to check against the data and severity threshold, and click apply, it will create a watch for you. You can go to the Watcher UI under Management tab so you can edit the watch further to configure watch actions. By default, there's a logging action.
Thanks,
Bohyun