I think the feature you're looking for is called throttling, which you can define as throttle_period at the top-level of the watch, or within an individual action:
https://www.elastic.co/guide/en/watcher/current/actions.html#actions-ack-throttle
That seems like it will probably work for you?