There are several settings in the current dev version of Kibana that allow you to configure the lifetime of a notification, could you check in the Management's Advanced Settings, searching for notifications there?
In the latest Kibana it looks like this:
Best,
Matthias