I am using curator for elasticsearch snapshot deletion, since couple of days I started observing that snapshot deleting took longer time than previous in short (more than 5 minutes) since then my curator job started failing it throws following error.
2021-04-28 06:36:01,541 INFO Deleting snapshot curator-2021-04-14-06:30:20... 2021-04-28 06:41:01,695 ERROR Failed to complete action: delete_snapshots. <class 'curator.exceptions.FailedExecution'>: Exception encountered. Rerun with loglevel DEBUG and/or check Elasticsearch logs for more information. Exception: NotFoundError(404, 'snapshot_missing_exception', '[manual-triggered:curator-2021-04-14-06:30:20] is missing')
Then I found timeout_override | Curator Reference [5.8] | Elastic and tried to put in my config but still I see curator still usages 300s as timeout.
--- actions: 1: action: delete_snapshots description: >- "Delete selected snapshots from 'manual-triggerd' older than 14 matching curator-" options: repository: manual-triggered retry_interval: 120 retry_count: 3 ignore_empty_list: True timeout_override: 21600 filters: - filtertype: pattern kind: prefix value: curator- - filtertype: age source: creation_date direction: older unit: days unit_count: 14
curator version - 5.8.1
elasticsearch version - 7.6.2