Hello,
recently we have experienced this issue:
[2021-03-30T08:08:54,049][ERROR][o.e.x.w.e.ExecutionService] [logstashatp4] Error deleting entry from .triggered_watches for watch [bYsk9A5mRbimxYswp5ogTg_xpack_license_expiration_1917a18a-3a57-4672-9753-4ceb6f14f98e-2021-03-30T05:50:13.199117Z] after thread pool rejection
org.elasticsearch.ElasticsearchTimeoutException: java.util.concurrent.TimeoutException: Timeout waiting for task.
at org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:78) ~[elasticsearch-7.9.2.jar:7.9.2]
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:61) ~[elasticsearch-7.9.2.jar:7.9.2]
at org.elasticsearch.xpack.watcher.execution.ExecutionService.deleteTrigger(ExecutionService.java:488) ~[x-pack-watcher-7.9.2.jar:7.9.2]
at org.elasticsearch.xpack.watcher.execution.ExecutionService.lambda$executeAsync$8(ExecutionService.java:439) [x-pack-watcher-7.9.2.jar:7.9.2]
at org.elasticsearch.xpack.watcher.execution.ExecutionService$WatchExecutionTask.run(ExecutionService.java:626) [x-pack-watcher-7.9.2.jar:7.9.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.9.2.jar:7.9.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task.
at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:243) ~[elasticsearch-7.9.2.jar:7.9.2]
at org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:65) ~[elasticsearch-7.9.2.jar:7.9.2]
at org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:76) ~[elasticsearch-7.9.2.jar:7.9.2]
Thing is our license is valid until next year April, how can we solve this issue?
We have Elasticstack version 7.9.2 installed.