Hi , what is this error saying. I am getting it multiple times .
org.elasticsearch.transport.RemoteTransportException: [indices:data/read/search[phase/query]]
Caused by: org.elasticsearch.search.query.QueryPhaseExecutionException: Query Failed [Failed to execute main query]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:305) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:113) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:335) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:355) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$executeQueryPhase$1(SearchService.java:340) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener.lambda$map$2(ActionListener.java:145) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$rewriteShardRequest$7(SearchService.java:1043) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:45) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:44) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:773) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.4.2.jar:7.4.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
Caused by: org.elasticsearch.tasks.TaskCancelledException: cancelled
at org.elasticsearch.search.query.QueryPhase.lambda$execute$1(QueryPhase.java:228) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.internal.CancellableBulkScorer.score(CancellableBulkScorer.java:54) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39) ~[lucene-core-8.2.0.jar:8.2.0 31d7ec7bbfdcd2c4cc61d9d35e962165410b65fe - ivera - 2019-07-19 15:05:56]
at org.elasticsearch.search.internal.ContextIndexSearcher.searchInternal(ContextIndexSearcher.java:193) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.internal.ContextIndexSearcher.search(ContextIndexSearcher.java:174) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:440) ~[lucene-core-8.2.0.jar:8.2.0 31d7ec7bbfdcd2c4cc61d9d35e962165410b65fe - ivera - 2019-07-19 15:05:56]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:270) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:113) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:335) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:355) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$executeQueryPhase$1(SearchService.java:340) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener.lambda$map$2(ActionListener.java:145) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$rewriteShardRequest$7(SearchService.java:1043) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:45) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:44) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:773) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.4.2.jar:7.4.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:830) ~[?:?]
[2023-01-23T05:08:06,998][DEBUG][o.e.a.s.TransportSearchAction] [ip-172-31-22-198] All shards failed for phase: [query]
org.elasticsearch.tasks.TaskCancelledException: cancelled
at org.elasticsearch.search.query.QueryPhase.lambda$execute$1(QueryPhase.java:228) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.internal.CancellableBulkScorer.score(CancellableBulkScorer.java:54) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39) ~[lucene-core-8.2.0.jar:8.2.0 31d7ec7bbfdcd2c4cc61d9d35e962165410b65fe - ivera - 2019-07-19 15:05:56]
at org.elasticsearch.search.internal.ContextIndexSearcher.searchInternal(ContextIndexSearcher.java:193) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.internal.ContextIndexSearcher.search(ContextIndexSearcher.java:174) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:440) ~[lucene-core-8.2.0.jar:8.2.0 31d7ec7bbfdcd2c4cc61d9d35e962165410b65fe - ivera - 2019-07-19 15:05:56]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:270) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:113) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:335) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:355) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$executeQueryPhase$1(SearchService.java:340) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener.lambda$map$2(ActionListener.java:145) ~[elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.search.SearchService.lambda$rewriteShardRequest$7(SearchService.java:1043) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:45) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:44) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:773) [elasticsearch-7.4.2.jar:7.4.2]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.4.2.jar:7.4.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2023-01-23T05:08:06,999][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153750374] to the node [aOIs7vbFQfWCm7BdHw9wlA]
Welcome to our community! 
Please note that Elasticsearch 7.4 is EOL and no longer supported, you should be looking to upgrade as a matter of urgency.
There should be more to the log, can you share it please.
These are the logs which produced before the above mentioned issue.
[2023-01-23T01:42:00,000][INFO ][o.e.x.m.MlDailyMaintenanceService] triggering scheduled [ML] maintenance tasks
[2023-01-23T01:42:00,026][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] Deleting expired data
[2023-01-23T01:42:00,070][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] Completed deletion of expired ML data
[2023-01-23T01:42:00,071][INFO ][o.e.x.m.MlDailyMaintenanceService] Successfully completed [ML] maintenance tasks
[2023-01-23T04:49:58,958][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:58,958][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:59,116][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,117][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,300][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:59,754][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,754][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,755][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,755][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,392][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:00,447][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:00,525][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:04,047][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:04,223][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:04,223][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,122][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:46,480][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:46,494][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,495][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,615][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,616][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,856][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:47,038][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731545] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:47,038][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731545] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:49,903][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:50,188][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:50,196][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:51,725][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:52,178][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:52,653][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:52,653][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,180][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,181][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,271][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:53,296][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,296][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T05:07:56,951][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153750231] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
Thanks for that! If you can please format your code/logs/config using the </> button, or markdown style back ticks. It helps to make things easy to read which helps us help you 
[2023-01-23T01:42:00,000][INFO ][o.e.x.m.MlDailyMaintenanceService] triggering scheduled [ML] maintenance tasks
[2023-01-23T01:42:00,026][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] Deleting expired data
[2023-01-23T01:42:00,070][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] Completed deletion of expired ML data
[2023-01-23T01:42:00,071][INFO ][o.e.x.m.MlDailyMaintenanceService] Successfully completed [ML] maintenance tasks
[2023-01-23T04:49:58,958][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:58,958][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:59,116][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,117][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723741] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,300][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:49:59,754][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,754][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723742] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,755][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:49:59,755][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723745] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,392][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:00,447][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:00,525][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723765] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:00,526][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723767] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:04,047][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:50:04,223][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:50:04,223][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153723823] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,122][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:46,480][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:46,494][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,495][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731537] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,615][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,616][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731535] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:46,856][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:47,038][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731545] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:47,038][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731545] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:49,903][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:50,188][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:50,196][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731618] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:51,725][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:52,178][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:52,653][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:52,653][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731640] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,180][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,181][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731652] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,271][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
[2023-01-23T04:54:53,296][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Sending remove ban for tasks with the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] to the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T04:54:53,296][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Removing ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153731698] on the node [aOIs7vbFQfWCm7BdHw9wlA]
[2023-01-23T05:07:56,951][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] Received ban for the parent [aOIs7vbFQfWCm7BdHw9wlA:153750231] on the node [aOIs7vbFQfWCm7BdHw9wlA], reason: [by user request]
OK looking at the logs it seems that a query was executed via an API and the cancelled;
Thanks, due to this the CPU utilization max out to 100%, how can it happens?
Can you check hot_threads when this is happening?
what is the command to get hot_threads at a particular date and time. can u please share?
You can't, it's live.
Okay, Is there any way to know how cpu utilization max out to 100%.
Hot threads, as I pointed out.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.