# Elasticsearch all shards failed **URL:** \ **Category:** Elasticsearch\ **Created:** [June 7, 2021, 2:29am UTC](https://discuss.elastic.co/t/elasticsearch-all-shards-failed/275088 "2021-06-07T02:29:08Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![jake\_JJ](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jake_jj/32/89150_2.png) [@jake\_JJ](https://discuss.elastic.co/u/jake_JJ)\ **Post date:** [June 7, 2021, 2:29am UTC](https://discuss.elastic.co/t/elasticsearch-all-shards-failed/275088/1 "2021-06-07T02:29:08Z")
```auto [2021-06-04T10:27:19,423][WARN][o.e.m.f.FsHealthService] [node-9800] health check of [/data/elasticsearch-7.12.0-9800/data/nodes/0] took [2144291ms] which is above the warn threshold of [5s] [2021-06-04T10:33:24,887][WARN][o.e.m.f.FsHealthService] [node-9800] health check of [/data/elasticsearch-7.12.0-9800/data/nodes/0] took [5204ms] which is above the warn threshold of [5s] [2021-06-04T12:35:29,248][WARN][r.suppressed] [node-9800] path: /service_instance_relation_client_cpm/_search, params: {typed_keys=true, ignore_unavailable=false, expand_wildcards=open, allow_no_indices=true, ignore_throttled=true, index=service_instance_relation_client_cpm, search_type=query_then_fetch, batched_reduce_size=512, ccs_minimize_roundtrips=true} org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseFailure(AbstractSearchAsyncAction.java:636) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.executeNextPhase(AbstractSearchAsyncAction.java:357) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseDone(AbstractSearchAsyncAction.java:669) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.onShardFailure(AbstractSearchAsyncAction.java:440) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.access$000(AbstractSearchAsyncAction.java:62) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction$1.onFailure(AbstractSearchAsyncAction.java:289) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchExecutionStatsCollector.onFailure(SearchExecutionStatsCollector.java:62) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.ActionListenerResponseHandler.handleException(ActionListenerResponseHandler.java:48) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchTransportService$ConnectionCountingHandler.handleException(SearchTransportService.java:405) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:775) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TransportService.sendChildRequest(TransportService.java:817) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TransportService.sendChildRequest(TransportService.java:809) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchTransportService.sendExecuteQuery(SearchTransportService.java:136) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchQueryThenFetchAsyncAction.executePhaseOnShard(SearchQueryThenFetchAsyncAction.java:71) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.lambda$performPhaseOnShard$4(AbstractSearchAsyncAction.java:273) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.performPhaseOnShard(AbstractSearchAsyncAction.java:310) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.onShardFailure(AbstractSearchAsyncAction.java:446) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction.access$000(AbstractSearchAsyncAction.java:62) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.AbstractSearchAsyncAction$1.onFailure(AbstractSearchAsyncAction.java:289) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchExecutionStatsCollector.onFailure(SearchExecutionStatsCollector.java:62) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.ActionListenerResponseHandler.handleException(ActionListenerResponseHandler.java:48) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.action.search.SearchTransportService$ConnectionCountingHandler.handleException(SearchTransportService.java:405) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TransportService$6.handleException(TransportService.java:745) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1290) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundHandler.lambda$handleException$3(InboundHandler.java:317) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:215) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:315) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:307) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:126) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:84) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:690) ~[elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:131) [elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:106) [elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:71) [elasticsearch-7.12.0.jar:7.12.0] at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:63) [transport-netty4-client-7.12.0.jar:7.12.0] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerC ``` ![image](https://us1.discourse-cdn.com/elastic/original/3X/6/3/6313f972202f00eab5665f6901ad761c31d3c436.png) os : centos7 ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [June 7, 2021, 2:41am UTC](https://discuss.elastic.co/t/elasticsearch-all-shards-failed/275088/2 "2021-06-07T02:41:43Z")
It's usually polite to add a bit more detail to your post other than just logs and screenshots. Are you having a problem you would like help on? When does the issue happen? What impact does it have? What version of the stack are you running? Have you made any changes recently? It appears this is Elasticsearch related, so what is the output from the `_cluster/stats?pretty&human` API? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 5, 2021, 2:41am UTC](https://discuss.elastic.co/t/elasticsearch-all-shards-failed/275088/3 "2021-07-05T02:41:53Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.