# Some indices failing with "SearchPhaseExecutionException\[Failed to execute phase \[query\], all shards failed\]"

**URL:** https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749
**Category:** Elasticsearch
**Created:** [September 12, 2014, 6:53am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749 "2014-09-12T06:53:18Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Kevin\_DeLand](https://avatars.discourse-cdn.com/v4/letter/k/7ea924/32.png) [@Kevin\_DeLand](https://discuss.elastic.co/u/Kevin_DeLand)
#### Post date: [September 12, 2014, 6:53am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/1 "2014-09-12T06:53:18Z")

</div>

Everything was working fine when all of a sudden some indices started  
failing.

_GET localhost:9200/logstash-2014.09.11/\_search_  
yields response:  
{"error":"SearchPhaseExecutionException[Failed to execute phase [query],  
all shards failed]","status":503}

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/67143a50-7cd9-4836-a19f-a2911bd05e1f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/67143a50-7cd9-4836-a19f-a2911bd05e1f%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [September 12, 2014, 6:56am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/2 "2014-09-12T06:56:53Z")

</div>

On Friday, September 12, 2014 at 08:53 CEST,  
Kevin DeLand [kevin.deland@gmail.com](mailto:kevin.deland@gmail.com) wrote:

> Everything was working fine when all of a sudden some indices started  
> failing.  
> GET localhost:9200/logstash-2014.09.11/\_search  
> yields response:  
> {"error":"SearchPhaseExecutionException[Failed to execute phase  
> [query], all shards failed]","status":503}

How's the cluster's health? Anything interesting in the Elasticsearch  
logs?

--  
Magnus Bäck | Software Engineer, Development Tools  
[magnus.back@sonymobile.com](mailto:magnus.back@sonymobile.com) | Sony Mobile Communications

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/20140912065653.GC3212%40seldlx20533.corpusers.net](https://groups.google.com/d/msgid/elasticsearch/20140912065653.GC3212%40seldlx20533.corpusers.net).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![Kevin\_DeLand](https://avatars.discourse-cdn.com/v4/letter/k/7ea924/32.png) [@Kevin\_DeLand](https://discuss.elastic.co/u/Kevin_DeLand)
#### Post date: [September 12, 2014, 7:17am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/3 "2014-09-12T07:17:43Z")

</div>

Cluster health is red:

> <https://gist.github.com/kevindeland/2d727c3d984139ab96d4>

On Friday, September 12, 2014 2:57:06 AM UTC-4, Magnus Bäck wrote:

> On Friday, September 12, 2014 at 08:53 CEST,  
> Kevin DeLand \<[kevin....@gmail.com](mailto:kevin....@gmail.com) \<javascript:\>\> wrote:
> 
> > Everything was working fine when all of a sudden some indices started  
> > failing.  
> > GET localhost:9200/logstash-2014.09.11/\_search  
> > yields response:  
> > {"error":"SearchPhaseExecutionException[Failed to execute phase  
> > [query], all shards failed]","status":503}
> 
> How's the cluster's health? Anything interesting in the Elasticsearch  
> logs?
> 
> --  
> Magnus Bäck | Software Engineer, Development Tools  
> [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \<javascript:\> | Sony Mobile Communications

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6849f141-64f0-4a15-99ca-ba43192f7064%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6849f141-64f0-4a15-99ca-ba43192f7064%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![Kevin\_DeLand](https://avatars.discourse-cdn.com/v4/letter/k/7ea924/32.png) [@Kevin\_DeLand](https://discuss.elastic.co/u/Kevin_DeLand)
#### Post date: [September 12, 2014, 7:21am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/4 "2014-09-12T07:21:04Z")

</div>

Which logs should I look in?

From  
\*~/elasticsearch-1.3.1/logs/elasticsearch.log \*  
[2014-09-12 07:17:26,047][DEBUG][action.bulk] [Frankie and  
Victoria] observer: timeout notification from cluster service. timeout  
setting [1m], time since start [1m]  
[2014-09-12 07:18:04,466][DEBUG][action.search.type] [Frankie and  
Victoria] All shards failed for phase: [query]  
[2014-09-12 07:18:27,103][DEBUG][action.bulk] [Frankie and  
Victoria] observer: timeout notification from cluster service. timeout  
setting [1m], time since start [1m]  
[2014-09-12 07:18:27,103][DEBUG][action.bulk] [Frankie and  
Victoria] observer: timeout notification from cluster service. timeout  
setting [1m], time since start [1m]

On Friday, September 12, 2014 2:57:06 AM UTC-4, Magnus Bäck wrote:

> On Friday, September 12, 2014 at 08:53 CEST,  
> Kevin DeLand \<[kevin....@gmail.com](mailto:kevin....@gmail.com) \<javascript:\>\> wrote:
> 
> > Everything was working fine when all of a sudden some indices started  
> > failing.  
> > GET localhost:9200/logstash-2014.09.11/\_search  
> > yields response:  
> > {"error":"SearchPhaseExecutionException[Failed to execute phase  
> > [query], all shards failed]","status":503}
> 
> How's the cluster's health? Anything interesting in the Elasticsearch  
> logs?
> 
> --  
> Magnus Bäck | Software Engineer, Development Tools  
> [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \<javascript:\> | Sony Mobile Communications

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/06391bb2-2ab4-4168-9ced-0ebadd6f08ba%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/06391bb2-2ab4-4168-9ced-0ebadd6f08ba%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![Kevin\_DeLand](https://avatars.discourse-cdn.com/v4/letter/k/7ea924/32.png) [@Kevin\_DeLand](https://discuss.elastic.co/u/Kevin_DeLand)
#### Post date: [September 12, 2014, 7:31am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/5 "2014-09-12T07:31:29Z")

</div>

There are six indices with a red cluster status, but only two fail... any  
advice on what to check?

On Friday, September 12, 2014 2:57:06 AM UTC-4, Magnus Bäck wrote:

> On Friday, September 12, 2014 at 08:53 CEST,  
> Kevin DeLand \<[kevin....@gmail.com](mailto:kevin....@gmail.com) \<javascript:\>\> wrote:
> 
> > Everything was working fine when all of a sudden some indices started  
> > failing.  
> > GET localhost:9200/logstash-2014.09.11/\_search  
> > yields response:  
> > {"error":"SearchPhaseExecutionException[Failed to execute phase  
> > [query], all shards failed]","status":503}
> 
> How's the cluster's health? Anything interesting in the Elasticsearch  
> logs?
> 
> --  
> Magnus Bäck | Software Engineer, Development Tools  
> [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \<javascript:\> | Sony Mobile Communications

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4f70cae6-8155-40b7-b458-0e6687000ce7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4f70cae6-8155-40b7-b458-0e6687000ce7%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:02am UTC](https://discuss.elastic.co/t/some-indices-failing-with-searchphaseexecutionexception-failed-to-execute-phase-query-all-shards-failed/19749/6 "2017-07-06T01:02:51Z")

</div>


