# Yellow cluster....why?

**URL:** <https://discuss.elastic.co/t/yellow-cluster-why/113941>\
**Category:** Elasticsearch\
**Created:** [January 3, 2018, 2:46pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941 "2018-01-03T14:46:32Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 2:46pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/1 "2018-01-03T14:46:32Z")

</div>

Hi all,  
my kibana monitoring says:

Elasticsearch cluster status is yellow. Allocate missing replica shards.

But all shards seems to be allocated:

GET \_cat/shards return taht all shards are started. Nothing else.  
How can i troubleshoot the problem????

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 2:51pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/2 "2018-01-03T14:51:13Z")

</div>

What do you see when running the following commands?

`curl localhost:9200/_cat/indices?v`  
`curl localhost:9200/_cat/shards?v`

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:06pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/3 "2018-01-03T15:06:28Z")

</div>

All indices started with 1p 1r 0r 0p  
All shards green with 2 pri and 1 rep, except for someone that has 1 pri 1 rep.

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:07pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/4 "2018-01-03T15:07:53Z")

</div>

Ok that means you have two shards per index with one replica each.  
And how many nodes are there in your cluster?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:09pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/5 "2018-01-03T15:09:10Z")

</div>

3 nodes..

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:10pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/6 "2018-01-03T15:10:28Z")

</div>

What do you get when running (please provide the full response)

`curl localhost:9200/_cluster/allocation/explain`

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:11pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/7 "2018-01-03T15:11:54Z")

</div>

> [@val](#):
>
> curl localhost:9200/\_cluster/allocation/explain

root@elastic01-test:~# curl localhost:9200/\_cluster/allocation/explain  
{"error":{"root\_cause":[{"type":"remote\_transport\_exception","reason":"[node3][172.16.0.6:9300][cluster:monitor/allocation/explain]"}],"type":"illegal\_argument\_exception","reason":"unable to find any unassigned shards to explain [ClusterAllocationExplainRequest[useAnyUnassignedShard=true,includeYesDecisions?=false]"},"status":400}

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:13pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/8 "2018-01-03T15:13:08Z")

</div>

Seems normal indeed. Can you restart/refresh Kibana, just in case?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:17pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/9 "2018-01-03T15:17:38Z")

</div>

Same warning..☹

Elasticsearch cluster status is yellow. Allocate missing replica shards.  
Last checked December 29, 2017 1:00:32 AM (since 5 days 15 hrs 16 min ago)

Also, in elastic logs in the indicated timestamp i have no error!!

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:20pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/10 "2018-01-03T15:20:36Z")

</div>

Are all nodes data nodes which can host data? or some of them are master nodes?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:23pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/11 "2018-01-03T15:23:50Z")

</div>

all data node and 1 of three is master node. All nodes are master node eligibles

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:26pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/12 "2018-01-03T15:26:32Z")

</div>

Do you happen to have XPack installed and system indices starting with a dot, i.e. `.monitoring-xyz`?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:28pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/13 "2018-01-03T15:28:17Z")

</div>

Yes i have:

green open .monitoring-es-6-2018.01.01 ejMYeHmaRSuvYYzYluMNPQ 2 1 1294130 11465 1.5gb 817.7mb  
green open .monitoring-alerts-6 b1pbQodrQYSh-WEoKfqyhg 1 1 2 0 26kb 13kb  
green open .monitoring-es-6-2018.01.03 9RJH4LRWTfa5UO\_77e3Z5Q 2 1 669263 10168 1gb 495.7mb  
green open .monitoring-es-6-2017.12.31 swfcIHxVROSU99dL0t6cfw 2 1 1304559 7312 1.5gb 811mb  
green open .monitoring-logstash-6-2018.01.01 tDk930glRGm1wbmxqrQ8jA 2 1 1603780 0 681.4mb 343.3mb  
green open .monitoring-logstash-6-2018.01.02 y0uGT989RkSnehiMM-sY4Q 2 1 1600912 0 669.1mb 337mb  
green open .monitoring-logstash-6-2017.12.30 fm9U7HYnQOOrLqywU4euDA 2 1 1600148 0 682.4mb 343.7mb  
green open .monitoring-kibana-6-2018.01.03 whu\_7bFTRI6W15V5gCaJbw 2 1 2614 0 1.4mb 772.6kb  
green open .monitoring-es-6-2018.01.02 ZRU2QCO3RxmMnrXxYgHeJg 2 1 1079885 13560 1.3gb 690.1mb  
green open .monitoring-es-6-2017.12.30 8QAagXYkT7SWyDglH1TMLA 2 1 1142098 99461 1.4gb 722.3mb  
green open .monitoring-logstash-6-2018.01.03 oLvlg5eRTLyNGMH-b6y4Rw 2 1 999777 0 419.7mb 207.8mb  
green open .monitoring-logstash-6-2017.12.31 VsJFlKQ8RP2P7VJDNCSPiA 2 1 1599258 0 678.6mb 335.8mb

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:29pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/14 "2018-01-03T15:29:19Z")

</div>

I still would like to see the full output of the `_cat/shards?v` call.

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:33pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/15 "2018-01-03T15:33:55Z")

</div>

Uploaded:  
[https://drive.google.com/file/d/1fPNYK9kY-gtPp5Gb412dEJXbGgyfFdnT/view?usp=sharing](https://drive.google.com/file/d/1fPNYK9kY-gtPp5Gb412dEJXbGgyfFdnT/view?usp=sharing)

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:48pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/16 "2018-01-03T15:48:33Z")

</div>

Can you screenshot what you see in Kibana under "Monitoring \> Elasticsearch \> Indices" (eventually check the "Show system indices" box).  
Do you see any yellow index? Do you see values \> 0 in the last column named "Unassigned shards"?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:50pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/17 "2018-01-03T15:50:40Z")

</div>

Hi have 20 pages and more.....  
but, no yellow index, all is green and no unassigned shards!!

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:52pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/18 "2018-01-03T15:52:40Z")

</div>

One more, can you show the result you get from `_cluster/health`?

---

<div class="post-metadata">

**Author:** ![sbampa](https://avatars.discourse-cdn.com/v4/letter/s/8e7dd6/32.png) [@sbampa](https://discuss.elastic.co/u/sbampa)\
**Post date:** [January 3, 2018, 3:54pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/19 "2018-01-03T15:54:34Z")

</div>

> [@val](#):
>
> \_cluster/health?

{"cluster\_name":"elk","status":"green","timed\_out":false,"number\_of\_nodes":3,"number\_of\_data\_nodes":3,"active\_primary\_shards":473,"active\_shards":946,"relocating\_shards":0,"initializing\_shards":0,"unassigned\_shards":0,"delayed\_unassigned\_shards":0,"number\_of\_pending\_tasks":0,"number\_of\_in\_flight\_fetch":0,"task\_max\_waiting\_in\_queue\_millis":0,"active\_shards\_percent\_as\_number":100.0}

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 3, 2018, 3:59pm UTC](https://discuss.elastic.co/t/yellow-cluster-why/113941/20 "2018-01-03T15:59:55Z")

</div>

Interesting one... And of course Kibana and ES have exactly the same version?

[Next page](https://discuss.elastic.co/t/yellow-cluster-why/113941.md?page=2)
