# Some of the data nodes not processing requests

**URL:** https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994
**Category:** Elasticsearch
**Created:** [June 27, 2016, 5:09am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994 "2016-06-27T05:09:03Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![prasadkgvs](https://avatars.discourse-cdn.com/v4/letter/p/f19dbf/32.png) [@prasadkgvs](https://discuss.elastic.co/u/prasadkgvs)
#### Post date: [June 27, 2016, 5:09am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/1 "2016-06-27T05:09:03Z")

</div>

Hi I am new to ElasticSerach. In our ElasticSearch cluster deployment we have total 12 nodes. Master-3, Data-7 and Client-3. During a load test we observed that out of 7 data nodes only 4 nodes participating and their CPU utilization reaching 100%. Other 3 nodes I am assuming not participating because their CPU utilization is negligible.

Our goal is to improve scalability of our application which uses ElasticSearch. Currently CPU utilization of ES data nodes hindering the scalability.

Please advice how to diagnose why 3 data nodes not participating in processing?

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [June 27, 2016, 5:38am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/2 "2016-06-27T05:38:39Z")

</div>

Are the indices you are indexing into and querying distributed evenly across all data nodes?

---

<div class="post-metadata">

### Author: ![prasadkgvs](https://avatars.discourse-cdn.com/v4/letter/p/f19dbf/32.png) [@prasadkgvs](https://discuss.elastic.co/u/prasadkgvs)
#### Post date: [June 27, 2016, 7:05am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/3 "2016-06-27T07:05:33Z")

</div>

How can I check?

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [June 27, 2016, 8:35am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/4 "2016-06-27T08:35:42Z")

</div>

You can get this information through the [\_cat/shards API](https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-shards.html).

---

<div class="post-metadata">

### Author: ![prasadkgvs](https://avatars.discourse-cdn.com/v4/letter/p/f19dbf/32.png) [@prasadkgvs](https://discuss.elastic.co/u/prasadkgvs)
#### Post date: [June 27, 2016, 8:58am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/5 "2016-06-27T08:58:31Z")

</div>

Thank you Christian, Here is the output

index shard prirep state docs store ip node  
core\_index\_production\_2 4 p STARTED 1672776 38.3gb 127.0.0.1 node1  
core\_index\_production\_2 0 p STARTED 1455556 28.8gb 127.0.0.1 node2  
core\_index\_production\_2 3 p STARTED 1468302 28.8gb 127.0.0.1 node3  
core\_index\_production\_2 1 p STARTED 1477667 29.1gb 127.0.0.1 node4  
core\_index\_production\_2 2 p STARTED 1665801 41.3gb 127.0.0.1 node5

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [June 27, 2016, 9:30am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/6 "2016-06-27T09:30:30Z")

</div>

Are you using routing or parent-child relationships that could cause some shards to receive more load than others? Are these the only shards in the cluster?

---

<div class="post-metadata">

### Author: ![prasadkgvs](https://avatars.discourse-cdn.com/v4/letter/p/f19dbf/32.png) [@prasadkgvs](https://discuss.elastic.co/u/prasadkgvs)
#### Post date: [June 27, 2016, 9:39am UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/7 "2016-06-27T09:39:52Z")

</div>

_Are you using routing or parent-child relationships that could cause some shards to receive more load than others?_  
No idea. Please share command for checking this.

_Are these the only shards in the cluster?_  
Complete output is as follows.

index shard prirep state docs store ip node  
core\_index\_production\_2 1 p STARTED 1477667 29.1gb 127.0.0.1 node1  
core\_index\_confirmation\_production 1 p STARTED 19 117.9kb 127.0.0.1 node1  
core\_index\_production\_2 4 p STARTED 1672776 38.3gb 127.0.0.1 node2  
core\_index\_invitation\_production 0 p STARTED 209 130.9kb 127.0.0.1 node2  
core\_index\_notification\_production 0 p STARTED 20 22.1kb 127.0.0.1 node2  
core\_index\_invitation\_production 3 p STARTED 192 132.1kb 127.0.0.1 node3  
core\_index\_notification\_production 2 p STARTED 11 14.8kb 127.0.0.1 node3  
core\_index\_confirmation\_production 0 p STARTED 23 20.5kb 127.0.0.1 node3  
core\_index\_production\_2 0 p STARTED 1455556 28.8gb 127.0.0.1 node4  
core\_index\_invitation\_production 2 p STARTED 235 167.9kb 127.0.0.1 node4  
core\_index\_confirmation\_production 3 p STARTED 23 116.5kb 127.0.0.1 node4  
core\_index\_invitation\_production 1 p STARTED 232 140.3kb 127.0.0.1 node5  
core\_index\_notification\_production 1 p STARTED 12 10.9kb 127.0.0.1 node5  
core\_index\_confirmation\_production 2 p STARTED 20 138.7kb 127.0.0.1 node5  
core\_index\_production\_2 3 p STARTED 1468302 28.8gb 127.0.0.1 node6  
core\_index\_notification\_production 4 p STARTED 12 18.3kb 127.0.0.1 node6  
core\_index\_confirmation\_production 4 p STARTED 15 111.8kb 127.0.0.1 node6  
core\_index\_production\_2 2 p STARTED 1665801 41.3gb 127.0.0.1 node7  
core\_index\_invitation\_production 4 p STARTED 219 139.5kb 127.0.0.1 node7  
core\_index\_notification\_production 3 p STARTED 14 19.6kb 127.0.0.1 node7

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 5, 2017, 10:40pm UTC](https://discuss.elastic.co/t/some-of-the-data-nodes-not-processing-requests/53994/8 "2017-07-05T22:40:20Z")

</div>


