# Asymmetric server load in a 2 node 1-replica cluster

**URL:** <https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381>\
**Category:** Elasticsearch\
**Created:** [October 16, 2012, 3:16pm UTC](https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381 "2012-10-16T15:16:01Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![T\_Vinod\_Gupta](https://avatars.discourse-cdn.com/v4/letter/t/fbc32d/32.png) [@T\_Vinod\_Gupta](https://discuss.elastic.co/u/T_Vinod_Gupta)\
**Post date:** [October 16, 2012, 3:16pm UTC](https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381/1 "2012-10-16T15:16:01Z")

</div>

hi,  
i have a 2 node ES cluster with identical hosts.. the only difference is  
that they are in different AZs in aws and one is using ebs instead of  
ephemeral store. i have a replica setting of 1 (so 2 copies). the problem  
im seeing is that the ebs based node is pegging the cpu.. there is nothing  
else running on that host. bigdesk indicates that there are 137k file  
descriptors on this one vs 3k on the ephemeral one. number of threads in  
hot host is more than twice of the cold one. used heap is also higher in  
hot host. they both are started with same max heap of 8gb.

any ideas on what could be going on?

thanks

--

---

<div class="post-metadata">

**Author:** ![ppearcy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ppearcy/32/980_2.png) [@ppearcy](https://discuss.elastic.co/u/ppearcy)\
**Post date:** [October 16, 2012, 5:43pm UTC](https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381/2 "2012-10-16T17:43:22Z")

</div>

If you're running searches, are you setting any shard preference options on  
the search side?

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

If you're setting primary or primary\_first that could cause  
it. Alternatively, if you're setting local, but requests aren't round  
robined, that could also account for it.

The file descriptor count is very odd. I have no explanation for what is  
causing that. I'd recommend moving to a common config to see if that sheds  
any light on things.

Best Regards,  
Paul

On Tuesday, October 16, 2012 9:16:09 AM UTC-6, T Vinod Gupta wrote:

> hi,  
> i have a 2 node ES cluster with identical hosts.. the only difference is  
> that they are in different AZs in aws and one is using ebs instead of  
> ephemeral store. i have a replica setting of 1 (so 2 copies). the problem  
> im seeing is that the ebs based node is pegging the cpu.. there is nothing  
> else running on that host. bigdesk indicates that there are 137k file  
> descriptors on this one vs 3k on the ephemeral one. number of threads in  
> hot host is more than twice of the cold one. used heap is also higher in  
> hot host. they both are started with same max heap of 8gb.
> 
> any ideas on what could be going on?
> 
> thanks

--

---

<div class="post-metadata">

**Author:** ![T\_Vinod\_Gupta](https://avatars.discourse-cdn.com/v4/letter/t/fbc32d/32.png) [@T\_Vinod\_Gupta](https://discuss.elastic.co/u/T_Vinod_Gupta)\
**Post date:** [October 16, 2012, 5:45pm UTC](https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381/3 "2012-10-16T17:45:46Z")

</div>

im not setting any shard preferences.. both configs are identical.  
also, i have a load balancer node in front of these 2 hosts. the LB is  
configured with no-data setting. all searches and index calls go through  
the LB. nobody calls the hosts behind it directly.

does that change your answer?

thanks

On Tue, Oct 16, 2012 at 10:43 AM, ppearcy [ppearcy@gmail.com](mailto:ppearcy@gmail.com) wrote:

> If you're running searches, are you setting any shard preference options  
> on the search side?  
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/api/search/preference.html)
> 
> If you're setting primary or primary\_first that could cause  
> it. Alternatively, if you're setting local, but requests aren't round  
> robined, that could also account for it.
> 
> The file descriptor count is very odd. I have no explanation for what is  
> causing that. I'd recommend moving to a common config to see if that sheds  
> any light on things.
> 
> Best Regards,  
> Paul
> 
> On Tuesday, October 16, 2012 9:16:09 AM UTC-6, T Vinod Gupta wrote:
> 
> > hi,  
> > i have a 2 node ES cluster with identical hosts.. the only difference is  
> > that they are in different AZs in aws and one is using ebs instead of  
> > ephemeral store. i have a replica setting of 1 (so 2 copies). the problem  
> > im seeing is that the ebs based node is pegging the cpu.. there is nothing  
> > else running on that host. bigdesk indicates that there are 137k file  
> > descriptors on this one vs 3k on the ephemeral one. number of threads in  
> > hot host is more than twice of the cold one. used heap is also higher in  
> > hot host. they both are started with same max heap of 8gb.
> > 
> > any ideas on what could be going on?
> > 
> > thanks
> 
> --

--

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:08am UTC](https://discuss.elastic.co/t/asymmetric-server-load-in-a-2-node-1-replica-cluster/9381/4 "2017-07-06T03:08:27Z")

</div>

Closed on July 6, 2017, 3:08am UTC


