# How to control load on ES nodes

**URL:** <https://discuss.elastic.co/t/how-to-control-load-on-es-nodes/12731>\
**Category:** Elasticsearch\
**Created:** [July 9, 2013, 11:38pm UTC](https://discuss.elastic.co/t/how-to-control-load-on-es-nodes/12731 "2013-07-09T23:38:58Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![MJR\_M](https://avatars.discourse-cdn.com/v4/letter/m/8c91f0/32.png) [@MJR\_M](https://discuss.elastic.co/u/MJR_M)\
**Post date:** [July 9, 2013, 11:38pm UTC](https://discuss.elastic.co/t/how-to-control-load-on-es-nodes/12731/1 "2013-07-09T23:38:58Z")

</div>

Hi

```
 In our prod ES cluster, we have 5 nodes and I have to re-index all the 

```

documents. I am doing bulk indexing through river, and while doing this  
load on ES nodes increase to 10 - 15+, and obviously this slows down the  
search. Can anyone suggest what should I do in order to bulk index through  
river and at the same time keep the load on nodes under control. I have to  
re-index 50 million documents.

Regards  
mjr

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![radu\_gheorghe](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/radu_gheorghe/32/556_2.png) [@radu\_gheorghe](https://discuss.elastic.co/u/radu_gheorghe)\
**Post date:** [July 10, 2013, 8:32am UTC](https://discuss.elastic.co/t/how-to-control-load-on-es-nodes/12731/2 "2013-07-10T08:32:13Z")

</div>

Hello,

Here are a few things I would try:

- decrease the number of bulk threads from the  
threadpool[http://www.elasticsearch.org/guide/reference/modules/threadpool/](http://www.elasticsearch.org/guide/reference/modules/threadpool/)
- make bulk requests smaller
- if you can change the river code, you can lower the number of concurrent  
bulk requests[https://github.com/elasticsearch/elasticsearch/blob/master/src/main/java/org/elasticsearch/action/bulk/BulkProcessor.java#L105](https://github.com/elasticsearch/elasticsearch/blob/master/src/main/java/org/elasticsearch/action/bulk/BulkProcessor.java#L105)from  
the default 1 to 0
- increase the refresh\_interval
- use store throttling[http://www.elasticsearch.org/guide/reference/index-modules/store/](http://www.elasticsearch.org/guide/reference/index-modules/store/),  
in case the I/O caused by merges hurts
- increase index buffer  
size[http://www.elasticsearch.org/guide/reference/modules/indices/](http://www.elasticsearch.org/guide/reference/modules/indices/)-  
that should make it more gentle to I/O, in exchange for some memory

Best regards,  
Radu

On Wed, Jul 10, 2013 at 2:38 AM, MJR M [emjayaarr@gmail.com](mailto:emjayaarr@gmail.com) wrote:

> Hi
> 
> ```
> In our prod ES cluster, we have 5 nodes and I have to re-index all
> 
> ```
> 
> the documents. I am doing bulk indexing through river, and while doing this  
> load on ES nodes increase to 10 - 15+, and obviously this slows down the  
> search. Can anyone suggest what should I do in order to bulk index through  
> river and at the same time keep the load on nodes under control. I have to  
> re-index 50 million documents.
> 
> Regards  
> mjr
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
[http://sematext.com/](http://sematext.com/) -- Elasticsearch -- Solr -- Lucene

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:27am UTC](https://discuss.elastic.co/t/how-to-control-load-on-es-nodes/12731/3 "2017-07-06T02:27:18Z")

</div>


