# Slow down/throttle indexing

**URL:** <https://discuss.elastic.co/t/slow-down-throttle-indexing/63857>\
**Category:** Elasticsearch\
**Created:** [October 25, 2016, 10:53am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857 "2016-10-25T10:53:53Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![dwjvaughan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dwjvaughan/32/10648_2.png) [@dwjvaughan](https://discuss.elastic.co/u/dwjvaughan)\
**Post date:** [October 25, 2016, 10:53am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/1 "2016-10-25T10:53:53Z")

</div>

I have a 3 node (all data/master) cluster running version 2.3.1. Each day I build a new 70GB (includes 1 replica) index, switch an alias at the end and drop the old index. The issue I'm having is the build process is hurting search performance. It gets worse at the end when I re-enable refresh (set to -1 for build phase).

I'd like to be able to throttle the index so it won't impact searching so much. so far I've tried:

Setting the refresh to 30s so it's not one big hit at the end (helped a little)  
Playing with indices.store.throttle.max\_bytes\_per\_sec (and type=merge), didn't seem to make any difference)

Any ideas?

Many thanks

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 26, 2016, 10:02am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/2 "2016-10-26T10:02:53Z")

</div>

Those settings won't do anything in 2.X as throttling is automatic - [https://www.elastic.co/guide/en/logstash/current/event-dependent-configuration.html#conditionals](https://www.elastic.co/guide/en/logstash/current/event-dependent-configuration.html#conditionals)

How do you know it's throttling?

---

<div class="post-metadata">

**Author:** ![dwjvaughan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dwjvaughan/32/10648_2.png) [@dwjvaughan](https://discuss.elastic.co/u/dwjvaughan)\
**Post date:** [October 26, 2016, 10:24am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/3 "2016-10-26T10:24:09Z")

</div>

> Those settings won't do anything in 2.X as throttling is automatic

OK, that makes sense - not sure how the link you provided relates though (I don't use logstash)?

Changing the refresh rate to 30s throughout the build did seem to help, in that there was not a big refresh right at the end of the build where I was setting it back from -1 to 1s.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 26, 2016, 10:29am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/4 "2016-10-26T10:29:34Z")

</div>

Oh, wrong link ☹  
[https://www.elastic.co/guide/en/elasticsearch/reference/2.4/breaking\_20\_setting\_changes.html#\_merge\_and\_merge\_throttling\_settings](https://www.elastic.co/guide/en/elasticsearch/reference/2.4/breaking_20_setting_changes.html#_merge_and_merge_throttling_settings)

---

<div class="post-metadata">

**Author:** ![dwjvaughan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dwjvaughan/32/10648_2.png) [@dwjvaughan](https://discuss.elastic.co/u/dwjvaughan)\
**Post date:** [October 26, 2016, 10:37am UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/5 "2016-10-26T10:37:49Z")

</div>

🙂 thank you, that makes more sense. It looks like I'm not able to throttle this from the ES end. I guess I'll have to look at slowing it down from the source.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:09pm UTC](https://discuss.elastic.co/t/slow-down-throttle-indexing/63857/6 "2017-07-05T22:09:32Z")

</div>


