# Throttle messages arriving to elastic, in elastic?

**URL:** <https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909>\
**Category:** Elasticsearch\
**Created:** [September 25, 2020, 5:57am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909 "2020-09-25T05:57:54Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![AClerk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aclerk/32/55297_2.png) [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Post date:** [September 25, 2020, 5:57am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/1 "2020-09-25T05:57:55Z")

</div>

Hello All,  
Is there a way to throttle messages sent to elastic and indexing?  
I saw a document on how to [increase indexing speed](https://www.elastic.co/guide/en/elasticsearch/reference/current/tune-for-indexing-speed.html).  
Is there a way to decrease the index rate?  
For example, if elastic gets 1 million messages per second, it will crash. Is there a way to digest these million messages slowly and surely?  
Thanks!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 25, 2020, 6:03am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/2 "2020-09-25T06:03:24Z")

</div>

When overloaded Elasticsearch will start rejecting requests and it is up to the client sending requests to handle this and back off. There is no other rate limiting functionality built in as far as I know.

---

<div class="post-metadata">

**Author:** ![AClerk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aclerk/32/55297_2.png) [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Post date:** [September 25, 2020, 6:22am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/3 "2020-09-25T06:22:39Z")

</div>

Elastic will reject messages? Foe sure?  
Is there a way to know what is the index rate elastic is capable of?  
Thanks!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 25, 2020, 6:25am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/4 "2020-09-25T06:25:30Z")

</div>

> [@AClerk](#):
>
> Elastic will reject messages? Foe sure?

Yes, Elasticsearch has internal queues that are limited in size. Once these get exceeded (search or indexing requests), requests will be rejected.

> [@AClerk](#):
>
> Is there a way to know what is the index rate elastic is capable of?

That you will need to test because it depends on a large number of factors, e.g. index settings, hardware, data, mappings, sharding setup and the bulk size used.

---

<div class="post-metadata">

**Author:** ![AClerk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aclerk/32/55297_2.png) [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Post date:** [September 25, 2020, 6:28am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/5 "2020-09-25T06:28:41Z")

</div>

> [@Christian\_Dahlqvist](#):
>
> bulk size used.

This is set by the client, right?  
Any settings on elastic side I can configure?  
Thanks

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 25, 2020, 6:33am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/6 "2020-09-25T06:33:32Z")

</div>

> [@AClerk](#):
>
> This is set by the client, right?

Yes.

> [@AClerk](#):
>
> Any settings on elastic side I can configure?

Not really. The defaults are generally quite good. You can tune queue sizes, but that is an advanced feature and can lead to a greater risk of the nodes falling over.

---

<div class="post-metadata">

**Author:** ![AClerk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aclerk/32/55297_2.png) [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Post date:** [September 25, 2020, 6:35am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/7 "2020-09-25T06:35:07Z")

</div>

@Christian_Dahlqvist  
Thanks a lot!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 23, 2020, 6:35am UTC](https://discuss.elastic.co/t/throttle-messages-arriving-to-elastic-in-elastic/249909/8 "2020-10-23T06:35:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
