# How to reduce thread-pool data rejection in elasticsearch cluster?

**URL:** <https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400>\
**Category:** Elasticsearch\
**Created:** [December 29, 2018, 7:51am UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400 "2018-12-29T07:51:57Z")\
**Posts on this page:** 5\
**Page:** 2

<div class="post-metadata">

**Author:** ![varun1992](https://avatars.discourse-cdn.com/v4/letter/v/3da27b/32.png) [@varun1992](https://discuss.elastic.co/u/varun1992)\
**Post date:** [December 31, 2018, 1:11pm UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400/21 "2018-12-31T13:11:35Z")

</div>

please help me to find out **_network.host_** settings

what should be the value of the **_network.host_**?

should i give public ip value or private ip value ?

i am having a confution in this settings. currently i gave

network.bind\_host =\> private ip value  
network.publish\_host =\> public ip value

is this ok

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [December 31, 2018, 1:19pm UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400/22 "2018-12-31T13:19:25Z")

</div>

What does that have to do with data rejection? Please open new questions in separate threads.

---

<div class="post-metadata">

**Author:** ![varun1992](https://avatars.discourse-cdn.com/v4/letter/v/3da27b/32.png) [@varun1992](https://discuss.elastic.co/u/varun1992)\
**Post date:** [December 31, 2018, 1:38pm UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400/23 "2018-12-31T13:38:22Z")

</div>

i configured logstash in cluster. everything is green . but sometimes i am getting

` **failed to send ping to #zen_unicast error** `

why is that ? when i check manually through browser all nodes were responding fine

---

<div class="post-metadata">

**Author:** ![jimyoo](https://avatars.discourse-cdn.com/v4/letter/j/53a042/32.png) [@jimyoo](https://discuss.elastic.co/u/jimyoo)\
**Post date:** [January 2, 2019, 7:21pm UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400/24 "2019-01-02T19:21:39Z")

</div>

I tested some heavy injections with tuning and those under helped. In my test case, injection rate was higher than yours and used high-end servers. You may need to find your own numbers by testing as Christian suggested.

- more core, memory and using SSD.
- increased refresh interval; I used 60 sec.
- maintained index size: \< 30GB per shard
- tuned index.translog.flush\_threshold\_size: I used 10G
- tuned bulk size (buffering before sending out to Elasticsearch): ~30MB
- To get these numbers: I pushed injection rate higher until I got rejections (429, Too many requests)

I didn’t use beats but it seems you can tune bulk size (buffering) in beats. For example,  
[https://www.elastic.co/guide/en/beats/packetbeat/6.2/configuring-internal-queue.html](https://www.elastic.co/guide/en/beats/packetbeat/6.2/configuring-internal-queue.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 7, 2019, 9:32am UTC](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400/26 "2019-02-07T09:32:32Z")

</div>

Closed on February 7, 2019, 9:32am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/how-to-reduce-thread-pool-data-rejection-in-elasticsearch-cluster/162400.md?page=1)