# Thread pool queue size suddenly spikes to thousands

**URL:** https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176
**Category:** Elasticsearch
**Created:** [October 8, 2021, 4:06am UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176 "2021-10-08T04:06:18Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![vibgy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vibgy/32/95564_2.png) [@vibgy](https://discuss.elastic.co/u/vibgy)
#### Post date: [October 8, 2021, 4:06am UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/1 "2021-10-08T04:06:18Z")

</div>

Every once in a while, thread pool queue size suddenly spike to thousands

 ![Screen Shot 2021-10-07 at 9.02.01 PM](https://us1.discourse-cdn.com/elastic/original/3X/3/e/3ea1021e15ea00cbd5786b536c99bb91724f887e.png)

When this happens, users start to notice that kibana becomes pretty much unresponsive, for minutes. In the above case, it became unresponsive for about 20 minutes.

How do we debug and improve this? Any suggestions?

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [October 8, 2021, 6:16am UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/2 "2021-10-08T06:16:23Z")

</div>

Is there anything in the logs around that time that might correlate? Can you run the hot threads API when this happens to see what is going on? What is the specification of the cluster? Which version of Elasticsearch are you using?

---

<div class="post-metadata">

### Author: ![vibgy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vibgy/32/95564_2.png) [@vibgy](https://discuss.elastic.co/u/vibgy)
#### Post date: [October 8, 2021, 6:05pm UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/3 "2021-10-08T18:05:50Z")

</div>

We will try the hot threads API when this happens next. ES version is 7.10  
Cluster is running 15 data nodes with 10TB disks and is ingesting logs from a lot of backend services.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [October 8, 2021, 6:15pm UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/4 "2021-10-08T18:15:33Z")

</div>

What is the full output of the [cluster stats API](https://www.elastic.co/guide/en/elasticsearch/reference/7.15/cluster-stats.html)?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [October 10, 2021, 10:16pm UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/5 "2021-10-10T22:16:57Z")

</div>

7.10 is quite old, you should upgrade as 7.15 is latest.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 7, 2021, 10:17pm UTC](https://discuss.elastic.co/t/thread-pool-queue-size-suddenly-spikes-to-thousands/286176/6 "2021-11-07T22:17:09Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
