# Node spikes to 1000 threads and hangs, once or twice a day. Help?
**URL:** https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895
**Category:** Elasticsearch
**Created:** [November 22, 2014, 5:51am UTC](https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895 "2014-11-22T05:51:31Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@Christopher\_Ambler\_2](https://discuss.elastic.co/u/Christopher_Ambler_2)
#### Post date: [November 22, 2014, 5:51am UTC](https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895/1 "2014-11-22T05:51:31Z")
Odd behavior - our 5-node cluster hums along happily but then, once or
twice a day, one node pops to all 1000 threads (the default limit) being
hit and the node becomes unresponsive, causing our whole cluster to become
extremely slow.
Has anyone experienced this? Any good way to diagnose this?
Memory and CPU appear normal, if that helps... I'm not even sure where to
start here.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@jprante](https://discuss.elastic.co/u/jprante)
#### Post date: [November 22, 2014, 3:13pm UTC](https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895/2 "2014-11-22T15:13:19Z")
Check the query logs. Maybe your site is crawled and you do not use
robots.txt
There is no default limit of 1000 threads, what are you talking about?
Jörg
On Sat, Nov 22, 2014 at 6:51 AM, Christopher Ambler \<
[const.dogberry@gmail.com](mailto:const.dogberry@gmail.com)\> wrote:
> Odd behavior - our 5-node cluster hums along happily but then, once or
> twice a day, one node pops to all 1000 threads (the default limit) being
> hit and the node becomes unresponsive, causing our whole cluster to become
> extremely slow.
>
> Has anyone experienced this? Any good way to diagnose this?
>
> Memory and CPU appear normal, if that helps... I'm not even sure where to
> start here.
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com)
> [https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0a92150b-ea74-410a-a5e1-8c9de24c461b%40googlegroups.com?utm_medium=email&utm_source=footer)
> .
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGH0JQAFp2YpTN-hHYmP3GV%3DqrXnts%3DNkfmOeDdnJcv2w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGH0JQAFp2YpTN-hHYmP3GV%3DqrXnts%3DNkfmOeDdnJcv2w%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@otisg](https://discuss.elastic.co/u/otisg)
#### Post date: [November 22, 2014, 4:29pm UTC](https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895/3 "2014-11-22T16:29:39Z")
Hi,
Look at query rates and see if they correlate. I'm guessing they jumped,
too. SPM [http://sematext.com/spm](http://sematext.com/spm) will help with that. Once you confirm
you can trace the source of queries further upstream.
## Otis
Monitoring \* Alerting \* Anomaly Detection \* Centralized Log Management
Solr & Elasticsearch Support \* [http://sematext.com/](http://sematext.com/)
On Saturday, November 22, 2014 12:51:31 AM UTC-5, Christopher Ambler wrote:
> Odd behavior - our 5-node cluster hums along happily but then, once or
> twice a day, one node pops to all 1000 threads (the default limit) being
> hit and the node becomes unresponsive, causing our whole cluster to become
> extremely slow.
>
> Has anyone experienced this? Any good way to diagnose this?
>
> Memory and CPU appear normal, if that helps... I'm not even sure where to
> start here.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0e9816ce-63da-4143-a1fa-7f939d4fc657%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0e9816ce-63da-4143-a1fa-7f939d4fc657%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 12:48am UTC](https://discuss.elastic.co/t/node-spikes-to-1000-threads-and-hangs-once-or-twice-a-day-help/20895/4 "2017-07-06T00:48:20Z")