aws1 search 7 672 0
aws1 search 7 625 0
aws1 search 7 593 0
aws1 search 7 1000 53
aws1 search 7 620 0
aws1 search 7 614 0
aws1 search 7 671 0
aws1 search 7 1000 39
aws1 search 7 590 0
aws1 search 7 1000 30
aws1 search 6 0 0
aws1 search 7 1000 33
aws1 search 6 0 0
aws1 search 7 653 0
aws1 search 7 661 0
aws1 search 7 776 0
aws1 search 7 598 0
aws1 search 7 630 0
The above is the partial output from /_cat/thread_pool API
I see queues are in this state for the past hour , there is no traffic to ES.
I see this queue is never dequeued
one of node where the queue is full looks like this http://pastebin.com/kJsDwtGx
how do I figure out what is causing this?
is there a way flush the queue out when this happens?