So, I am seeing interesting metrics that don't really make much sense to me. Given I'm using the datadog integration that tells me these details, but they seem accurate with everything else so I have confidence in the numbers. Anyway, I am seeing a case where the number of active search threads by host doesn't exceed 2 threads, and yet I have the search thread queue increasing over 1. From my understanding the search thread queue is only there to act as a buffer so that large querying can simply slow down and not outright fail. Am I misunderstanding this in the documentation?
The queue_size allows to control the initial size of the queue of pending requests that have no threads to execute them