Server keeps creating threads even though using fixed threadpool in config


(Xavier Stevens) #1

We're using ES 0.17.9 and it seems that the server keeps creating more
and more threads in the index pool. What is the default number of
fixed threads?

I grabbed this from YourKit which shows that most of them are all
waiting on a lock in the queue.

http://xstevens.pastebin.mozilla.org/1365860


(Shay Banon) #2

Can you gist your config of the thread pool? You can set threadpool to
DEBUG in the logging file, and see which threads pools get created, types,
and sizes.

On Thu, Oct 27, 2011 at 8:04 PM, Xavier xavier.stevens@gmail.com wrote:

We're using ES 0.17.9 and it seems that the server keeps creating more
and more threads in the index pool. What is the default number of
fixed threads?

I grabbed this from YourKit which shows that most of them are all
waiting on a lock in the queue.

http://xstevens.pastebin.mozilla.org/1365860


(Xavier Stevens) #3

Here's our config:

http://xstevens.pastebin.mozilla.org/1365875

We don't specify specific sizes currently.

-Xavier

On Oct 27, 11:22 am, Shay Banon kim...@gmail.com wrote:

Can you gist your config of the thread pool? You can set threadpool to
DEBUG in the logging file, and see which threads pools get created, types,
and sizes.

On Thu, Oct 27, 2011 at 8:04 PM, Xavier xavier.stev...@gmail.com wrote:

We're using ES 0.17.9 and it seems that the server keeps creating more
and more threads in the index pool. What is the default number of
fixed threads?

I grabbed this from YourKit which shows that most of them are all
waiting on a lock in the queue.

http://xstevens.pastebin.mozilla.org/1365860


(Shay Banon) #4

The default size for a fixed thread pool is the number of available
processors * 5. You can see what exact value it uses by changing the logging
that I mentioned before.

On Thu, Oct 27, 2011 at 8:30 PM, Xavier xavier.stevens@gmail.com wrote:

Here's our config:

http://xstevens.pastebin.mozilla.org/1365875

We don't specify specific sizes currently.

-Xavier

On Oct 27, 11:22 am, Shay Banon kim...@gmail.com wrote:

Can you gist your config of the thread pool? You can set threadpool to
DEBUG in the logging file, and see which threads pools get created,
types,
and sizes.

On Thu, Oct 27, 2011 at 8:04 PM, Xavier xavier.stev...@gmail.com
wrote:

We're using ES 0.17.9 and it seems that the server keeps creating more
and more threads in the index pool. What is the default number of
fixed threads?

I grabbed this from YourKit which shows that most of them are all
waiting on a lock in the queue.

http://xstevens.pastebin.mozilla.org/1365860


(Xavier Stevens) #5

That's makes sense then. Thanks!

On Oct 27, 11:58 am, Shay Banon kim...@gmail.com wrote:

The default size for a fixed thread pool is the number of available
processors * 5. You can see what exact value it uses by changing the logging
that I mentioned before.

On Thu, Oct 27, 2011 at 8:30 PM, Xavier xavier.stev...@gmail.com wrote:

Here's our config:

http://xstevens.pastebin.mozilla.org/1365875

We don't specify specific sizes currently.

-Xavier

On Oct 27, 11:22 am, Shay Banon kim...@gmail.com wrote:

Can you gist your config of the thread pool? You can set threadpool to
DEBUG in the logging file, and see which threads pools get created,
types,
and sizes.

On Thu, Oct 27, 2011 at 8:04 PM, Xavier xavier.stev...@gmail.com
wrote:

We're using ES 0.17.9 and it seems that the server keeps creating more
and more threads in the index pool. What is the default number of
fixed threads?

I grabbed this from YourKit which shows that most of them are all
waiting on a lock in the queue.

http://xstevens.pastebin.mozilla.org/1365860


(system) #6