Threadpool setting notworking


(Huy Le) #1

Hi,

I tried to configure threadpool in elasticsearch.yml for ES 0.17.6, but it
fails to start up. Here is my setting:

threadpool:
search:
type: blocking
min: 5
max: 20
wait_time: 30s
keep_alive: 90s
index:
type: blocking
min: 3
max: 10
wait_time: 30s
keep_alive: 90s

When try to it start up, ES logged "creating thread_pool" over 100,000 times
like the following:

[2011-09-10 16:08:27,500][DEBUG][
threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]

Eventually it logged error:

[2011-09-10 16:09:04,753][ERROR][bootstrap ]
{elasticsearch/0.17.6}: Initialization Failed ...

  1. IllegalStateException[This is a proxy used to support circular references
    involving constructors. The object we're proxying is not constructed yet.
    Please wait until after injection has completed to use this object.]2)
    IllegalArgumentException[null]

Am I missing something in the config?

Thanks!

Huy


(Huy Le) #2

It looks like the issue is with "blocking" type. Changing type to
"fixed" it worked fine. The following setting works:

threadpool:
index:
type: fixed
size: 50
search:
type: fixed
size: 500

Huy

On Sep 10, 12:21 pm, Huy Le hu...@leveragingit.com wrote:

Hi,

I tried to configure threadpool in elasticsearch.yml for ES 0.17.6, but it
fails to start up. Here is my setting:

threadpool:
search:
type: blocking
min: 5
max: 20
wait_time: 30s
keep_alive: 90s
index:
type: blocking
min: 3
max: 10
wait_time: 30s
keep_alive: 90s

When try to it start up, ES logged "creating thread_pool" over 100,000 times
like the following:

[2011-09-10 16:08:27,500][DEBUG][
threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]

Eventually it logged error:

[2011-09-10 16:09:04,753][ERROR][bootstrap ]
{elasticsearch/0.17.6}: Initialization Failed ...

  1. IllegalStateException[This is a proxy used to support circular references
    involving constructors. The object we're proxying is not constructed yet.
    Please wait until after injection has completed to use this object.]2)
    IllegalArgumentException[null]

Am I missing something in the config?

Thanks!

Huy


(Shay Banon) #3

heya, yea, its a bug, fixed here:
https://github.com/elasticsearch/elasticsearch/issues/1321. Will be part of
0.17.7, which will have more options to thread pool config. Once 0.17.7 is
out, I will also properly document all the different thread pool options and
what they mean.

On Sat, Sep 10, 2011 at 7:33 PM, Huy Le huyle@leveragingit.com wrote:

It looks like the issue is with "blocking" type. Changing type to
"fixed" it worked fine. The following setting works:

threadpool:
index:
type: fixed
size: 50
search:
type: fixed
size: 500

Huy

On Sep 10, 12:21 pm, Huy Le hu...@leveragingit.com wrote:

Hi,

I tried to configure threadpool in elasticsearch.yml for ES 0.17.6, but
it
fails to start up. Here is my setting:

threadpool:
search:
type: blocking
min: 5
max: 20
wait_time: 30s
keep_alive: 90s
index:
type: blocking
min: 3
max: 10
wait_time: 30s
keep_alive: 90s

When try to it start up, ES logged "creating thread_pool" over 100,000
times
like the following:

[2011-09-10 16:08:27,500][DEBUG][
threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [cached], type [cached], keep_alive [30s]
[2011-09-10 16:08:27,500][DEBUG][threadpool ] [staging-ss5]
creating thread_pool [index], type [blocking], min [3], size [10],
keep_alive [1.5m], wait_time [30s]

Eventually it logged error:

[2011-09-10 16:09:04,753][ERROR][bootstrap ]
{elasticsearch/0.17.6}: Initialization Failed ...

  1. IllegalStateException[This is a proxy used to support circular
    references
    involving constructors. The object we're proxying is not constructed yet.
    Please wait until after injection has completed to use this object.]2)
    IllegalArgumentException[null]

Am I missing something in the config?

Thanks!

Huy


(system) #4