# Add non existing settings in cluster settings in elasticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [March 28, 2015, 3:09pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961 "2015-03-28T15:09:13Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Ayman](https://avatars.discourse-cdn.com/v4/letter/a/dec6dc/32.png) [@Ayman](https://discuss.elastic.co/u/Ayman)\ **Post date:** [March 28, 2015, 3:09pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/1 "2015-03-28T15:09:13Z")
Hi there, Recently i have built elasticsearch with fluentd and Kibana and all is working fine, but we are facing high cpu load while performing search caused by java. I have 60 GB Ram and 16 processors and each processor has 2 cores. ES\_HEAP\_SIZE=32g -find below more details curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" search.rejected 387 curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" index.rejected 0 - snapshot from elasticsearch.log [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard [true] org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: rejected execution (queue capacity 1000) on org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f at org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) at org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:551) at org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:228) at org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) Now i read that i have to update the threadpool settings in ES and i have now curl -XGET localhost:9200/\_cluster/settings?pretty { "persistent" : { }, "transient" : { } } i'm trying to update the settings with the below commands curl -XPUT localhost:9200/\_cluster/settings -d '{ "threadpool" : { "index": { "type": "fixed", "size": 32, "queue\_size": 1000 }, "bulk": { "type": "fixed", "size": 32, "queue\_size": 1000 }, "search": { "type": "fixed", "size": 96, "queue\_size": 1000 } } }' but i keep getting {"error":"ActionRequestValidationException[Validation Failed: 1: no settings to update;]","status":400} What's wrong with this command? is it the right solution for my issue ? Please advise Thanks. Ayman ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 29, 2015, 8:44pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/2 "2015-03-29T20:44:00Z")
You should drop your heap to 31GB, look for java pointer compression if you want to know more. If your threadpools are filling up then your node is overloaded and you need more nodes. Take a look at > **[Don’t Touch These Settings! | Elasticsearch: The Definitive Guide \[2.x\] |...](https://www.elastic.co/guide/en/elasticsearch/guide/current/_don_8217_t_touch_these_settings.html#_threadpools)** On 29 March 2015 at 02:09, Ayman [aymanshorman@gmail.com](mailto:aymanshorman@gmail.com) wrote: > Hi there, > > Recently i have built elasticsearch with fluentd and Kibana and all is > working fine, but we are facing high cpu load while performing search > caused > by java. > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > ES\_HEAP\_SIZE=32g > -find below more details > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > search.rejected > 387 > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > index.rejected > 0 > > - snapshot from elasticsearch.log > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard [true] > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > rejected execution (queue capacity 1000) on > org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f > at > > org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) > at > java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) > at > > java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) > at > > org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:551) > at > > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:228) > at > > org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > at > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > Now i read that i have to update the threadpool settings in ES and i have > now > curl -XGET localhost:9200/\_cluster/settings?pretty > { > "persistent" : { }, > "transient" : { } > } > > i'm trying to update the settings with the below commands > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > "threadpool" : { > "index": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "bulk": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "search": { > "type": "fixed", > "size": 96, > "queue\_size": 1000 > } > } > }' > > but i keep getting {"error":"ActionRequestValidationException[Validation > Failed: 1: no settings to update;]","status":400} > > What's wrong with this command? is it the right solution for my issue ? > > Please advise > > Thanks. > > Ayman > > -- > View this message in context: > [http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html](http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html) > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com](https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9ZJm\_iXOA7%2B83EsLsoE7%2Bk%3DUg1rMWnY\_fa2it\_BNuePw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9ZJm_iXOA7%2B83EsLsoE7%2Bk%3DUg1rMWnY_fa2it_BNuePw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Ayman](https://avatars.discourse-cdn.com/v4/letter/a/dec6dc/32.png) [@Ayman](https://discuss.elastic.co/u/Ayman)\ **Post date:** [April 5, 2015, 2:04pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/3 "2015-04-05T14:04:19Z")
I dropped the HEAP size to 31g as per your recommendation but i still have issues. Sorry i'm newbie to elasticsearch can you please guide me to add new node without losing the current indexed data? I have attached screenshot from my cluster. I'm having high load when trying to execute a bulk of queries On Sunday, March 29, 2015 at 10:15:27 AM UTC+3, Ayman Shorman wrote: > Hi there, > > Recently i have built elasticsearch with fluentd and Kibana and all is > working fine, but we are facing high cpu load while performing search > caused > by java. > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > ES\_HEAP\_SIZE=32g > -find below more details > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > search.rejected > 387 > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > index.rejected > 0 > > - snapshot from elasticsearch.log > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard [true] > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > rejected execution (queue capacity 1000) on > org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f > at > org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) > > ``` > at > > ``` > > java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) > > ``` > at > > ``` > > java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) > > ``` > at > > ``` > > org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:551) > > ``` > at > > ``` > > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:228) > > ``` > at > > ``` > > org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > > ``` > at > > ``` > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > Now i read that i have to update the threadpool settings in ES and i have > now > curl -XGET localhost:9200/\_cluster/settings?pretty > { > "persistent" : { }, > "transient" : { } > } > > i'm trying to update the settings with the below commands > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > "threadpool" : { > "index": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "bulk": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "search": { > "type": "fixed", > "size": 96, > "queue\_size": 1000 > } > } > }' > > but i keep getting {"error":"ActionRequestValidationException[Validation > Failed: 1: no settings to update;]","status":400} > > What's wrong with this command? is it the right solution for my issue ? > > Please advise > > Thanks. > > Ayman > > -- > View this message in context: > [http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html](http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html) > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8559b221-233e-40cd-838e-2feb2163b2f3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8559b221-233e-40cd-838e-2feb2163b2f3%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 6, 2015, 12:18am UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/4 "2015-04-06T00:18:00Z")
What version are you on, what OS, what java version and release, how much data do you have in the cluster, how are you monitoring the cluster? On 29 March 2015 at 02:09, Ayman [aymanshorman@gmail.com](mailto:aymanshorman@gmail.com) wrote: > Hi there, > > Recently i have built elasticsearch with fluentd and Kibana and all is > working fine, but we are facing high cpu load while performing search > caused > by java. > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > ES\_HEAP\_SIZE=32g > -find below more details > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > search.rejected > 387 > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > index.rejected > 0 > > - snapshot from elasticsearch.log > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard [true] > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > rejected execution (queue capacity 1000) on > org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f > at > > org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) > at > java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) > at > > java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) > at > > org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:551) > at > > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:228) > at > > org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > at > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > Now i read that i have to update the threadpool settings in ES and i have > now > curl -XGET localhost:9200/\_cluster/settings?pretty > { > "persistent" : { }, > "transient" : { } > } > > i'm trying to update the settings with the below commands > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > "threadpool" : { > "index": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "bulk": { > "type": "fixed", > "size": 32, > "queue\_size": 1000 > }, > "search": { > "type": "fixed", > "size": 96, > "queue\_size": 1000 > } > } > }' > > but i keep getting {"error":"ActionRequestValidationException[Validation > Failed: 1: no settings to update;]","status":400} > > What's wrong with this command? is it the right solution for my issue ? > > Please advise > > Thanks. > > Ayman > > -- > View this message in context: > [http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html](http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html) > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com](https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9R%2BrbcZDyvTLZu3fe6W20%3DQnzFmoXLa7dgP%2BXrJDV9Aw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9R%2BrbcZDyvTLZu3fe6W20%3DQnzFmoXLa7dgP%2BXrJDV9Aw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Ayman](https://avatars.discourse-cdn.com/v4/letter/a/dec6dc/32.png) [@Ayman](https://discuss.elastic.co/u/Ayman)\ **Post date:** [April 6, 2015, 9:17am UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/5 "2015-04-06T09:17:12Z")
- OS: Linux - Redhat 5.2 - Elasticsearch version: 1.4.4 - Java: 1.7.0\_75 - Data: i have now around 200GB, around 5 ~ 7 GB daily. - I'm using Kibana 4 - I have 60GB RAM 30GB as HEAP size. On Monday, April 6, 2015 at 3:18:28 AM UTC+3, Mark Walkom wrote: > What version are you on, what OS, what java version and release, how much > data do you have in the cluster, how are you monitoring the cluster? > > On 29 March 2015 at 02:09, Ayman \<[aymans...@gmail.com](mailto:aymans...@gmail.com) \\> > wrote: > > > Hi there, > > > > Recently i have built elasticsearch with fluentd and Kibana and all is > > working fine, but we are facing high cpu load while performing search > > caused > > by java. > > > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > > > ES\_HEAP\_SIZE=32g > > -find below more details > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > > search.rejected > > 387 > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > > index.rejected > > 0 > > > > - snapshot from elasticsearch.log > > > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard [true] > > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > > rejected execution (queue capacity 1000) on > > org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f > > at > > > > org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) > > at > > > > java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) > > at > > > > java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) > > at > > > > org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:551) > > at > > > > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:228) > > at > > > > org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > > at > > > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > > > Now i read that i have to update the threadpool settings in ES and i have > > now > > curl -XGET localhost:9200/\_cluster/settings?pretty > > { > > "persistent" : { }, > > "transient" : { } > > } > > > > i'm trying to update the settings with the below commands > > > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > > > "threadpool" : { > > "index": { > > "type": "fixed", > > "size": 32, > > "queue\_size": 1000 > > }, > > "bulk": { > > "type": "fixed", > > "size": 32, > > "queue\_size": 1000 > > }, > > "search": { > > "type": "fixed", > > "size": 96, > > "queue\_size": 1000 > > } > > } > > }' > > > > but i keep getting {"error":"ActionRequestValidationException[Validation > > Failed: 1: no settings to update;]","status":400} > > > > What's wrong with this command? is it the right solution for my issue ? > > > > Please advise > > > > Thanks. > > > > Ayman > > > > -- > > View this message in context: > > [http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html](http://elasticsearch-users.115913.n3.nabble.com/Add-non-existing-settings-in-cluster-settings-in-elasticsearch-tp4072768.html) > > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com](https://groups.google.com/d/msgid/elasticsearch/1427555353485-4072768.post%40n3.nabble.com) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 6, 2015, 9:08pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/6 "2015-04-06T21:08:44Z")
And how are you monitoring the cluster? That part is important as you need to find out what is putting pressure on your system to start backing up the queue. On 6 April 2015 at 19:17, Ayman Shorman [aymanshorman@gmail.com](mailto:aymanshorman@gmail.com) wrote: > - OS: Linux - Redhat 5.2 > - Elasticsearch version: 1.4.4 > - Java: 1.7.0\_75 > - Data: i have now around 200GB, around 5 ~ 7 GB daily. > - I'm using Kibana 4 > - I have 60GB RAM 30GB as HEAP size. > > On Monday, April 6, 2015 at 3:18:28 AM UTC+3, Mark Walkom wrote: > > > What version are you on, what OS, what java version and release, how much > > data do you have in the cluster, how are you monitoring the cluster? > > > > On 29 March 2015 at 02:09, Ayman [aymans...@gmail.com](mailto:aymans...@gmail.com) wrote: > > > > > Hi there, > > > > > > Recently i have built elasticsearch with fluentd and Kibana and all is > > > working fine, but we are facing high cpu load while performing search > > > caused > > > by java. > > > > > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > > > > > ES\_HEAP\_SIZE=32g > > > -find below more details > > > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > > > search.rejected > > > 387 > > > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > > > index.rejected > > > 0 > > > > > > - snapshot from elasticsearch.log > > > > > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > > > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > > > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard > > > [true] > > > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > > > rejected execution (queue capacity 1000) on > > > org.elasticsearch.search.action.SearchServiceTransportAction$23@1d7c9f0f > > > at > > > org.elasticsearch.common.util.concurrent.EsAbortPolicy. > > > rejectedExecution(EsAbortPolicy.java:62) > > > at > > > java.util.concurrent.ThreadPoolExecutor.reject( > > > ThreadPoolExecutor.java:821) > > > at > > > java.util.concurrent.ThreadPoolExecutor.execute( > > > ThreadPoolExecutor.java:1372) > > > at > > > org.elasticsearch.search.action.SearchServiceTransportAction.execute( > > > SearchServiceTransportAction.java:551) > > > at > > > org.elasticsearch.search.action.SearchServiceTransportAction. > > > sendExecuteQuery(SearchServiceTransportAction.java:228) > > > at > > > org.elasticsearch.action.search.type.TransportSearchCountAction$ > > > AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > > > at > > > org.elasticsearch.action.search.type.TransportSearchTypeAction$ > > > BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > > > > > Now i read that i have to update the threadpool settings in ES and i have > > > now > > > curl -XGET localhost:9200/\_cluster/settings?pretty > > > { > > > "persistent" : { }, > > > "transient" : { } > > > } > > > > > > i'm trying to update the settings with the below commands > > > > > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > > > > > "threadpool" : { > > > "index": { > > > "type": "fixed", > > > "size": 32, > > > "queue\_size": 1000 > > > }, > > > "bulk": { > > > "type": "fixed", > > > "size": 32, > > > "queue\_size": 1000 > > > }, > > > "search": { > > > "type": "fixed", > > > "size": 96, > > > "queue\_size": 1000 > > > } > > > } > > > }' > > > > > > but i keep getting {"error":"ActionRequestValidationException[Validation > > > Failed: 1: no settings to update;]","status":400} > > > > > > What's wrong with this command? is it the right solution for my issue ? > > > > > > Please advise > > > > > > Thanks. > > > > > > Ayman > > > > > > -- > > > View this message in context: [http://elasticsearch-users](http://elasticsearch-users). > > > [115913.n3.nabble.com/Add-non-existing-settings-in-cluster-](http://115913.n3.nabble.com/Add-non-existing-settings-in-cluster-) > > > settings-in-elasticsearch-tp4072768.html > > > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/1427555353485-4072768.post%[40n3.nabble.com](http://40n3.nabble.com). > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X84JXHUzm6FnBpsDPcuA%3DE6s7%3DharD442gmbn\_Ln%3DMbyw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X84JXHUzm6FnBpsDPcuA%3DE6s7%3DharD442gmbn_Ln%3DMbyw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Ayman](https://avatars.discourse-cdn.com/v4/letter/a/dec6dc/32.png) [@Ayman](https://discuss.elastic.co/u/Ayman)\ **Post date:** [April 6, 2015, 10:03pm UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/7 "2015-04-06T22:03:01Z")
Hi Mark, Not sure what do you mean, but i use elasticsearch-head plugin. On Tuesday, April 7, 2015 at 12:09:16 AM UTC+3, Mark Walkom wrote: > And how are you monitoring the cluster? > That part is important as you need to find out what is putting pressure on > your system to start backing up the queue. > > On 6 April 2015 at 19:17, Ayman Shorman \<[aymans...@gmail.com](mailto:aymans...@gmail.com) \ > > > wrote: > > > - OS: Linux - Redhat 5.2 > > - Elasticsearch version: 1.4.4 > > - Java: 1.7.0\_75 > > - Data: i have now around 200GB, around 5 ~ 7 GB daily. > > - I'm using Kibana 4 > > - I have 60GB RAM 30GB as HEAP size. > > > > On Monday, April 6, 2015 at 3:18:28 AM UTC+3, Mark Walkom wrote: > > > > > What version are you on, what OS, what java version and release, how > > > much data do you have in the cluster, how are you monitoring the cluster? > > > > > > On 29 March 2015 at 02:09, Ayman [aymans...@gmail.com](mailto:aymans...@gmail.com) wrote: > > > > > > > Hi there, > > > > > > > > Recently i have built elasticsearch with fluentd and Kibana and all is > > > > working fine, but we are facing high cpu load while performing search > > > > caused > > > > by java. > > > > > > > > I have 60 GB Ram and 16 processors and each processor has 2 cores. > > > > > > > > ES\_HEAP\_SIZE=32g > > > > -find below more details > > > > > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=search.rejected" > > > > search.rejected > > > > 387 > > > > > > > > curl "localhost:9200/\_cat/thread\_pool?v&h=index.rejected" > > > > index.rejected > > > > 0 > > > > > > > > - snapshot from elasticsearch.log > > > > > > > > [DEBUG][action.search.type] [Hulk 2099] [logstash-2015.03.14][4], > > > > node[qxcAN3lURs65Lf1GMhB\_qg], [P], s[STARTED]: Failed to execute > > > > [org.elasticsearch.action.search.SearchRequest@7c71025f] lastShard > > > > [true] > > > > org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: > > > > rejected execution (queue capacity 1000) on > > > > org.elasticsearch.search.action.SearchServiceTransportAction$ > > > > 23@1d7c9f0f > > > > at > > > > org.elasticsearch.common.util.concurrent.EsAbortPolicy. > > > > rejectedExecution(EsAbortPolicy.java:62) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor.reject( > > > > ThreadPoolExecutor.java:821) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor.execute( > > > > ThreadPoolExecutor.java:1372) > > > > at > > > > org.elasticsearch.search.action.SearchServiceTransportAction.execute( > > > > SearchServiceTransportAction.java:551) > > > > at > > > > org.elasticsearch.search.action.SearchServiceTransportAction. > > > > sendExecuteQuery(SearchServiceTransportAction.java:228) > > > > at > > > > org.elasticsearch.action.search.type.TransportSearchCountAction$ > > > > AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:71) > > > > at > > > > org.elasticsearch.action.search.type.TransportSearchTypeAction$ > > > > BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) > > > > > > > > Now i read that i have to update the threadpool settings in ES and i > > > > have > > > > now > > > > curl -XGET localhost:9200/\_cluster/settings?pretty > > > > { > > > > "persistent" : { }, > > > > "transient" : { } > > > > } > > > > > > > > i'm trying to update the settings with the below commands > > > > > > > > curl -XPUT localhost:9200/\_cluster/settings -d '{ > > > > > > > > "threadpool" : { > > > > "index": { > > > > "type": "fixed", > > > > "size": 32, > > > > "queue\_size": 1000 > > > > }, > > > > "bulk": { > > > > "type": "fixed", > > > > "size": 32, > > > > "queue\_size": 1000 > > > > }, > > > > "search": { > > > > "type": "fixed", > > > > "size": 96, > > > > "queue\_size": 1000 > > > > } > > > > } > > > > }' > > > > > > > > but i keep getting {"error":"ActionRequestValidationExcepti > > > > on[Validation > > > > Failed: 1: no settings to update;]","status":400} > > > > > > > > What's wrong with this command? is it the right solution for my issue ? > > > > > > > > Please advise > > > > > > > > Thanks. > > > > > > > > Ayman > > > > > > > > -- > > > > View this message in context: [http://elasticsearch-users](http://elasticsearch-users). > > > > [115913.n3.nabble.com/Add-non-existing-settings-in-cluster-](http://115913.n3.nabble.com/Add-non-existing-settings-in-cluster-) > > > > settings-in-elasticsearch-tp4072768.html > > > > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/1427555353485-4072768.post%[40n3.nabble.com](http://40n3.nabble.com). > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/0b407b66-3d40-45c3-ba45-df7ce8170f13%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/0a2a2384-d09b-482d-a087-7606f0915c0f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/0a2a2384-d09b-482d-a087-7606f0915c0f%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:21am UTC](https://discuss.elastic.co/t/add-non-existing-settings-in-cluster-settings-in-elasticsearch/22961/8 "2017-07-06T00:21:22Z")