# Elasticsearch node under utilising file descriptors **URL:** \ **Category:** Elasticsearch\ **Created:** [May 14, 2014, 5:47am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502 "2014-05-14T05:47:07Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![Tamanjit\_Bindra](https://avatars.discourse-cdn.com/v4/letter/t/9de053/32.png) [@Tamanjit\_Bindra](https://discuss.elastic.co/u/Tamanjit_Bindra)\ **Post date:** [May 14, 2014, 5:47am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/1 "2014-05-14T05:47:07Z")
Hi, I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), that we should set the soft and hard values of nooffiles for ES to utilise. I have done that, but somehow my BigDesk console shows that even though the upper limit is 65535, ES is only using about 2K+ file descriptors at any given moment. I have set the ulimit -Hn and ulimit -Sn to 32000. Why is this so? I ask this because my queries are performing slow. We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to ES. Please Help! -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 14, 2014, 5:57am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/2 "2014-05-14T05:57:07Z")
ES will use descriptors to open files it needs for general operations and it can have a lot of those open at one time. But the level you've set and the level you're using are not related to your slow queries. How much data do you have in your cluster? What version of ES, what version of java? You should also check your slow log (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads (GET /\_cluster/nodes/hot\_threads) to see what is happening. Also try installing a plugin like Marvel or ElasticHQ to give you a better idea of what your resource usage is like on a cluster level. Bigdesk is good but it limited to a node only view. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 14 May 2014 15:47, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > Hi, > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > that we should set the soft and hard values of nooffiles for ES to utilise. > > I have done that, but somehow my BigDesk console shows that even though > the upper limit is 65535, ES is only using about 2K+ file descriptors at > any given moment. > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > Why is this so? > > I ask this because my queries are performing slow. > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to ES. > > Please Help! > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624Z%3DA8FRq-d4rW9nhBsmkx4KDUS0Wyp9Vu%2BzQKM4oPeCxw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624Z%3DA8FRq-d4rW9nhBsmkx4KDUS0Wyp9Vu%2BzQKM4oPeCxw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Tamanjit\_Bindra](https://avatars.discourse-cdn.com/v4/letter/t/9de053/32.png) [@Tamanjit\_Bindra](https://discuss.elastic.co/u/Tamanjit_Bindra)\ **Post date:** [May 14, 2014, 6:17am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/3 "2014-05-14T06:17:10Z")
Hi Mark, Thanks for the reply. We are using ES 0.90 on Java 7 The stats are as under : "ok" : true, "\_shards" : { "total" : 300, "successful" : 300, "failed" : 0 }, "\_all" : { "primaries" : { "docs" : { "count" : 28403397, "deleted" : 1385142 }, "store" : { "size" : "465.4gb", "size\_in\_bytes" : 499761991425, "throttle\_time" : "0s", "throttle\_time\_in\_millis" : 0 }, "indexing" : { "index\_total" : 2343265, "index\_time" : "13.9d", "index\_time\_in\_millis" : 1204844492, "index\_current" : 0, "delete\_total" : 5, "delete\_time" : "659ms", "delete\_time\_in\_millis" : 659, "delete\_current" : 0 }, "get" : { "total" : 9, "get\_time" : "3.2s", "time\_in\_millis" : 3277, "exists\_total" : 6, "exists\_time" : "3.2s", "exists\_time\_in\_millis" : 3277, "missing\_total" : 3, "missing\_time" : "0s", "missing\_time\_in\_millis" : 0, "current" : 0 }, "search" : { "open\_contexts" : 32, "query\_total" : 262779551, "query\_time" : "430.4d", "query\_time\_in\_millis" : 37193583386, "query\_current" : 3, "fetch\_total" : 115208512, "fetch\_time" : "541.6d", "fetch\_time\_in\_millis" : 46798459635, "fetch\_current" : 9 } }, "total" : { "docs" : { "count" : 56806794, "deleted" : 2770284 }, "store" : { "size" : "930.8gb", "size\_in\_bytes" : 999509417525, "throttle\_time" : "0s", "throttle\_time\_in\_millis" : 0 }, "indexing" : { "index\_total" : 4682044, "index\_time" : "34.6d", "index\_time\_in\_millis" : 2993312068, "index\_current" : 2232, "delete\_total" : 10, "delete\_time" : "2.4s", "delete\_time\_in\_millis" : 2404, "delete\_current" : 0 }, "get" : { "total" : 24, "get\_time" : "9.8s", "time\_in\_millis" : 9855, "exists\_total" : 15, "exists\_time" : "9.8s", "exists\_time\_in\_millis" : 9855, "missing\_total" : 9, "missing\_time" : "0s", "missing\_time\_in\_millis" : 0, "current" : 0 }, "search" : { "open\_contexts" : 64, "query\_total" : 525308020, "query\_time" : "816.1d", "query\_time\_in\_millis" : 70519558277, "query\_current" : 6, "fetch\_total" : 230215915, "fetch\_time" : "939.6d", "fetch\_time\_in\_millis" : 81182884575, "fetch\_current" : 10 } } } I am attaching along the hot\_threads output, though I couldn't make much sense of it. Pardon me if I sound N00Bish, because I am pretty new to ES. On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > ES will use descriptors to open files it needs for general operations and > it can have a lot of those open at one time. But the level you've set and > the level you're using are not related to your slow queries. > > How much data do you have in your cluster? What version of ES, what > version of java? You should also check your slow log > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads (GET > /\_cluster/nodes/hot\_threads) to see what is happening. > Also try installing a plugin like Marvel or ElasticHQ to give you a better > idea of what your resource usage is like on a cluster level. Bigdesk is > good but it limited to a node only view. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \ > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 14 May 2014 15:47, Tamanjit Bindra \<[bindra....@gmail.com](mailto:bindra....@gmail.com) \\>wrote: > > > Hi, > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > I have done that, but somehow my BigDesk console shows that even though > > the upper limit is 65535, ES is only using about 2K+ file descriptors at > > any given moment. > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > Why is this so? > > > > I ask this because my queries are performing slow. > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to ES. > > > > Please Help! > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 14, 2014, 6:19am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/4 "2014-05-14T06:19:19Z")
It's better to put that sort of thing in a gist/pastebin 🙂 Any reason you aren't running a more recent version of ES? You'll get much better performance from the new versions. Also can you be specific about your java, what update, OpenJDK or Oracle? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 14 May 2014 16:17, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > Hi Mark, > Thanks for the reply. We are using ES 0.90 on Java 7 > > The stats are as under : > > "ok" : true, > "\_shards" : { > "total" : 300, > "successful" : 300, > "failed" : 0 > }, > "\_all" : { > "primaries" : { > "docs" : { > "count" : 28403397, > "deleted" : 1385142 > }, > "store" : { > "size" : "465.4gb", > "size\_in\_bytes" : 499761991425, > "throttle\_time" : "0s", > "throttle\_time\_in\_millis" : 0 > }, > "indexing" : { > "index\_total" : 2343265, > "index\_time" : "13.9d", > "index\_time\_in\_millis" : 1204844492, > "index\_current" : 0, > "delete\_total" : 5, > "delete\_time" : "659ms", > "delete\_time\_in\_millis" : 659, > "delete\_current" : 0 > }, > "get" : { > "total" : 9, > "get\_time" : "3.2s", > "time\_in\_millis" : 3277, > "exists\_total" : 6, > "exists\_time" : "3.2s", > "exists\_time\_in\_millis" : 3277, > "missing\_total" : 3, > "missing\_time" : "0s", > "missing\_time\_in\_millis" : 0, > "current" : 0 > }, > "search" : { > "open\_contexts" : 32, > "query\_total" : 262779551, > "query\_time" : "430.4d", > "query\_time\_in\_millis" : 37193583386, > "query\_current" : 3, > "fetch\_total" : 115208512, > "fetch\_time" : "541.6d", > "fetch\_time\_in\_millis" : 46798459635, > "fetch\_current" : 9 > } > }, > "total" : { > "docs" : { > "count" : 56806794, > "deleted" : 2770284 > }, > "store" : { > "size" : "930.8gb", > "size\_in\_bytes" : 999509417525, > "throttle\_time" : "0s", > "throttle\_time\_in\_millis" : 0 > }, > "indexing" : { > "index\_total" : 4682044, > "index\_time" : "34.6d", > "index\_time\_in\_millis" : 2993312068, > "index\_current" : 2232, > "delete\_total" : 10, > "delete\_time" : "2.4s", > "delete\_time\_in\_millis" : 2404, > "delete\_current" : 0 > }, > "get" : { > "total" : 24, > "get\_time" : "9.8s", > "time\_in\_millis" : 9855, > "exists\_total" : 15, > "exists\_time" : "9.8s", > "exists\_time\_in\_millis" : 9855, > "missing\_total" : 9, > "missing\_time" : "0s", > "missing\_time\_in\_millis" : 0, > "current" : 0 > }, > "search" : { > "open\_contexts" : 64, > "query\_total" : 525308020, > "query\_time" : "816.1d", > "query\_time\_in\_millis" : 70519558277, > "query\_current" : 6, > "fetch\_total" : 230215915, > "fetch\_time" : "939.6d", > "fetch\_time\_in\_millis" : 81182884575, > "fetch\_current" : 10 > } > } > } > > I am attaching along the hot\_threads output, though I couldn't make much > sense of it. Pardon me if I sound N00Bish, because I am pretty new to ES. > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > ES will use descriptors to open files it needs for general operations and > > it can have a lot of those open at one time. But the level you've set and > > the level you're using are not related to your slow queries. > > > > How much data do you have in your cluster? What version of ES, what > > version of java? You should also check your slow log > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads (GET > > /\_cluster/nodes/hot\_threads) to see what is happening. > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > better idea of what your resource usage is like on a cluster level. Bigdesk > > is good but it limited to a node only view. > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > Hi, > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > I have done that, but somehow my BigDesk console shows that even though > > > the upper limit is 65535, ES is only using about 2K+ file descriptors at > > > any given moment. > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > Why is this so? > > > > > > I ask this because my queries are performing slow. > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to ES. > > > > > > Please Help! > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d% > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624aHa485CQOcu1Mk8m6\_w115-0VwKofT9CD%2BLyLhgue%2BVg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624aHa485CQOcu1Mk8m6_w115-0VwKofT9CD%2BLyLhgue%2BVg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Tamanjit\_Bindra](https://avatars.discourse-cdn.com/v4/letter/t/9de053/32.png) [@Tamanjit\_Bindra](https://discuss.elastic.co/u/Tamanjit_Bindra)\ **Post date:** [May 14, 2014, 6:37am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/5 "2014-05-14T06:37:12Z")
Hi, Sorry about the paste thing. I have recently joined the organisation and they have been using ES for some time now. I am not too sure if there is any plan to migrate to 1.X version any time soon. Although yes that is something that we may have to do eventually. But is there any possibility of tweaking in the current scenario? Java version details: java version "1.7.0\_09" OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > It's better to put that sort of thing in a gist/pastebin 🙂 > > Any reason you aren't running a more recent version of ES? You'll get much > better performance from the new versions. > Also can you be specific about your java, what update, OpenJDK or Oracle? > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \ > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 14 May 2014 16:17, Tamanjit Bindra \<[bindra....@gmail.com](mailto:bindra....@gmail.com) \\>wrote: > > > Hi Mark, > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > The stats are as under : > > > > "ok" : true, > > "\_shards" : { > > "total" : 300, > > "successful" : 300, > > "failed" : 0 > > }, > > "\_all" : { > > "primaries" : { > > "docs" : { > > "count" : 28403397, > > "deleted" : 1385142 > > }, > > "store" : { > > "size" : "465.4gb", > > "size\_in\_bytes" : 499761991425, > > "throttle\_time" : "0s", > > "throttle\_time\_in\_millis" : 0 > > }, > > "indexing" : { > > "index\_total" : 2343265, > > "index\_time" : "13.9d", > > "index\_time\_in\_millis" : 1204844492, > > "index\_current" : 0, > > "delete\_total" : 5, > > "delete\_time" : "659ms", > > "delete\_time\_in\_millis" : 659, > > "delete\_current" : 0 > > }, > > "get" : { > > "total" : 9, > > "get\_time" : "3.2s", > > "time\_in\_millis" : 3277, > > "exists\_total" : 6, > > "exists\_time" : "3.2s", > > "exists\_time\_in\_millis" : 3277, > > "missing\_total" : 3, > > "missing\_time" : "0s", > > "missing\_time\_in\_millis" : 0, > > "current" : 0 > > }, > > "search" : { > > "open\_contexts" : 32, > > "query\_total" : 262779551, > > "query\_time" : "430.4d", > > "query\_time\_in\_millis" : 37193583386, > > "query\_current" : 3, > > "fetch\_total" : 115208512, > > "fetch\_time" : "541.6d", > > "fetch\_time\_in\_millis" : 46798459635, > > "fetch\_current" : 9 > > } > > }, > > "total" : { > > "docs" : { > > "count" : 56806794, > > "deleted" : 2770284 > > }, > > "store" : { > > "size" : "930.8gb", > > "size\_in\_bytes" : 999509417525, > > "throttle\_time" : "0s", > > "throttle\_time\_in\_millis" : 0 > > }, > > "indexing" : { > > "index\_total" : 4682044, > > "index\_time" : "34.6d", > > "index\_time\_in\_millis" : 2993312068, > > "index\_current" : 2232, > > "delete\_total" : 10, > > "delete\_time" : "2.4s", > > "delete\_time\_in\_millis" : 2404, > > "delete\_current" : 0 > > }, > > "get" : { > > "total" : 24, > > "get\_time" : "9.8s", > > "time\_in\_millis" : 9855, > > "exists\_total" : 15, > > "exists\_time" : "9.8s", > > "exists\_time\_in\_millis" : 9855, > > "missing\_total" : 9, > > "missing\_time" : "0s", > > "missing\_time\_in\_millis" : 0, > > "current" : 0 > > }, > > "search" : { > > "open\_contexts" : 64, > > "query\_total" : 525308020, > > "query\_time" : "816.1d", > > "query\_time\_in\_millis" : 70519558277, > > "query\_current" : 6, > > "fetch\_total" : 230215915, > > "fetch\_time" : "939.6d", > > "fetch\_time\_in\_millis" : 81182884575, > > "fetch\_current" : 10 > > } > > } > > } > > > > I am attaching along the hot\_threads output, though I couldn't make much > > sense of it. Pardon me if I sound N00Bish, because I am pretty new to ES. > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > ES will use descriptors to open files it needs for general operations > > > and it can have a lot of those open at one time. But the level you've set > > > and the level you're using are not related to your slow queries. > > > > > > How much data do you have in your cluster? What version of ES, what > > > version of java? You should also check your slow log > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads > > > (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > is good but it limited to a node only view. > > > > > > Regards, > > > Mark Walkom > > > > > > Infrastructure Engineer > > > Campaign Monitor > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > Hi, > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > I have done that, but somehow my BigDesk console shows that even though > > > > the upper limit is 65535, ES is only using about 2K+ file descriptors at > > > > any given moment. > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > Why is this so? > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to > > > > ES. > > > > > > > > Please Help! > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d% > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 14, 2014, 9:11am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/6 "2014-05-14T09:11:41Z")
The prime objectives you should be aiming for here are 1) update to Oracle JDK (7u55), you will get much better performance and stability and, 2) upgrade ES to the latest, for the same reasons. Can you gist/pastebin your current config? There be little that can be done with such an old version, but we can take a look. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 14 May 2014 16:37, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > Hi, > Sorry about the paste thing. > > I have recently joined the organisation and they have been using ES for > some time now. I am not too sure if there is any plan to migrate to 1.X > version any time soon. Although yes that is something that we may have to > do eventually. But is there any possibility of tweaking in the current > scenario? > > Java version details: > > java version "1.7.0\_09" > OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) > OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) > > On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > > > It's better to put that sort of thing in a gist/pastebin 🙂 > > > > Any reason you aren't running a more recent version of ES? You'll get > > much better performance from the new versions. > > Also can you be specific about your java, what update, OpenJDK or Oracle? > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 14 May 2014 16:17, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > Hi Mark, > > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > > > The stats are as under : > > > > > > "ok" : true, > > > "\_shards" : { > > > "total" : 300, > > > "successful" : 300, > > > "failed" : 0 > > > }, > > > "\_all" : { > > > "primaries" : { > > > "docs" : { > > > "count" : 28403397, > > > "deleted" : 1385142 > > > }, > > > "store" : { > > > "size" : "465.4gb", > > > "size\_in\_bytes" : 499761991425, > > > "throttle\_time" : "0s", > > > "throttle\_time\_in\_millis" : 0 > > > }, > > > "indexing" : { > > > "index\_total" : 2343265, > > > "index\_time" : "13.9d", > > > "index\_time\_in\_millis" : 1204844492, > > > "index\_current" : 0, > > > "delete\_total" : 5, > > > "delete\_time" : "659ms", > > > "delete\_time\_in\_millis" : 659, > > > "delete\_current" : 0 > > > }, > > > "get" : { > > > "total" : 9, > > > "get\_time" : "3.2s", > > > "time\_in\_millis" : 3277, > > > "exists\_total" : 6, > > > "exists\_time" : "3.2s", > > > "exists\_time\_in\_millis" : 3277, > > > "missing\_total" : 3, > > > "missing\_time" : "0s", > > > "missing\_time\_in\_millis" : 0, > > > "current" : 0 > > > }, > > > "search" : { > > > "open\_contexts" : 32, > > > "query\_total" : 262779551, > > > "query\_time" : "430.4d", > > > "query\_time\_in\_millis" : 37193583386, > > > "query\_current" : 3, > > > "fetch\_total" : 115208512, > > > "fetch\_time" : "541.6d", > > > "fetch\_time\_in\_millis" : 46798459635, > > > "fetch\_current" : 9 > > > } > > > }, > > > "total" : { > > > "docs" : { > > > "count" : 56806794, > > > "deleted" : 2770284 > > > }, > > > "store" : { > > > "size" : "930.8gb", > > > "size\_in\_bytes" : 999509417525, > > > "throttle\_time" : "0s", > > > "throttle\_time\_in\_millis" : 0 > > > }, > > > "indexing" : { > > > "index\_total" : 4682044, > > > "index\_time" : "34.6d", > > > "index\_time\_in\_millis" : 2993312068, > > > "index\_current" : 2232, > > > "delete\_total" : 10, > > > "delete\_time" : "2.4s", > > > "delete\_time\_in\_millis" : 2404, > > > "delete\_current" : 0 > > > }, > > > "get" : { > > > "total" : 24, > > > "get\_time" : "9.8s", > > > "time\_in\_millis" : 9855, > > > "exists\_total" : 15, > > > "exists\_time" : "9.8s", > > > "exists\_time\_in\_millis" : 9855, > > > "missing\_total" : 9, > > > "missing\_time" : "0s", > > > "missing\_time\_in\_millis" : 0, > > > "current" : 0 > > > }, > > > "search" : { > > > "open\_contexts" : 64, > > > "query\_total" : 525308020, > > > "query\_time" : "816.1d", > > > "query\_time\_in\_millis" : 70519558277, > > > "query\_current" : 6, > > > "fetch\_total" : 230215915, > > > "fetch\_time" : "939.6d", > > > "fetch\_time\_in\_millis" : 81182884575, > > > "fetch\_current" : 10 > > > } > > > } > > > } > > > > > > I am attaching along the hot\_threads output, though I couldn't make much > > > sense of it. Pardon me if I sound N00Bish, because I am pretty new to ES. > > > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > > > ES will use descriptors to open files it needs for general operations > > > > and it can have a lot of those open at one time. But the level you've set > > > > and the level you're using are not related to your slow queries. > > > > > > > > How much data do you have in your cluster? What version of ES, what > > > > version of java? You should also check your slow log > > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads > > > > (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > > is good but it limited to a node only view. > > > > > > > > Regards, > > > > Mark Walkom > > > > > > > > Infrastructure Engineer > > > > Campaign Monitor > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > Hi, > > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > > > I have done that, but somehow my BigDesk console shows that even > > > > > though the upper limit is 65535, ES is only using about 2K+ file > > > > > descriptors at any given moment. > > > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > > > Why is this so? > > > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to > > > > > ES. > > > > > > > > > > Please Help! > > > > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40goo > > > > > [glegroups.com](http://glegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047% > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624YsSgQM5w-in5fdYvGn6d7EhWLa-s0RgQH3TrR%3DxaTG-g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624YsSgQM5w-in5fdYvGn6d7EhWLa-s0RgQH3TrR%3DxaTG-g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Tamanjit\_Bindra](https://avatars.discourse-cdn.com/v4/letter/t/9de053/32.png) [@Tamanjit\_Bindra](https://discuss.elastic.co/u/Tamanjit_Bindra)\ **Post date:** [May 14, 2014, 9:29am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/7 "2014-05-14T09:29:21Z")
Here [http://pastebin.com/6EAQ8znF](http://pastebin.com/6EAQ8znF) is the link to the config. On Wednesday, May 14, 2014 2:41:41 PM UTC+5:30, Mark Walkom wrote: > The prime objectives you should be aiming for here are 1) update to Oracle > JDK (7u55), you will get much better performance and stability and, 2) > upgrade ES to the latest, for the same reasons. > > Can you gist/pastebin your current config? There be little that can be > done with such an old version, but we can take a look. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \ > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 14 May 2014 16:37, Tamanjit Bindra \<[bindra....@gmail.com](mailto:bindra....@gmail.com) \\>wrote: > > > Hi, > > Sorry about the paste thing. > > > > I have recently joined the organisation and they have been using ES for > > some time now. I am not too sure if there is any plan to migrate to 1.X > > version any time soon. Although yes that is something that we may have to > > do eventually. But is there any possibility of tweaking in the current > > scenario? > > > > Java version details: > > > > java version "1.7.0\_09" > > OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) > > OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) > > > > On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > > > > > It's better to put that sort of thing in a gist/pastebin 🙂 > > > > > > Any reason you aren't running a more recent version of ES? You'll get > > > much better performance from the new versions. > > > Also can you be specific about your java, what update, OpenJDK or Oracle? > > > > > > Regards, > > > Mark Walkom > > > > > > Infrastructure Engineer > > > Campaign Monitor > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > On 14 May 2014 16:17, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > Hi Mark, > > > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > > > > > The stats are as under : > > > > > > > > "ok" : true, > > > > "\_shards" : { > > > > "total" : 300, > > > > "successful" : 300, > > > > "failed" : 0 > > > > }, > > > > "\_all" : { > > > > "primaries" : { > > > > "docs" : { > > > > "count" : 28403397, > > > > "deleted" : 1385142 > > > > }, > > > > "store" : { > > > > "size" : "465.4gb", > > > > "size\_in\_bytes" : 499761991425, > > > > "throttle\_time" : "0s", > > > > "throttle\_time\_in\_millis" : 0 > > > > }, > > > > "indexing" : { > > > > "index\_total" : 2343265, > > > > "index\_time" : "13.9d", > > > > "index\_time\_in\_millis" : 1204844492, > > > > "index\_current" : 0, > > > > "delete\_total" : 5, > > > > "delete\_time" : "659ms", > > > > "delete\_time\_in\_millis" : 659, > > > > "delete\_current" : 0 > > > > }, > > > > "get" : { > > > > "total" : 9, > > > > "get\_time" : "3.2s", > > > > "time\_in\_millis" : 3277, > > > > "exists\_total" : 6, > > > > "exists\_time" : "3.2s", > > > > "exists\_time\_in\_millis" : 3277, > > > > "missing\_total" : 3, > > > > "missing\_time" : "0s", > > > > "missing\_time\_in\_millis" : 0, > > > > "current" : 0 > > > > }, > > > > "search" : { > > > > "open\_contexts" : 32, > > > > "query\_total" : 262779551, > > > > "query\_time" : "430.4d", > > > > "query\_time\_in\_millis" : 37193583386, > > > > "query\_current" : 3, > > > > "fetch\_total" : 115208512, > > > > "fetch\_time" : "541.6d", > > > > "fetch\_time\_in\_millis" : 46798459635, > > > > "fetch\_current" : 9 > > > > } > > > > }, > > > > "total" : { > > > > "docs" : { > > > > "count" : 56806794, > > > > "deleted" : 2770284 > > > > }, > > > > "store" : { > > > > "size" : "930.8gb", > > > > "size\_in\_bytes" : 999509417525, > > > > "throttle\_time" : "0s", > > > > "throttle\_time\_in\_millis" : 0 > > > > }, > > > > "indexing" : { > > > > "index\_total" : 4682044, > > > > "index\_time" : "34.6d", > > > > "index\_time\_in\_millis" : 2993312068, > > > > "index\_current" : 2232, > > > > "delete\_total" : 10, > > > > "delete\_time" : "2.4s", > > > > "delete\_time\_in\_millis" : 2404, > > > > "delete\_current" : 0 > > > > }, > > > > "get" : { > > > > "total" : 24, > > > > "get\_time" : "9.8s", > > > > "time\_in\_millis" : 9855, > > > > "exists\_total" : 15, > > > > "exists\_time" : "9.8s", > > > > "exists\_time\_in\_millis" : 9855, > > > > "missing\_total" : 9, > > > > "missing\_time" : "0s", > > > > "missing\_time\_in\_millis" : 0, > > > > "current" : 0 > > > > }, > > > > "search" : { > > > > "open\_contexts" : 64, > > > > "query\_total" : 525308020, > > > > "query\_time" : "816.1d", > > > > "query\_time\_in\_millis" : 70519558277, > > > > "query\_current" : 6, > > > > "fetch\_total" : 230215915, > > > > "fetch\_time" : "939.6d", > > > > "fetch\_time\_in\_millis" : 81182884575, > > > > "fetch\_current" : 10 > > > > } > > > > } > > > > } > > > > > > > > I am attaching along the hot\_threads output, though I couldn't make > > > > much sense of it. Pardon me if I sound N00Bish, because I am pretty new to > > > > ES. > > > > > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > ES will use descriptors to open files it needs for general operations > > > > > and it can have a lot of those open at one time. But the level you've set > > > > > and the level you're using are not related to your slow queries. > > > > > > > > > > How much data do you have in your cluster? What version of ES, what > > > > > version of java? You should also check your slow log > > > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads > > > > > (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > > > is good but it limited to a node only view. > > > > > > > > > > Regards, > > > > > Mark Walkom > > > > > > > > > > Infrastructure Engineer > > > > > Campaign Monitor > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > Hi, > > > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > > > > > I have done that, but somehow my BigDesk console shows that even > > > > > > though the upper limit is 65535, ES is only using about 2K+ file > > > > > > descriptors at any given moment. > > > > > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > > > > > Why is this so? > > > > > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to > > > > > > ES. > > > > > > > > > > > > Please Help! > > > > > > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > > > Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40goo > > > > > > [glegroups.com](http://glegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047% > > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 14, 2014, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/8 "2014-05-14T10:39:36Z")
You really need to set this "bootstrap.mlockall: true", it helps with performance and stops the process being swapped out, which is extremely expensive. Also depending on the minor version of the 0.90 release, you can try enabling compression, index.store.compress.stored and [index.store.compress.tv](http://index.store.compress.tv). Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 14 May 2014 19:29, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > Here [http://pastebin.com/6EAQ8znF](http://pastebin.com/6EAQ8znF) is the link to the config. > > On Wednesday, May 14, 2014 2:41:41 PM UTC+5:30, Mark Walkom wrote: > > > The prime objectives you should be aiming for here are 1) update to > > Oracle JDK (7u55), you will get much better performance and stability and, > > 2) upgrade ES to the latest, for the same reasons. > > > > Can you gist/pastebin your current config? There be little that can be > > done with such an old version, but we can take a look. > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 14 May 2014 16:37, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > Hi, > > > Sorry about the paste thing. > > > > > > I have recently joined the organisation and they have been using ES for > > > some time now. I am not too sure if there is any plan to migrate to 1.X > > > version any time soon. Although yes that is something that we may have to > > > do eventually. But is there any possibility of tweaking in the current > > > scenario? > > > > > > Java version details: > > > > > > java version "1.7.0\_09" > > > OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) > > > OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) > > > > > > On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > > > > > > > It's better to put that sort of thing in a gist/pastebin 🙂 > > > > > > > > Any reason you aren't running a more recent version of ES? You'll get > > > > much better performance from the new versions. > > > > Also can you be specific about your java, what update, OpenJDK or > > > > Oracle? > > > > > > > > Regards, > > > > Mark Walkom > > > > > > > > Infrastructure Engineer > > > > Campaign Monitor > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > On 14 May 2014 16:17, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > Hi Mark, > > > > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > > > > > > > The stats are as under : > > > > > > > > > > "ok" : true, > > > > > "\_shards" : { > > > > > "total" : 300, > > > > > "successful" : 300, > > > > > "failed" : 0 > > > > > }, > > > > > "\_all" : { > > > > > "primaries" : { > > > > > "docs" : { > > > > > "count" : 28403397, > > > > > "deleted" : 1385142 > > > > > }, > > > > > "store" : { > > > > > "size" : "465.4gb", > > > > > "size\_in\_bytes" : 499761991425, > > > > > "throttle\_time" : "0s", > > > > > "throttle\_time\_in\_millis" : 0 > > > > > }, > > > > > "indexing" : { > > > > > "index\_total" : 2343265, > > > > > "index\_time" : "13.9d", > > > > > "index\_time\_in\_millis" : 1204844492, > > > > > "index\_current" : 0, > > > > > "delete\_total" : 5, > > > > > "delete\_time" : "659ms", > > > > > "delete\_time\_in\_millis" : 659, > > > > > "delete\_current" : 0 > > > > > }, > > > > > "get" : { > > > > > "total" : 9, > > > > > "get\_time" : "3.2s", > > > > > "time\_in\_millis" : 3277, > > > > > "exists\_total" : 6, > > > > > "exists\_time" : "3.2s", > > > > > "exists\_time\_in\_millis" : 3277, > > > > > "missing\_total" : 3, > > > > > "missing\_time" : "0s", > > > > > "missing\_time\_in\_millis" : 0, > > > > > "current" : 0 > > > > > }, > > > > > "search" : { > > > > > "open\_contexts" : 32, > > > > > "query\_total" : 262779551, > > > > > "query\_time" : "430.4d", > > > > > "query\_time\_in\_millis" : 37193583386, > > > > > "query\_current" : 3, > > > > > "fetch\_total" : 115208512, > > > > > "fetch\_time" : "541.6d", > > > > > "fetch\_time\_in\_millis" : 46798459635, > > > > > "fetch\_current" : 9 > > > > > } > > > > > }, > > > > > "total" : { > > > > > "docs" : { > > > > > "count" : 56806794, > > > > > "deleted" : 2770284 > > > > > }, > > > > > "store" : { > > > > > "size" : "930.8gb", > > > > > "size\_in\_bytes" : 999509417525, > > > > > "throttle\_time" : "0s", > > > > > "throttle\_time\_in\_millis" : 0 > > > > > }, > > > > > "indexing" : { > > > > > "index\_total" : 4682044, > > > > > "index\_time" : "34.6d", > > > > > "index\_time\_in\_millis" : 2993312068, > > > > > "index\_current" : 2232, > > > > > "delete\_total" : 10, > > > > > "delete\_time" : "2.4s", > > > > > "delete\_time\_in\_millis" : 2404, > > > > > "delete\_current" : 0 > > > > > }, > > > > > "get" : { > > > > > "total" : 24, > > > > > "get\_time" : "9.8s", > > > > > "time\_in\_millis" : 9855, > > > > > "exists\_total" : 15, > > > > > "exists\_time" : "9.8s", > > > > > "exists\_time\_in\_millis" : 9855, > > > > > "missing\_total" : 9, > > > > > "missing\_time" : "0s", > > > > > "missing\_time\_in\_millis" : 0, > > > > > "current" : 0 > > > > > }, > > > > > "search" : { > > > > > "open\_contexts" : 64, > > > > > "query\_total" : 525308020, > > > > > "query\_time" : "816.1d", > > > > > "query\_time\_in\_millis" : 70519558277, > > > > > "query\_current" : 6, > > > > > "fetch\_total" : 230215915, > > > > > "fetch\_time" : "939.6d", > > > > > "fetch\_time\_in\_millis" : 81182884575, > > > > > "fetch\_current" : 10 > > > > > } > > > > > } > > > > > } > > > > > > > > > > I am attaching along the hot\_threads output, though I couldn't make > > > > > much sense of it. Pardon me if I sound N00Bish, because I am pretty new to > > > > > ES. > > > > > > > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > > > ES will use descriptors to open files it needs for general operations > > > > > > and it can have a lot of those open at one time. But the level you've set > > > > > > and the level you're using are not related to your slow queries. > > > > > > > > > > > > How much data do you have in your cluster? What version of ES, what > > > > > > version of java? You should also check your slow log > > > > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads > > > > > > (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > > > > is good but it limited to a node only view. > > > > > > > > > > > > Regards, > > > > > > Mark Walkom > > > > > > > > > > > > Infrastructure Engineer > > > > > > Campaign Monitor > > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > > > Hi, > > > > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > > > > > > > I have done that, but somehow my BigDesk console shows that even > > > > > > > though the upper limit is 65535, ES is only using about 2K+ file > > > > > > > descriptors at any given moment. > > > > > > > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > > > > > > > Why is this so? > > > > > > > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated > > > > > > > to ES. > > > > > > > > > > > > > > Please Help! > > > > > > > > > > > > > > -- > > > > > > > You received this message because you are subscribed to the Google > > > > > > > Groups "elasticsearch" group. > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > To view this discussion on the web visit > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a) > > > > > > > 4-470b-96db-08117f554b7d%[40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > . > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > > > Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40goo > > > > > > [glegroups.com](http://glegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7% > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k\_W-r4jc2QTWvTAKRSA\_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k_W-r4jc2QTWvTAKRSA_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Tamanjit\_Bindra](https://avatars.discourse-cdn.com/v4/letter/t/9de053/32.png) [@Tamanjit\_Bindra](https://discuss.elastic.co/u/Tamanjit_Bindra)\ **Post date:** [May 14, 2014, 4:27pm UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/9 "2014-05-14T16:27:51Z")
I too had drilled down to mlockall. That surely needs a change. The rest two am not sure. If I remember correctly 0.90 version already handles this. Would need to check this. One more thing. Is there a way to reconfigure mlockall without restarting a node? On 14 May 2014 16:10, "Mark Walkom" [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) wrote: > You really need to set this "bootstrap.mlockall: true", it helps with > performance and stops the process being swapped out, which is extremely > expensive. > Also depending on the minor version of the 0.90 release, you can try > enabling compression, index.store.compress.stored and > [index.store.compress.tv](http://index.store.compress.tv). > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 14 May 2014 19:29, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > > > Here [http://pastebin.com/6EAQ8znF](http://pastebin.com/6EAQ8znF) is the link to the config. > > > > On Wednesday, May 14, 2014 2:41:41 PM UTC+5:30, Mark Walkom wrote: > > > > > The prime objectives you should be aiming for here are 1) update to > > > Oracle JDK (7u55), you will get much better performance and stability and, > > > 2) upgrade ES to the latest, for the same reasons. > > > > > > Can you gist/pastebin your current config? There be little that can be > > > done with such an old version, but we can take a look. > > > > > > Regards, > > > Mark Walkom > > > > > > Infrastructure Engineer > > > Campaign Monitor > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > On 14 May 2014 16:37, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > Hi, > > > > Sorry about the paste thing. > > > > > > > > I have recently joined the organisation and they have been using ES for > > > > some time now. I am not too sure if there is any plan to migrate to 1.X > > > > version any time soon. Although yes that is something that we may have to > > > > do eventually. But is there any possibility of tweaking in the current > > > > scenario? > > > > > > > > Java version details: > > > > > > > > java version "1.7.0\_09" > > > > OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) > > > > OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) > > > > > > > > On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > It's better to put that sort of thing in a gist/pastebin 🙂 > > > > > > > > > > Any reason you aren't running a more recent version of ES? You'll get > > > > > much better performance from the new versions. > > > > > Also can you be specific about your java, what update, OpenJDK or > > > > > Oracle? > > > > > > > > > > Regards, > > > > > Mark Walkom > > > > > > > > > > Infrastructure Engineer > > > > > Campaign Monitor > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > On 14 May 2014 16:17, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > Hi Mark, > > > > > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > > > > > > > > > The stats are as under : > > > > > > > > > > > > "ok" : true, > > > > > > "\_shards" : { > > > > > > "total" : 300, > > > > > > "successful" : 300, > > > > > > "failed" : 0 > > > > > > }, > > > > > > "\_all" : { > > > > > > "primaries" : { > > > > > > "docs" : { > > > > > > "count" : 28403397, > > > > > > "deleted" : 1385142 > > > > > > }, > > > > > > "store" : { > > > > > > "size" : "465.4gb", > > > > > > "size\_in\_bytes" : 499761991425, > > > > > > "throttle\_time" : "0s", > > > > > > "throttle\_time\_in\_millis" : 0 > > > > > > }, > > > > > > "indexing" : { > > > > > > "index\_total" : 2343265, > > > > > > "index\_time" : "13.9d", > > > > > > "index\_time\_in\_millis" : 1204844492, > > > > > > "index\_current" : 0, > > > > > > "delete\_total" : 5, > > > > > > "delete\_time" : "659ms", > > > > > > "delete\_time\_in\_millis" : 659, > > > > > > "delete\_current" : 0 > > > > > > }, > > > > > > "get" : { > > > > > > "total" : 9, > > > > > > "get\_time" : "3.2s", > > > > > > "time\_in\_millis" : 3277, > > > > > > "exists\_total" : 6, > > > > > > "exists\_time" : "3.2s", > > > > > > "exists\_time\_in\_millis" : 3277, > > > > > > "missing\_total" : 3, > > > > > > "missing\_time" : "0s", > > > > > > "missing\_time\_in\_millis" : 0, > > > > > > "current" : 0 > > > > > > }, > > > > > > "search" : { > > > > > > "open\_contexts" : 32, > > > > > > "query\_total" : 262779551, > > > > > > "query\_time" : "430.4d", > > > > > > "query\_time\_in\_millis" : 37193583386, > > > > > > "query\_current" : 3, > > > > > > "fetch\_total" : 115208512, > > > > > > "fetch\_time" : "541.6d", > > > > > > "fetch\_time\_in\_millis" : 46798459635, > > > > > > "fetch\_current" : 9 > > > > > > } > > > > > > }, > > > > > > "total" : { > > > > > > "docs" : { > > > > > > "count" : 56806794, > > > > > > "deleted" : 2770284 > > > > > > }, > > > > > > "store" : { > > > > > > "size" : "930.8gb", > > > > > > "size\_in\_bytes" : 999509417525, > > > > > > "throttle\_time" : "0s", > > > > > > "throttle\_time\_in\_millis" : 0 > > > > > > }, > > > > > > "indexing" : { > > > > > > "index\_total" : 4682044, > > > > > > "index\_time" : "34.6d", > > > > > > "index\_time\_in\_millis" : 2993312068, > > > > > > "index\_current" : 2232, > > > > > > "delete\_total" : 10, > > > > > > "delete\_time" : "2.4s", > > > > > > "delete\_time\_in\_millis" : 2404, > > > > > > "delete\_current" : 0 > > > > > > }, > > > > > > "get" : { > > > > > > "total" : 24, > > > > > > "get\_time" : "9.8s", > > > > > > "time\_in\_millis" : 9855, > > > > > > "exists\_total" : 15, > > > > > > "exists\_time" : "9.8s", > > > > > > "exists\_time\_in\_millis" : 9855, > > > > > > "missing\_total" : 9, > > > > > > "missing\_time" : "0s", > > > > > > "missing\_time\_in\_millis" : 0, > > > > > > "current" : 0 > > > > > > }, > > > > > > "search" : { > > > > > > "open\_contexts" : 64, > > > > > > "query\_total" : 525308020, > > > > > > "query\_time" : "816.1d", > > > > > > "query\_time\_in\_millis" : 70519558277, > > > > > > "query\_current" : 6, > > > > > > "fetch\_total" : 230215915, > > > > > > "fetch\_time" : "939.6d", > > > > > > "fetch\_time\_in\_millis" : 81182884575, > > > > > > "fetch\_current" : 10 > > > > > > } > > > > > > } > > > > > > } > > > > > > > > > > > > I am attaching along the hot\_threads output, though I couldn't make > > > > > > much sense of it. Pardon me if I sound N00Bish, because I am pretty new to > > > > > > ES. > > > > > > > > > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > > > > > ES will use descriptors to open files it needs for general > > > > > > > operations and it can have a lot of those open at one time. But the level > > > > > > > you've set and the level you're using are not related to your slow queries. > > > > > > > > > > > > > > How much data do you have in your cluster? What version of ES, what > > > > > > > version of java? You should also check your slow log > > > > > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot threads > > > > > > > (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > > > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > > > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > > > > > is good but it limited to a node only view. > > > > > > > > > > > > > > Regards, > > > > > > > Mark Walkom > > > > > > > > > > > > > > Infrastructure Engineer > > > > > > > Campaign Monitor > > > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > > > > > Hi, > > > > > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > > > > > > > > > I have done that, but somehow my BigDesk console shows that even > > > > > > > > though the upper limit is 65535, ES is only using about 2K+ file > > > > > > > > descriptors at any given moment. > > > > > > > > > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > > > > > > > > > Why is this so? > > > > > > > > > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated > > > > > > > > to ES. > > > > > > > > > > > > > > > > Please Help! > > > > > > > > > > > > > > > > -- > > > > > > > > You received this message because you are subscribed to the Google > > > > > > > > Groups "elasticsearch" group. > > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > > To view this discussion on the web visit > > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a) > > > > > > > > 4-470b-96db-08117f554b7d%[40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > > > -- > > > > > > > You received this message because you are subscribed to the Google > > > > > > > Groups "elasticsearch" group. > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > > msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40goo > > > > > > > [glegroups.com](http://glegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > . > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7% > > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/9ruH5k\_rN\_Y/unsubscribe](https://groups.google.com/d/topic/elasticsearch/9ruH5k_rN_Y/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k\_W-r4jc2QTWvTAKRSA\_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k_W-r4jc2QTWvTAKRSA_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k\_W-r4jc2QTWvTAKRSA\_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k_W-r4jc2QTWvTAKRSA_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CADA%3D\_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADA%3D_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 14, 2014, 10:58pm UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/10 "2014-05-14T22:58:24Z")
Later versions on 0.90 had compression enabled by default, but you haven't supplied the exact version you are running so I took a guess. You have to restart the node to apply mlockall. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 15 May 2014 02:27, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > I too had drilled down to mlockall. That surely needs a change. The rest > two am not sure. If I remember correctly 0.90 version already handles this. > Would need to check this. > One more thing. Is there a way to reconfigure mlockall without restarting > a node? > On 14 May 2014 16:10, "Mark Walkom" [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) wrote: > > > You really need to set this "bootstrap.mlockall: true", it helps with > > performance and stops the process being swapped out, which is extremely > > expensive. > > Also depending on the minor version of the 0.90 release, you can try > > enabling compression, index.store.compress.stored and > > [index.store.compress.tv](http://index.store.compress.tv). > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 14 May 2014 19:29, Tamanjit Bindra [bindra.tamanjit@gmail.com](mailto:bindra.tamanjit@gmail.com) wrote: > > > > > Here [http://pastebin.com/6EAQ8znF](http://pastebin.com/6EAQ8znF) is the link to the config. > > > > > > On Wednesday, May 14, 2014 2:41:41 PM UTC+5:30, Mark Walkom wrote: > > > > > > > The prime objectives you should be aiming for here are 1) update to > > > > Oracle JDK (7u55), you will get much better performance and stability and, > > > > 2) upgrade ES to the latest, for the same reasons. > > > > > > > > Can you gist/pastebin your current config? There be little that can be > > > > done with such an old version, but we can take a look. > > > > > > > > Regards, > > > > Mark Walkom > > > > > > > > Infrastructure Engineer > > > > Campaign Monitor > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > On 14 May 2014 16:37, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > Hi, > > > > > Sorry about the paste thing. > > > > > > > > > > I have recently joined the organisation and they have been using ES > > > > > for some time now. I am not too sure if there is any plan to migrate to 1.X > > > > > version any time soon. Although yes that is something that we may have to > > > > > do eventually. But is there any possibility of tweaking in the current > > > > > scenario? > > > > > > > > > > Java version details: > > > > > > > > > > java version "1.7.0\_09" > > > > > OpenJDK Runtime Environment (IcedTea7 2.3.3) (7u9-2.3.3-0ubuntu1~12.04.1) > > > > > OpenJDK 64-Bit Server VM (build 23.2-b09, mixed mode) > > > > > > > > > > On Wednesday, May 14, 2014 11:49:19 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > > > It's better to put that sort of thing in a gist/pastebin 🙂 > > > > > > > > > > > > Any reason you aren't running a more recent version of ES? You'll get > > > > > > much better performance from the new versions. > > > > > > Also can you be specific about your java, what update, OpenJDK or > > > > > > Oracle? > > > > > > > > > > > > Regards, > > > > > > Mark Walkom > > > > > > > > > > > > Infrastructure Engineer > > > > > > Campaign Monitor > > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > > > On 14 May 2014 16:17, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > > > Hi Mark, > > > > > > > Thanks for the reply. We are using ES 0.90 on Java 7 > > > > > > > > > > > > > > The stats are as under : > > > > > > > > > > > > > > "ok" : true, > > > > > > > "\_shards" : { > > > > > > > "total" : 300, > > > > > > > "successful" : 300, > > > > > > > "failed" : 0 > > > > > > > }, > > > > > > > "\_all" : { > > > > > > > "primaries" : { > > > > > > > "docs" : { > > > > > > > "count" : 28403397, > > > > > > > "deleted" : 1385142 > > > > > > > }, > > > > > > > "store" : { > > > > > > > "size" : "465.4gb", > > > > > > > "size\_in\_bytes" : 499761991425, > > > > > > > "throttle\_time" : "0s", > > > > > > > "throttle\_time\_in\_millis" : 0 > > > > > > > }, > > > > > > > "indexing" : { > > > > > > > "index\_total" : 2343265, > > > > > > > "index\_time" : "13.9d", > > > > > > > "index\_time\_in\_millis" : 1204844492, > > > > > > > "index\_current" : 0, > > > > > > > "delete\_total" : 5, > > > > > > > "delete\_time" : "659ms", > > > > > > > "delete\_time\_in\_millis" : 659, > > > > > > > "delete\_current" : 0 > > > > > > > }, > > > > > > > "get" : { > > > > > > > "total" : 9, > > > > > > > "get\_time" : "3.2s", > > > > > > > "time\_in\_millis" : 3277, > > > > > > > "exists\_total" : 6, > > > > > > > "exists\_time" : "3.2s", > > > > > > > "exists\_time\_in\_millis" : 3277, > > > > > > > "missing\_total" : 3, > > > > > > > "missing\_time" : "0s", > > > > > > > "missing\_time\_in\_millis" : 0, > > > > > > > "current" : 0 > > > > > > > }, > > > > > > > "search" : { > > > > > > > "open\_contexts" : 32, > > > > > > > "query\_total" : 262779551, > > > > > > > "query\_time" : "430.4d", > > > > > > > "query\_time\_in\_millis" : 37193583386, > > > > > > > "query\_current" : 3, > > > > > > > "fetch\_total" : 115208512, > > > > > > > "fetch\_time" : "541.6d", > > > > > > > "fetch\_time\_in\_millis" : 46798459635, > > > > > > > "fetch\_current" : 9 > > > > > > > } > > > > > > > }, > > > > > > > "total" : { > > > > > > > "docs" : { > > > > > > > "count" : 56806794, > > > > > > > "deleted" : 2770284 > > > > > > > }, > > > > > > > "store" : { > > > > > > > "size" : "930.8gb", > > > > > > > "size\_in\_bytes" : 999509417525, > > > > > > > "throttle\_time" : "0s", > > > > > > > "throttle\_time\_in\_millis" : 0 > > > > > > > }, > > > > > > > "indexing" : { > > > > > > > "index\_total" : 4682044, > > > > > > > "index\_time" : "34.6d", > > > > > > > "index\_time\_in\_millis" : 2993312068, > > > > > > > "index\_current" : 2232, > > > > > > > "delete\_total" : 10, > > > > > > > "delete\_time" : "2.4s", > > > > > > > "delete\_time\_in\_millis" : 2404, > > > > > > > "delete\_current" : 0 > > > > > > > }, > > > > > > > "get" : { > > > > > > > "total" : 24, > > > > > > > "get\_time" : "9.8s", > > > > > > > "time\_in\_millis" : 9855, > > > > > > > "exists\_total" : 15, > > > > > > > "exists\_time" : "9.8s", > > > > > > > "exists\_time\_in\_millis" : 9855, > > > > > > > "missing\_total" : 9, > > > > > > > "missing\_time" : "0s", > > > > > > > "missing\_time\_in\_millis" : 0, > > > > > > > "current" : 0 > > > > > > > }, > > > > > > > "search" : { > > > > > > > "open\_contexts" : 64, > > > > > > > "query\_total" : 525308020, > > > > > > > "query\_time" : "816.1d", > > > > > > > "query\_time\_in\_millis" : 70519558277, > > > > > > > "query\_current" : 6, > > > > > > > "fetch\_total" : 230215915, > > > > > > > "fetch\_time" : "939.6d", > > > > > > > "fetch\_time\_in\_millis" : 81182884575, > > > > > > > "fetch\_current" : 10 > > > > > > > } > > > > > > > } > > > > > > > } > > > > > > > > > > > > > > I am attaching along the hot\_threads output, though I couldn't make > > > > > > > much sense of it. Pardon me if I sound N00Bish, because I am pretty new to > > > > > > > ES. > > > > > > > > > > > > > > On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote: > > > > > > > > > > > > > > > ES will use descriptors to open files it needs for general > > > > > > > > operations and it can have a lot of those open at one time. But the level > > > > > > > > you've set and the level you're using are not related to your slow queries. > > > > > > > > > > > > > > > > How much data do you have in your cluster? What version of ES, what > > > > > > > > version of java? You should also check your slow log > > > > > > > > (/var/log/elasticsearch/\*\_index\_search\_slowlog.log) and hot > > > > > > > > threads (GET /\_cluster/nodes/hot\_threads) to see what is happening. > > > > > > > > Also try installing a plugin like Marvel or ElasticHQ to give you a > > > > > > > > better idea of what your resource usage is like on a cluster level. Bigdesk > > > > > > > > is good but it limited to a node only view. > > > > > > > > > > > > > > > > Regards, > > > > > > > > Mark Walkom > > > > > > > > > > > > > > > > Infrastructure Engineer > > > > > > > > Campaign Monitor > > > > > > > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > > > > > > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > > > > > > > > > > > > > On 14 May 2014 15:47, Tamanjit Bindra [bindra....@gmail.com](mailto:bindra....@gmail.com) wrote: > > > > > > > > > > > > > > > > > Hi, > > > > > > > > > I have read here[http://www.elasticsearch.org/tutorials/too-many-open-files/](http://www.elasticsearch.org/tutorials/too-many-open-files/), > > > > > > > > > that we should set the soft and hard values of nooffiles for ES to utilise. > > > > > > > > > > > > > > > > > > I have done that, but somehow my BigDesk console shows that even > > > > > > > > > though the upper limit is 65535, ES is only using about 2K+ file > > > > > > > > > descriptors at any given moment. > > > > > > > > > > > > > > > > > > I have set the ulimit -Hn and ulimit -Sn to 32000. > > > > > > > > > > > > > > > > > > Why is this so? > > > > > > > > > > > > > > > > > > I ask this because my queries are performing slow. > > > > > > > > > > > > > > > > > > We are using 2 nodes. Both servers have 16G RAM with 10G dedicated > > > > > > > > > to ES. > > > > > > > > > > > > > > > > > > Please Help! > > > > > > > > > > > > > > > > > > -- > > > > > > > > > You received this message because you are subscribed to the Google > > > > > > > > > Groups "elasticsearch" group. > > > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > > > To view this discussion on the web visit > > > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a) > > > > > > > > > 4-470b-96db-08117f554b7d%[40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > > > . > > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > > > > > -- > > > > > > > > You received this message because you are subscribed to the Google > > > > > > > > Groups "elasticsearch" group. > > > > > > > > To unsubscribe from this group and stop receiving emails from it, > > > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > > > To view this discussion on the web visit > > > > > > > > [https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a) > > > > > > > > 0-4424-86b0-2322f18b6047%[40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > > > Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > > > > msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7% > > > > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d8317d44-f8d9-400f-b72d-089840db0cc7%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > > To view this discussion on the web visit > > > > [https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/518692f6-e743-4323-bccf-44e299471c86%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to a topic in the > > Google Groups "elasticsearch" group. > > To unsubscribe from this topic, visit > > [https://groups.google.com/d/topic/elasticsearch/9ruH5k\_rN\_Y/unsubscribe](https://groups.google.com/d/topic/elasticsearch/9ruH5k_rN_Y/unsubscribe). > > To unsubscribe from this group and all its topics, send an email to > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k\_W-r4jc2QTWvTAKRSA\_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k_W-r4jc2QTWvTAKRSA_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k\_W-r4jc2QTWvTAKRSA\_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEM624b-XQJGE0k_W-r4jc2QTWvTAKRSA_RK%3Di%3DBw4dmoOgJjA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CADA%3D\_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CADA%3D_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CADA%3D\_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CADA%3D_UMa52BOvcXQnx709kgYkvgPsNOnet6ae80P7zHjQOiHfQ%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624asEd%3DAHaOJnN9xYMdP%2BUGTEJL3L-TYTXS%2BKHfxtnKXZw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624asEd%3DAHaOJnN9xYMdP%2BUGTEJL3L-TYTXS%2BKHfxtnKXZw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:29am UTC](https://discuss.elastic.co/t/elasticsearch-node-under-utilising-file-descriptors/17502/11 "2017-07-06T01:29:20Z")