# Too many open files even after increasing limit **URL:** \ **Category:** Elasticsearch\ **Created:** [November 11, 2013, 7:00pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354 "2013-11-11T19:00:30Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Aaron\_Troy](https://avatars.discourse-cdn.com/v4/letter/a/5e9695/32.png) [@Aaron\_Troy](https://discuss.elastic.co/u/Aaron_Troy)\ **Post date:** [November 11, 2013, 7:00pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/1 "2013-11-11T19:00:30Z")
Hi all, I'm running into a 'Too many open files' issue even after I've greatly increased the file limit on each node of the ES cluster. The set up is 6 storage nodes with around 630 million total indexed documents. Here's the node output showing that the limit is indeed 65,535 per node (500,000 on one where I was testing): { "ok" : true, "cluster\_name" : "Odine", "nodes" : { "J\_vVn1gKQMmcDYADbcPlfw" : { "name" : "rap-es-1", "transport\_address" : "inet[/141.161.88.174:9300]", "hostname" : "rap-es-1.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.174:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 31729, "max\_file\_descriptors" : 65535 } }, "hT\_Z-JneS6uCem0M-7nTEQ" : { "name" : "rap-es", "transport\_address" : "inet[/141.161.88.169:9300]", "hostname" : "rap-es.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.169:9200]", "attributes" : { "data" : "false" }, "os" : { "refresh\_interval" : 1000, "available\_processors" : 2, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 2, "total\_sockets" : 2, "cores\_per\_socket" : 1, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255303680 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 10282, "max\_file\_descriptors" : 500000 } }, "-76vB5ISTUq4M7ESizP7og" : { "name" : "rap-es-4", "transport\_address" : "inet[/141.161.88.177:9301]", "hostname" : "rap-es-4.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.177:9201]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 2462, "max\_file\_descriptors" : 65535 } }, "xssBGLKITpicDcxdeEjr4A" : { "name" : "rap-es-6", "transport\_address" : "inet[/141.161.88.179:9300]", "hostname" : "rap-es-6.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.179:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 2608, "max\_file\_descriptors" : 65535 } }, "wg\_I5wBfRxqs6kdH-S\_kww" : { "name" : "rap-es-6", "transport\_address" : "inet[/141.161.88.179:9301]", "hostname" : "rap-es-6.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.179:9201]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 2570, "max\_file\_descriptors" : 65535 } }, "lG0sqr95Q02Lt-iTCcg6qg" : { "name" : "rap-es-5", "transport\_address" : "inet[/141.161.88.178:9300]", "hostname" : "rap-es-5.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.178:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 22580, "max\_file\_descriptors" : 65535 } }, "biDQwwn4R9GTkesZUlNW1g" : { "name" : "rap-es-2", "transport\_address" : "inet[/141.161.88.175:9300]", "hostname" : "rap-es-2.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.175:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 5190, "max\_file\_descriptors" : 65535 } }, "A7E7I7R5SIib6RJPA3RNug" : { "name" : "rap-es-4", "transport\_address" : "inet[/141.161.88.177:9300]", "hostname" : "rap-es-4.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.177:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 2500, "max\_file\_descriptors" : 65535 } }, "oQG-yfURTTWZiFC6eOwjAg" : { "name" : "rap-es-3", "transport\_address" : "inet[/141.161.88.176:9300]", "hostname" : "rap-es-3.uis.georgetown.edu", "version" : "0.90.3", "http\_address" : "inet[/141.161.88.176:9200]", "os" : { "refresh\_interval" : 1000, "available\_processors" : 4, "cpu" : { "vendor" : "Intel", "model" : "Xeon", "mhz" : 1995, "total\_cores" : 4, "total\_sockets" : 1, "cores\_per\_socket" : 4, "cache\_size" : "18kb", "cache\_size\_in\_bytes" : 18432 }, "mem" : { "total" : "7.6gb", "total\_in\_bytes" : 8255045632 }, "swap" : { "total" : "7.9gb", "total\_in\_bytes" : 8589926400 } }, "process" : { "refresh\_interval" : 1000, "id" : 1291, "max\_file\_descriptors" : 65535 } } } } Any idea why I'm still getting this error? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [November 11, 2013, 7:59pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/2 "2013-11-11T19:59:48Z")
Probably too many shards per node, right? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 11 nov. 2013 à 20:00, Aaron Troy [atoy3731@gmail.com](mailto:atoy3731@gmail.com) a écrit : > Hi all, > > I'm running into a 'Too many open files' issue even after I've greatly increased the file limit on each node of the ES cluster. The set up is 6 storage nodes with around 630 million total indexed documents. > > Here's the node output showing that the limit is indeed 65,535 per node (500,000 on one where I was testing): > > { > "ok" : true, > "cluster\_name" : "Odine", > "nodes" : { > "J\_vVn1gKQMmcDYADbcPlfw" : { > "name" : "rap-es-1", > "transport\_address" : "inet[/141.161.88.174:9300]", > "hostname" : "rap-es-1.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.174:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 31729, > "max\_file\_descriptors" : 65535 > } > }, > "hT\_Z-JneS6uCem0M-7nTEQ" : { > "name" : "rap-es", > "transport\_address" : "inet[/141.161.88.169:9300]", > "hostname" : "rap-es.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.169:9200]", > "attributes" : { > "data" : "false" > }, > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 2, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 2, > "total\_sockets" : 2, > "cores\_per\_socket" : 1, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255303680 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 10282, > "max\_file\_descriptors" : 500000 > } > }, > "-76vB5ISTUq4M7ESizP7og" : { > "name" : "rap-es-4", > "transport\_address" : "inet[/141.161.88.177:9301]", > "hostname" : "rap-es-4.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.177:9201]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2462, > "max\_file\_descriptors" : 65535 > } > }, > "xssBGLKITpicDcxdeEjr4A" : { > "name" : "rap-es-6", > "transport\_address" : "inet[/141.161.88.179:9300]", > "hostname" : "rap-es-6.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.179:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2608, > "max\_file\_descriptors" : 65535 > } > }, > "wg\_I5wBfRxqs6kdH-S\_kww" : { > "name" : "rap-es-6", > "transport\_address" : "inet[/141.161.88.179:9301]", > "hostname" : "rap-es-6.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.179:9201]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2570, > "max\_file\_descriptors" : 65535 > } > }, > "lG0sqr95Q02Lt-iTCcg6qg" : { > "name" : "rap-es-5", > "transport\_address" : "inet[/141.161.88.178:9300]", > "hostname" : "rap-es-5.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.178:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 22580, > "max\_file\_descriptors" : 65535 > } > }, > "biDQwwn4R9GTkesZUlNW1g" : { > "name" : "rap-es-2", > "transport\_address" : "inet[/141.161.88.175:9300]", > "hostname" : "rap-es-2.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.175:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 5190, > "max\_file\_descriptors" : 65535 > } > }, > "A7E7I7R5SIib6RJPA3RNug" : { > "name" : "rap-es-4", > "transport\_address" : "inet[/141.161.88.177:9300]", > "hostname" : "rap-es-4.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.177:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2500, > "max\_file\_descriptors" : 65535 > } > }, > "oQG-yfURTTWZiFC6eOwjAg" : { > "name" : "rap-es-3", > "transport\_address" : "inet[/141.161.88.176:9300]", > "hostname" : "rap-es-3.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.176:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 1291, > "max\_file\_descriptors" : 65535 > } > } > } > } > > ## Any idea why I'm still getting this error? > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Aaron\_Troy](https://avatars.discourse-cdn.com/v4/letter/a/5e9695/32.png) [@Aaron\_Troy](https://discuss.elastic.co/u/Aaron_Troy)\ **Post date:** [November 11, 2013, 8:17pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/3 "2013-11-11T20:17:42Z")
Ah, perhaps that is the issue. Right now I have 48 indexes, each with 12 shards randomly allocated across the nodes. Would reducing the number of shards per index (perhaps 6) help the issue with open files? On Monday, November 11, 2013 2:59:48 PM UTC-5, David Pilato wrote: > Probably too many shards per node, right? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 11 nov. 2013 à 20:00, Aaron Troy \<[atoy...@gmail.com](mailto:atoy...@gmail.com) \\> a > écrit : > > Hi all, > > I'm running into a 'Too many open files' issue even after I've greatly > increased the file limit on each node of the ES cluster. The set up is 6 > storage nodes with around 630 million total indexed documents. > > Here's the node output showing that the limit is indeed 65,535 per node > (500,000 on one where I was testing): > > { > "ok" : true, > "cluster\_name" : "Odine", > "nodes" : { > "J\_vVn1gKQMmcDYADbcPlfw" : { > "name" : "rap-es-1", > "transport\_address" : "inet[/141.161.88.174:9300]", > "hostname" : "rap-es-1.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.174:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 31729, > "max\_file\_descriptors" : 65535 > } > }, > "hT\_Z-JneS6uCem0M-7nTEQ" : { > "name" : "rap-es", > "transport\_address" : "inet[/141.161.88.169:9300]", > "hostname" : "rap-es.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.169:9200]", > "attributes" : { > "data" : "false" > }, > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 2, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 2, > "total\_sockets" : 2, > "cores\_per\_socket" : 1, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255303680 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 10282, > "max\_file\_descriptors" : 500000 > } > }, > "-76vB5ISTUq4M7ESizP7og" : { > "name" : "rap-es-4", > "transport\_address" : "inet[/141.161.88.177:9301]", > "hostname" : "rap-es-4.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.177:9201]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2462, > "max\_file\_descriptors" : 65535 > } > }, > "xssBGLKITpicDcxdeEjr4A" : { > "name" : "rap-es-6", > "transport\_address" : "inet[/141.161.88.179:9300]", > "hostname" : "rap-es-6.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.179:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2608, > "max\_file\_descriptors" : 65535 > } > }, > "wg\_I5wBfRxqs6kdH-S\_kww" : { > "name" : "rap-es-6", > "transport\_address" : "inet[/141.161.88.179:9301]", > "hostname" : "rap-es-6.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.179:9201]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2570, > "max\_file\_descriptors" : 65535 > } > }, > "lG0sqr95Q02Lt-iTCcg6qg" : { > "name" : "rap-es-5", > "transport\_address" : "inet[/141.161.88.178:9300]", > "hostname" : "rap-es-5.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.178:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 22580, > "max\_file\_descriptors" : 65535 > } > }, > "biDQwwn4R9GTkesZUlNW1g" : { > "name" : "rap-es-2", > "transport\_address" : "inet[/141.161.88.175:9300]", > "hostname" : "rap-es-2.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.175:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 5190, > "max\_file\_descriptors" : 65535 > } > }, > "A7E7I7R5SIib6RJPA3RNug" : { > "name" : "rap-es-4", > "transport\_address" : "inet[/141.161.88.177:9300]", > "hostname" : "rap-es-4.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.177:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 2500, > "max\_file\_descriptors" : 65535 > } > }, > "oQG-yfURTTWZiFC6eOwjAg" : { > "name" : "rap-es-3", > "transport\_address" : "inet[/141.161.88.176:9300]", > "hostname" : "rap-es-3.uis.georgetown.edu", > "version" : "0.90.3", > "http\_address" : "inet[/141.161.88.176:9200]", > "os" : { > "refresh\_interval" : 1000, > "available\_processors" : 4, > "cpu" : { > "vendor" : "Intel", > "model" : "Xeon", > "mhz" : 1995, > "total\_cores" : 4, > "total\_sockets" : 1, > "cores\_per\_socket" : 4, > "cache\_size" : "18kb", > "cache\_size\_in\_bytes" : 18432 > }, > "mem" : { > "total" : "7.6gb", > "total\_in\_bytes" : 8255045632 > }, > "swap" : { > "total" : "7.9gb", > "total\_in\_bytes" : 8589926400 > } > }, > "process" : { > "refresh\_interval" : 1000, > "id" : 1291, > "max\_file\_descriptors" : 65535 > } > } > } > } > > Any idea why I'm still getting this error? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [November 11, 2013, 8:34pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/4 "2013-11-11T20:34:49Z")
And also how many replica do you have? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 11 nov. 2013 à 21:17, Aaron Troy [atoy3731@gmail.com](mailto:atoy3731@gmail.com) a écrit : > Ah, perhaps that is the issue. > > Right now I have 48 indexes, each with 12 shards randomly allocated across the nodes. Would reducing the number of shards per index (perhaps 6) help the issue with open files? > > On Monday, November 11, 2013 2:59:48 PM UTC-5, David Pilato wrote: > > > Probably too many shards per node, right? > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 11 nov. 2013 à 20:00, Aaron Troy [atoy...@gmail.com](mailto:atoy...@gmail.com) a écrit : > > > > > Hi all, > > > > > > I'm running into a 'Too many open files' issue even after I've greatly increased the file limit on each node of the ES cluster. The set up is 6 storage nodes with around 630 million total indexed documents. > > > > > > Here's the node output showing that the limit is indeed 65,535 per node (500,000 on one where I was testing): > > > > > > { > > > "ok" : true, > > > "cluster\_name" : "Odine", > > > "nodes" : { > > > "J\_vVn1gKQMmcDYADbcPlfw" : { > > > "name" : "rap-es-1", > > > "transport\_address" : "inet[/141.161.88.174:9300]", > > > "hostname" : "rap-es-1.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.174:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 31729, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "hT\_Z-JneS6uCem0M-7nTEQ" : { > > > "name" : "rap-es", > > > "transport\_address" : "inet[/141.161.88.169:9300]", > > > "hostname" : "rap-es.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.169:9200]", > > > "attributes" : { > > > "data" : "false" > > > }, > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 2, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 2, > > > "total\_sockets" : 2, > > > "cores\_per\_socket" : 1, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255303680 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 10282, > > > "max\_file\_descriptors" : 500000 > > > } > > > }, > > > "-76vB5ISTUq4M7ESizP7og" : { > > > "name" : "rap-es-4", > > > "transport\_address" : "inet[/141.161.88.177:9301]", > > > "hostname" : "rap-es-4.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.177:9201]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 2462, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "xssBGLKITpicDcxdeEjr4A" : { > > > "name" : "rap-es-6", > > > "transport\_address" : "inet[/141.161.88.179:9300]", > > > "hostname" : "rap-es-6.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.179:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 2608, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "wg\_I5wBfRxqs6kdH-S\_kww" : { > > > "name" : "rap-es-6", > > > "transport\_address" : "inet[/141.161.88.179:9301]", > > > "hostname" : "rap-es-6.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.179:9201]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 2570, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "lG0sqr95Q02Lt-iTCcg6qg" : { > > > "name" : "rap-es-5", > > > "transport\_address" : "inet[/141.161.88.178:9300]", > > > "hostname" : "rap-es-5.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.178:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 22580, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "biDQwwn4R9GTkesZUlNW1g" : { > > > "name" : "rap-es-2", > > > "transport\_address" : "inet[/141.161.88.175:9300]", > > > "hostname" : "rap-es-2.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.175:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 5190, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "A7E7I7R5SIib6RJPA3RNug" : { > > > "name" : "rap-es-4", > > > "transport\_address" : "inet[/141.161.88.177:9300]", > > > "hostname" : "rap-es-4.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.177:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 2500, > > > "max\_file\_descriptors" : 65535 > > > } > > > }, > > > "oQG-yfURTTWZiFC6eOwjAg" : { > > > "name" : "rap-es-3", > > > "transport\_address" : "inet[/141.161.88.176:9300]", > > > "hostname" : "rap-es-3.uis.georgetown.edu", > > > "version" : "0.90.3", > > > "http\_address" : "inet[/141.161.88.176:9200]", > > > "os" : { > > > "refresh\_interval" : 1000, > > > "available\_processors" : 4, > > > "cpu" : { > > > "vendor" : "Intel", > > > "model" : "Xeon", > > > "mhz" : 1995, > > > "total\_cores" : 4, > > > "total\_sockets" : 1, > > > "cores\_per\_socket" : 4, > > > "cache\_size" : "18kb", > > > "cache\_size\_in\_bytes" : 18432 > > > }, > > > "mem" : { > > > "total" : "7.6gb", > > > "total\_in\_bytes" : 8255045632 > > > }, > > > "swap" : { > > > "total" : "7.9gb", > > > "total\_in\_bytes" : 8589926400 > > > } > > > }, > > > "process" : { > > > "refresh\_interval" : 1000, > > > "id" : 1291, > > > "max\_file\_descriptors" : 65535 > > > } > > > } > > > } > > > } > > > > > > ## Any idea why I'm still getting this error? > > > > > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Aaron\_Troy](https://avatars.discourse-cdn.com/v4/letter/a/5e9695/32.png) [@Aaron\_Troy](https://discuss.elastic.co/u/Aaron_Troy)\ **Post date:** [November 11, 2013, 8:40pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/5 "2013-11-11T20:40:05Z")
Only one replica per shard. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [November 11, 2013, 8:55pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/6 "2013-11-11T20:55:26Z")
So you have 1152 shards on 6 nodes. About 200 shards per node. Each shard needs many file descriptors for files but for socket as well. I would really reduce the number of shard per node. Which means to me: Decrease the number of shard (don't over allocate) Increase the number of nodes HTH -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 11 nov. 2013 à 21:40, Aaron Troy [atoy3731@gmail.com](mailto:atoy3731@gmail.com) a écrit : ## Only one replica per shard. You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Aaron\_Troy](https://avatars.discourse-cdn.com/v4/letter/a/5e9695/32.png) [@Aaron\_Troy](https://discuss.elastic.co/u/Aaron_Troy)\ **Post date:** [November 11, 2013, 9:10pm UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/7 "2013-11-11T21:10:22Z")
Thanks for the input, David. As the system is still ingesting and collecting data, I think decreasing the number of shards per index is the way to go as of now. Guess I'd better start reindexing. Thanks again! On Monday, November 11, 2013 3:55:26 PM UTC-5, David Pilato wrote: > So you have 1152 shards on 6 nodes. > About 200 shards per node. > > Each shard needs many file descriptors for files but for socket as well. > > I would really reduce the number of shard per node. Which means to me: > Decrease the number of shard (don't over allocate) > Increase the number of nodes > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 11 nov. 2013 à 21:40, Aaron Troy \<[atoy...@gmail.com](mailto:atoy...@gmail.com) \\> a > écrit : > > Only one replica per shard. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Scott\_Davis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/scott_davis/32/1992_2.png) [@Scott\_Davis](https://discuss.elastic.co/u/Scott_Davis)\ **Post date:** [November 12, 2013, 9:13am UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/8 "2013-11-12T09:13:19Z")
Aaron - also, if you aren't already, be sure to checkout some of the site plugins available to help review various performance metrics: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-plugins.html#site) On Monday, November 11, 2013 4:10:22 PM UTC-5, Aaron Troy wrote: > Thanks for the input, David. As the system is still ingesting and > collecting data, I think decreasing the number of shards per index is the > way to go as of now. > > Guess I'd better start reindexing. > > Thanks again! > > On Monday, November 11, 2013 3:55:26 PM UTC-5, David Pilato wrote: > > > So you have 1152 shards on 6 nodes. > > About 200 shards per node. > > > > Each shard needs many file descriptors for files but for socket as well. > > > > I would really reduce the number of shard per node. Which means to me: > > Decrease the number of shard (don't over allocate) > > Increase the number of nodes > > > > HTH > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 11 nov. 2013 à 21:40, Aaron Troy [atoy...@gmail.com](mailto:atoy...@gmail.com) a écrit : > > > > Only one replica per shard. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:07am UTC](https://discuss.elastic.co/t/too-many-open-files-even-after-increasing-limit/14354/9 "2017-07-06T02:07:43Z")