Excessive Number of Open File Descriptor Count

Elastic Stack Elasticsearch
4

I've restarted everything and I'm now at 1106 open file descriptors (lsof
-p | wc -l)

On Monday, April 16, 2012 9:21:35 AM UTC+2, Stanislas Polu wrote:

Nope posting to the same index.

On Monday, April 16, 2012 9:13:18 AM UTC+2, kimchy wrote:

Does your number of shards (indices) grows? Or you just continue to index
into the same index more and more data?

On Mon, Apr 16, 2012 at 9:16 AM, Stanislas Polu <polu.stanislas@gmail.com

wrote:

Hi everyone,

I run a cluster of 3 instances with local storage.
I'm indexing ~60 elements per seconds and have been doing so for the
past month.
The number of concurrent queries is fairly low at the moment.

The number of file descriptors needed has been constantly growing and
has now grown to a point where it feels like a real issue
my current limit is 946000 and it's still not enough

Is there anything I should do?
Should I attempt to grant unlimited number of file descriptors?

Thanks for your help!

Best,

-stan

--
Stanislas Polu
Mo: +33 6 83 71 90 04 | Tw: @spolu | http://teleportd.com | Realtime
Photo Search