Excessive Number of Open File Descriptor Count

Does your number of shards (indices) grows? Or you just continue to index
into the same index more and more data?

On Mon, Apr 16, 2012 at 9:16 AM, Stanislas Polu polu.stanislas@gmail.comwrote:

Hi everyone,

I run a cluster of 3 instances with local storage.
I'm indexing ~60 elements per seconds and have been doing so for the past
month.
The number of concurrent queries is fairly low at the moment.

The number of file descriptors needed has been constantly growing and has
now grown to a point where it feels like a real issue
my current limit is 946000 and it's still not enough

Is there anything I should do?
Should I attempt to grant unlimited number of file descriptors?

Thanks for your help!

Best,

-stan

--
Stanislas Polu
Mo: +33 6 83 71 90 04 | Tw: @spolu | http://teleportd.com | Realtime
Photo Search