After a rather amazing run, I got the "too many open files" report again.
The platform is a commodity pc with 8gb ram, 1tb hard disk, running a
slightly out of date Ubuntu.
I added lines to /etc/security/limits.conf; something about max and
min 32000 and booted with ./elasticsearch -f -Xmx4g -Xms2g
and still got the crash.
I was running the same program on a different platform and, in about
the same level of importing, that one blew out with No Node Available;
looking at the nix console there says No route to host (never mind
that it had been running fine on a local gigabit network with no
I am still interested whether there is some background "too many open
files" going on.
Thanks in advance for ideas.
Log trace below:
Exception in thread "Thread-16" Exception in thread "Thread-2098" org.elasticsea
rch.index.engine.IndexFailedEngineException: [vertices] Index failed for [cor
Caused by: java.io.FileNotFoundException: /usr/local/lib/elasticsearch-0.90.9/da
ta/elasticsearch/nodes/0/indices/vertices/4/index/_k7z.fdt (Too many open files)
On Fri, Dec 27, 2013 at 5:19 PM, Jack Park firstname.lastname@example.org wrote:
talks about merging segments.
My curiosity/interest in this process grew when, after an overnight
data import, the index went down with Too Many Open Files.
Sure, I was able to find some instructions about telling nix to set
max files to 32000. Question is this: really, how many open files does
ES keep when importing monster loads?
Would it make sense to do an optimize following a monster load and
before further work? If so, from a Java client, how do you do that?
Thanks in advance.
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAH6s0fx32AV0%2B-KEoct251y%3DRRT6Hb2iXqZXdzSf77bvy%3DPxxQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.