I'm using Apache Camel to index data from a Enterprise Service. I'm testing it out on a local elasticsearch instance. It appears to index about 12000 files then starts giving me a Too many files error. I set my ulimit to 64000 and some other settings:
sudo sysctl kern.maxfiles=64000 sudo sysctl kern.maxfilesperproc=64000 sudo ulimit 64000 sudo ulimit -Hn 64000 sudo ulimit -Sn 64000
This got rid of the too many open files issue, but I'm now running into a Socket Closed issue. I'm not sure if these problems will go away when I'm running multiple nodes in a hosted environment instead of my local machine.