Server didn't recover from too many open files error


(Pavel Dvorak) #1

I didn't have unlimited files option enabled. ES worked fine for few months
and today it crashed. Had 0.19.2.
IndexFailedEngineException occured with Too many open files
I tried to restart ES but i didn't shutdown, so I killed it. But didn't
start again...
Had to restore from backup
Attaching full log
Note: failed to obtain node lock error is due wrong file permission after
restoring from backup
thanks for help


(Shay Banon) #2

I don't see the problem in the log, seems like ti started properly, maybe I am missing something? As a side note, things has improved even more in recent versions.

On Aug 5, 2012, at 11:46 PM, Pavel Dvorak pavel.dvorak.work@gmail.com wrote:

I didn't have unlimited files option enabled. ES worked fine for few months and today it crashed. Had 0.19.2.
IndexFailedEngineException occured with Too many open files
I tried to restart ES but i didn't shutdown, so I killed it. But didn't start again...
Had to restore from backup
Attaching full log
Note: failed to obtain node lock error is due wrong file permission after restoring from backup
thanks for help
<elasticsearch.zip>


(Pavel Dvorak) #3

I have updated now
the last part of the log is after restore
try to find this line
org.elasticsearch.index.IndexShardMissingException: [action_log_console][1]
missing
it didn't work after this, it displayed red status

Dne úterý, 7. srpna 2012 23:51:58 UTC+2 kimchy napsal(a):

I don't see the problem in the log, seems like ti started properly, maybe
I am missing something? As a side note, things has improved even more in
recent versions.

On Aug 5, 2012, at 11:46 PM, Pavel Dvorak <pavel.dv...@gmail.com<javascript:>>
wrote:

I didn't have unlimited files option enabled. ES worked fine for few
months and today it crashed. Had 0.19.2.
IndexFailedEngineException occured with Too many open files
I tried to restart ES but i didn't shutdown, so I killed it. But didn't
start again...
Had to restore from backup
Attaching full log
Note: failed to obtain node lock error is due wrong file permission
after restoring from backup
thanks for help
<elasticsearch.zip>


(system) #4