I am running elasticsearch and kibana 5.2.2.
I have a cluster of two nodes. One node kept disappearing with no trace. The only entries in the log are
[2017-03-13T14:37:20,341][INFO ][o.e.n.Node ] [PerfNode_2] stopping ...
[2017-03-13T14:37:20,715][INFO ][o.e.n.Node ] [PerfNode_2] stopped
[2017-03-13T14:37:20,715][INFO ][o.e.n.Node ] [PerfNode_2] closing ...
[2017-03-13T14:37:20,743][INFO ][o.e.n.Node ] [PerfNode_2] closed
I have turned on Debug:
"logger" : {
"action" : {
"level" : "debug"
}
}
From what I have researched it seemed to indicate that maybe it's a JVM OOM and got killed by OS? But I have the setting as 2G and the host has plenty memory.
I just enabled the host to generate kernel log. Hopefully I can catch the OOM details.