hi All,
we have a cluster consists of 15 data nodes.
we keep having high JVM heap usage (99% max) and result in elasticseach crash.
everytime when we have this issue, we have to restart the whole cluster and after awhile (few days) it crash again.
we are using elasticsearch 2.4.1 and below are the configurations we used for data node:
elaticsearch config file:
ES_HEAP_SIZE=31g
bootstrap.memory_lock: true
/etc/security/limits.conf:
elasticsearch soft nofile 65536
elasticsearch hard nofile 196608
elasticsearch soft memlock unlimited
elasticsearch hard memlock unlimited
/etc/sysctl.conf:
vm.swappiness = 1
what can we do to resolve this issue???? please help!