I am running a 10 nodes es cluster, and everything is ok. yesterday I add 8 new nodes to the cluster, the new nodes work well at beginning, but after several hours later, all the new nodes disconnected from the cluster, and the http request to new nodes will get stuck, while the old nodes still work well.
The es process in new nodes still exist but not ouput any log(include gc log). cannot be kill by sign 15. But when I use strace or jstack operate on es process, it back to noraml again, I tried this 4 times, and 4 times the process back to normal!!!
info about os, jvm, es:
os:Linux 2.6.32-504.el6.x86_64 #1 SMP Wed Oct 15 04:27:16 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
jdk: 1.8.0_131
es: 5.2.2
es config:
es jvm config:
gc log:
Spent whole day still cannot fix it, Anyone encounter this problem before?
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.