Elasticsearch version:5.2.0
Plugins installed: []
JVM version:1.8.0_121
OS version:redhat
config/jvm.options
-Xms20g
-Xmx20g
-XX:+UseCondCardMark
-XX:CMSWaitDuration=250
-XX:+UseG1GC
-XX:MaxGCPauseMillis=200
=============================================================================
I need to configure how to solve this problem?
and how to optimize index?
[2017-02-25T22:24:23,840][INFO ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][young][2829][54] duration [1.6s], collections [2]/[2.4s], total [1.6s]/[8.1s], memory [10.6gb]->[6.2gb]/[20gb], all_pools {[young] [8.8gb]->[8mb]/[0b]}{[survivor] [40mb]->[72mb]/[0b]}{[old] [1.7gb]->[6.2gb]/[20gb]}
[2017-02-25T22:24:23,841][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2829] overhead, spent [1.6s] collecting in the last [2.4s]
[2017-02-25T22:24:24,841][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2830] overhead, spent [653ms] collecting in the last [1s]
[2017-02-25T22:24:25,869][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2831] overhead, spent [591ms] collecting in the last [1s]
[2017-02-25T22:24:26,908][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2832] overhead, spent [710ms] collecting in the last [1s]
[2017-02-25T22:24:27,957][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2833] overhead, spent [703ms] collecting in the last [1s]
[2017-02-25T22:24:29,070][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2834] overhead, spent [733ms] collecting in the last [1.1s]
[2017-02-25T22:24:30,071][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2835] overhead, spent [747ms] collecting in the last [1s]
[2017-02-25T22:24:39,251][INFO ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][old][2836][1] duration [8.1s], collections [1]/[9.1s], total [8.1s]/[8.1s], memory [17.9gb]->[18.1gb]/[20gb], all_pools {[young] [304mb]->[8mb]/[0b]}{[survivor] [128mb]->[0b]/[0b]}{[old] [17.5gb]->[18.1gb]/[20gb]}
[2017-02-25T22:24:39,251][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2836] overhead, spent [8.8s] collecting in the last [9.1s]
[2017-02-25T22:24:42,208][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2837] overhead, spent [2.7s] collecting in the last [2.9s]
[2017-02-25T22:24:44,980][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2838] overhead, spent [2.6s] collecting in the last [2.7s]
[2017-02-25T22:24:47,093][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2839] overhead, spent [2s] collecting in the last [2.1s]
[2017-02-25T22:24:48,403][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2840] overhead, spent [1.3s] collecting in the last [1.3s]
[2017-02-25T22:26:55,561][WARN ][o.e.m.j.JvmGcMonitorService] [node-3] [gc][2841] overhead, spent [1.2m] collecting in the last [2.1m]
[2017-02-25T22:26:55,584][WARN ][o.e.d.z.PublishClusterStateAction] [node-3] received a cluster state from a different master than the current one, rejecting (received {node-4}{5BRY8-u3Tj-K274V8qT0wg}{3OGNrcBvS424iNK6BQwLgw}{125.39.176.88}{125.39.176.88:9300}, current {node-2}{S77O9WbzR_Sv0R2tJXgUfQ}{doWv8sGUSOGPuvUv-uEvZA}{125.39.176.86}{125.39.176.86:9300})
[2017-02-25T22:26:55,610][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][search][T#15]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,609][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][generic][T#3]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,609][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][refresh][T#3]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,559][WARN ][i.n.u.c.SingleThreadEventExecutor] Unexpected exception from an event executor:
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,609][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][generic][T#5]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,609][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][generic][T#2]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,564][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,560][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,561][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,564][WARN ][i.n.u.c.SingleThreadEventExecutor] Unexpected exception from an event executor:
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,557][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,564][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,609][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-3] fatal error in thread [elasticsearch[node-3][generic][T#1]], exiting
java.lang.OutOfMemoryError: Java heap space
[2017-02-25T22:26:55,557][WARN ][i.n.c.n.NioEventLoop ] Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: Java heap space