Hi,
We recently had a few incidents where a single index with low memory is
impacting the entire cluster. All the cluster related APIs are not
responding. Kibana 3 and 4 are failing to load too. From log it seems it's
doing GC and not responding to any requests. And there's no log between
2:29 to 4:07 where i restarted the node. Is there anyway to make this more
resilient?
[2015-02-05 14:29:17,199][INFO ][monitor.jvm ] [Big Wheel]
[gc][young][78379][36567] duration [864ms], collections [1]/[1.7s], total
[864ms]/[1.4h], memory [15.2gb]->[14.6gb]/[19.9gb], all_pools {[young]
[599.8mb]->[2.8mb]/[665.6mb]}{[survivor] [75.6mb]->[83.1mb]/[83.1mb]}{[old]
[14.5gb]->[14.5gb]/[19.1gb]}
[2015-02-05 14:29:23,302][WARN ][monitor.jvm ] [Big Wheel]
[gc][young][78384][36568] duration [1.4s], collections [1]/[2s], total
[1.4s]/[1.4h], memory [15.1gb]->[14.7gb]/[19.9gb], all_pools {[young]
[459.7mb]->[15.7mb]/[665.6mb]}{[survivor]
[83.1mb]->[83.1mb]/[83.1mb]}{[old] [14.5gb]->[14.6gb]/[19.1gb]}
[2015-02-05 14:29:34,990][INFO ][monitor.jvm ] [Big Wheel]
[gc][young][78395][36571] duration [900ms], collections [1]/[1.4s], total
[900ms]/[1.4h], memory [15.1gb]->[14.6gb]/[19.9gb], all_pools {[young]
[484.9mb]->[3.9mb]/[665.6mb]}{[survivor] [71.7mb]->[52.4mb]/[83.1mb]}{[old]
[14.6gb]->[14.6gb]/[19.1gb]}
[2015-02-05 14:29:45,055*][WARN ][monitor.jvm ] [Big Wheel]
[gc][young][78404][36574] duration [1.2s], collections [1]/[2s], total
[1.2s]/[1.4h], memory [15.1gb]->[14.7gb]/[19.9gb], all_pools {[young]
[472.8mb]->[2.9mb]/[665.6mb]}{[survivor] [83.1mb]->[67.6mb]/[83.1mb]}{[old]
[14.6gb]->[14.6gb]/[19.1gb]}*
*[2015-02-05 16:07:15,509][*INFO ][node ] [Pyro]
version[1.4.2], pid[9796], build[927caff/2014-12-16T14:11:12Z]
[2015-02-05 16:07:15,510][INFO ][node ] [Pyro]
initializing ...
[2015-02-05 16:07:15,638][INFO ][plugins ] [Pyro] loaded
[marvel, cloud-azure], sites [marvel, kopf]
[2015-02-05 16:07:24,844][INFO ][node ] [Pyro]
initialized
[2015-02-05 16:07:24,845][INFO ][node ] [Pyro]
starting ...
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/39c89f64-8614-4c4d-bef4-420a5a9eae46%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.