Performance drops when "collection occurred" appears in logs

Elastic Stack Elasticsearch
1

I am running Master 0.16, (from around the end of March) and I've
attached a portion of the logs which correspond to a large drop in
performance. I have ES configured for 2GB MIN and MAX on a machine
with 4GB (and based on my memory metrics the heap shouldn't be being
pushed out of memory). I couldn't find the meaning of "collection
occurred" but it seems to be at the heart of the issue:

-brian

[2011-04-13 00:32:50,583][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2013] took [12s]/[10.4m], reclaimed
[-2.7E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:00,585][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2014] took [10.3s]/[10.4m], reclaimed
[-1.8E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:12,599][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2015] took [11s]/[10.4m], reclaimed
[-3.2E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:24,602][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2016] took [11.8s]/[10.4m], reclaimed
[-1.6E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:34:09,309][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2021] took [10.2s]/[10.4m], reclaimed
[-5437536b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:34:52,712][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [5.9s]
[2011-04-13 00:35:18,143][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [5.9s]
[2011-04-13 00:35:43,561][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6.1s]
[2011-04-13 00:36:10,158][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6.3s]
[2011-04-13 00:36:35,503][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6s]
[2011-04-13 00:37:00,803][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6s]
[

2

Seems like there is strain on the memory usage, and you are hitting that 2gb wall, you either need more memory, or more servers. You can try and get a feeling of where memory is used using the node stats API.
On Wednesday, April 13, 2011 at 4:45 PM, merrellb wrote:

I am running Master 0.16, (from around the end of March) and I've
attached a portion of the logs which correspond to a large drop in
performance. I have ES configured for 2GB MIN and MAX on a machine
with 4GB (and based on my memory metrics the heap shouldn't be being
pushed out of memory). I couldn't find the meaning of "collection
occurred" but it seems to be at the heart of the issue:

-brian

[2011-04-13 00:32:50,583][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2013] took [12s]/[10.4m], reclaimed
[-2.7E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:00,585][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2014] took [10.3s]/[10.4m], reclaimed
[-1.8E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:12,599][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2015] took [11s]/[10.4m], reclaimed
[-3.2E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:33:24,602][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2016] took [11.8s]/[10.4m], reclaimed
[-1.6E7b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:34:09,309][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep][2021] took [10.2s]/[10.4m], reclaimed
[-5437536b], leaving [1.9gb] used, max [2.1gb]
[2011-04-13 00:34:52,712][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [5.9s]
[2011-04-13 00:35:18,143][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [5.9s]
[2011-04-13 00:35:43,561][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6.1s]
[2011-04-13 00:36:10,158][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6.3s]
[2011-04-13 00:36:35,503][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6s]
[2011-04-13 00:37:00,803][INFO ][monitor.jvm ] [Exploding
Man] [gc][ConcurrentMarkSweep] collection occurred, took [6s]
[