# Elasticsearch endless garbage collection **URL:** \ **Category:** Elasticsearch\ **Created:** [February 25, 2015, 11:51am UTC](https://discuss.elastic.co/t/elasticsearch-endless-garbage-collection/22382 "2015-02-25T11:51:00Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![chris85lang](https://avatars.discourse-cdn.com/v4/letter/c/a587f6/32.png) [@chris85lang](https://discuss.elastic.co/u/chris85lang)\ **Post date:** [February 25, 2015, 11:51am UTC](https://discuss.elastic.co/t/elasticsearch-endless-garbage-collection/22382/1 "2015-02-25T11:51:00Z")
Hello, we use a elasticsearch cluster with two nodes together with logstash and kibana. When we receive a large amount of logs (\>200 per sec.) elasticsearch becomes unusable slow. We see a lot of garbage collection going on as well: [2015-02-25 18:27:02,494][WARN][monitor.jvm] [server1] [gc][old][564][30] duration [12.4s], collections [1]/[13s], total [12.4s]/[3.5m], memory [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[323.4mb]/[1.1gb]}{[survivor] [65.5mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:27:14,098][INFO][monitor.jvm] [server1] [gc][old][566][31] duration [9.2s], collections [1]/[9.8s], total [9.2s]/[3.7m], memory [9.7gb]-\>[8.7gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[237.4mb]/[1.1gb]}{[survivor] [65.7mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:27:27,717][WARN][monitor.jvm] [server1] [gc][old][568][32] duration [12s], collections [1]/[12.6s], total [12s]/[3.9m], memory [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[275.2mb]/[1.1gb]}{[survivor] [73.1mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:27:39,518][INFO][monitor.jvm] [server1] [gc][old][570][33] duration [9.5s], collections [1]/[9.9s], total [9.5s]/[4.1m], memory [9.8gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[341mb]/[1.1gb]}{[survivor] [99.7mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:27:49,549][INFO][monitor.jvm] [server1] [gc][old][571][34] duration [9s], collections [1]/[10s], total [9s]/[4.2m], memory [8.8gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [341mb]-\>[364.5mb]/[1.1gb]}{[survivor] [0b]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:27:59,113][INFO][monitor.jvm] [server1] [gc][old][572][35] duration [8.5s], collections [1]/[9.5s], total [8.5s]/[4.4m], memory [8.8gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] [364.5mb]-\>[379.8mb]/[1.1gb]}{[survivor] [0b]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:28:08,713][INFO][monitor.jvm] [server1] [gc][old][574][36] duration [8.5s], collections [1]/[8.5s], total [8.5s]/[4.5m], memory [9.8gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[420.4mb]/[1.1gb]}{[survivor] [146.1mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:28:18,486][INFO][monitor.jvm] [server1] [gc][old][576][37] duration [8.3s], collections [1]/[8.7s], total [8.3s]/[4.6m], memory [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[365.2mb]/[1.1gb]}{[survivor] [66.6mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:28:28,169][INFO][monitor.jvm] [server1] [gc][old][578][38] duration [8.3s], collections [1]/[8.6s], total [8.3s]/[4.8m], memory [9.7gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[389mb]/[1.1gb]}{[survivor] [88.7mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:28:38,022][INFO][monitor.jvm] [server1] [gc][old][580][39] duration [8.6s], collections [1]/[8.8s], total [8.6s]/[4.9m], memory [9.7gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[387.2mb]/[1.1gb]}{[survivor] [79mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} [2015-02-25 18:28:48,061][INFO][monitor.jvm] [server1] [gc][old][582][40] duration [8.2s], collections [1]/[9s], total [8.2s]/[5.1m], memory [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] [1.1gb]-\>[325.4mb]/[1.1gb]}{[survivor] [14.6mb]-\>[0b]/[149.7mb]}{[old] [8.5gb]-\>[8.5gb]/[8.5gb]} In htop we see its mainly one core who is busy all the time: [![](http://i.imgur.com/7LDS8h4.png) ](http://i.imgur.com/7LDS8h4.png) Any ideas? Cheers, Chris -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [February 26, 2015, 12:55am UTC](https://discuss.elastic.co/t/elasticsearch-endless-garbage-collection/22382/2 "2015-02-26T00:55:34Z")
How much heap do you have, how much system RAM, how much data, what ES version, what java version and release? On 25 February 2015 at 22:51, [chris85lang@googlemail.com](mailto:chris85lang@googlemail.com) wrote: > Hello, > > we use a elasticsearch cluster with two nodes together with logstash and > kibana. When we receive a large amount of logs (\>200 per sec.) > elasticsearch becomes unusable slow. > > We see a lot of garbage collection going on as well: > [2015-02-25 18:27:02,494][WARN][monitor.jvm] [server1] [gc][old][564][30] > duration [12.4s], collections [1]/[13s], total [12.4s]/[3.5m], memory > [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[323.4mb]/[1.1gb]}{[survivor] [65.5mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:27:14,098][INFO][monitor.jvm] [server1] [gc][old][566][31] > duration [9.2s], collections [1]/[9.8s], total [9.2s]/[3.7m], memory > [9.7gb]-\>[8.7gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[237.4mb]/[1.1gb]}{[survivor] [65.7mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:27:27,717][WARN][monitor.jvm] [server1] [gc][old][568][32] > duration [12s], collections [1]/[12.6s], total [12s]/[3.9m], memory > [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[275.2mb]/[1.1gb]}{[survivor] [73.1mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:27:39,518][INFO][monitor.jvm] [server1] [gc][old][570][33] > duration [9.5s], collections [1]/[9.9s], total [9.5s]/[4.1m], memory > [9.8gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[341mb]/[1.1gb]}{[survivor] [99.7mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:27:49,549][INFO][monitor.jvm] [server1] [gc][old][571][34] > duration [9s], collections [1]/[10s], total [9s]/[4.2m], memory > [8.8gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [341mb]-\>[364.5mb]/[1.1gb]}{[survivor] [0b]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:27:59,113][INFO][monitor.jvm] [server1] [gc][old][572][35] > duration [8.5s], collections [1]/[9.5s], total [8.5s]/[4.4m], memory > [8.8gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] > [364.5mb]-\>[379.8mb]/[1.1gb]}{[survivor] [0b]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:28:08,713][INFO][monitor.jvm] [server1] [gc][old][574][36] > duration [8.5s], collections [1]/[8.5s], total [8.5s]/[4.5m], memory > [9.8gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[420.4mb]/[1.1gb]}{[survivor] [146.1mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:28:18,486][INFO][monitor.jvm] [server1] [gc][old][576][37] > duration [8.3s], collections [1]/[8.7s], total [8.3s]/[4.6m], memory > [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[365.2mb]/[1.1gb]}{[survivor] [66.6mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:28:28,169][INFO][monitor.jvm] [server1] [gc][old][578][38] > duration [8.3s], collections [1]/[8.6s], total [8.3s]/[4.8m], memory > [9.7gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[389mb]/[1.1gb]}{[survivor] [88.7mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:28:38,022][INFO][monitor.jvm] [server1] [gc][old][580][39] > duration [8.6s], collections [1]/[8.8s], total [8.6s]/[4.9m], memory > [9.7gb]-\>[8.9gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[387.2mb]/[1.1gb]}{[survivor] [79mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > [2015-02-25 18:28:48,061][INFO][monitor.jvm] [server1] [gc][old][582][40] > duration [8.2s], collections [1]/[9s], total [8.2s]/[5.1m], memory > [9.7gb]-\>[8.8gb]/[9.8gb], all\_pools {[young] > [1.1gb]-\>[325.4mb]/[1.1gb]}{[survivor] [14.6mb]-\>[0b]/[149.7mb]}{[old] > [8.5gb]-\>[8.5gb]/[8.5gb]} > > In htop we see its mainly one core who is busy all the time: > [http://i.imgur.com/7LDS8h4.png](http://i.imgur.com/7LDS8h4.png) > > Any ideas? > > Cheers, > Chris > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/e03dcdcf-2c74-405f-b073-8190c10959a9%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_bKQi9VRi8bPV\_eK8G7ou5UFy%2BJpueT%3DtqcL16esNn8g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_bKQi9VRi8bPV_eK8G7ou5UFy%2BJpueT%3DtqcL16esNn8g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:30am UTC](https://discuss.elastic.co/t/elasticsearch-endless-garbage-collection/22382/3 "2017-07-06T00:30:01Z")