# Garbage collector logs long passes **URL:** \ **Category:** Elasticsearch\ **Created:** [June 17, 2014, 11:00am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151 "2014-06-17T11:00:43Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Kevin\_Qi](https://avatars.discourse-cdn.com/v4/letter/k/47e85d/32.png) [@Kevin\_Qi](https://discuss.elastic.co/u/Kevin_Qi)\ **Post date:** [June 17, 2014, 11:00am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/1 "2014-06-17T11:00:43Z")
_Hi,_ _We are running Elasticsearch 0.90.7 on Linux sever (1 node cluster)._ _From time to time, Elasticsearch stop responding and the issue looks related to the Garbage Collector. The log file is shown blow:_ _[2014-06-16 09:35:48,563][WARN][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674153][113273] duration [12.1s], collections [1]/[12.3s], total [12.1s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [158.2mb]-\>[95.3mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:35:58,800][INFO][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674154][113274] duration [9.9s], collections [1]/[10.2s], total [9.9s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [95.3mb]-\>[58.6mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:36:11,236][WARN][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674155][113275] duration [12s], collections [1]/[12.4s], total [12s]/[17.9h], memory [7.2gb]-\>[7.3gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [58.6mb]-\>[138.1mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:36:23,879][WARN][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674156][113276] duration [12.3s], collections [1]/[12.6s], total [12.3s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [138.1mb]-\>[113mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:36:34,043][INFO][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674157][113277] duration [9.8s], collections [1]/[10.1s], total [9.8s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [113mb]-\>[79mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:36:46,486][WARN][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674158][113278] duration [12.1s], collections [1]/[12.4s], total [12.1s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [79mb]-\>[107.2mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:36:56,649][INFO][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674159][113279] duration [9.9s], collections [1]/[10.1s], total [9.9s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [107.2mb]-\>[68.7mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ _[2014-06-16 09:37:08,995][WARN][monitor.jvm] [node01] [gc][ConcurrentMarkSweep][1674160][113280] duration [12s], collections [1]/[12.3s], total [12s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] [68.7mb]-\>[79.7mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] [34.7mb]-\>[34.7mb]/[82mb]}_ \*The garbage collector logs long passes (around 10 seconds). Our system has total memory of 32G and we set the ES\_HEAP\_SIZA to be 8G. \* _We are almost sure this issue comes from long GC run._ _What can we do to prevent this behavior and run ES smoothly ?_ _Thanks,_ _Kevin_ -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [June 17, 2014, 11:43am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/2 "2014-06-17T11:43:03Z")
Upgrade to a newer version of ES, also upgrade java, and if you can, increase your heap. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 17 June 2014 21:00, Kevin Qi [p8kevinqi@gmail.com](mailto:p8kevinqi@gmail.com) wrote: > _Hi,_ > _We are running Elasticsearch 0.90.7 on Linux sever (1 node cluster)._ > _From time to time, Elasticsearch stop responding and the issue looks > related to the Garbage Collector. The log file is shown blow:_ > > _[2014-06-16 09:35:48,563][WARN][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674153][113273] duration [12.1s], collections > [1]/[12.3s], total [12.1s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [158.2mb]-\>[95.3mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:35:58,800][INFO][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674154][113274] duration [9.9s], collections > [1]/[10.2s], total [9.9s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [95.3mb]-\>[58.6mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:36:11,236][WARN][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674155][113275] duration [12s], collections > [1]/[12.4s], total [12s]/[17.9h], memory [7.2gb]-\>[7.3gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [58.6mb]-\>[138.1mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:36:23,879][WARN][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674156][113276] duration [12.3s], collections > [1]/[12.6s], total [12.3s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [138.1mb]-\>[113mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:36:34,043][INFO][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674157][113277] duration [9.8s], collections > [1]/[10.1s], total [9.8s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [113mb]-\>[79mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:36:46,486][WARN][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674158][113278] duration [12.1s], collections > [1]/[12.4s], total [12.1s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [79mb]-\>[107.2mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:36:56,649][INFO][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674159][113279] duration [9.9s], collections > [1]/[10.1s], total [9.9s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [107.2mb]-\>[68.7mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > _[2014-06-16 09:37:08,995][WARN][monitor.jvm] [node01] > [gc][ConcurrentMarkSweep][1674160][113280] duration [12s], collections > [1]/[12.3s], total [12s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > [68.7mb]-\>[79.7mb]/[665.6mb]}{[Par Survivor Space] > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > [34.7mb]-\>[34.7mb]/[82mb]}_ > > \*The garbage collector logs long passes (around 10 seconds). Our system > has total memory of 32G and we set the ES\_HEAP\_SIZA to be 8G. \* > _We are almost sure this issue comes from long GC run._ > _What can we do to prevent this behavior and run ES smoothly ?_ > > _Thanks,_ > > _Kevin_ > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624bDWg-uQ6wM1nFM8byCZXXbHF9V3L34wV1%2BmmS0LLNoWA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624bDWg-uQ6wM1nFM8byCZXXbHF9V3L34wV1%2BmmS0LLNoWA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\ **Post date:** [June 17, 2014, 2:10pm UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/3 "2014-06-17T14:10:48Z")
You likely want to find out whats taking up your heap. The biggest consumer of heap is fielddata. This will tell you what is in your fielddata and you can track it back to your code to see where you are using these fields: curl localhost:9200/\_nodes/stats/indices/fielddata/\*?pretty -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6b539a31-a164-4398-8154-d87a3f3ee037%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6b539a31-a164-4398-8154-d87a3f3ee037%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Kevin\_Qi](https://avatars.discourse-cdn.com/v4/letter/k/47e85d/32.png) [@Kevin\_Qi](https://discuss.elastic.co/u/Kevin_Qi)\ **Post date:** [June 23, 2014, 10:52am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/4 "2014-06-23T10:52:29Z")
Thanks Mark. Any suggestions on how to set the heap? Our machine has s total RAM of 32 G. Mark Walkom於 2014年6月17日星期二UTC+8下午7時44分32秒寫道： > Upgrade to a newer version of ES, also upgrade java, and if you can, > increase your heap. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \ > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 17 June 2014 21:00, Kevin Qi \<[p8ke...@gmail.com](mailto:p8ke...@gmail.com) \\> wrote: > > > _Hi,_ > > _We are running Elasticsearch 0.90.7 on Linux sever (1 node cluster)._ > > _From time to time, Elasticsearch stop responding and the issue looks > > related to the Garbage Collector. The log file is shown blow:_ > > > > _[2014-06-16 09:35:48,563][WARN][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674153][113273] duration [12.1s], collections > > [1]/[12.3s], total [12.1s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [158.2mb]-\>[95.3mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:35:58,800][INFO][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674154][113274] duration [9.9s], collections > > [1]/[10.2s], total [9.9s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [95.3mb]-\>[58.6mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:36:11,236][WARN][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674155][113275] duration [12s], collections > > [1]/[12.4s], total [12s]/[17.9h], memory [7.2gb]-\>[7.3gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [58.6mb]-\>[138.1mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:36:23,879][WARN][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674156][113276] duration [12.3s], collections > > [1]/[12.6s], total [12.3s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [138.1mb]-\>[113mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:36:34,043][INFO][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674157][113277] duration [9.8s], collections > > [1]/[10.1s], total [9.8s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [113mb]-\>[79mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:36:46,486][WARN][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674158][113278] duration [12.1s], collections > > [1]/[12.4s], total [12.1s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [79mb]-\>[107.2mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:36:56,649][INFO][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674159][113279] duration [9.9s], collections > > [1]/[10.1s], total [9.9s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [107.2mb]-\>[68.7mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > _[2014-06-16 09:37:08,995][WARN][monitor.jvm] [node01] > > [gc][ConcurrentMarkSweep][1674160][113280] duration [12s], collections > > [1]/[12.3s], total [12s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > [68.7mb]-\>[79.7mb]/[665.6mb]}{[Par Survivor Space] > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > > \*The garbage collector logs long passes (around 10 seconds). Our system > > has total memory of 32G and we set the ES\_HEAP\_SIZA to be 8G. \* > > _We are almost sure this issue comes from long GC run._ > > _What can we do to prevent this behavior and run ES smoothly ?_ > > > > _Thanks,_ > > > > _Kevin_ > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Kevin\_Qi](https://avatars.discourse-cdn.com/v4/letter/k/47e85d/32.png) [@Kevin\_Qi](https://discuss.elastic.co/u/Kevin_Qi)\ **Post date:** [June 23, 2014, 10:54am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/5 "2014-06-23T10:54:15Z")
Thanks for your kind help Binh, the result shows : "indices" : { "fielddata" : { "memory\_size" : "0b", "memory\_size\_in\_bytes" : 0, "evictions" : 0, "fields" : { } } } Is there something wrong? Binh Ly於 2014年6月17日星期二UTC+8下午10時10分49秒寫道： > You likely want to find out whats taking up your heap. The biggest > consumer of heap is fielddata. This will tell you what is in your fielddata > and you can track it back to your code to see where you are using these > fields: > > curl localhost:9200/\_nodes/stats/indices/fielddata/\*?pretty -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/3f0a5026-f695-4345-84a8-a34de4aea4f3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/3f0a5026-f695-4345-84a8-a34de4aea4f3%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [June 23, 2014, 10:55am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/6 "2014-06-23T10:55:58Z")
Preferably 50% of system RAM, in your case 16G. You also really want to upgrade to 1.X, there are a lot of performance improvements. What version and release of java are you running? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 23 June 2014 20:52, Kevin Qi [p8kevinqi@gmail.com](mailto:p8kevinqi@gmail.com) wrote: > Thanks Mark. Any suggestions on how to set the heap? Our machine has s > total RAM of 32 G. > > Mark Walkom於 2014年6月17日星期二UTC+8下午7時44分32秒寫道： > > > Upgrade to a newer version of ES, also upgrade java, and if you can, > > increase your heap. > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 17 June 2014 21:00, Kevin Qi [p8ke...@gmail.com](mailto:p8ke...@gmail.com) wrote: > > > > > _Hi,_ > > > _We are running Elasticsearch 0.90.7 on Linux sever (1 node cluster)._ > > > _From time to time, Elasticsearch stop responding and the issue looks > > > related to the Garbage Collector. The log file is shown blow:_ > > > > > > _[2014-06-16 09:35:48,563][WARN][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674153][113273] duration [12.1s], collections > > > [1]/[12.3s], total [12.1s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [158.2mb]-\>[95.3mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:35:58,800][INFO][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674154][113274] duration [9.9s], collections > > > [1]/[10.2s], total [9.9s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [95.3mb]-\>[58.6mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:36:11,236][WARN][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674155][113275] duration [12s], collections > > > [1]/[12.4s], total [12s]/[17.9h], memory [7.2gb]-\>[7.3gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [58.6mb]-\>[138.1mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:36:23,879][WARN][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674156][113276] duration [12.3s], collections > > > [1]/[12.6s], total [12.3s]/[17.9h], memory [7.3gb]-\>[7.2gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [138.1mb]-\>[113mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:36:34,043][INFO][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674157][113277] duration [9.8s], collections > > > [1]/[10.1s], total [9.8s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [113mb]-\>[79mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > > > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:36:46,486][WARN][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674158][113278] duration [12.1s], collections > > > [1]/[12.4s], total [12.1s]/[17.9h], memory [7.2gb]-\>[7.2gb]/[7.9gb], > > > all\_pools {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [79mb]-\>[107.2mb]/[665.6mb]}{[Par Survivor Space] [0b]-\>[0b]/[83.1mb]}{[CMS > > > Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:36:56,649][INFO][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674159][113279] duration [9.9s], collections > > > [1]/[10.1s], total [9.9s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > > > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [107.2mb]-\>[68.7mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > _[2014-06-16 09:37:08,995][WARN][monitor.jvm] [node01] > > > [gc][ConcurrentMarkSweep][1674160][113280] duration [12s], collections > > > [1]/[12.3s], total [12s]/[18h], memory [7.2gb]-\>[7.2gb]/[7.9gb], all\_pools > > > {[Code Cache] [15.5mb]-\>[15.5mb]/[48mb]}{[Par Eden Space] > > > [68.7mb]-\>[79.7mb]/[665.6mb]}{[Par Survivor Space] > > > [0b]-\>[0b]/[83.1mb]}{[CMS Old Gen] [7.1gb]-\>[7.1gb]/[7.1gb]}{[CMS Perm Gen] > > > [34.7mb]-\>[34.7mb]/[82mb]}_ > > > > > > \*The garbage collector logs long passes (around 10 seconds). Our system > > > has total memory of 32G and we set the ES\_HEAP\_SIZA to be 8G. \* > > > _We are almost sure this issue comes from long GC run._ > > > _What can we do to prevent this behavior and run ES smoothly ?_ > > > > > > _Thanks,_ > > > > > > _Kevin_ > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d% > > > [40googlegroups.com](http://40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/bac7e7fb-e166-457f-89af-e832ce76010d%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/594717f0-a099-423d-8d9d-600814fd101e%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624bEtNUcfaF-BrEay1x%3DUG2VmV58ev77JfUe8T66QNQU0g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624bEtNUcfaF-BrEay1x%3DUG2VmV58ev77JfUe8T66QNQU0g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:20am UTC](https://discuss.elastic.co/t/garbage-collector-logs-long-passes/18151/7 "2017-07-06T01:20:38Z")