ElasticSearch gc performance on cluster

Elastic Stack Elasticsearch
1

Hi All,

I have few doubts around es JVM setting and GC scenarios. i have the
following cluster. i have 2 nodes in my cluster

Node 1 : memory 24 GB Heap space allocated : 12 GB
Node 2 : memory 24 GB Heap space allocated : 12 GB

No of Records will index in to ES per day is 750,000

Few days back i am getting following information from elastic search
frequently.

   [2015-02-19 08:39:35,445][INFO ][monitor.jvm              ] [node2]

[gc][young][794293][3926] duration [812ms], collections [1]/[1s], total
[812ms]/[5.9m], memory [8gb]->[8.2gb]/[11.9gb], all_pools {[young]
[33.1mb]->[64.1mb]/[133.1mb]}{[survivor] [16.6mb]->[16.6mb]/[16.6mb]}{[old]
[8gb]->[8.1gb]/[11.8gb]}

[2015-02-19 08:40:08,079][INFO ][monitor.jvm ] [node2]
[gc][young][794323][3972] duration [729ms], collections [1]/[1s], total
[729ms]/[6.1m], memory [3.6gb]->[3.8gb]/[11.9gb], all_pools {[young]
[3.6mb]->[53mb]/[133.1mb]}{[survivor] [16.6mb]->[16.6mb]/[16.6mb]}{[old]
[3.6gb]->[3.7gb]/[11.8gb]}

  when i do some R & D around i got a point this will perform by

garbage collector young to sweep the memory. if i got gc long pauses my
records indexing process will interrupt i may lose some data.

   ES suggesting no JVM tweaking required. so please suggest me where i

need to optimize the cluster to get rid of GC pauses based on my
configurations.

Thanks,
phani

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/957b1e14-1ebe-4841-98e1-6bebc9444b25%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

You don't really have much to worry about here, you aren't even hitting
single second GC periods.

On 23 February 2015 at 23:08, phani.nadiminti@goktree.com wrote:

Hi All,

I have few doubts around es JVM setting and GC scenarios. i have the
following cluster. i have 2 nodes in my cluster

Node 1 : memory 24 GB Heap space allocated : 12 GB
Node 2 : memory 24 GB Heap space allocated : 12 GB

No of Records will index in to ES per day is 750,000

Few days back i am getting following information from Elasticsearch
frequently.

   [2015-02-19 08:39:35,445][INFO ][monitor.jvm              ] [node2]

[gc][young][794293][3926] duration [812ms], collections [1]/[1s], total
[812ms]/[5.9m], memory [8gb]->[8.2gb]/[11.9gb], all_pools {[young]
[33.1mb]->[64.1mb]/[133.1mb]}{[survivor] [16.6mb]->[16.6mb]/[16.6mb]}{[old]
[8gb]->[8.1gb]/[11.8gb]}

[2015-02-19 08:40:08,079][INFO ][monitor.jvm ] [node2]
[gc][young][794323][3972] duration [729ms], collections [1]/[1s], total
[729ms]/[6.1m], memory [3.6gb]->[3.8gb]/[11.9gb], all_pools {[young]
[3.6mb]->[53mb]/[133.1mb]}{[survivor] [16.6mb]->[16.6mb]/[16.6mb]}{[old]
[3.6gb]->[3.7gb]/[11.8gb]}

  when i do some R & D around i got a point this will perform by

garbage collector young to sweep the memory. if i got gc long pauses my
records indexing process will interrupt i may lose some data.

   ES suggesting no JVM tweaking required. so please suggest me where

i need to optimize the cluster to get rid of GC pauses based on my
configurations.

Thanks,
phani

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/957b1e14-1ebe-4841-98e1-6bebc9444b25%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/957b1e14-1ebe-4841-98e1-6bebc9444b25%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_aRxGetyPcwfcdCaRS26gXi%3Do7vYU9xSX4HY7m7uySfw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Hi ,

I have all my production cluster nodes are master nodes let say gc is performing on node1 the request will be stop if it has long gc pause.so at that time node1 not able to server request .can node2 will server request if node1 has long gc pause?

Thanks & Regards,
phani