MetricBeat - how to define Elasticsearch JVM metrics

Elastic Stack Beats
1

Hello to everyone.
I want to know how to define Elasticsearch JVM heap usage in percentage and number of garbage collectors per some period of time.
I have already configure Elasticsearch module for Metricbeat and saw these https://www.elastic.co/guide/en/beats/metricbeat/current/exported-fields-elasticsearch.html#_jvm_gc_collectors_fields fields but right know don't understand how to get such information from them...

2

You need to use the Elasticsearch module of Metricbeat. This documentation contains an example configuration: https://www.elastic.co/guide/en/beats/metricbeat/master/metricbeat-module-elasticsearch.html

Please share your config, if you have problems with using the module.

3

I have set my configuration. Everything is working and I gather metrics but I don't know how to calculate fields heap usage in percentage and number of garbage collectors per some period of time for displaying grafics on Kibana/Grafana. To be more exactly, it's not a fields but meanings which I want to get from fields - https://www.elastic.co/guide/en/beats/metricbeat/current/exported-fields-elasticsearch.html

4

Sorry, I though you had problems with Metricbeat.

Unfortunately, right now Elasticsearch module does not contain enough info to calculate these values.

5

elasticsearch.node.stats.jvm.mem.pools.young.used.bytes - as I understood, it's used bytes (in young gen) by memory pool but not by memory heap. Pool is a part of heap.
Am I right?

6

I think the raw json output from the elasticsearch endpoint explains it best. Here you can find it: https://github.com/elastic/beats/blob/master/metricbeat/module/elasticsearch/node_stats/_meta/test/node_stats.522.json#L176

We plan to add more values to the Elasticsearch metricsets in the near future.

7

Thanks. Please, in the next version of metric beat add values"heap_used_in_bytes", "heap_used_percent".
Should I write it to some gitHub task or something else?

8

Best comment here so we don't foget about it: https://github.com/elastic/beats/issues/5965

9

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.