Get Perf Counters for ElasticSearch Nodes using JSON

Elastic Stack Elasticsearch
1

Hi

I need to read the Performance counters (OS CPU%,JVM Memory,Disk Free
Space,Iops) of the elastic search nodes using JSON in my C#.NET
application. To do that first I need the JSON query to get the counters
like the ones that appear under "Nodes" section in Marvel webpage.

Does anyone know how to get that? I know it should be something like we get
when we click "Inspect" element in marvel. (something like below) but I
don't see any "Inspect" element for the "nodes" section.

The following JSON query seems to be for Document section.

GET .marvel-2014.07.16/_search?pretty
{
"facets": {
"0": {
"date_histogram": {
"key_field": "@timestamp",
"value_field": "total.search.query_total",
"interval": "1m"
},
"global": true,
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"query_string": {
"query": "_type:indices_stats"
} ....................
...............................

Appreciate if anyone can provide some pointers on this?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8e44e3d3-a4c4-4f7b-a278-7cebd7f31845%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

You will want the cat API to start, then check out the cluster one next.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index.html

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 17 July 2014 10:14, Krishna nvamshikrishna@gmail.com wrote:

Hi

I need to read the Performance counters (OS CPU%,JVM Memory,Disk Free
Space,Iops) of the elastic search nodes using JSON in my C#.NET
application. To do that first I need the JSON query to get the counters
like the ones that appear under "Nodes" section in Marvel webpage.

Does anyone know how to get that? I know it should be something like we
get when we click "Inspect" element in marvel. (something like below) but I
don't see any "Inspect" element for the "nodes" section.

The following JSON query seems to be for Document section.

GET .marvel-2014.07.16/_search?pretty
{
"facets": {
"0": {
"date_histogram": {
"key_field": "@timestamp",
"value_field": "total.search.query_total",
"interval": "1m"
},
"global": true,
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"query_string": {
"query": "_type:indices_stats"
} ....................
...............................

Appreciate if anyone can provide some pointers on this?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8e44e3d3-a4c4-4f7b-a278-7cebd7f31845%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/8e44e3d3-a4c4-4f7b-a278-7cebd7f31845%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624bR975QP3WmVLTPDHXGT-DZxrNyOtWGxM%3Dn%3DzPQUH3MzA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Are you looking for something
like http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-stats.html
?

Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

On Wednesday, July 16, 2014 8:14:00 PM UTC-4, Krishna wrote:

Hi

I need to read the Performance counters (OS CPU%,JVM Memory,Disk Free
Space,Iops) of the elastic search nodes using JSON in my C#.NET
application. To do that first I need the JSON query to get the counters
like the ones that appear under "Nodes" section in Marvel webpage.

Does anyone know how to get that? I know it should be something like we
get when we click "Inspect" element in marvel. (something like below) but I
don't see any "Inspect" element for the "nodes" section.

The following JSON query seems to be for Document section.

GET .marvel-2014.07.16/_search?pretty
{
"facets": {
"0": {
"date_histogram": {
"key_field": "@timestamp",
"value_field": "total.search.query_total",
"interval": "1m"
},
"global": true,
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"query_string": {
"query": "_type:indices_stats"
} ....................
...............................

Appreciate if anyone can provide some pointers on this?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/83d395c5-2312-4b20-8a4f-6b708e0c3ed3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

4

Thanks Otis, I am looking for Node level stats (Each nodes's
CPU/Memory/Disk space etc). Looks like cluster API gives cluster level
stats. I also looked at the above reply by Mark but looks like results from
CAT apis are a bit difficult to parse using JSON as mentioned in
elasticsearch.org. I was trying to use Query DSL to get Perf results in
JSON format for each node but not successful so far yet.

Any hints would be appreciated.

On Friday, July 18, 2014 9:29:46 PM UTC-7, Otis Gospodnetic wrote:

Are you looking for something like
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-stats.html
?

Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

On Wednesday, July 16, 2014 8:14:00 PM UTC-4, Krishna wrote:

Hi

I need to read the Performance counters (OS CPU%,JVM Memory,Disk Free
Space,Iops) of the elastic search nodes using JSON in my C#.NET
application. To do that first I need the JSON query to get the counters
like the ones that appear under "Nodes" section in Marvel webpage.

Does anyone know how to get that? I know it should be something like we
get when we click "Inspect" element in marvel. (something like below) but I
don't see any "Inspect" element for the "nodes" section.

The following JSON query seems to be for Document section.

GET .marvel-2014.07.16/_search?pretty
{
"facets": {
"0": {
"date_histogram": {
"key_field": "@timestamp",
"value_field": "total.search.query_total",
"interval": "1m"
},
"global": true,
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"query_string": {
"query": "_type:indices_stats"
} ....................
...............................

Appreciate if anyone can provide some pointers on this?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e4912754-0328-46ab-a770-04dba20fae06%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

5