How to Monitor Cache Usage?

Elastic Stack Elasticsearch
1

I have seen several questions on this topic, but no direct usable answers.
Is there an endpoint I can access via the api to see how the cache is being
used, whether or not it is full, whether particular queries are utilizing
the cache?

I am primarily interested in node level filter cache, but all information
would be appreciated.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

Which cache are you talking about? The filter cache?

You can use the nodes stats API

get info about how the filter cache, but you can't dive into the
details
of what is stored there.

Also, to see what filters are cached, you can use the validate API with
explain=true Elasticsearch Platform — Find real-time answers at scale | Elastic

curl -XGET 'http://127.0.0.1:9200/_all/_validate/query?pretty=1&explain=true'
-d '
{
"filtered" : {
"filter" : {
"term" : {
"foo" : "bar"
}
}
}
}
'

--> "explanation" : "ConstantScore(cache(foo:bar))"

On 15 May 2013 22:01, Benjamin Sanders insightfulquery@gmail.com wrote:

I have seen several questions on this topic, but no direct usable answers.
Is there an endpoint I can access via the api to see how the cache is being
used, whether or not it is full, whether particular queries are utilizing
the cache?

I am primarily interested in node level filter cache, but all information
would be appreciated.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

That helps a lot, thank you. I had looked at that endpoint while I was
digging through the guide, but somehow I missed seeing the cache stats.
That will at least tell me how much memory the cache is using, and how many
evictions there are. Do you know, other than the guide, where I might read
to learn more details? For instance, it says "filter evictions", but does
not give any indication if that is for the last 5 minutes, or for the
duration the server is running.

On Thursday, May 16, 2013 4:07:28 AM UTC-5, Clinton Gormley wrote:

Which cache are you talking about? The filter cache?

You can use the nodes stats API
Elasticsearch Platform — Find real-time answers at scale | Elastic get info about how the filter cache, but you can't dive into the details
of what is stored there.

Also, to see what filters are cached, you can use the validate API with
explain=true Elasticsearch Platform — Find real-time answers at scale | Elastic

curl -XGET '
http://127.0.0.1:9200/_all/_validate/query?pretty=1&explain=true' -d '
{
"filtered" : {
"filter" : {
"term" : {
"foo" : "bar"
}
}
}
}
'

--> "explanation" : "ConstantScore(cache(foo:bar))"

On 15 May 2013 22:01, Benjamin Sanders <insight...@gmail.com <javascript:>

wrote:

I have seen several questions on this topic, but no direct usable
answers. Is there an endpoint I can access via the api to see how the cache
is being used, whether or not it is full, whether particular queries are
utilizing the cache?

I am primarily interested in node level filter cache, but all information
would be appreciated.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

4

On 16 May 2013 18:05, Benjamin Sanders insightfulquery@gmail.com wrote:

For instance, it says "filter evictions", but does not give any indication
if that is for the last 5 minutes, or for the duration the server is
running.

All of the node stats are since the node started. They are never reset

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

5

Hi Ben,

I know we have various (all?) filter stats in SPM for Elasticsearch (see
sig), so you may find that useful if you are trying to understand your
caches. BigDesk may have this info, too.

Otis

ELASTICSEARCH Performance Monitoring - Sematext Monitoring | Infrastructure Monitoring Service
Search Analytics - Cloud Monitoring Tools & Services | Sematext

On Thursday, May 16, 2013 12:05:56 PM UTC-4, Benjamin Sanders wrote:

That helps a lot, thank you. I had looked at that endpoint while I was
digging through the guide, but somehow I missed seeing the cache stats.
That will at least tell me how much memory the cache is using, and how many
evictions there are. Do you know, other than the guide, where I might read
to learn more details? For instance, it says "filter evictions", but does
not give any indication if that is for the last 5 minutes, or for the
duration the server is running.

On Thursday, May 16, 2013 4:07:28 AM UTC-5, Clinton Gormley wrote:

Which cache are you talking about? The filter cache?

You can use the nodes stats API
Elasticsearch Platform — Find real-time answers at scale | Elastic get info about how the filter cache, but you can't dive into the details
of what is stored there.

Also, to see what filters are cached, you can use the validate API with
explain=true Elasticsearch Platform — Find real-time answers at scale | Elastic

curl -XGET '
http://127.0.0.1:9200/_all/_validate/query?pretty=1&explain=true' -d '
{
"filtered" : {
"filter" : {
"term" : {
"foo" : "bar"
}
}
}
}
'

--> "explanation" : "ConstantScore(cache(foo:bar))"

On 15 May 2013 22:01, Benjamin Sanders insight...@gmail.com wrote:

I have seen several questions on this topic, but no direct usable
answers. Is there an endpoint I can access via the api to see how the cache
is being used, whether or not it is full, whether particular queries are
utilizing the cache?

I am primarily interested in node level filter cache, but all
information would be appreciated.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

6

Awesome! I'll check it out, thanks!
On May 19, 2013 7:29 PM, "Otis Gospodnetic" otis.gospodnetic@gmail.com
wrote:

Hi Ben,

I know we have various (all?) filter stats in SPM for Elasticsearch (see
sig), so you may find that useful if you are trying to understand your
caches. BigDesk may have this info, too.

Otis

ELASTICSEARCH Performance Monitoring - Sematext Monitoring | Infrastructure Monitoring Service
Search Analytics - Cloud Monitoring Tools & Services | Sematext

On Thursday, May 16, 2013 12:05:56 PM UTC-4, Benjamin Sanders wrote:

That helps a lot, thank you. I had looked at that endpoint while I was
digging through the guide, but somehow I missed seeing the cache stats.
That will at least tell me how much memory the cache is using, and how many
evictions there are. Do you know, other than the guide, where I might read
to learn more details? For instance, it says "filter evictions", but does
not give any indication if that is for the last 5 minutes, or for the
duration the server is running.

On Thursday, May 16, 2013 4:07:28 AM UTC-5, Clinton Gormley wrote:

Which cache are you talking about? The filter cache?

You can use the nodes stats API http://www.elasticsearch.**
org/guide/reference/api/admin-**cluster-nodes-stats/http://www.elasticsearch.org/guide/reference/api/admin-cluster-nodes-stats/to get info about how the filter cache, but you can't dive into the details
of what is stored there.

Also, to see what filters are cached, you can use the validate API with
explain=true http://www.Elasticsearch Platform — Find real-time answers at scale | Elastic
reference/api/validate/http://www.elasticsearch.org/guide/reference/api/validate/

curl -XGET 'http://127.0.0.1:9200/_all/_**validate/query?pretty=1&**
explain=truehttp://127.0.0.1:9200/_all/_validate/query?pretty=1&explain=true'
-d '
{
"filtered" : {
"filter" : {
"term" : {
"foo" : "bar"
}
}
}
}
'

--> "explanation" : "ConstantScore(cache(foo:bar))**"

On 15 May 2013 22:01, Benjamin Sanders insight...@gmail.com wrote:

I have seen several questions on this topic, but no direct usable
answers. Is there an endpoint I can access via the api to see how the cache
is being used, whether or not it is full, whether particular queries are
utilizing the cache?

I am primarily interested in node level filter cache, but all
information would be appreciated.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.**com.
For more options, visit https://groups.google.com/**groups/opt_outhttps://groups.google.com/groups/opt_out
.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/QxuXRMqrOaM/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.