In our SPM for Solr service we have a graph that shows performance of
different Solr search components (see attachment for a stacked version of
this graph).
I know ES doesn't have the equivalent of SearchComponents, although it has
request actions, but is there anything in ES that one could track
performance of similarly to what's in the attached image for Solr?
We can try finding key components/classes/methods in ES for performance
monitoring purposes, but I thought I'd ask here first.
The only thing I'm aware of at the moment is the amazing bigdesk plugin
(GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch cluster.) but unfortunately, it doesn't
track internal components like your image shows. It's more along the lines
of local OS and JVM stats, GC, reads and writes. Still, I find it super
useful to see in real-time some of the activity that's happening on the
nodes.
-GS
On Monday, July 30, 2012 7:04:19 PM UTC-4, Otis Gospodnetic wrote:
Hi,
In our SPM for Solr service we have a graph that shows performance of
different Solr search components (see attachment for a stacked version of
this graph).
I know ES doesn't have the equivalent of SearchComponents, although it has
request actions, but is there anything in ES that one could track
performance of similarly to what's in the attached image for Solr?
We can try finding key components/classes/methods in ES for performance
monitoring purposes, but I thought I'd ask here first.
I probably didn't do a good job of asking the question.
I know of Elasticsearch performance monitoring solutions like BigDesk as
well as our SPM for ES (see Elasticsearch Monitoring ).
What I was wondering was what components inside ES can be monitored, for
example to see what the slowest parts in search request processing are.
For example, if you look at the screenshot I sent, which is a graph from
SPM for Solr, you can see "QueryComponent" takes the most time, followed by
SpellCheckComponent.
I was wondering if there are any components in ES whose performance one
could track in a similar fashion?
Thanks,
Otis
On Monday, July 30, 2012 7:59:54 PM UTC-4, George Stathis wrote:
The only thing I'm aware of at the moment is the amazing bigdesk plugin ( GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch cluster.) but unfortunately, it doesn't
track internal components like your image shows. It's more along the lines
of local OS and JVM stats, GC, reads and writes. Still, I find it super
useful to see in real-time some of the activity that's happening on the
nodes.
-GS
On Monday, July 30, 2012 7:04:19 PM UTC-4, Otis Gospodnetic wrote:
Hi,
In our SPM for Solr service we have a graph that shows performance of
different Solr search components (see attachment for a stacked version of
this graph).
I know ES doesn't have the equivalent of SearchComponents, although it
has request actions, but is there anything in ES that one could track
performance of similarly to what's in the attached image for Solr?
We can try finding key components/classes/methods in ES for performance
monitoring purposes, but I thought I'd ask here first.
I haven't looked at 1.0 so not sure if already addressed but would be
loverly to have a more granular breakdown. The main issue we have is
tracking timings on individual queries. Maybe there is already some
setting to allow this?
On Tuesday, 31 July 2012 11:41:19 UTC+1, Otis Gospodnetic wrote:
Hi,
I probably didn't do a good job of asking the question.
I know of Elasticsearch performance monitoring solutions like BigDesk as
well as our SPM for ES (see Elasticsearch Monitoring ).
What I was wondering was what components inside ES can be monitored, for
example to see what the slowest parts in search request processing are.
For example, if you look at the screenshot I sent, which is a graph from
SPM for Solr, you can see "QueryComponent" takes the most time, followed by
SpellCheckComponent.
I was wondering if there are any components in ES whose performance one
could track in a similar fashion?
Thanks,
Otis
On Monday, July 30, 2012 7:59:54 PM UTC-4, George Stathis wrote:
The only thing I'm aware of at the moment is the amazing bigdesk plugin ( GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch cluster.) but unfortunately, it doesn't
track internal components like your image shows. It's more along the lines
of local OS and JVM stats, GC, reads and writes. Still, I find it super
useful to see in real-time some of the activity that's happening on the
nodes.
-GS
On Monday, July 30, 2012 7:04:19 PM UTC-4, Otis Gospodnetic wrote:
Hi,
In our SPM for Solr service we have a graph that shows performance of
different Solr search components (see attachment for a stacked version of
this graph).
I know ES doesn't have the equivalent of SearchComponents, although it
has request actions, but is there anything in ES that one could track
performance of similarly to what's in the attached image for Solr?
We can try finding key components/classes/methods in ES for performance
monitoring purposes, but I thought I'd ask here first.
I think the per-shard stats are still not available, unless it got added
recently and I missed it?
Have a look at SPM for Elasticsearch, it may be detailed enough for you.
SPM doesn't show timing for individual queries, but our free Search
Analytics service does give you per-query timing info, per-query
click-through rates, per-query zero-hits, and so on - Cloud Monitoring Tools & Services | Sematext
there is a live demo (look for the big blue button) you can play with.
On Friday, January 24, 2014 10:22:54 PM UTC-5, hazzadous wrote:
Old thread, sure but what's happened with this?
Things I'd like to see:
per shard search
per shard facetting times
reduce times for the above
wait times on merges(?)
I haven't looked at 1.0 so not sure if already addressed but would be
loverly to have a more granular breakdown. The main issue we have is
tracking timings on individual queries. Maybe there is already some
setting to allow this?
On Tuesday, 31 July 2012 11:41:19 UTC+1, Otis Gospodnetic wrote:
Hi,
I probably didn't do a good job of asking the question.
I know of Elasticsearch performance monitoring solutions like BigDesk as
well as our SPM for ES (see Elasticsearch Monitoring
).
What I was wondering was what components inside ES can be monitored, for
example to see what the slowest parts in search request processing are.
For example, if you look at the screenshot I sent, which is a graph from
SPM for Solr, you can see "QueryComponent" takes the most time, followed by
SpellCheckComponent.
I was wondering if there are any components in ES whose performance one
could track in a similar fashion?
Thanks,
Otis
On Monday, July 30, 2012 7:59:54 PM UTC-4, George Stathis wrote:
The only thing I'm aware of at the moment is the amazing bigdesk plugin ( GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch cluster.) but unfortunately, it doesn't
track internal components like your image shows. It's more along the lines
of local OS and JVM stats, GC, reads and writes. Still, I find it super
useful to see in real-time some of the activity that's happening on the
nodes.
-GS
On Monday, July 30, 2012 7:04:19 PM UTC-4, Otis Gospodnetic wrote:
Hi,
In our SPM for Solr service we have a graph that shows performance of
different Solr search components (see attachment for a stacked version of
this graph).
I know ES doesn't have the equivalent of SearchComponents, although it
has request actions, but is there anything in ES that one could track
performance of similarly to what's in the attached image for Solr?
We can try finding key components/classes/methods in ES for performance
monitoring purposes, but I thought I'd ask here first.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.