# Performance metrics reporting tools for ES **URL:** \ **Category:** Elasticsearch\ **Created:** [July 5, 2012, 1:21am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319 "2012-07-05T01:21:01Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![T\_Vinod\_Gupta](https://avatars.discourse-cdn.com/v4/letter/t/fbc32d/32.png) [@T\_Vinod\_Gupta](https://discuss.elastic.co/u/T_Vinod_Gupta)\ **Post date:** [July 5, 2012, 1:21am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/1 "2012-07-05T01:21:01Z")
i want to be able to measure the health of my ES deployment by looking at various key counters/metrics like throughput, latency, load, disk IOs, etc. that way i have visibility on how things are progressing.. are there any recommendations or does ES have an API for the same? i see some solutions when i google for it - 1. [http://sematext.com/spm/elasticsearch-performance-monitoring/index.html](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) 2. [http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) are these particularly good enough? thanks ---
**Author:** ![Radu\_Gheorghe1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/radu_gheorghe1/32/2688_2.png) [@Radu\_Gheorghe1](https://discuss.elastic.co/u/Radu_Gheorghe1)\ **Post date:** [July 5, 2012, 7:59am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/2 "2012-07-05T07:59:37Z")
If you want to look at how these metrics look like (without alerts, for example), I've used BigDesk and I liked it: > **[GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch...](https://github.com/lukas-vlcek/bigdesk)** > > Live charts and statistics for Elasticsearch cluster. - GitHub - lukas-vlcek/bigdesk: Live charts and statistics for Elasticsearch cluster. It seems to be the popular choice. On Thursday, July 5, 2012 4:21:01 AM UTC+3, T Vinod Gupta wrote: > i want to be able to measure the health of my ES deployment by looking at > various key counters/metrics like throughput, latency, load, disk IOs, etc. > that way i have visibility on how things are progressing.. > > are there any recommendations or does ES have an API for the same? > > i see some solutions when i google for it - > > 1. [Elasticsearch Monitoring](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > 2. > > [http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > are these particularly good enough? > > thanks ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [July 5, 2012, 5:12pm UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/3 "2012-07-05T17:12:50Z")
Hello, For what it's worth we use SPM for Elasticsearch a LOT in all our Elasticsearch work/engagements with clients. Radu mentioned Alerts, and SPM has them in the current release, though we are keeping them limited to a few test accounts in the backend for now. I think BigDesk is handy for "ad-hoc" looking at ES, while SPM is handy if you want to continuously monitor ES (and not just ES), if you want to be alerted when there are issues, if you want to be able to look at historical data, etc. ## Otis Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) On Wednesday, July 4, 2012 9:21:01 PM UTC-4, T Vinod Gupta wrote: > i want to be able to measure the health of my ES deployment by looking at > various key counters/metrics like throughput, latency, load, disk IOs, etc. > that way i have visibility on how things are progressing.. > > are there any recommendations or does ES have an API for the same? > > i see some solutions when i google for it - > > 1. [Elasticsearch - Sematext Documentation](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > 2. > > [http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > are these particularly good enough? > > thanks ---
**Author:** ![T\_Vinod\_Gupta](https://avatars.discourse-cdn.com/v4/letter/t/fbc32d/32.png) [@T\_Vinod\_Gupta](https://discuss.elastic.co/u/T_Vinod_Gupta)\ **Post date:** [July 9, 2012, 2:22am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/4 "2012-07-09T02:22:53Z")
Hi Otis, this looks like a really cool tool. i was excited and tried to install it. somehow it didnt work for me.. when i installed and made the changes to elasticsearch.in.sh file, elasticsearch won't start. it starts when i revert the changes made to that file. after installing spm, i just added this line to elasticsearch.in.shat the very end - JAVA\_OPTS="$JAVA\_OPTS -Dcom.sun.management.jmxremote -javaagent:/spm/spm-monitor/lib/spm-monitor-es-1.5.0-withdeps.jar=/spm/spm-monitor/conf/spm-monitor-config--default.xml" i start elasticsearch by just doing "./bin/elasticsearch". am i missing something? thanks On Thu, Jul 5, 2012 at 10:12 AM, Otis Gospodnetic \< [otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com)\> wrote: > Hello, > > For what it's worth we use SPM for Elasticsearch a LOT in all our > Elasticsearch work/engagements with clients. Radu mentioned Alerts, and > SPM has them in the current release, though we are keeping them limited to > a few test accounts in the backend for now. I think BigDesk is handy for > "ad-hoc" looking at ES, while SPM is handy if you want to continuously > monitor ES (and not just ES), if you want to be alerted when there are > issues, if you want to be able to look at historical data, etc. > > ## Otis > > Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) > Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) > > On Wednesday, July 4, 2012 9:21:01 PM UTC-4, T Vinod Gupta wrote: > > > i want to be able to measure the health of my ES deployment by looking at > > various key counters/metrics like throughput, latency, load, disk IOs, etc. > > that way i have visibility on how things are progressing.. > > > > are there any recommendations or does ES have an API for the same? > > > > i see some solutions when i google for it - > > > > 1. [http://sematext.com/spm/\*\*elasticsearch-performance-](http://sematext.com/spm/**elasticsearch-performance-)\*\* > > monitoring/index.html[http://sematext.com/spm/elasticsearch-performance-monitoring/index.html](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > > 2. [http://manpages.ubuntu.com/\*\*manpages/oneiric/man1/](http://manpages.ubuntu.com/**manpages/oneiric/man1/)\*\* > > pmdaelasticsearch.1.html[http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > > > are these particularly good enough? > > > > thanks ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [July 9, 2012, 9:34pm UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/5 "2012-07-09T21:34:16Z")
Hi Vinod, That looks correct. Why don't we switch over to this communication channel, though, so we don't bother everyone here: > **[Sematext Monitoring | Infrastructure Monitoring Service](https://sematext.com/spm/)** > > Bring together your servers, Apps, Metrics, Logs & Events ✓ Over 40 integrations to easily collect metrics & events across your whole stack ✓ Start now! ## Otis Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) On Sunday, July 8, 2012 10:22:53 PM UTC-4, T Vinod Gupta wrote: > Hi Otis, > this looks like a really cool tool. i was excited and tried to install it. > somehow it didnt work for me.. > when i installed and made the changes to elasticsearch.in.sh file, > elasticsearch won't start. it starts when i revert the changes made to that > file. after installing spm, i just added this line to elasticsearch.in.shat the very end - > > JAVA\_OPTS="$JAVA\_OPTS -Dcom.sun.management.jmxremote > -javaagent:/spm/spm-monitor/lib/spm-monitor-es-1.5.0-withdeps.jar=/spm/spm-monitor/conf/spm-monitor-config--default.xml" > > i start elasticsearch by just doing "./bin/elasticsearch". am i missing > something? > > thanks > > On Thu, Jul 5, 2012 at 10:12 AM, Otis Gospodnetic \< > [otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com)\> wrote: > > > Hello, > > > > For what it's worth we use SPM for Elasticsearch a LOT in all our > > Elasticsearch work/engagements with clients. Radu mentioned Alerts, and > > SPM has them in the current release, though we are keeping them limited to > > a few test accounts in the backend for now. I think BigDesk is handy for > > "ad-hoc" looking at ES, while SPM is handy if you want to continuously > > monitor ES (and not just ES), if you want to be alerted when there are > > issues, if you want to be able to look at historical data, etc. > > > > ## Otis > > > > Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) > > Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) > > > > On Wednesday, July 4, 2012 9:21:01 PM UTC-4, T Vinod Gupta wrote: > > > > > i want to be able to measure the health of my ES deployment by looking > > > at various key counters/metrics like throughput, latency, load, disk IOs, > > > etc. that way i have visibility on how things are progressing.. > > > > > > are there any recommendations or does ES have an API for the same? > > > > > > i see some solutions when i google for it - > > > > > > 1. [http://sematext.com/spm/\*\*elasticsearch-performance-](http://sematext.com/spm/**elasticsearch-performance-)\*\* > > > monitoring/index.html[http://sematext.com/spm/elasticsearch-performance-monitoring/index.html](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > > > 2. [http://manpages.ubuntu.com/\*\*manpages/oneiric/man1/](http://manpages.ubuntu.com/**manpages/oneiric/man1/)\*\* > > > pmdaelasticsearch.1.html[http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > > > > > are these particularly good enough? > > > > > > thanks ---
**Author:** ![Brad\_Lhotsky](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/brad_lhotsky/32/2293_2.png) [@Brad\_Lhotsky](https://discuss.elastic.co/u/Brad_Lhotsky)\ **Post date:** [July 9, 2012, 10:31pm UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/6 "2012-07-09T22:31:59Z")
I've been fighting with some problems on ES 0.18.x (production) and ES 0.19.x in my dev environment and came up with a home brew solution for performance monitoring Elasticsearch: [http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html](http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html) I like BigDesk for a heads up view, but Graphite is king for being able compare data sets.. On Thursday, July 5, 2012 3:21:01 AM UTC+2, T Vinod Gupta wrote: > i want to be able to measure the health of my ES deployment by looking at > various key counters/metrics like throughput, latency, load, disk IOs, etc. > that way i have visibility on how things are progressing.. > > are there any recommendations or does ES have an API for the same? > > i see some solutions when i google for it - > > 1. [Elasticsearch Monitoring](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > 2. > > [http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > are these particularly good enough? > > thanks ---
**Author:** ![Lukas\_Vlcek1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lukas_vlcek1/32/819_2.png) [@Lukas\_Vlcek1](https://discuss.elastic.co/u/Lukas_Vlcek1)\ **Post date:** [July 10, 2012, 4:53am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/7 "2012-07-10T04:53:08Z")
Hi, speaking about bigdesk Otis is right, people can find it handy for quick checking of the cluster (for now namely Node Stats) - that is what it was build for. But for now it lacks features that would make it a solid production tool like ability to store large amount of data into some datastore, alerts and customizations. Personally, I am/was using bigdesk especially when I was experimenting with elasticsearch as it allowed me to quickly realize how to better plan resources for production deployment. More then monitoring tool bigdesk is like an exploration tool. You can also try to check elasticsearch-paramedic [1] by Karmi. But again, IMO it lacks the same features like bigdesk that would make it a solid production tool, though it brings some cool charts and some fancy signals for red cluster has been implemented there recently! 🙂 Regards, Lukas [1] [GitHub - karmi/elasticsearch-paramedic: A simple tool to inspect the state and statistics about ElasticSearch clusters](https://github.com/karmi/elasticsearch-paramedic) On Tue, Jul 10, 2012 at 12:31 AM, Brad Lhotsky [brad.lhotsky@gmail.com](mailto:brad.lhotsky@gmail.com)wrote: > I've been fighting with some problems on ES 0.18.x (production) and ES > 0.19.x in my dev environment and came up with a home brew solution for > performance monitoring Elasticsearch: > > [divisonbyzero.net](http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html) > > I like BigDesk for a heads up view, but Graphite is king for being able > compare data sets.. > > On Thursday, July 5, 2012 3:21:01 AM UTC+2, T Vinod Gupta wrote: > > > i want to be able to measure the health of my ES deployment by looking at > > various key counters/metrics like throughput, latency, load, disk IOs, etc. > > that way i have visibility on how things are progressing.. > > > > are there any recommendations or does ES have an API for the same? > > > > i see some solutions when i google for it - > > > > 1. [http://sematext.com/spm/\*\*elasticsearch-performance-](http://sematext.com/spm/**elasticsearch-performance-)\*\* > > monitoring/index.html[http://sematext.com/spm/elasticsearch-performance-monitoring/index.html](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > > 2. [http://manpages.ubuntu.com/\*\*manpages/oneiric/man1/](http://manpages.ubuntu.com/**manpages/oneiric/man1/)\*\* > > pmdaelasticsearch.1.html[http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > > > are these particularly good enough? > > > > thanks ---
**Author:** ![Lukas\_Vlcek1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lukas_vlcek1/32/819_2.png) [@Lukas\_Vlcek1](https://discuss.elastic.co/u/Lukas_Vlcek1)\ **Post date:** [July 10, 2012, 7:57am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/8 "2012-07-10T07:57:10Z")
Hi, just found this interesting blog post [http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html](http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html) I think it might be useful to post it here for inspiration. Regards, Lukas On Tue, Jul 10, 2012 at 6:53 AM, Lukáš Vlček [lukas.vlcek@gmail.com](mailto:lukas.vlcek@gmail.com) wrote: > Hi, > > speaking about bigdesk Otis is right, people can find it handy for quick > checking of the cluster (for now namely Node Stats) - that is what it was > build for. But for now it lacks features that would make it a solid > production tool like ability to store large amount of data into some > datastore, alerts and customizations. Personally, I am/was using bigdesk > especially when I was experimenting with elasticsearch as it allowed me to > quickly realize how to better plan resources for production deployment. > More then monitoring tool bigdesk is like an exploration tool. > > You can also try to check elasticsearch-paramedic [1] by Karmi. But again, > IMO it lacks the same features like bigdesk that would make it a solid > production tool, though it brings some cool charts and some fancy signals > for red cluster has been implemented there recently! 🙂 > > Regards, > Lukas > > [1] [GitHub - karmi/elasticsearch-paramedic: A simple tool to inspect the state and statistics about ElasticSearch clusters](https://github.com/karmi/elasticsearch-paramedic) > > On Tue, Jul 10, 2012 at 12:31 AM, Brad Lhotsky [brad.lhotsky@gmail.com](mailto:brad.lhotsky@gmail.com)wrote: > > > I've been fighting with some problems on ES 0.18.x (production) and ES > > 0.19.x in my dev environment and came up with a home brew solution for > > performance monitoring Elasticsearch: > > > > [divisonbyzero.net](http://divisionbyzero.net/article/2012/07/09/silly-graphite-trick.html) > > > > I like BigDesk for a heads up view, but Graphite is king for being able > > compare data sets.. > > > > On Thursday, July 5, 2012 3:21:01 AM UTC+2, T Vinod Gupta wrote: > > > > > i want to be able to measure the health of my ES deployment by looking > > > at various key counters/metrics like throughput, latency, load, disk IOs, > > > etc. that way i have visibility on how things are progressing.. > > > > > > are there any recommendations or does ES have an API for the same? > > > > > > i see some solutions when i google for it - > > > > > > 1. [http://sematext.com/spm/\*\*elasticsearch-performance-](http://sematext.com/spm/**elasticsearch-performance-)\*\* > > > monitoring/index.html[http://sematext.com/spm/elasticsearch-performance-monitoring/index.html](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > > > 2. [http://manpages.ubuntu.com/\*\*manpages/oneiric/man1/](http://manpages.ubuntu.com/**manpages/oneiric/man1/)\*\* > > > pmdaelasticsearch.1.html[http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html](http://manpages.ubuntu.com/manpages/oneiric/man1/pmdaelasticsearch.1.html) > > > > > > are these particularly good enough? > > > > > > thanks ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:20am UTC](https://discuss.elastic.co/t/performance-metrics-reporting-tools-for-es/8319/9 "2017-07-06T03:20:47Z")