# Retrieving query stats **URL:** \ **Category:** Elasticsearch\ **Created:** [July 30, 2012, 2:41pm UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564 "2012-07-30T14:41:00Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Vinicius\_Carvalho](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vinicius_carvalho/32/770_2.png) [@Vinicius\_Carvalho](https://discuss.elastic.co/u/Vinicius_Carvalho)\ **Post date:** [July 30, 2012, 2:41pm UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564/1 "2012-07-30T14:41:00Z")
Hello there! I'm trying to find a way to get stats on the searches our ES nodes are serving. My first idea was to index all the search terms we have in a separate index. This would also assist in a future effort to use click through analysis. So my plan was to store all the terms and later display the top terms. Well, I know luke has some support for that, so I'm assuming it should not be that complicated to create a plugin of some sort for ES and use lucene internal api to retrieve the information on terms frequencies and counts. But, I'd like to visualize phrases as well, and this is where I'm a bit lost. let me put an example: Suppose we have lots of searches for "free mp3" but also for "mp3 download" and "free mp3 download", What I would like is to have a sort of radixtree for the shingles: mp3 = 3 - free = 2 - download= 1 - {empty} = 1 - download = 1 -{empty} = 1 Could someone share some thoughts on how one could achieve that? If that is useful I'm willing to submit any code as a plugin for ES if someone else is interested. Regards ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [July 30, 2012, 3:37pm UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564/2 "2012-07-30T15:37:13Z")
+1 for the idea. It would help to suggest searches based on popular searches sent by users, as google does it. David. Le 30 juillet 2012 à 16:41, Vinicius Carvalho [viniciusccarvalho@gmail.com](mailto:viniciusccarvalho@gmail.com) a écrit : > Hello there! I'm trying to find a way to get stats on the searches our ES > nodes are serving. My first idea was to index all the search terms we have in > a separate index. This would also assist in a future effort to use click > through analysis. > > So my plan was to store all the terms and later display the top terms. Well, > I know luke has some support for that, so I'm assuming it should not be that > complicated to create a plugin of some sort for ES and use lucene internal api > to retrieve the information on terms frequencies and counts. > > But, I'd like to visualize phrases as well, and this is where I'm a bit lost. > let me put an example: > > Suppose we have lots of searches for "free mp3" but also for "mp3 download" > and "free mp3 download", What I would like is to have a sort of radixtree for > the shingles: > > mp3 = 3 > > - free = 2 > - download= 1 > - {empty} = 1 > > - download = 1 > -{empty} = 1 > > Could someone share some thoughts on how one could achieve that? If that is > useful I'm willing to submit any code as a plugin for ES if someone else is > interested. > > Regards -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [July 30, 2012, 10:16pm UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564/3 "2012-07-30T22:16:14Z")
Hi Vinicius, That might be interesting. You may also want to check out the Search Analytics service we run (still all free) - see URL in signature below. While we don't yet provide the feedback loop you are describing, that's coming soon. You may find the following interesting: [http://blog.sematext.com/2011/11/02/search-analytics-at-enterprise-search-summit-fall-2011-presentation/](http://blog.sematext.com/2011/11/02/search-analytics-at-enterprise-search-summit-fall-2011-presentation/) > **[Apache Solr Tutorial: What Is, How It Works & What Is It Used For](https://sematext.com/guides/solr/)** > > Apache Solr: Find out how this open-source platform can power up the most complex search & analytics applications. ## Otis Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) On Monday, July 30, 2012 10:41:00 AM UTC-4, Vinicius Carvalho wrote: > Hello there! I'm trying to find a way to get stats on the searches our ES > nodes are serving. My first idea was to index all the search terms we have > in a separate index. This would also assist in a future effort to use click > through analysis. > > So my plan was to store all the terms and later display the top terms. > Well, I know luke has some support for that, so I'm assuming it should not > be that complicated to create a plugin of some sort for ES and use lucene > internal api to retrieve the information on terms frequencies and counts. > > But, I'd like to visualize phrases as well, and this is where I'm a bit > lost. let me put an example: > > Suppose we have lots of searches for "free mp3" but also for "mp3 > download" and "free mp3 download", What I would like is to have a sort of > radixtree for the shingles: > > mp3 = 3 > > - free = 2 > - download= 1 > - {empty} = 1 > > - download = 1 > -{empty} = 1 > > Could someone share some thoughts on how one could achieve that? If that > is useful I'm willing to submit any code as a plugin for ES if someone else > is interested. > > Regards ---
**Author:** ![Vinicius\_Carvalho](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vinicius_carvalho/32/770_2.png) [@Vinicius\_Carvalho](https://discuss.elastic.co/u/Vinicius_Carvalho)\ **Post date:** [July 31, 2012, 12:38am UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564/4 "2012-07-31T00:38:08Z")
Hi Otis, thanks a lot for the information, I'm reading your book on lucene again to get more info on subject. I'll look into sematex solution, looks like a very powerful tool for our current needs, All I need was a way to display this type of query information. I'm still digging on a way to implement it, checking some word suffix trees to maybe work this out. Thanks for the valuable links. Regards On Monday, July 30, 2012 6:16:14 PM UTC-4, Otis Gospodnetic wrote: > Hi Vinicius, > > That might be interesting. > You may also want to check out the Search Analytics service we run (still > all free) - see URL in signature below. While we don't yet provide the > feedback loop you are describing, that's coming soon. You may find the > following interesting: > > [Search Analytics at Enterprise Search Summit Fall 2011 Presentation - Sematext](http://blog.sematext.com/2011/11/02/search-analytics-at-enterprise-search-summit-fall-2011-presentation/) > > [Apache Solr Tutorial: What Is, How It Works & What Is It Used For - Sematext](http://blog.sematext.com/2012/01/06/relevance-tuning-and-competitive-advantage-via-search-analytics/) > > ## Otis > > Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) > Scalable Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) > > On Monday, July 30, 2012 10:41:00 AM UTC-4, Vinicius Carvalho wrote: > > > Hello there! I'm trying to find a way to get stats on the searches our ES > > nodes are serving. My first idea was to index all the search terms we have > > in a separate index. This would also assist in a future effort to use click > > through analysis. > > > > So my plan was to store all the terms and later display the top terms. > > Well, I know luke has some support for that, so I'm assuming it should not > > be that complicated to create a plugin of some sort for ES and use lucene > > internal api to retrieve the information on terms frequencies and counts. > > > > But, I'd like to visualize phrases as well, and this is where I'm a bit > > lost. let me put an example: > > > > Suppose we have lots of searches for "free mp3" but also for "mp3 > > download" and "free mp3 download", What I would like is to have a sort of > > radixtree for the shingles: > > > > mp3 = 3 > > > > - free = 2 > > - download= 1 > > - {empty} = 1 > > > > - download = 1 > > -{empty} = 1 > > > > Could someone share some thoughts on how one could achieve that? If that > > is useful I'm willing to submit any code as a plugin for ES if someone else > > is interested. > > > > Regards ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:18am UTC](https://discuss.elastic.co/t/retrieving-query-stats/8564/5 "2017-07-06T03:18:23Z")