# Memory for Facet query with filter **URL:** https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326 **Category:** Elasticsearch **Created:** [July 5, 2012, 11:09am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326 "2012-07-05T11:09:18Z") **Posts on this page:** 11 **Page:** 1
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 5, 2012, 11:09am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/1 "2012-07-05T11:09:18Z")
Hi I am running facet query with date range filter. It consume the same memory whether I am running it for 7 days, or 70 days. I know facet loads the index in memory but What if I am using filter. Does it load complete index irrespective of filtered data? Any help would be highly appreciated. Regards, Pulkit Agrawal ---
### Author: ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy) #### Post date: [July 5, 2012, 10:42pm UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/2 "2012-07-05T22:42:51Z")
A facet query (or a facet filter) with an additional filter do not load any field to memory, since they do not "run" on a specific field. On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com)wrote: > Hi > > I am running facet query with date range filter. > > It consume the same memory whether I am running it for 7 days, or 70 days. > I know facet loads the index in memory but What if I am using filter. > Does it load complete index irrespective of filtered data? > > Any help would be highly appreciated. > > Regards, > Pulkit Agrawal ---
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 23, 2012, 6:33am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/3 "2012-07-23T06:33:42Z")
Hi Shay, Thanks for your prompt reply. I am pasting facet query with filters on date. {"query": {"filtered": {"query": {"bool": {"should":[{"field":{"MsgData":"(royal AND Marriage)"}}],"minimum\_number\_should\_match":1} } ,"filter":{"range":{"CreatedAt": {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}}} This query loads the whole index irrespective of date filter range. Please have a look on the query and let me know what's wrong with that. Thanks, Pulkit Agrawal On Fri, Jul 6, 2012 at 4:12 AM, Shay Banon [kimchy@gmail.com](mailto:kimchy@gmail.com) wrote: > A facet query (or a facet filter) with an additional filter do not load > any field to memory, since they do not "run" on a specific field. > > On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com)wrote: > > > Hi > > > > I am running facet query with date range filter. > > > > It consume the same memory whether I am running it for 7 days, or 70 > > days. I know facet loads the index in memory but What if I am using filter. > > Does it load complete index irrespective of filtered data? > > > > Any help would be highly appreciated. > > > > Regards, > > Pulkit Agrawal ---
### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet) #### Post date: [July 23, 2012, 6:36am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/4 "2012-07-23T06:36:47Z")
Apply a filter on the facet also ! It will load only what you need to see. HTH David 😉 Twitter : @dadoonet / @elasticsearchfr Le 23 juil. 2012 à 08:33, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a écrit : > Hi Shay, > > Thanks for your prompt reply. > > I am pasting facet query with filters on date. > > {"query": > {"filtered": > {"query": > {"bool": > {"should":[{"field":{"MsgData":"(royal AND Marriage)"}}],"minimum\_number\_should\_match":1} } > ,"filter":{"range":{"CreatedAt": {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}}} > > This query loads the whole index irrespective of date filter range. > > Please have a look on the query and let me know what's wrong with that. > > Thanks, > Pulkit Agrawal > > On Fri, Jul 6, 2012 at 4:12 AM, Shay Banon [kimchy@gmail.com](mailto:kimchy@gmail.com) wrote: > A facet query (or a facet filter) with an additional filter do not load any field to memory, since they do not "run" on a specific field. > > On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) wrote: > Hi > > I am running facet query with date range filter. > > It consume the same memory whether I am running it for 7 days, or 70 days. I know facet loads the index in memory but What if I am using filter. > Does it load complete index irrespective of filtered data? > > Any help would be highly appreciated. > > Regards, > Pulkit Agrawal ---
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 23, 2012, 6:53am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/5 "2012-07-23T06:53:21Z")
Hi David, You mean a query like below will fix the problem. {"query": {"filtered": {"query": {"bool": {"should":[{"field":{"MsgData":"(royal AND Marriage)"}}],"minimum\_number\_should\_match":1} } ,"filter":{"range":{"CreatedAt": {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}, "facet\_filter": {"range": { ``` "from": "2012-7-8T00:00:00", "to": "2012-7-19T23:59:59" } ``` } }} Please review the query and let me know if it is proper or not. Thanks, Pulkit Agrawal On Mon, Jul 23, 2012 at 12:06 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Apply a filter on the facet also ! > It will load only what you need to see. > > HTH > David 😉 > Twitter : @dadoonet / @elasticsearchfr > > Le 23 juil. 2012 à 08:33, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a écrit : > > Hi Shay, > > Thanks for your prompt reply. > > I am pasting facet query with filters on date. > > {"query": > {"filtered": > {"query": > {"bool": > {"should":[{"field":{"MsgData":"(royal AND Marriage)"}}],"minimum\_number\_should\_match":1} } > ,"filter":{"range":{"CreatedAt": {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}}} > > This query loads the whole index irrespective of date filter range. > > Please have a look on the query and let me know what's wrong with that. > > Thanks, > Pulkit Agrawal > > On Fri, Jul 6, 2012 at 4:12 AM, Shay Banon [kimchy@gmail.com](mailto:kimchy@gmail.com) wrote: > > > A facet query (or a facet filter) with an additional filter do not load any field to memory, since they do not "run" on a specific field. > > > > On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) wrote: > > > > > Hi > > > > > > I am running facet query with date range filter. > > > > > > It consume the same memory whether I am running it for 7 days, or 70 days. I know facet loads the index in memory but What if I am using filter. > > > Does it load complete index irrespective of filtered data? > > > > > > Any help would be highly appreciated. > > > > > > Regards, > > > Pulkit Agrawal ---
### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet) #### Post date: [July 23, 2012, 7:42am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/6 "2012-07-23T07:42:45Z")
Yes but with the same filter. Something like: "facets":{ "MsgData":{ "terms":{ "field":"MsgData", "size":20 } }, "facet\_filter":{ "range":{ "CreatedAt":{ "from":"2012-7-8T00:00:00", "to":"2012-7-19T23:59:59" } } } } See [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/api/search/facets/index.html) [http://www.elasticsearch.org/guide/reference/api/search/facets/index.html](http://www.elasticsearch.org/guide/reference/api/search/facets/index.html) David. Le 23 juillet 2012 à 08:53, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a écrit : > Hi David, > > You mean a query like below will fix the problem. > > {"query": > {"filtered": > {"query": > {"bool": > {"should":[{"field":{"MsgData":"(royal AND > Marriage)"}}],"minimum\_number\_should\_match":1} } > ,"filter":{"range":{"CreatedAt": > {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}, > "facet\_filter": {"range": { > > ``` > "from": "2012-7-8T00:00:00", > "to": "2012-7-19T23:59:59" > > } > > ``` > > } > }} > > Please review the query and let me know if it is proper or not. > > Thanks, > Pulkit Agrawal > > On Mon, Jul 23, 2012 at 12:06 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > Apply a filter on the facet also ! > > It will load only what you need to see. > > > > HTH > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr > > > > Le 23 juil. 2012 à 08:33, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a écrit : > > > > Hi Shay, > > > > Thanks for your prompt reply. > > > > I am pasting facet query with filters on date. > > > > {"query": > > {"filtered": > > {"query": > > {"bool": > > {"should":[{"field":{"MsgData":"(royal AND > > Marriage)"}}],"minimum\_number\_should\_match":1} } > > ,"filter":{"range":{"CreatedAt": > > {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}}} > > > > This query loads the whole index irrespective of date filter range. > > > > Please have a look on the query and let me know what's wrong with that. > > > > Thanks, > > Pulkit Agrawal > > > > On Fri, Jul 6, 2012 at 4:12 AM, Shay Banon [kimchy@gmail.com](mailto:kimchy@gmail.com) wrote: > > > > > A facet query (or a facet filter) with an additional filter do not load any > > > field to memory, since they do not "run" on a specific field. > > > > > > On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) > > > wrote: > > > > > > > Hi > > > > > > > > I am running facet query with date range filter. > > > > > > > > It consume the same memory whether I am running it for 7 days, or 70 days. > > > > I know facet loads the index in memory but What if I am using filter. > > > > Does it load complete index irrespective of filtered data? > > > > > > > > Any help would be highly appreciated. > > > > > > > > Regards, > > > > Pulkit Agrawal -- David Pilato [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet ---
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 23, 2012, 9:25am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/7 "2012-07-23T09:25:01Z")
David as per your suggestion I drafted this query curl -XGET '[http://localhost:9200/new\_index/new\_indext/\_search](http://localhost:9200/new_index/new_indext/_search)' -d '{ "query": { "bool": { "should": [ { "field": { "MsgData": "Hero" } } ], "minimum\_number\_should\_match": 1 }}, "facets": { "MsgData": { "terms": { "field": "MsgData", "size": 20 } }, "facet\_filter": {"range": {"CreatedAt": {"from": "2012-7-8T00:00:00","to": "2012-7-19T23:59:59"}}} } }' But it returns FacetPhaseExecutionException[Facet [facet\_filter]: no ranges defined for range facet]; }]","status":500} What's wrong with this query? Thanks On Mon, Jul 23, 2012 at 1:12 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Yes but with the same filter. Something like: > > "facets":{ > "MsgData":{ > "terms":{ "field":"MsgData", "size":20 } > }, > "facet\_filter":{ > "range":{ > > "CreatedAt":{ > > ``` > "from":"2012-7-8T00:00:00", > "to":"2012-7-19T23:59:59" > > ``` > > } > } > } > } > > See > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/api/search/facets/index.html) > > David. > > Le 23 juillet 2012 à 08:53, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a écrit > : > > > Hi David, > > > > You mean a query like below will fix the problem. > > > > {"query": > > {"filtered": > > {"query": > > {"bool": > > {"should":[{"field":{"MsgData":"(royal AND > > Marriage)"}}],"minimum\_number\_should\_match":1} } > > ,"filter":{"range":{"CreatedAt": > > {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}, > > "facet\_filter": {"range": { > > > > ``` > > "from": "2012-7-8T00:00:00", > > "to": "2012-7-19T23:59:59" > > > > } > > > > ``` > > > > } > > }} > > > > Please review the query and let me know if it is proper or not. > > > > Thanks, > > Pulkit Agrawal > > > > On Mon, Jul 23, 2012 at 12:06 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > Apply a filter on the facet also ! > > > It will load only what you need to see. > > > > > > HTH > > > David 😉 > > > Twitter : @dadoonet / @elasticsearchfr > > > > > > Le 23 juil. 2012 à 08:33, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) a > > > écrit : > > > > > > Hi Shay, > > > > > > Thanks for your prompt reply. > > > > > > I am pasting facet query with filters on date. > > > > > > {"query": > > > {"filtered": > > > {"query": > > > {"bool": > > > {"should":[{"field":{"MsgData":"(royal AND > > > Marriage)"}}],"minimum\_number\_should\_match":1} } > > > ,"filter":{"range":{"CreatedAt": > > > {"from":"2012-7-8T00:00:00","to":"2012-7-19T23:59:59"}}}}, > > > "facets":{"MsgData":{"terms":{"field":"MsgData","size":20}}}} > > > > > > This query loads the whole index irrespective of date filter range. > > > > > > Please have a look on the query and let me know what's wrong with that. > > > > > > Thanks, > > > Pulkit Agrawal > > > > > > On Fri, Jul 6, 2012 at 4:12 AM, Shay Banon [kimchy@gmail.com](mailto:kimchy@gmail.com) wrote: > > > > > > > A facet query (or a facet filter) with an additional filter do not load > > > > any field to memory, since they do not "run" on a specific field. > > > > > > > > On Thu, Jul 5, 2012 at 1:09 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) > > > > wrote: > > > > > > > > > Hi > > > > > > > > > > I am running facet query with date range filter. > > > > > > > > > > It consume the same memory whether I am running it for 7 days, or 70 > > > > > days. I know facet loads the index in memory but What if I am using filter. > > > > > Does it load complete index irrespective of filtered data? > > > > > > > > > > Any help would be highly appreciated. > > > > > > > > > > Regards, > > > > > Pulkit Agrawal > > -- > David Pilato > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet ---
### Author: ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley) #### Post date: [July 23, 2012, 9:29am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/8 "2012-07-23T09:29:11Z")
Hi Pukit > ``` > "facets": { > "MsgData": { > "terms": { > "field": "MsgData", > "size": 20 > } > }, > "facet_filter": {"range": {"CreatedAt": {"from": > > ``` > > "2012-7-8T00:00:00","to": "2012-7-19T23:59:59"}}} > } > > }' Your facet\_filter should be at the same level as 'terms', not as 'MsgData'. See > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. clint ---
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 23, 2012, 9:32am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/9 "2012-07-23T09:32:26Z")
Thanks a lot clint. It is working now. Regards, Pulkit Agrawal On Mon, Jul 23, 2012 at 2:59 PM, Clinton Gormley [clint@traveljury.com](mailto:clint@traveljury.com) wrote: > Hi Pukit > > > ``` > > "facets": { > > "MsgData": { > > "terms": { > > "field": "MsgData", > > "size": 20 > > } > > }, > > "facet_filter": {"range": {"CreatedAt": {"from": > > > > ``` > > > > "2012-7-8T00:00:00","to": "2012-7-19T23:59:59"}}} > > } > > > > }' > > Your facet\_filter should be at the same level as 'terms', not as > 'MsgData'. See > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/api/search/facets/) > > clint ---
### Author: ![Kartavya](https://avatars.discourse-cdn.com/v4/letter/k/65b543/32.png) [@Kartavya](https://discuss.elastic.co/u/Kartavya) #### Post date: [July 23, 2012, 1:47pm UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/10 "2012-07-23T13:47:17Z")
Hi Now, I have two facet queries Query 1: curl -XGET '[http://localhost:9200/new\_index/new\_indext/\_search](http://localhost:9200/new_index/new_indext/_search)' -d '{ "query": { "filtered": { "query": { "bool": { "should": [ { "field": { "MsgData": "google" } } ], "minimum\_number\_should\_match": 1 } }, "filter": { "range": { "CreatedAt": { "from": "2012-6-12T00:00:00", "to": "2012-7-23T23:59:59" } } } } }, "facets": { "MsgData": { "terms": { "field": "MsgData", "size": 100 } } } }' Query 2: curl -XGET '[http://localhost:9200/new\_index/new\_indext/\_search](http://localhost:9200/new_index/new_indext/_search)' -d '{"query": {"bool": {"should": [ { "field": { "MsgData": "google" } } ], "minimum\_number\_should\_match": 1 }}, "facets": { "MsgData": { "terms": { "field": "MsgData", "size": 20 }, "facet\_filter": {"range": {"CreatedAt": {"from": "2012-6-12T00:00:00","to": "2012-7-23T23:59:59"}}} } } }' Are they differ in performance and memory usage? Which one would be fast and using less heap space? Thanks, Pulkit Agrawal On Mon, Jul 23, 2012 at 3:02 PM, Pulkit Agrawal [pulkitdotcom@gmail.com](mailto:pulkitdotcom@gmail.com) wrote: > Thanks a lot clint. > > It is working now. > > Regards, > Pulkit Agrawal > > On Mon, Jul 23, 2012 at 2:59 PM, Clinton Gormley [clint@traveljury.com](mailto:clint@traveljury.com) wrote: > > > Hi Pukit > > > > > ``` > > > "facets": { > > > "MsgData": { > > > "terms": { > > > "field": "MsgData", > > > "size": 20 > > > } > > > }, > > > "facet_filter": {"range": {"CreatedAt": {"from": > > > > > > ``` > > > > > > "2012-7-8T00:00:00","to": "2012-7-19T23:59:59"}}} > > > } > > > > > > }' > > > > Your facet\_filter should be at the same level as 'terms', not as > > 'MsgData'. See > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/api/search/facets/) > > > > clint ---
### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system) #### Post date: [July 6, 2017, 3:19am UTC](https://discuss.elastic.co/t/memory-for-facet-query-with-filter/8326/11 "2017-07-06T03:19:26Z")