# Terms Aggregation and scope **URL:** \ **Category:** Elasticsearch\ **Created:** [July 7, 2014, 12:09pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504 "2014-07-07T12:09:52Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Diederik\_Meijer\_Ten\_](https://avatars.discourse-cdn.com/v4/letter/d/7bcc69/32.png) [@Diederik\_Meijer\_Ten\_](https://discuss.elastic.co/u/Diederik_Meijer_Ten_)\ **Post date:** [July 7, 2014, 12:09pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/1 "2014-07-07T12:09:52Z")
Dear list, I need to create an aggregation by a specific field, named "datum\_uitspraak\_ymd'. I am using the below curl command and it works fine in a sense that it returns the aggregation listed below. While this result seems OK enough, it seems that the keys listed in the aggregation are limited to those listed in 10 records. As the number of unique values for this key is much higher than 10, it seems that the aggregation's scope is global as far as it searches for documents with a value identical to one of the 10 listed, but it is limited as far as the key values used in the aggregation is concerned. How do I need to set up my curl command in order for the aggregation to return more key-value pairs? Many thanks, Diederik Command: curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd" } } } }' Returns: "aggregations" : { "datum\_uitspraak\_ymd" : { "buckets" : [ { "key" : "20121219", "doc\_count" : 612 }, { "key" : "20120516", "doc\_count" : 526 }, { "key" : "20110601", "doc\_count" : 472 }, { "key" : "20121218", "doc\_count" : 468 }, { "key" : "20090520", "doc\_count" : 349 }, { "key" : "20101222", "doc\_count" : 274 }, { "key" : "20120711", "doc\_count" : 272 }, { "key" : "20090429", "doc\_count" : 246 }, { "key" : "20120718", "doc\_count" : 230 }, { "key" : "20120425", "doc\_count" : 226 } ] } } -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/34b8c9ca-8fe1-45ca-96b1-49b2a4f55696%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/34b8c9ca-8fe1-45ca-96b1-49b2a4f55696%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![colings86](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/colings86/32/44960_2.png) [@colings86](https://discuss.elastic.co/u/colings86)\ **Post date:** [July 7, 2014, 12:47pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/2 "2014-07-07T12:47:17Z")
Diederik, To increase the number of terms returned by the terms aggregation you will need to add the 'size' parameter to your aggregation. The below curl command will return you the top 200 terms (ordered by decending doc\_count). curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd", "size" : 200 } } } }' You may also find the following link to the documentation useful regarding the size parameter of the terms aggregation. > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. Hope this helps, Colin On Monday, 7 July 2014 13:09:52 UTC+1, Diederik Meijer wrote: > Dear list, > > I need to create an aggregation by a specific field, named > "datum\_uitspraak\_ymd'. I am using the below curl command and it works fine > in a sense that it returns the aggregation listed below. While this result > seems OK enough, it seems that the keys listed in the aggregation are > limited to those listed in 10 records. > > As the number of unique values for this key is much higher than 10, it > seems that the aggregation's scope is global as far as it searches for > documents with a value identical to one of the 10 listed, but it is limited > as far as the key values used in the aggregation is concerned. > > How do I need to set up my curl command in order for the aggregation to > return more key-value pairs? > > Many thanks, > Diederik > > Command: > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, > "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": > "datum\_uitspraak\_ymd" } } } }' > > Returns: > "aggregations" : { "datum\_uitspraak\_ymd" : { "buckets" : [ { "key" : > "20121219", "doc\_count" : 612 }, { "key" : "20120516", "doc\_count" : 526 }, > { "key" : "20110601", "doc\_count" : 472 }, { "key" : "20121218", > "doc\_count" : 468 }, { "key" : "20090520", "doc\_count" : 349 }, { "key" : > "20101222", "doc\_count" : 274 }, { "key" : "20120711", "doc\_count" : 272 }, > { "key" : "20090429", "doc\_count" : 246 }, { "key" : "20120718", > "doc\_count" : 230 }, { "key" : "20120425", "doc\_count" : 226 } ] } } -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Diederik\_Meijer\_Ten\_](https://avatars.discourse-cdn.com/v4/letter/d/7bcc69/32.png) [@Diederik\_Meijer\_Ten\_](https://discuss.elastic.co/u/Diederik_Meijer_Ten_)\ **Post date:** [July 7, 2014, 12:59pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/3 "2014-07-07T12:59:44Z")
Hi Colin, Thank you, that works perfectly! Is there any way to limit the key-value pairs by a certain parameter, in the example below: to limit the aggregation to "datum\_uitspraak\_ymd" keys that start with "2014"? Or does that require the combination of a filter and an aggregation? Many thanks, Diederik Op Jul 7, 2014, om 2:47 PM heeft Colin Goodheart-Smithe [colin.goodheart-smithe@elasticsearch.com](mailto:colin.goodheart-smithe@elasticsearch.com) het volgende geschreven: > Diederik, > > To increase the number of terms returned by the terms aggregation you will need to add the 'size' parameter to your aggregation. The below curl command will return you the top 200 terms (ordered by decending doc\_count). > > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd", "size" : 200 } } } }' > > You may also find the following link to the documentation useful regarding the size parameter of the terms aggregation. > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-terms-aggregation.html#_size_amp_shard_size) > > Hope this helps, > > Colin > > On Monday, 7 July 2014 13:09:52 UTC+1, Diederik Meijer wrote: > Dear list, > > I need to create an aggregation by a specific field, named "datum\_uitspraak\_ymd'. I am using the below curl command and it works fine in a sense that it returns the aggregation listed below. While this result seems OK enough, it seems that the keys listed in the aggregation are limited to those listed in 10 records. > > As the number of unique values for this key is much higher than 10, it seems that the aggregation's scope is global as far as it searches for documents with a value identical to one of the 10 listed, but it is limited as far as the key values used in the aggregation is concerned. > > How do I need to set up my curl command in order for the aggregation to return more key-value pairs? > > Many thanks, > Diederik > > Command: > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd" } } } }' > > Returns: > "aggregations" : { "datum\_uitspraak\_ymd" : { "buckets" : [{ "key" : "20121219", "doc\_count" : 612 }, { "key" : "20120516", "doc\_count" : 526 }, { "key" : "20110601", "doc\_count" : 472 }, { "key" : "20121218", "doc\_count" : 468 }, { "key" : "20090520", "doc\_count" : 349 }, { "key" : "20101222", "doc\_count" : 274 }, { "key" : "20120711", "doc\_count" : 272 }, { "key" : "20090429", "doc\_count" : 246 }, { "key" : "20120718", "doc\_count" : 230 }, { "key" : "20120425", "doc\_count" : 226 }] } } > > -- > You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/wCkb\_xHaUmQ/unsubscribe](https://groups.google.com/d/topic/elasticsearch/wCkb_xHaUmQ/unsubscribe). > To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/2CC2403E-C358-4405-AA70-3ECDE29BF9D2%40tenhorses.com](https://groups.google.com/d/msgid/elasticsearch/2CC2403E-C358-4405-AA70-3ECDE29BF9D2%40tenhorses.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![colings86](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/colings86/32/44960_2.png) [@colings86](https://discuss.elastic.co/u/colings86)\ **Post date:** [July 7, 2014, 1:10pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/4 "2014-07-07T13:10:04Z")
Glad it worked. Yes, there are options for includes and excludes patterns. Take a look at the following link for information on how to use them. > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. Colin On Monday, 7 July 2014 14:04:56 UTC+1, Diederik Meijer wrote: > Hi Colin, > > Thank you, that works perfectly! > > Is there any way to limit the key-value pairs by a certain parameter, in > the example below: to limit the aggregation to "datum\_uitspraak\_ymd" keys > that start with "2014"? > > Or does that require the combination of a filter and an aggregation? > > Many thanks, > > Diederik > > Op Jul 7, 2014, om 2:47 PM heeft Colin Goodheart-Smithe \< > [colin.goodheart-smithe@elasticsearch.com](mailto:colin.goodheart-smithe@elasticsearch.com)\> het volgende geschreven: > > Diederik, > > To increase the number of terms returned by the terms aggregation you will > need to add the 'size' parameter to your aggregation. The below curl > command will return you the top 200 terms (ordered by decending doc\_count). > > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, > "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": > "datum\_uitspraak\_ymd", "size" : 200 } } } }' > > You may also find the following link to the documentation useful regarding > the size parameter of the terms aggregation. > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-terms-aggregation.html#_size_amp_shard_size) > > Hope this helps, > > Colin > > On Monday, 7 July 2014 13:09:52 UTC+1, Diederik Meijer wrote: > > > Dear list, > > > > I need to create an aggregation by a specific field, named > > "datum\_uitspraak\_ymd'. I am using the below curl command and it works fine > > in a sense that it returns the aggregation listed below. While this result > > seems OK enough, it seems that the keys listed in the aggregation are > > limited to those listed in 10 records. > > > > As the number of unique values for this key is much higher than 10, it > > seems that the aggregation's scope is global as far as it searches for > > documents with a value identical to one of the 10 listed, but it is limited > > as far as the key values used in the aggregation is concerned. > > > > How do I need to set up my curl command in order for the aggregation to > > return more key-value pairs? > > > > Many thanks, > > Diederik > > > > Command: > > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, > > "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": > > "datum\_uitspraak\_ymd" } } } }' > > > > Returns: > > "aggregations" : { "datum\_uitspraak\_ymd" : { "buckets" : [ { "key" : > > "20121219", "doc\_count" : 612 }, { "key" : "20120516", "doc\_count" : 526 }, > > { "key" : "20110601", "doc\_count" : 472 }, { "key" : "20121218", > > "doc\_count" : 468 }, { "key" : "20090520", "doc\_count" : 349 }, { "key" : > > "20101222", "doc\_count" : 274 }, { "key" : "20120711", "doc\_count" : 272 }, > > { "key" : "20090429", "doc\_count" : 246 }, { "key" : "20120718", > > "doc\_count" : 230 }, { "key" : "20120425", "doc\_count" : 226 } ] } } > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/wCkb\_xHaUmQ/unsubscribe](https://groups.google.com/d/topic/elasticsearch/wCkb_xHaUmQ/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bcd2fd44-6771-4c30-acfc-68ad731074b3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bcd2fd44-6771-4c30-acfc-68ad731074b3%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Diederik\_Meijer\_Ten\_](https://avatars.discourse-cdn.com/v4/letter/d/7bcc69/32.png) [@Diederik\_Meijer\_Ten\_](https://discuss.elastic.co/u/Diederik_Meijer_Ten_)\ **Post date:** [July 7, 2014, 1:13pm UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/5 "2014-07-07T13:13:39Z")
Awesome, just ran the curl command below, works fine! curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd", "include":"2014.\*", "size":10000 } } } }' Op Jul 7, 2014, om 3:10 PM heeft Colin Goodheart-Smithe [colin.goodheart-smithe@elasticsearch.com](mailto:colin.goodheart-smithe@elasticsearch.com) het volgende geschreven: > Glad it worked. > > Yes, there are options for includes and excludes patterns. Take a look at the following link for information on how to use them. > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-terms-aggregation.html#_filtering_values) > > Colin > > On Monday, 7 July 2014 14:04:56 UTC+1, Diederik Meijer wrote: > Hi Colin, > > Thank you, that works perfectly! > > Is there any way to limit the key-value pairs by a certain parameter, in the example below: to limit the aggregation to "datum\_uitspraak\_ymd" keys that start with "2014"? > > Or does that require the combination of a filter and an aggregation? > > Many thanks, > > Diederik > > Op Jul 7, 2014, om 2:47 PM heeft Colin Goodheart-Smithe [colin.goodheart-smithe@elasticsearch.com](mailto:colin.goodheart-smithe@elasticsearch.com) het volgende geschreven: > > > Diederik, > > > > To increase the number of terms returned by the terms aggregation you will need to add the 'size' parameter to your aggregation. The below curl command will return you the top 200 terms (ordered by decending doc\_count). > > > > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd", "size" : 200 } } } }' > > > > You may also find the following link to the documentation useful regarding the size parameter of the terms aggregation. > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-terms-aggregation.html#_size_amp_shard_size) > > > > Hope this helps, > > > > Colin > > > > On Monday, 7 July 2014 13:09:52 UTC+1, Diederik Meijer wrote: > > Dear list, > > > > I need to create an aggregation by a specific field, named "datum\_uitspraak\_ymd'. I am using the below curl command and it works fine in a sense that it returns the aggregation listed below. While this result seems OK enough, it seems that the keys listed in the aggregation are limited to those listed in 10 records. > > > > As the number of unique values for this key is much higher than 10, it seems that the aggregation's scope is global as far as it searches for documents with a value identical to one of the 10 listed, but it is limited as far as the key values used in the aggregation is concerned. > > > > How do I need to set up my curl command in order for the aggregation to return more key-value pairs? > > > > Many thanks, > > Diederik > > > > Command: > > curl -XGET '[http://localhost:9200/\_search?pretty=true](http://localhost:9200/_search?pretty=true)' -d '{ "size": 0, "aggs": { "datum\_uitspraak\_ymd": { "terms": { "field": "datum\_uitspraak\_ymd" } } } }' > > > > Returns: > > "aggregations" : { "datum\_uitspraak\_ymd" : { "buckets" : [{ "key" : "20121219", "doc\_count" : 612 }, { "key" : "20120516", "doc\_count" : 526 }, { "key" : "20110601", "doc\_count" : 472 }, { "key" : "20121218", "doc\_count" : 468 }, { "key" : "20090520", "doc\_count" : 349 }, { "key" : "20101222", "doc\_count" : 274 }, { "key" : "20120711", "doc\_count" : 272 }, { "key" : "20090429", "doc\_count" : 246 }, { "key" : "20120718", "doc\_count" : 230 }, { "key" : "20120425", "doc\_count" : 226 }] } } > > > > -- > > You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. > > To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/wCkb\_xHaUmQ/unsubscribe](https://groups.google.com/d/topic/elasticsearch/wCkb_xHaUmQ/unsubscribe). > > To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9f0cb2af-fa2d-40b0-9930-b884141f2969%40googlegroups.com). > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/wCkb\_xHaUmQ/unsubscribe](https://groups.google.com/d/topic/elasticsearch/wCkb_xHaUmQ/unsubscribe). > To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bcd2fd44-6771-4c30-acfc-68ad731074b3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bcd2fd44-6771-4c30-acfc-68ad731074b3%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/578C3BD6-8AC2-46E0-A6C7-EC3F51A44645%40tenhorses.com](https://groups.google.com/d/msgid/elasticsearch/578C3BD6-8AC2-46E0-A6C7-EC3F51A44645%40tenhorses.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:17am UTC](https://discuss.elastic.co/t/terms-aggregation-and-scope/18504/6 "2017-07-06T01:17:35Z")