# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1964

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1965

---

## [Aggregation: Remove a aggregation buckets from multi aggregated response](https://discuss.elastic.co/t/aggregation-remove-a-aggregation-buckets-from-multi-aggregated-response/98800)

<div class="topic-metadata">

**Author:** [@Tamizh](https://discuss.elastic.co/u/Tamizh)\
**Replies:** 0\
**Last updated:** [August 30, 2017, 7:03am UTC](https://discuss.elastic.co/t/aggregation-remove-a-aggregation-buckets-from-multi-aggregated-response/98800 "2017-08-30T07:03:24Z")

</div>

GET testing/\_search { "size": 0, "aggs": { "users": { "terms": { "field": "user.keyword", "size": 225000 }, "aggs": { "followers\_count": { "max": { …

---

## [What's the problem with these query?](https://discuss.elastic.co/t/whats-the-problem-with-these-query/98587)

<div class="topic-metadata">

**Author:** [@Fellipe\_Henrique](https://discuss.elastic.co/u/Fellipe_Henrique)\
**Replies:** 5\
**Last updated:** [August 30, 2017, 6:31am UTC](https://discuss.elastic.co/t/whats-the-problem-with-these-query/98587 "2017-08-30T06:31:48Z")

</div>

Hello, I have these index: { "my\_collection\_data": { "mappings": { "document\_data\_index": { "properties": { "abstract": { "type": "keyw…

---

## [Find Duplicate candidates (similar) articles](https://discuss.elastic.co/t/find-duplicate-candidates-similar-articles/98790)

<div class="topic-metadata">

**Author:** [@yusef-sheypoor](https://discuss.elastic.co/u/yusef-sheypoor)\
**Replies:** 0\
**Last updated:** [August 30, 2017, 5:40am UTC](https://discuss.elastic.co/t/find-duplicate-candidates-similar-articles/98790 "2017-08-30T05:40:43Z")

</div>

We have a websites which users can post Content to website and after moderation check Contents they published,Title and Description are the most important field that content, we want to prevent users to publish similar p…

---

## [Split in filter overwrite the value](https://discuss.elastic.co/t/split-in-filter-overwrite-the-value/98773)

<div class="topic-metadata">

**Author:** [@vinay\_garg](https://discuss.elastic.co/u/vinay_garg)\
**Replies:** 0\
**Last updated:** [August 30, 2017, 2:15am UTC](https://discuss.elastic.co/t/split-in-filter-overwrite-the-value/98773 "2017-08-30T02:15:15Z")

</div>

Hi All, I’ve define grok pattern and mutate in filter in logstash. if “Correlation\_Session\_0” in \[CorrelationSession\] { mutate { split =\> \[“RequestInTime” , “\_”\] add\_field =\> \[ “RequstInsplitime”, “%{\[RequestInTime\]…

---

## [Can we join two index fields in one index](https://discuss.elastic.co/t/can-we-join-two-index-fields-in-one-index/98624)

<div class="topic-metadata">

**Author:** [@vinay\_garg](https://discuss.elastic.co/u/vinay_garg)\
**Replies:** 6\
**Last updated:** [August 30, 2017, 2:05am UTC](https://discuss.elastic.co/t/can-we-join-two-index-fields-in-one-index/98624 "2017-08-30T02:05:40Z")

</div>

Hi All, Environment: ELK 5.5 We are having two index of different logs (haproxy-index and fuselog-index). Both index having different grok pattern. but in haproxy grok pattern having three fields ’col1-ID’:1 ’col2…

---

## [Unassigned replica shards after creation of an index, even though there is enough space](https://discuss.elastic.co/t/unassigned-replica-shards-after-creation-of-an-index-even-though-there-is-enough-space/98729)

<div class="topic-metadata">

**Author:** [@bviz](https://discuss.elastic.co/u/bviz)\
**Replies:** 1\
**Last updated:** [August 30, 2017, 1:32am UTC](https://discuss.elastic.co/t/unassigned-replica-shards-after-creation-of-an-index-even-though-there-is-enough-space/98729 "2017-08-30T01:32:01Z")

</div>

Hey, I’ve been having a problem lately, first with ES 1.7X, and then with ES 5.4X, which didn’t solve the problem. Sometimes, when I create an index (more likely when I create a few indices in a row), I get unassigned …

---

## [Extend ES5 query parser to expand one field into many](https://discuss.elastic.co/t/extend-es5-query-parser-to-expand-one-field-into-many/98770)

<div class="topic-metadata">

**Author:** [@joeferner](https://discuss.elastic.co/u/joeferner)\
**Replies:** 0\
**Last updated:** [August 30, 2017, 1:15am UTC](https://discuss.elastic.co/t/extend-es5-query-parser-to-expand-one-field-into-many/98770 "2017-08-30T01:15:35Z")

</div>

We are in the process of upgrading from ES1 to ES5. One of the plugins we had implemented was a custom query parser which was a copy of QueryStringQueryParser with the added ability to expand field queries into many or’e…

---

## [X-pack security custom roles provider example](https://discuss.elastic.co/t/x-pack-security-custom-roles-provider-example/98762)

<div class="topic-metadata">

**Author:** [@asanderson](https://discuss.elastic.co/u/asanderson)\
**Replies:** 4\
**Last updated:** [August 29, 2017, 11:38pm UTC](https://discuss.elastic.co/t/x-pack-security-custom-roles-provider-example/98762 "2017-08-29T23:38:43Z")

</div>

I would greatly appreciate if someone would point me to a working example of a x-pack security custom roles provider as briefly explained here: https://www.elastic.co/guide/en/x-pack/5.5/custom-roles-provider.html.

---

## [Configuration for High Volume Search 10k/sec](https://discuss.elastic.co/t/configuration-for-high-volume-search-10k-sec/98609)

<div class="topic-metadata">

**Author:** [@wpearson4](https://discuss.elastic.co/u/wpearson4)\
**Replies:** 3\
**Last updated:** [August 29, 2017, 10:04pm UTC](https://discuss.elastic.co/t/configuration-for-high-volume-search-10k-sec/98609 "2017-08-29T22:04:16Z")

</div>

Cluster Id: b3ceb5 I am currently running elastic search in Elastic cloud. I have a single node cluster with 64 gb of ram and 1.5 terabytes of hard drive space. I am doing high volume of searches. Users upload csv fi…

---

## [What time zone does "now" assume in Date math?](https://discuss.elastic.co/t/what-time-zone-does-now-assume-in-date-math/98733)

<div class="topic-metadata">

**Author:** [@Omar\_Verduzco](https://discuss.elastic.co/u/Omar_Verduzco)\
**Replies:** 1\
**Last updated:** [August 29, 2017, 6:40pm UTC](https://discuss.elastic.co/t/what-time-zone-does-now-assume-in-date-math/98733 "2017-08-29T18:40:33Z")

</div>

I’m trying to find out a way to search for documents before the current date. I found a solution using the following in the query: { range: { last\_published\_date: { lte: 'now/m' } } } but I’m wonderin…

---

## [Why this is showing differently in mappings?](https://discuss.elastic.co/t/why-this-is-showing-differently-in-mappings/98730)

<div class="topic-metadata">

**Author:** [@srinin](https://discuss.elastic.co/u/srinin)\
**Replies:** 1\
**Last updated:** [August 29, 2017, 5:10pm UTC](https://discuss.elastic.co/t/why-this-is-showing-differently-in-mappings/98730 "2017-08-29T17:10:36Z")

</div>

Hello, I have \[1\] in my schema. But when I look at \_mappings, it is showing as \[2\]. Why those extra added? Is it expected? How to stop this change? \[1\] "banner\_image": { "properties": { "id": { "type": "ke…

---

## [Data field format question](https://discuss.elastic.co/t/data-field-format-question/97600)

<div class="topic-metadata">

**Author:** [@cord\_thomas](https://discuss.elastic.co/u/cord_thomas)\
**Replies:** 1\
**Last updated:** [August 29, 2017, 4:25pm UTC](https://discuss.elastic.co/t/data-field-format-question/97600 "2017-08-29T16:25:01Z")

</div>

I have a date format of “Fri Jul 27 2012 09:44:36 GMT-0400” - quotes are simply to frame the date I am trying to index it with this Joda format: “E M d Y H:m:s ‘GMT’Z” It is not working. Throws an error: Invalid form…

---

## [Removing stemming override on error](https://discuss.elastic.co/t/removing-stemming-override-on-error/98725)

<div class="topic-metadata">

**Author:** [@MarkTierney](https://discuss.elastic.co/u/MarkTierney)\
**Replies:** 0\
**Last updated:** [August 29, 2017, 4:11pm UTC](https://discuss.elastic.co/t/removing-stemming-override-on-error/98725 "2017-08-29T16:11:06Z")

</div>

Hello Folks, We applied a stemming override to one of our indexes via rules\_path. We encountered a problem when the file pointed to in the rules\_path was not found on all nodes in the cluster (someone did not copy it pr…

---

## [Indexing string as integer then getting back the integer value in search result](https://discuss.elastic.co/t/indexing-string-as-integer-then-getting-back-the-integer-value-in-search-result/98721)

<div class="topic-metadata">

**Author:** [@MikeThomsen](https://discuss.elastic.co/u/MikeThomsen)\
**Replies:** 0\
**Last updated:** [August 29, 2017, 3:17pm UTC](https://discuss.elastic.co/t/indexing-string-as-integer-then-getting-back-the-integer-value-in-search-result/98721 "2017-08-29T15:17:18Z")

</div>

A team I am working with has a lot of dirty data. Sometimes a field might be a string, sometimes an integer for a particular field in several related Mongo collections. When it’s a string, we can always rely on it being …

---

## [Using AWS EC2 for elasticsearch cluster](https://discuss.elastic.co/t/using-aws-ec2-for-elasticsearch-cluster/98683)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 1\
**Last updated:** [August 29, 2017, 3:15pm UTC](https://discuss.elastic.co/t/using-aws-ec2-for-elasticsearch-cluster/98683 "2017-08-29T15:15:48Z")

</div>

Is there any points we should be aware of while planning to have the ELK stack on AWS EC2 instances.

---

## [Count Via REST Endpoint Query](https://discuss.elastic.co/t/count-via-rest-endpoint-query/98600)

<div class="topic-metadata">

**Author:** [@Velusamy\_Velu](https://discuss.elastic.co/u/Velusamy_Velu)\
**Replies:** 2\
**Last updated:** [August 29, 2017, 2:11pm UTC](https://discuss.elastic.co/t/count-via-rest-endpoint-query/98600 "2017-08-29T14:11:39Z")

</div>

I would like to get the number of documents that meet a query criteria via REST endpoint. Something similar to this: http://\<server\>:9200/\<index\>/\<type\>/\_search?q={...} Please let me know the syntax. Thanks in advance. …

---

## [Highlight if all word matches](https://discuss.elastic.co/t/highlight-if-all-word-matches/98699)

<div class="topic-metadata">

**Author:** [@HritikJain](https://discuss.elastic.co/u/HritikJain)\
**Replies:** 0\
**Last updated:** [August 29, 2017, 1:36pm UTC](https://discuss.elastic.co/t/highlight-if-all-word-matches/98699 "2017-08-29T13:36:30Z")

</div>

Hello Guys, I am working with Highlight functionality with ES 2.4.x I need to have highlight field if all the words matches. If I search for “The Old Vic” and if all three words match then only highlight should come. …

---

## [Storing the html stripped version of a document in elasticsearch](https://discuss.elastic.co/t/storing-the-html-stripped-version-of-a-document-in-elasticsearch/98519)

<div class="topic-metadata">

**Author:** [@Melvyn\_Peignon](https://discuss.elastic.co/u/Melvyn_Peignon)\
**Replies:** 3\
**Last updated:** [August 29, 2017, 1:16pm UTC](https://discuss.elastic.co/t/storing-the-html-stripped-version-of-a-document-in-elasticsearch/98519 "2017-08-29T13:16:24Z")

</div>

Hi! I have a piece of text, let’s say: "\<p\>\<br/\>台灣人，奧運直播，使用PPStream，(PPS網路電視)，觀看同步奧運實況\</b\>!" I succeed to index this text without the html tags, using “strip\_html”. Now I’m trying to store this text without the HTML t…

---

## [Bulk operation locked on actionGet ES 1.7.x](https://discuss.elastic.co/t/bulk-operation-locked-on-actionget-es-1-7-x/98690)

<div class="topic-metadata">

**Author:** [@Slava\_G](https://discuss.elastic.co/u/Slava_G)\
**Replies:** 0\
**Last updated:** [August 29, 2017, 1:08pm UTC](https://discuss.elastic.co/t/bulk-operation-locked-on-actionget-es-1-7-x/98690 "2017-08-29T13:08:16Z")

</div>

Hi, I know that similar questions were asked , but not found solution for that issue. My app has 10 threads that part of them can run bulk index, there number of servers running same app , from time to time I see that …

---

## [How do we know the list of analyzer(s) applied on the particular document?](https://discuss.elastic.co/t/how-do-we-know-the-list-of-analyzer-s-applied-on-the-particular-document/98581)

<div class="topic-metadata">

**Author:** [@Ramchandram](https://discuss.elastic.co/u/Ramchandram)\
**Replies:** 3\
**Last updated:** [August 29, 2017, 12:55pm UTC](https://discuss.elastic.co/t/how-do-we-know-the-list-of-analyzer-s-applied-on-the-particular-document/98581 "2017-08-29T12:55:18Z")

</div>

Hi, I am new to elastic search. So guys, could you please let me know the answer for the below question: How do we know the list of analyzer(s) applied on the particular document?

---

## [ES(5.x)-to-JSON logging log4j.properties example/snippet](https://discuss.elastic.co/t/es-5-x-to-json-logging-log4j-properties-example-snippet/97566)

<div class="topic-metadata">

**Author:** [@uschtwill](https://discuss.elastic.co/u/uschtwill)\
**Replies:** 5\
**Last updated:** [August 29, 2017, 12:49pm UTC](https://discuss.elastic.co/t/es-5-x-to-json-logging-log4j-properties-example-snippet/97566 "2017-08-29T12:49:47Z")

</div>

Hello everybody, I am trying to get ES to log to JSON with https://github.com/vy/log4j2-logstash-layout, but can not get it to work. The examples I found are using the deprecated logging.yml. Does anybody have an examp…

---

## [Circuit breaker not effective](https://discuss.elastic.co/t/circuit-breaker-not-effective/98681)

<div class="topic-metadata">

**Author:** [@fphilippon](https://discuss.elastic.co/u/fphilippon)\
**Replies:** 3\
**Last updated:** [August 29, 2017, 12:41pm UTC](https://discuss.elastic.co/t/circuit-breaker-not-effective/98681 "2017-08-29T12:41:49Z")

</div>

Hi community! We have a situation on our Elasticsearch cluster where a single request can quickly bring down all cluster nodes (with an OOM exception). We updated the cluster configuration in order to have following ci…

---

## [Setting SSL Between Elasticsearch and Active Directory \[ELK running on Windows server\]](https://discuss.elastic.co/t/setting-ssl-between-elasticsearch-and-active-directory-elk-running-on-windows-server/98661)

<div class="topic-metadata">

**Author:** [@Bozzerreaneaux](https://discuss.elastic.co/u/Bozzerreaneaux)\
**Replies:** 4\
**Last updated:** [August 29, 2017, 12:02pm UTC](https://discuss.elastic.co/t/setting-ssl-between-elasticsearch-and-active-directory-elk-running-on-windows-server/98661 "2017-08-29T12:02:54Z")

</div>

Hi Team, I’ve been working on sort of unorthodox ELK stack logging POC solution where all components (ElasticSearch, Kibana, Logstash, X-Pack) are running on windows server. I’ve been able to integrate Elastic search w…

---

## [Problems while inserting data to index](https://discuss.elastic.co/t/problems-while-inserting-data-to-index/96838)

<div class="topic-metadata">

**Author:** [@vinaya\_dhinu](https://discuss.elastic.co/u/vinaya_dhinu)\
**Replies:** 5\
**Last updated:** [August 29, 2017, 11:01am UTC](https://discuss.elastic.co/t/problems-while-inserting-data-to-index/96838 "2017-08-29T11:01:22Z")

</div>

I am getting following error : {“error”:{“root\_cause”:\[{“type”:“illegal\_argument\_exception”,“reason”:“Limit of total fields \[1000\] in index \[priceline\_hotels\] has been exceeded”}\]. The same error i got for another indi…

---

## [Could not resolve org.elasticsearch:elasticsearch:5.5.2-SNAPSHOT](https://discuss.elastic.co/t/could-not-resolve-org-elasticsearch-elasticsearch-5-5-2-snapshot/98430)

<div class="topic-metadata">

**Author:** [@saliormoon](https://discuss.elastic.co/u/saliormoon)\
**Replies:** 4\
**Last updated:** [August 29, 2017, 10:30am UTC](https://discuss.elastic.co/t/could-not-resolve-org-elasticsearch-elasticsearch-5-5-2-snapshot/98430 "2017-08-29T10:30:01Z")

</div>

Elasticsearch Version: 5.5.2 OS: Windows When I use grdle to build elasticsearch source code, I get a unknown problem, like this: What went wrong: Could not determine the dependencies of task ':benchmarks:javadoc'. …

---

## [Matched Queries not always functioning](https://discuss.elastic.co/t/matched-queries-not-always-functioning/97241)

<div class="topic-metadata">

**Author:** [@ddorian43](https://discuss.elastic.co/u/ddorian43)\
**Replies:** 3\
**Last updated:** [August 29, 2017, 10:23am UTC](https://discuss.elastic.co/t/matched-queries-not-always-functioning/97241 "2017-08-29T10:23:21Z")

</div>

Using ES 5.2.0. When I do: {'query': {'bool': {'filter': {'bool': {'should': \[{'bool': {'filter': {'bool': {'should': \[{'term': {'title\_raw': {'value': 'stylebubble', '\_name': 'stylebubble'}}}\], 'must': ({'type': {'val…

---

## [Common Terms Query Corpus Question](https://discuss.elastic.co/t/common-terms-query-corpus-question/98413)

<div class="topic-metadata">

**Author:** [@Khalysto\_Funkadelic](https://discuss.elastic.co/u/Khalysto_Funkadelic)\
**Replies:** 1\
**Last updated:** [August 29, 2017, 10:03am UTC](https://discuss.elastic.co/t/common-terms-query-corpus-question/98413 "2017-08-29T10:03:39Z")

</div>

Working on an implementation of Elasticsearch for enterprise search and I’m exploring alternatives to noise words / stop words. Can Common Terms Query be used without defining the corpus manually? I.E. Does elasticsearc…

---

## [J hipster enable and disable elastic search](https://discuss.elastic.co/t/j-hipster-enable-and-disable-elastic-search/98631)

<div class="topic-metadata">

**Author:** [@amitkumar](https://discuss.elastic.co/u/amitkumar)\
**Replies:** 4\
**Last updated:** [August 29, 2017, 9:23am UTC](https://discuss.elastic.co/t/j-hipster-enable-and-disable-elastic-search/98631 "2017-08-29T09:23:44Z")

</div>

Hi , J hipster provide elastic search feature but can you please guide me how do i enable and disable elastic search feature with in J hipster For reference : http://www.jhipster.tech/using-elasticsearch/

---

## [Too many open files on bitnami virtual appliance](https://discuss.elastic.co/t/too-many-open-files-on-bitnami-virtual-appliance/98567)

<div class="topic-metadata">

**Author:** [@mkorayem](https://discuss.elastic.co/u/mkorayem)\
**Replies:** 2\
**Last updated:** [August 29, 2017, 8:52am UTC](https://discuss.elastic.co/t/too-many-open-files-on-bitnami-virtual-appliance/98567 "2017-08-29T08:52:50Z")

</div>

I have only one cluster and one node on which is Elasticsearch, Logstash and Kibana This is a bitnami virtual appliance The system was working fine until we had to reboot the machine then the Elasticsearch cannot start…

---

## [Reporting back search results via email](https://discuss.elastic.co/t/reporting-back-search-results-via-email/98258)

<div class="topic-metadata">

**Author:** [@X\_Calibur](https://discuss.elastic.co/u/X_Calibur)\
**Replies:** 2\
**Last updated:** [August 29, 2017, 8:50am UTC](https://discuss.elastic.co/t/reporting-back-search-results-via-email/98258 "2017-08-29T08:50:36Z")

</div>

Hi, Is it possible to configure a Watcher to attach the search query results to the email once it’s fired? Thanks

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1963)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1965)
