# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1209 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1210 --- ## [SEGMENT MERGING](https://discuss.elastic.co/t/segment-merging/192932)
**Author:** [@zatom](https://discuss.elastic.co/u/zatom)\ **Replies:** 2\ **Last updated:** [July 30, 2019, 5:21pm UTC](https://discuss.elastic.co/t/segment-merging/192932 "2019-07-30T17:21:31Z")
I recently reindexed where I had to update docs multiple times and deleted huge amount of docs. I see deleted and updated docs are still occupying disk space. From my research so far, force merge of segments is not a go… --- ## [Curator\_cli: filter suffix pattern seems to be acting like a regex pattern](https://discuss.elastic.co/t/curator-cli-filter-suffix-pattern-seems-to-be-acting-like-a-regex-pattern/192947)
**Author:** [@Daniel314](https://discuss.elastic.co/u/Daniel314)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 4:30pm UTC](https://discuss.elastic.co/t/curator-cli-filter-suffix-pattern-seems-to-be-acting-like-a-regex-pattern/192947 "2019-07-30T16:30:33Z")
Hello, I'm using curator\_cli version 5.7.5. When the following command was executed, the filter pattern matched every single index (and consequently deleted every index). Is this expected behavior? From what I can te… --- ## [User in Kibana get 403](https://discuss.elastic.co/t/user-in-kibana-get-403/192818)
**Author:** [@Gidi\_Kalef](https://discuss.elastic.co/u/Gidi_Kalef)\ **Replies:** 3\ **Last updated:** [July 30, 2019, 4:24pm UTC](https://discuss.elastic.co/t/user-in-kibana-get-403/192818 "2019-07-30T16:24:01Z")
Hi Guys, i create a role with the following permissions and assigned it to user : "webrtmon" : { "cluster" : \[ \], "indices" : \[ { "names" : \[ "\*" \], "privileges" : \[ … --- ## [Add a new field to all index in ElasticSearch](https://discuss.elastic.co/t/add-a-new-field-to-all-index-in-elasticsearch/192854)
**Author:** [@iaskdoubt](https://discuss.elastic.co/u/iaskdoubt)\ **Replies:** 3\ **Last updated:** [July 30, 2019, 3:49pm UTC](https://discuss.elastic.co/t/add-a-new-field-to-all-index-in-elasticsearch/192854 "2019-07-30T15:49:16Z")
Hi, We are using Elastic Search 2.2 . We are in a need to add a new field to all the elastic search indices. Currently we create a new index each day. So need to add the specified field to all the documents in each ind… --- ## [Choosing an elasticsearch version](https://discuss.elastic.co/t/choosing-an-elasticsearch-version/192930)
**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 3:21pm UTC](https://discuss.elastic.co/t/choosing-an-elasticsearch-version/192930 "2019-07-30T15:21:42Z")
Currently, we are using elastic 5.4. We want to upgrade it to the latest stable version possible. What is the most recommended and stable version currently? (6.8.2,7.1.1, 7.2.0) --- ## [Reverse salesforce integration](https://discuss.elastic.co/t/reverse-salesforce-integration/192924)
**Author:** [@mad823](https://discuss.elastic.co/u/mad823)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 3:11pm UTC](https://discuss.elastic.co/t/reverse-salesforce-integration/192924 "2019-07-30T15:11:53Z")
Hi! I'm looking for a way to trigger events in salesforce based on certain log events created in elasticsearch. Eg. if there is a "user data change" event logged by elasticsearch, I want to take certain automatic actions… --- ## [Problems with bulk indexing via JavaScript client](https://discuss.elastic.co/t/problems-with-bulk-indexing-via-javascript-client/192535)
**Author:** [@waynesmallman](https://discuss.elastic.co/u/waynesmallman)\ **Replies:** 5\ **Last updated:** [July 30, 2019, 2:38pm UTC](https://discuss.elastic.co/t/problems-with-bulk-indexing-via-javascript-client/192535 "2019-07-30T14:38:46Z")
Hi, I'm using a variant of the code for bulk indexing from the documentation for Elastic 6.x, and I'm having a few problems. Here's a typical document: { index: { \_index: 'messages', \_type: '\_doc', \_id: 21653 } }, { … --- ## [ILM with rollover for APM indices on Elastic Cloud](https://discuss.elastic.co/t/ilm-with-rollover-for-apm-indices-on-elastic-cloud/192039)
**Author:** [@p-j](https://discuss.elastic.co/u/p-j)\ **Replies:** 3\ **Last updated:** [July 30, 2019, 2:15pm UTC](https://discuss.elastic.co/t/ilm-with-rollover-for-apm-indices-on-elastic-cloud/192039 "2019-07-30T14:15:06Z")
Hi everyone; I've been trying to setup ILM with Rollover for APM Indices and I'm still not able to achieve what I want and I don't even know if it is at all possible on Elastic Cloud. The context: Our deployment is us… --- ## [Is there some sort of preproduction staging mechanism (reindexing takes quite some time)](https://discuss.elastic.co/t/is-there-some-sort-of-preproduction-staging-mechanism-reindexing-takes-quite-some-time/192915)
**Author:** [@tom2](https://discuss.elastic.co/u/tom2)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 2:05pm UTC](https://discuss.elastic.co/t/is-there-some-sort-of-preproduction-staging-mechanism-reindexing-takes-quite-some-time/192915 "2019-07-30T14:05:24Z")
Hi there, I'm currently evaluating Elasticsearch for our project. In this project we want to completely reindex our database from time to time, which will probably take a few hours up to a couple of days. This must not… --- ## [CASE WHEN THEN](https://discuss.elastic.co/t/case-when-then/192756)
**Author:** [@Farouk6072](https://discuss.elastic.co/u/Farouk6072)\ **Replies:** 4\ **Last updated:** [July 30, 2019, 1:42pm UTC](https://discuss.elastic.co/t/case-when-then/192756 "2019-07-30T13:42:23Z")
I have put this Query on Canva Elasticsearch SQL query : SELECT CASE sexe WHEN 1 THEN 'Male' WHEN 2 THEN 'Female' END FROM "test\*" WHERE sexe IS NOT NULL I have this error message : Whoops! Expression failed Ex… --- ## [Elasticsearch didn't start](https://discuss.elastic.co/t/elasticsearch-didnt-start/192905)
**Author:** [@Jalis\_Diehl](https://discuss.elastic.co/u/Jalis_Diehl)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 1:28pm UTC](https://discuss.elastic.co/t/elasticsearch-didnt-start/192905 "2019-07-30T13:28:31Z")
elasticsearch-7.2.0\]$ bin/elasticsearch \[2019-07-30T09:28:07,915\]\[INFO \]\[o.e.x.s.a.s.FileRolesStore\] \[node-1\] parsed \[0\] roles from file \[/home/app/elk/elasticsearch-7.2.0/config/roles.yml\] \[2019-07-30T09:28:19,055\]\[WA… --- ## [Problem with Infrastructure tab](https://discuss.elastic.co/t/problem-with-infrastructure-tab/192902)
**Author:** [@antonopo](https://discuss.elastic.co/u/antonopo)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 1:16pm UTC](https://discuss.elastic.co/t/problem-with-infrastructure-tab/192902 "2019-07-30T13:16:56Z")
Hi, I have problem with infrastructure tab. I can see all the hosts grouped by CPU, memory, load etc. but when i am going to view the metrics of a host before one hour for example i am getting an message that "There is … --- ## [Storing long fields in ELK](https://discuss.elastic.co/t/storing-long-fields-in-elk/192875)
**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\ **Replies:** 2\ **Last updated:** [July 30, 2019, 12:42pm UTC](https://discuss.elastic.co/t/storing-long-fields-in-elk/192875 "2019-07-30T12:42:30Z")
Hi, I have few very large fields, in order of few MB's. When i query for something on that index i used to get "length of the field crossed max allowed for highlighting". To work around this problem, i started indexing … --- ## [Elasticsearch terms aggregation and querrying](https://discuss.elastic.co/t/elasticsearch-terms-aggregation-and-querrying/192748)
**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\ **Replies:** 1\ **Last updated:** [July 29, 2019, 5:18pm UTC](https://discuss.elastic.co/t/elasticsearch-terms-aggregation-and-querrying/192748 "2019-07-29T17:18:15Z")
Hi I have two types of log messages: Jul 23 09:24:16 rrr mrr-core\[222\]: Aweg3AOMTs\_1563866656871111.mt processMTMessage() #12798 realtime: 5.684 ms Jul 23 09:24:18 rrr mrr-core\[2222\]: Aweg3AOMTs\_1563866656871111.0.dn p… --- ## [Trim all text fields when indexing](https://discuss.elastic.co/t/trim-all-text-fields-when-indexing/191761)
**Author:** [@Ayala](https://discuss.elastic.co/u/Ayala)\ **Replies:** 3\ **Last updated:** [July 30, 2019, 12:28pm UTC](https://discuss.elastic.co/t/trim-all-text-fields-when-indexing/191761 "2019-07-30T12:28:00Z")
Hi, I would like all text fields to be SAVED in elastic without leading and trailing spaces. (That is, in \_source) Pipeline didn't work, but also is not good enough, because I don't want to add each field to it. How … --- ## [BulkProcessor afterBulk method not getting invoked when cluster is Red](https://discuss.elastic.co/t/bulkprocessor-afterbulk-method-not-getting-invoked-when-cluster-is-red/192884)
**Author:** [@PDN10](https://discuss.elastic.co/u/PDN10)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 11:19am UTC](https://discuss.elastic.co/t/bulkprocessor-afterbulk-method-not-getting-invoked-when-cluster-is-red/192884 "2019-07-30T11:19:42Z")
I got into a situation where long running queries on cluster made CPU utilization to go high on all nodes. And cluster went into Red. We have an application which constantly Indexes documents in Elasticsearch using Bulk… --- ## [Comparison of tokens must not be repeated from query side to index document side](https://discuss.elastic.co/t/comparison-of-tokens-must-not-be-repeated-from-query-side-to-index-document-side/192882)
**Author:** [@jyothsna](https://discuss.elastic.co/u/jyothsna)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 11:16am UTC](https://discuss.elastic.co/t/comparison-of-tokens-must-not-be-repeated-from-query-side-to-index-document-side/192882 "2019-07-30T11:16:05Z")
0 for example if i have a name query with name "pier luigi bersani" and index document having name "pi luigi bersani". here we have used bigram filter. the name query has "er" token which is repeated two times.the docum… --- ## [When I'm using prefix query it getting the documents where input string in middle also?](https://discuss.elastic.co/t/when-im-using-prefix-query-it-getting-the-documents-where-input-string-in-middle-also/192877)
**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 11:04am UTC](https://discuss.elastic.co/t/when-im-using-prefix-query-it-getting-the-documents-where-input-string-in-middle-also/192877 "2019-07-30T11:04:19Z")
I'm using Prefix query and here is the query { "query": { "prefix": { "name": { "value": "asp" } } } } So I'm assuming that I need to get the documents based on the name property startin… --- ## [How to create Elaticsearch index dynamically from spring boot with the help of settings and mappings JSON file?](https://discuss.elastic.co/t/how-to-create-elaticsearch-index-dynamically-from-spring-boot-with-the-help-of-settings-and-mappings-json-file/192870)
**Author:** [@Ramesh\_Kanakarajan](https://discuss.elastic.co/u/Ramesh_Kanakarajan)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 10:47am UTC](https://discuss.elastic.co/t/how-to-create-elaticsearch-index-dynamically-from-spring-boot-with-the-help-of-settings-and-mappings-json-file/192870 "2019-07-30T10:47:11Z")
How to create Elaticsearch index dynamically from spring boot with the help of settings and mappings JSON file? --- ## [HI I trying to search document based on date which is in format 'mm/dd/yyyy'?](https://discuss.elastic.co/t/hi-i-trying-to-search-document-based-on-date-which-is-in-format-mm-dd-yyyy/192829)
**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\ **Replies:** 4\ **Last updated:** [July 30, 2019, 10:39am UTC](https://discuss.elastic.co/t/hi-i-trying-to-search-document-based-on-date-which-is-in-format-mm-dd-yyyy/192829 "2019-07-30T10:39:17Z")
So my query is { "\_source": "dob", "query": { "bool": { "must": \[ { "term": { "dob": "01/01/1965" } } \] } } } I'm getting documents having 11/01/1965, 12/01/1965, 01/01/1965 etc So I need to get only docum… --- ## [Query doesn't show right result](https://discuss.elastic.co/t/query-doesnt-show-right-result/192858)
**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\ **Replies:** 2\ **Last updated:** [July 30, 2019, 10:25am UTC](https://discuss.elastic.co/t/query-doesnt-show-right-result/192858 "2019-07-30T10:25:43Z")
Hello everybody ! :v: I sent a log message to elasticsearch and as we can see in kibana it has the following format: So we know that there is the field num1 number and field suffix which has value mt or dn. Despite t… --- ## [List sorted nested objects from multiple documents](https://discuss.elastic.co/t/list-sorted-nested-objects-from-multiple-documents/191986)
**Author:** [@creaticious](https://discuss.elastic.co/u/creaticious)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 10:02am UTC](https://discuss.elastic.co/t/list-sorted-nested-objects-from-multiple-documents/191986 "2019-07-30T10:02:27Z")
Hey guys, i want to know if it is possible to return a list of nested objects, sorted by a nested field but include parent fields...something like an inverted document... Imagine a product list with nested "date"-objec… --- ## [X-pack sql - summation of case statement does not work](https://discuss.elastic.co/t/x-pack-sql-summation-of-case-statement-does-not-work/192727)
**Author:** [@isurika\_lakmali](https://discuss.elastic.co/u/isurika_lakmali)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 9:59am UTC](https://discuss.elastic.co/t/x-pack-sql-summation-of-case-statement-does-not-work/192727 "2019-07-30T09:59:26Z")
Hi Team, I am trying to execute following sql query using x-pack sql. POST /\_sql { "query" : "select sum(case when metric\_name ='requirement' then 1 else 0 end) as req\_count ,sum(case when metric\_name ='defect' then… --- ## [Nodes unable to join cluster](https://discuss.elastic.co/t/nodes-unable-to-join-cluster/192823)
**Author:** [@msk\_76](https://discuss.elastic.co/u/msk_76)\ **Replies:** 8\ **Last updated:** [July 30, 2019, 9:59am UTC](https://discuss.elastic.co/t/nodes-unable-to-join-cluster/192823 "2019-07-30T09:59:08Z")
I have following node configurations for 3 node cluster : Each node has two network cards, one for private IP for internode communication and another for public IP to connect from kibana/ external users. The private IP… --- ## [Pulling Data in response to a Query in ELK](https://discuss.elastic.co/t/pulling-data-in-response-to-a-query-in-elk/192863)
**Author:** [@Nik\_Gupta](https://discuss.elastic.co/u/Nik_Gupta)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 9:48am UTC](https://discuss.elastic.co/t/pulling-data-in-response-to-a-query-in-elk/192863 "2019-07-30T09:48:04Z")
Is it possible to operate ELK in way that it pulls data in response to a query and 'drops' it after some period of time? For context, I have an extremely large amount of data in which I'd like to examine specific small s… --- ## [Logstash-active index fails to create due to duplicate indexes that don't exist](https://discuss.elastic.co/t/logstash-active-index-fails-to-create-due-to-duplicate-indexes-that-dont-exist/192862)
**Author:** [@cdloh](https://discuss.elastic.co/u/cdloh)\ **Replies:** 0\ **Last updated:** [July 30, 2019, 9:44am UTC](https://discuss.elastic.co/t/logstash-active-index-fails-to-create-due-to-duplicate-indexes-that-dont-exist/192862 "2019-07-30T09:44:18Z")
I'm having trouble with logstash outputting to elasticsearch and it creating it's logstash index \[2019-07-30T10:41:54,893\]\[INFO \]\[logstash.outputs.elasticsearch\] retrying failed action with response code: 500 ({"type"=\>"… --- ## [What is Full stack monitoring in Elastic?](https://discuss.elastic.co/t/what-is-full-stack-monitoring-in-elastic/192845)
**Author:** [@Sundaramoorthy\_Anand](https://discuss.elastic.co/u/Sundaramoorthy_Anand)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 9:44am UTC](https://discuss.elastic.co/t/what-is-full-stack-monitoring-in-elastic/192845 "2019-07-30T09:44:17Z")
I found that in Basic License version, in Alerting section, Full stack monitoring is enabled/open-sourced. I found NO supporting document which explains what kind of data/metrics is available for Full stack monitoring. … --- ## [Problem in terms aggregation result buckets in rollup\_search](https://discuss.elastic.co/t/problem-in-terms-aggregation-result-buckets-in-rollup-search/191651)
**Author:** [@darkwarrior](https://discuss.elastic.co/u/darkwarrior)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 9:41am UTC](https://discuss.elastic.co/t/problem-in-terms-aggregation-result-buckets-in-rollup-search/191651 "2019-07-30T09:41:07Z")
Hello, We have large number of documents on ES and coz of that we have created rollup job. but we are facing a problem while performing terms aggregation. We have one field as city\_name and there are thousands of uniqu… --- ## [Replicas ignoring allocation rules](https://discuss.elastic.co/t/replicas-ignoring-allocation-rules/192639)
**Author:** [@retep007](https://discuss.elastic.co/u/retep007)\ **Replies:** 6\ **Last updated:** [July 30, 2019, 9:37am UTC](https://discuss.elastic.co/t/replicas-ignoring-allocation-rules/192639 "2019-07-30T09:37:49Z")
Hi, I've set-up a small testing cluster with hot-warm architecture. 1 hot, 1 warm node. Hot is also master and ingest node. Warm is only data and coordinator. I have ILM policy which rotates after 24h index from hot to … --- ## [Xpack LDAP entegration](https://discuss.elastic.co/t/xpack-ldap-entegration/192843)
**Author:** [@eylulekinoksu](https://discuss.elastic.co/u/eylulekinoksu)\ **Replies:** 1\ **Last updated:** [July 30, 2019, 7:38am UTC](https://discuss.elastic.co/t/xpack-ldap-entegration/192843 "2019-07-30T07:38:58Z")
Hello Dears, I'm using ES stack 7.1 x-pack security enabled. { "license" : { "status" : "active", "uid" : "993fefae-18b5-4311-8835-fca4bf877ed8", "type" : "basic", "issue\_date" : "2019-07-26T13:07:18.170Z", "issu… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1208) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1210)