# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=890

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 891

---

## [Copy documents in another index on creation](https://discuss.elastic.co/t/copy-documents-in-another-index-on-creation/236705)

<div class="topic-metadata">

**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 11:39pm UTC](https://discuss.elastic.co/t/copy-documents-in-another-index-on-creation/236705 "2020-06-15T23:39:46Z")

</div>

We want to keep track of all the changes of a document, so we want to store all the document versions in separate index. Is there a way when a new document is added or changes to send the entire document in another inde…

---

## [Elasticsearch SLM error](https://discuss.elastic.co/t/elasticsearch-slm-error/236767)

<div class="topic-metadata">

**Author:** [@zil2020](https://discuss.elastic.co/u/zil2020)\
**Replies:** 0\
**Last updated:** [June 11, 2020, 5:54pm UTC](https://discuss.elastic.co/t/elasticsearch-slm-error/236767 "2020-06-11T17:54:38Z")

</div>

Hi, I have Elasticsearch 7.7.1 and i want to configure SLM policy with cron schedule that triggers multiple times. In terminal curl -X PUT "localhost:9200/\_slm/policy/nightly-snapshots?pretty" -H 'Content-Type: applic…

---

## [Index template index-pattern](https://discuss.elastic.co/t/index-template-index-pattern/236864)

<div class="topic-metadata">

**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 11:22pm UTC](https://discuss.elastic.co/t/index-template-index-pattern/236864 "2020-06-15T23:22:10Z")

</div>

First time creating an index template and not sure about the syntax. I would like it to apply to every index with suffix -2 How should I write that in index-pattern? \*-2 And another rookie question. Can I apply mappin…

---

## [Audit logging doesn't work for Elasticsearch](https://discuss.elastic.co/t/audit-logging-doesnt-work-for-elasticsearch/236873)

<div class="topic-metadata">

**Author:** [@mokaymakci](https://discuss.elastic.co/u/mokaymakci)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 11:19pm UTC](https://discuss.elastic.co/t/audit-logging-doesnt-work-for-elasticsearch/236873 "2020-06-15T23:19:55Z")

</div>

Hello, I'm using Elasticsearch by docker-compose. I've set xpack.security.audit.enabled to true, but there is no audit log in the logs folder, but there are gc.log.\* files. Elastic configuration in my docker-compose fi…

---

## [ILM Warm phase settings](https://discuss.elastic.co/t/ilm-warm-phase-settings/236703)

<div class="topic-metadata">

**Author:** [@Viktor\_Markvardt](https://discuss.elastic.co/u/Viktor_Markvardt)\
**Replies:** 0\
**Last updated:** [June 11, 2020, 12:36pm UTC](https://discuss.elastic.co/t/ilm-warm-phase-settings/236703 "2020-06-11T12:36:57Z")

</div>

Hi guys, I created an index lifecycle policy for warm phase, but I can not understand where new documents are? My goal is: move old documents to read-only indexes. Please see details below: PUT \_ilm/policy/ro …

---

## [Elasticsearch join on indexes using SIREN](https://discuss.elastic.co/t/elasticsearch-join-on-indexes-using-siren/237014)

<div class="topic-metadata">

**Author:** [@Lokesh\_Kumar1](https://discuss.elastic.co/u/Lokesh_Kumar1)\
**Replies:** 0\
**Last updated:** [June 14, 2020, 6:38am UTC](https://discuss.elastic.co/t/elasticsearch-join-on-indexes-using-siren/237014 "2020-06-14T06:38:27Z")

</div>

Hi All. I hope all well there. :slight\_smile: Guys, Can you please clear the below doubt? As we already know we can't perform the join between two indexes like in the relational database, in NoSQL, it doesn't provide …

---

## [Ingest pipeline dissect processor](https://discuss.elastic.co/t/ingest-pipeline-dissect-processor/237019)

<div class="topic-metadata">

**Author:** [@Ajay\_Singh2](https://discuss.elastic.co/u/Ajay_Singh2)\
**Replies:** 0\
**Last updated:** [June 14, 2020, 10:13am UTC](https://discuss.elastic.co/t/ingest-pipeline-dissect-processor/237019 "2020-06-14T10:13:30Z")

</div>

Can i do something like if a log contains a specific text ,then use the specific dissect processor statement, else use another dissect statement { "pipeline" : { "processors" : \[ { "if": { "co…

---

## [Root mapping definition has unsupported parameters new](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-new/237136)

<div class="topic-metadata">

**Author:** [@Ashwini\_Machale](https://discuss.elastic.co/u/Ashwini_Machale)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 10:39pm UTC](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-new/237136 "2020-06-15T22:39:41Z")

</div>

reason": "Root mapping definition has unsupported parameters: \[set : {dynamic=true, dynamic\_templates=\[{set={path\_match=\*, mapping={type=text, fields={custom={analyzer=custom\_english, type=text}, raw={index=true, type=ke…

---

## [How to update nested field using query in elasticsearch 2.4?](https://discuss.elastic.co/t/how-to-update-nested-field-using-query-in-elasticsearch-2-4/237164)

<div class="topic-metadata">

**Author:** [@prasad98](https://discuss.elastic.co/u/prasad98)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 9:54pm UTC](https://discuss.elastic.co/t/how-to-update-nested-field-using-query-in-elasticsearch-2-4/237164 "2020-06-15T21:54:21Z")

</div>

I have made an Elasticsearch query: GET shop/products/\_search { "\_source": \[ "similar\_group.product\_info.product\_id", "shop\_id", "similar\_group.product\_info.tags", "similar\_group.product\_info.…

---

## [How to use search\_as\_you\_type datatype with multiple languages? Best practice/experiences](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-with-multiple-languages-best-practice-experiences/237153)

<div class="topic-metadata">

**Author:** [@as\_ES](https://discuss.elastic.co/u/as_ES)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 2:31pm UTC](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-with-multiple-languages-best-practice-experiences/237153 "2020-06-15T14:31:56Z")

</div>

Hi, how does one handle the combination of search\_as\_you\_type dataytpe and fields in multiple languages? Or is it not applicable in such a use-case? For Example: An index of books has a field book\_title and alternativ…

---

## [Aggs Painless DateTime Modify inline](https://discuss.elastic.co/t/aggs-painless-datetime-modify-inline/237162)

<div class="topic-metadata">

**Author:** [@AndyS](https://discuss.elastic.co/u/AndyS)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 3:37pm UTC](https://discuss.elastic.co/t/aggs-painless-datetime-modify-inline/237162 "2020-06-15T15:37:21Z")

</div>

Hia, As per title I'm stuck with a painless timezone Q: Customer, WebUI, tz UTC+5 The WebUI issues a query and converts query to UTC Elastic processes in UTC and then aggs by hour and by minute "aggs": { "time": { …

---

## [Getting issue using Index Lifecycle Policies (Does not point to index and it not a write index)](https://discuss.elastic.co/t/getting-issue-using-index-lifecycle-policies-does-not-point-to-index-and-it-not-a-write-index/237186)

<div class="topic-metadata">

**Author:** [@Pao\_Alcantar](https://discuss.elastic.co/u/Pao_Alcantar)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 8:39pm UTC](https://discuss.elastic.co/t/getting-issue-using-index-lifecycle-policies-does-not-point-to-index-and-it-not-a-write-index/237186 "2020-06-15T20:39:02Z")

</div>

Hi all, good day! I am new on this and on the ELK tech, I'm looking for some help to understand what I'm doing wrong with my ILM Policy. I've created the following policy: PUT \_ilm/policy/rollover-120-days { …

---

## [Index Lifecycle Management rollover on time, but deleting every 10min](https://discuss.elastic.co/t/index-lifecycle-management-rollover-on-time-but-deleting-every-10min/237005)

<div class="topic-metadata">

**Author:** [@jbalaguero](https://discuss.elastic.co/u/jbalaguero)\
**Replies:** 3\
**Last updated:** [June 15, 2020, 6:14pm UTC](https://discuss.elastic.co/t/index-lifecycle-management-rollover-on-time-but-deleting-every-10min/237005 "2020-06-15T18:14:27Z")

</div>

Hello, We have this setting in our elasticsearch.yml configuration file: indices.lifecycle.poll\_interval: 30s And we have a set of indexes that must roll over every 3 minutes and must be alive for 6 minutes. The roll…

---

## [Return big amount of values without paging](https://discuss.elastic.co/t/return-big-amount-of-values-without-paging/235369)

<div class="topic-metadata">

**Author:** [@ivgenik](https://discuss.elastic.co/u/ivgenik)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 3:05pm UTC](https://discuss.elastic.co/t/return-big-amount-of-values-without-paging/235369 "2020-06-15T15:05:21Z")

</div>

Hello, Lets say I got an index with a big amount of documents. Each one has a field called UniqueId. I need to create a query with a simple filter and return all of the uniqueIds that answers the query. The data look…

---

## [Multiple Index Step by step query](https://discuss.elastic.co/t/multiple-index-step-by-step-query/234096)

<div class="topic-metadata">

**Author:** [@ivgenik](https://discuss.elastic.co/u/ivgenik)\
**Replies:** 4\
**Last updated:** [June 15, 2020, 3:09pm UTC](https://discuss.elastic.co/t/multiple-index-step-by-step-query/234096 "2020-06-15T15:09:46Z")

</div>

Hello, I probably need to create a multi step multi index query and I am not sure if such a thing is supported or if it is the right approach at all. Example Data: 2 indexes , 1 for orders, 1 for invoices I made a sim…

---

## [Query and return aggs group by terms](https://discuss.elastic.co/t/query-and-return-aggs-group-by-terms/234290)

<div class="topic-metadata">

**Author:** [@ivgenik](https://discuss.elastic.co/u/ivgenik)\
**Replies:** 5\
**Last updated:** [June 15, 2020, 2:56pm UTC](https://discuss.elastic.co/t/query-and-return-aggs-group-by-terms/234290 "2020-06-15T14:56:17Z")

</div>

Hello, A minimal data example: ... References: \[ { DocType: { SysName: "order"} DocId: "12345" }, { "DocType: {SysName: "invoice"} "DocId: "22222"} \] MessageDate: "05/05/20" ... I need to query this data, scan the ref…

---

## [Creating a partial clone of a cluster](https://discuss.elastic.co/t/creating-a-partial-clone-of-a-cluster/237106)

<div class="topic-metadata">

**Author:** [@Konrad\_Moskal](https://discuss.elastic.co/u/Konrad_Moskal)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 2:14pm UTC](https://discuss.elastic.co/t/creating-a-partial-clone-of-a-cluster/237106 "2020-06-15T14:14:54Z")

</div>

My ES cluster is constantly updating but I have a use case where I'd like to have a snapshot of static data, which I'd update periodically. Doesn't have to be all of the data, could be a fraction of it. Any tips on how w…

---

## [Reindex, convert float to float, mapper \[variableX\] cannot be changed from type \[float\] to \[long\]](https://discuss.elastic.co/t/reindex-convert-float-to-float-mapper-variablex-cannot-be-changed-from-type-float-to-long/237123)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 2:13pm UTC](https://discuss.elastic.co/t/reindex-convert-float-to-float-mapper-variablex-cannot-be-changed-from-type-float-to-long/237123 "2020-06-15T14:13:58Z")

</div>

Hi, I am trying to reindex something. It works with 4/5 of my indcies but the last one fails because of: { "took": 4178, "timed\_out": false, "total": 56576151, "updated": 0, "created": 994, "del…

---

## [Types Removal](https://discuss.elastic.co/t/types-removal/236772)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 1:56pm UTC](https://discuss.elastic.co/t/types-removal/236772 "2020-06-15T13:56:12Z")

</div>

I've previously posted a question about this, but waited too long to respond and the topic got closed. I've read the notice about types being removed, but I can't figure it out. I'm getting a warning in my deprecation …

---

## [To store and search a File content using elastic search](https://discuss.elastic.co/t/to-store-and-search-a-file-content-using-elastic-search/237062)

<div class="topic-metadata">

**Author:** [@Romy\_Bobby](https://discuss.elastic.co/u/Romy_Bobby)\
**Replies:** 11\
**Last updated:** [June 15, 2020, 12:18pm UTC](https://discuss.elastic.co/t/to-store-and-search-a-file-content-using-elastic-search/237062 "2020-06-15T12:18:53Z")

</div>

Hi, My requirement is an FAQ in my application where I require to Upload FAQ documents and later search and find these documents using the keywords in search cloumn. I Would like to know how to store and search a File c…

---

## [Unable to fetch exact result at first when searching with special charecters](https://discuss.elastic.co/t/unable-to-fetch-exact-result-at-first-when-searching-with-special-charecters/235584)

<div class="topic-metadata">

**Author:** [@mallikarjuna.manne](https://discuss.elastic.co/u/mallikarjuna.manne)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 11:00am UTC](https://discuss.elastic.co/t/unable-to-fetch-exact-result-at-first-when-searching-with-special-charecters/235584 "2020-06-15T11:00:49Z")

</div>

Hello mates, When I used the following query It unable to fetch the exact result even though data existed. {"query": {"query\_string": {"query": "column1:(1.3 \\"@\\")"}}} This query is fetching results that are only hav…

---

## [Bool query with a must and 2 match queries](https://discuss.elastic.co/t/bool-query-with-a-must-and-2-match-queries/237108)

<div class="topic-metadata">

**Author:** [@hcraes](https://discuss.elastic.co/u/hcraes)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 9:56am UTC](https://discuss.elastic.co/t/bool-query-with-a-must-and-2-match-queries/237108 "2020-06-15T09:56:43Z")

</div>

Hello, I recently started learning Elasticsearh and I have (probably) one noobie question. I have a field "name" & "surname". Both fields can have multiple words. Let's say I have a user with a name "Test Test2" and a s…

---

## [Why does this reindex API fail (Reindex multiple indexes at once)](https://discuss.elastic.co/t/why-does-this-reindex-api-fail-reindex-multiple-indexes-at-once/237104)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 9:57am UTC](https://discuss.elastic.co/t/why-does-this-reindex-api-fail-reindex-multiple-indexes-at-once/237104 "2020-06-15T09:57:06Z")

</div>

Hi, I have 5 Indices on my Elasticsearch and want to reindex all of them. Is there an API which can do this? I tried it with this approach: { "conflicts": "proceed", "source": { "index": \["index1", "index2","in…

---

## [Elastic Cloud Service search performance](https://discuss.elastic.co/t/elastic-cloud-service-search-performance/236368)

<div class="topic-metadata">

**Author:** [@cr-solutions](https://discuss.elastic.co/u/cr-solutions)\
**Replies:** 11\
**Last updated:** [June 15, 2020, 9:08am UTC](https://discuss.elastic.co/t/elastic-cloud-service-search-performance/236368 "2020-06-15T09:08:32Z")

</div>

Hello, we currently evaluating Elasticsearch as replacement of our Sphinxsearch (sphinxsearch.com). As step one we tried the Elasticsearch service from AWS, but it really sucks. Now we are currently trying the Elastic…

---

## [Should Inside Must](https://discuss.elastic.co/t/should-inside-must/237095)

<div class="topic-metadata">

**Author:** [@prvn\_prasher](https://discuss.elastic.co/u/prvn_prasher)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 8:56am UTC](https://discuss.elastic.co/t/should-inside-must/237095 "2020-06-15T08:56:42Z")

</div>

I am trying to create a query like Simply, I am trying to recreate this SQL query: SELECT \* FROM test where com\_ref= 'ddfdfdfdf' and (fr\_id = 511168 or fr\_id = 511258 ). { "query": { "bool": { "filter": { "bool": { "…

---

## [High cardinality multi bucket terms aggregation - huge memory consumption](https://discuss.elastic.co/t/high-cardinality-multi-bucket-terms-aggregation-huge-memory-consumption/235530)

<div class="topic-metadata">

**Author:** [@str8y](https://discuss.elastic.co/u/str8y)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 8:44am UTC](https://discuss.elastic.co/t/high-cardinality-multi-bucket-terms-aggregation-huge-memory-consumption/235530 "2020-06-15T08:44:45Z")

</div>

Hi all, I' m pretty new to the elastic stack but I'm facing an issue which I don't understand. I tried to reproduce it with the easiest example: My documents look like this: { "a1" : "3abcdefghi", "a2" : "3ab…

---

## [Elasticsearch terms aggregations performance of many unique values](https://discuss.elastic.co/t/elasticsearch-terms-aggregations-performance-of-many-unique-values/236661)

<div class="topic-metadata">

**Author:** [@ming1997](https://discuss.elastic.co/u/ming1997)\
**Replies:** 6\
**Last updated:** [June 15, 2020, 8:40am UTC](https://discuss.elastic.co/t/elasticsearch-terms-aggregations-performance-of-many-unique-values/236661 "2020-06-15T08:40:38Z")

</div>

I use terms aggregations to aggregate my data . But there is a problem. For example , If i have 300 million data in my ES cluster. I use terms aggregation to aggregate the bytes of ip. If the ip field has 1000 unique ip…

---

## [Elasticsearch/Logstash low indexing rate](https://discuss.elastic.co/t/elasticsearch-logstash-low-indexing-rate/236852)

<div class="topic-metadata">

**Author:** [@urkole](https://discuss.elastic.co/u/urkole)\
**Replies:** 5\
**Last updated:** [June 15, 2020, 8:19am UTC](https://discuss.elastic.co/t/elasticsearch-logstash-low-indexing-rate/236852 "2020-06-15T08:19:00Z")

</div>

Hello, I'm setting up an Elasticsearch cluster in my laptop to do some testing before migrating to a better infrastructure, so I'm still learning how this works. As I've said, I have an Elasticsearch instance running (…

---

## [Filter is occasionally including wrong results](https://discuss.elastic.co/t/filter-is-occasionally-including-wrong-results/236544)

<div class="topic-metadata">

**Author:** [@Will\_Monk](https://discuss.elastic.co/u/Will_Monk)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 8:05am UTC](https://discuss.elastic.co/t/filter-is-occasionally-including-wrong-results/236544 "2020-06-15T08:05:19Z")

</div>

Cluster summary: 8 GB RAM 240 GB storage 1 node 2 zones Version 7.4.2 46 shards Query: { "query": { "bool": { "filter": \[ { "term": { "id": "uuid" } }, …

---

## [Upgrade from 6.8 to 7.7.1 asks for re-index which was already performed](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-7-1-asks-for-re-index-which-was-already-performed/237076)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 7:09am UTC](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-7-1-asks-for-re-index-which-was-already-performed/237076 "2020-06-15T07:09:04Z")

</div>

Hi, I am trying to upgrade a snapshot from 5.2 to 7.7. I did this with the help of the documentation. I restored the snapshot to 6.8 which should reindex it right? Now i performed the upgrade, moving the data to the new…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=889)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=891)
