# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=575

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 576

---

## [Restoring Snapshot to another cluster](https://discuss.elastic.co/t/restoring-snapshot-to-another-cluster/284292)

<div class="topic-metadata">

**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\
**Replies:** 1\
**Last updated:** [September 15, 2021, 2:48pm UTC](https://discuss.elastic.co/t/restoring-snapshot-to-another-cluster/284292 "2021-09-15T14:48:33Z")

</div>

I have two v7.12.0 elastic clusters. I want to snapshot data from one and restore to another. Both clusters have the same "type": "fs" snapshot repository configured with the same "settings.location" and the snapshot …

---

## [Out Of Memory errors after G1GC migration](https://discuss.elastic.co/t/out-of-memory-errors-after-g1gc-migration/284227)

<div class="topic-metadata">

**Author:** [@malcon-moreira-sm](https://discuss.elastic.co/u/malcon-moreira-sm)\
**Replies:** 12\
**Last updated:** [September 15, 2021, 2:26pm UTC](https://discuss.elastic.co/t/out-of-memory-errors-after-g1gc-migration/284227 "2021-09-15T14:26:14Z")

</div>

We have an Elastic environment with 83 nodes and 3 masters inside docker containers that recently were migrated from CMS Garbage Collector to G1. The version of the cluster is 7.4.2: "docker.elastic.co/elasticsearch/ela…

---

## [Configure ILM : Delete index = delete data?](https://discuss.elastic.co/t/configure-ilm-delete-index-delete-data/284273)

<div class="topic-metadata">

**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 2:10pm UTC](https://discuss.elastic.co/t/configure-ilm-delete-index-delete-data/284273 "2021-09-15T14:10:25Z")

</div>

Hello everyone, I send data every day on a single index, and I would like to delete all the data that are older than one year in order to optimize the available space on my disk. Will choosing the "Delete after 2 days"…

---

## [Azure repository creation issue in 7.10.2](https://discuss.elastic.co/t/azure-repository-creation-issue-in-7-10-2/283896)

<div class="topic-metadata">

**Author:** [@margold](https://discuss.elastic.co/u/margold)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 1:30pm UTC](https://discuss.elastic.co/t/azure-repository-creation-issue-in-7-10-2/283896 "2021-09-15T13:30:57Z")

</div>

(I'm using this image: amazon/opendistro-for-elasticsearch:1.13.2) Following the docs on setting up an azure repository: Added storage account name and key and reloaded settings (Azure Repository | Elasticsearch Plugi…

---

## [Logs to investigate constant shard initialization](https://discuss.elastic.co/t/logs-to-investigate-constant-shard-initialization/283310)

<div class="topic-metadata">

**Author:** [@Maycon\_Santos](https://discuss.elastic.co/u/Maycon_Santos)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 11:59am UTC](https://discuss.elastic.co/t/logs-to-investigate-constant-shard-initialization/283310 "2021-09-15T11:59:17Z")

</div>

Hello, I would like to enable more verbose logs to help investigate what is causing constant shard initialization tasks in my cluster. I've set the following without any luck: org.elasticsearch.cluster.routing: TRACE …

---

## [Node communication](https://discuss.elastic.co/t/node-communication/284199)

<div class="topic-metadata">

**Author:** [@Ashwin\_Patil1](https://discuss.elastic.co/u/Ashwin_Patil1)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 11:20am UTC](https://discuss.elastic.co/t/node-communication/284199 "2021-09-15T11:20:30Z")

</div>

I have 3 elastic nodes, I am trying to establish connection between 3 nodes, but not able to establish communication between nodes. Below is the elasticsearch.yml file, please let me what am I doing wrong. # ===========…

---

## [Does applying custom rules on machine learning jobs altert the ML model?](https://discuss.elastic.co/t/does-applying-custom-rules-on-machine-learning-jobs-altert-the-ml-model/283797)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 5\
**Last updated:** [September 15, 2021, 11:17am UTC](https://discuss.elastic.co/t/does-applying-custom-rules-on-machine-learning-jobs-altert-the-ml-model/283797 "2021-09-15T11:17:51Z")

</div>

Hi, I was wondering if applying custom rules on machine learning jobs altert the ML model? or the ML model stays the same, just those anomalies are not shown?

---

## [Highlight not working with script\_score query?](https://discuss.elastic.co/t/highlight-not-working-with-script-score-query/282189)

<div class="topic-metadata">

**Author:** [@Ejaz\_Ahmed](https://discuss.elastic.co/u/Ejaz_Ahmed)\
**Replies:** 3\
**Last updated:** [September 15, 2021, 10:29am UTC](https://discuss.elastic.co/t/highlight-not-working-with-script-score-query/282189 "2021-09-15T10:29:56Z")

</div>

Highlights are not working script\_score query in elasticsearch version 7.13. Please suggest

---

## [Wrong timestamp in kibana index](https://discuss.elastic.co/t/wrong-timestamp-in-kibana-index/284181)

<div class="topic-metadata">

**Author:** [@Tejas\_Bhosale](https://discuss.elastic.co/u/Tejas_Bhosale)\
**Replies:** 2\
**Last updated:** [September 15, 2021, 10:13am UTC](https://discuss.elastic.co/t/wrong-timestamp-in-kibana-index/284181 "2021-09-15T10:13:26Z")

</div>

I get worng time data in my index in kibana there is around lot of difference in @timestamp and log\_timestamp field. grok filter which i am using grok { match =\> \[ "message" , '%{IP:remote\_addr} -…

---

## [Reindex data from local to Server?](https://discuss.elastic.co/t/reindex-data-from-local-to-server/284262)

<div class="topic-metadata">

**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Replies:** 1\
**Last updated:** [September 15, 2021, 10:13am UTC](https://discuss.elastic.co/t/reindex-data-from-local-to-server/284262 "2021-09-15T10:13:10Z")

</div>

I am trying to send index npb\_bro to my server. But I am getting error. Below is my query POST \_reindex { "source": { "remote": { "host": "http://192.168.216.192:1992", "username": "xxxx", "passw…

---

## [Elastic pipeline calculate value for field](https://discuss.elastic.co/t/elastic-pipeline-calculate-value-for-field/283752)

<div class="topic-metadata">

**Author:** [@111452](https://discuss.elastic.co/u/111452)\
**Replies:** 2\
**Last updated:** [September 15, 2021, 10:07am UTC](https://discuss.elastic.co/t/elastic-pipeline-calculate-value-for-field/283752 "2021-09-15T10:07:16Z")

</div>

I'm trying to calculate the time value inside elastic pipeline and set this value for field. I need something like this : curl -X PUT "localhost:9200/\_ingest/pipeline/time-pipeline?pretty" -H 'Content-Type: application/…

---

## [Search timeouts during indexing](https://discuss.elastic.co/t/search-timeouts-during-indexing/284153)

<div class="topic-metadata">

**Author:** [@Drept](https://discuss.elastic.co/u/Drept)\
**Replies:** 10\
**Last updated:** [September 15, 2021, 8:49am UTC](https://discuss.elastic.co/t/search-timeouts-during-indexing/284153 "2021-09-15T08:49:06Z")

</div>

I have an index of around 90 million documents in Elasticsearch. I manage it via django-elasticsearch-dsl. The settings are the following: number\_of\_shards: 1 number\_of\_replicas: 0 The mapping is: { "series" : { …

---

## [Is it possible to make new property having default normalizer](https://discuss.elastic.co/t/is-it-possible-to-make-new-property-having-default-normalizer/284252)

<div class="topic-metadata">

**Author:** [@VincentGWZhang](https://discuss.elastic.co/u/VincentGWZhang)\
**Replies:** 0\
**Last updated:** [September 15, 2021, 6:55am UTC](https://discuss.elastic.co/t/is-it-possible-to-make-new-property-having-default-normalizer/284252 "2021-09-15T06:55:41Z")

</div>

Suppose I have a index having mapping setting as: { "settings": { "index": { "number\_of\_shards": 3, "number\_of\_replicas": 1 }, "analysis": { "normalizer": { "lowercase\_normalizer"…

---

## [Going from 6.8.15 to 6.8.18 should be no issue correct](https://discuss.elastic.co/t/going-from-6-8-15-to-6-8-18-should-be-no-issue-correct/284198)

<div class="topic-metadata">

**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 5:29am UTC](https://discuss.elastic.co/t/going-from-6-8-15-to-6-8-18-should-be-no-issue-correct/284198 "2021-09-15T05:29:23Z")

</div>

Good Day, I have a cluster that has ES 6.8.15 install and see that 6.8.18 is there to upgrade to. This should be a straight forward upgrade correct. Everything is currently working in our cluster, but I wanted to make…

---

## [Elasticsearch 7.8.1 maximum shards open error](https://discuss.elastic.co/t/elasticsearch-7-8-1-maximum-shards-open-error/284234)

<div class="topic-metadata">

**Author:** [@ManOfDestiny](https://discuss.elastic.co/u/ManOfDestiny)\
**Replies:** 2\
**Last updated:** [September 15, 2021, 5:17am UTC](https://discuss.elastic.co/t/elasticsearch-7-8-1-maximum-shards-open-error/284234 "2021-09-15T05:17:01Z")

</div>

How can I solve this problem? Env 1. elsticsearch version : 7.8.1 2. cluster 1) master node 3EA 2) data Node : 7EA ConfigFile : elasticsearch.yml cluster.max\_shards\_per\_node: 10000 Cluster setting GET /\_clust…

---

## [Routing to an Index Partition - Custom Routing](https://discuss.elastic.co/t/routing-to-an-index-partition-custom-routing/284240)

<div class="topic-metadata">

**Author:** [@sudhir-ch](https://discuss.elastic.co/u/sudhir-ch)\
**Replies:** 0\
**Last updated:** [September 15, 2021, 3:28am UTC](https://discuss.elastic.co/t/routing-to-an-index-partition-custom-routing/284240 "2021-09-15T03:28:31Z")

</div>

Hi, I have configured the index such that custom routing values will go to a subset of the shards rather than a single shard by providing the index level setting "index.routing\_partition\_size" at index creation. Index …

---

## [Rally is not able to manage multiple types](https://discuss.elastic.co/t/rally-is-not-able-to-manage-multiple-types/283577)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 6\
**Last updated:** [September 15, 2021, 2:43am UTC](https://discuss.elastic.co/t/rally-is-not-able-to-manage-multiple-types/283577 "2021-09-15T02:43:46Z")

</div>

Hey there, I created a custom track from an existing index that includes several document types (at least 3). Can I know how to use this track during the import phase to have the correct imported type? If I specify ta…

---

## [The rebalancing task lasted for more than a week without stopping, and the balance has not been reached](https://discuss.elastic.co/t/the-rebalancing-task-lasted-for-more-than-a-week-without-stopping-and-the-balance-has-not-been-reached/284020)

<div class="topic-metadata">

**Author:** [@liwanjie](https://discuss.elastic.co/u/liwanjie)\
**Replies:** 17\
**Last updated:** [September 15, 2021, 2:32am UTC](https://discuss.elastic.co/t/the-rebalancing-task-lasted-for-more-than-a-week-without-stopping-and-the-balance-has-not-been-reached/284020 "2021-09-15T02:32:51Z")

</div>

version ：7.10.2 My cluster has a total of 30 machines, one machine has two data nodes, so there are a total of 60 nodes i add a dataNode to cluster，and then the rebalance tasks started... but a week has passed，rebalan…

---

## [Elasticsearch7.5 routing hash function](https://discuss.elastic.co/t/elasticsearch7-5-routing-hash-function/284187)

<div class="topic-metadata">

**Author:** [@chenchuangc](https://discuss.elastic.co/u/chenchuangc)\
**Replies:** 0\
**Last updated:** [September 14, 2021, 1:15pm UTC](https://discuss.elastic.co/t/elasticsearch7-5-routing-hash-function/284187 "2021-09-14T13:15:37Z")

</div>

the Elasticsearch routine description like this routing\_factor = num\_routing\_shards / num\_primary\_shards shard\_num = (hash(\_routing) % num\_routing\_shards) / routing\_factor i want to know the hash function so that i …

---

## [Object Array in Painless source loses values and indexes with "\[\]" for values](https://discuss.elastic.co/t/object-array-in-painless-source-loses-values-and-indexes-with-for-values/284160)

<div class="topic-metadata">

**Author:** [@jthoni](https://discuss.elastic.co/u/jthoni)\
**Replies:** 3\
**Last updated:** [September 14, 2021, 11:05pm UTC](https://discuss.elastic.co/t/object-array-in-painless-source-loses-values-and-indexes-with-for-values/284160 "2021-09-14T23:05:14Z")

</div>

We have just upgraded from ES/Nest v5 to v 6.8. We have an api that does an upsert using a Painless script. The script checks to see that the lastUpdated date in the payload is greater than that in the indexed document, …

---

## [Is changing the jvm heap size a problem?](https://discuss.elastic.co/t/is-changing-the-jvm-heap-size-a-problem/284172)

<div class="topic-metadata">

**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\
**Replies:** 3\
**Last updated:** [September 14, 2021, 9:50pm UTC](https://discuss.elastic.co/t/is-changing-the-jvm-heap-size-a-problem/284172 "2021-09-14T21:50:58Z")

</div>

Hello, there are a total of 16 nodes in the cluster, including 13 data nodes and 3 master nodes. Master nodes have 64 gb ram. But jvm heap is set to 16gb. Data nodes have 64 GB ram. But jvm heap is set to 30gb. Does t…

---

## [Scripting a Field with multiple fields with Null values](https://discuss.elastic.co/t/scripting-a-field-with-multiple-fields-with-null-values/284207)

<div class="topic-metadata">

**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\
**Replies:** 0\
**Last updated:** [September 14, 2021, 5:05pm UTC](https://discuss.elastic.co/t/scripting-a-field-with-multiple-fields-with-null-values/284207 "2021-09-14T17:05:38Z")

</div>

Hi, I'm attempting to use a script processor to add the sum of other fields into a total field, but some of the values are null. I know that I can use a "gsub" or "set" processors to set null values to 0, but the "gsub…

---

## [How to disable geoip usage in 7.14.0](https://discuss.elastic.co/t/how-to-disable-geoip-usage-in-7-14-0/281076)

<div class="topic-metadata">

**Author:** [@Alex\_Batt](https://discuss.elastic.co/u/Alex_Batt)\
**Replies:** 21\
**Last updated:** [September 14, 2021, 2:18pm UTC](https://discuss.elastic.co/t/how-to-disable-geoip-usage-in-7-14-0/281076 "2021-09-14T14:18:55Z")

</div>

hi, I want to disable the usage of geoip functionality because of licensing and no usage . I have a single node cluster, which works fine. I've tried to disable the geoip on a cluster level using the following param: ing…

---

## ["type": "parsing\_exception","reason":"unknown query \[aggs\] - Elasticsearch node js client](https://discuss.elastic.co/t/type-parsing-exception-reason-unknown-query-aggs-elasticsearch-node-js-client/281402)

<div class="topic-metadata">

**Author:** [@manojkrishna561994](https://discuss.elastic.co/u/manojkrishna561994)\
**Replies:** 4\
**Last updated:** [September 14, 2021, 2:11pm UTC](https://discuss.elastic.co/t/type-parsing-exception-reason-unknown-query-aggs-elasticsearch-node-js-client/281402 "2021-09-14T14:11:42Z")

</div>

Hi, I want to connect to elasticsearch through elasticsearch node js client. I'm using search api and want to run few aggregation to calculate the total count of docs which passes the given condition. However, im gettin…

---

## [Installed Elasticsearch docker does not have a password](https://discuss.elastic.co/t/installed-elasticsearch-docker-does-not-have-a-password/281805)

<div class="topic-metadata">

**Author:** [@evo](https://discuss.elastic.co/u/evo)\
**Replies:** 6\
**Last updated:** [September 14, 2021, 2:10pm UTC](https://discuss.elastic.co/t/installed-elasticsearch-docker-does-not-have-a-password/281805 "2021-09-14T14:10:55Z")

</div>

I have just following the docker installation guide and have got ES up and running but anyone can add documents to it. I am confused on how to secure it. Is the authentication only pre-configured in the paid version? W…

---

## [Geo\_shape size and elastic performance](https://discuss.elastic.co/t/geo-shape-size-and-elastic-performance/283920)

<div class="topic-metadata">

**Author:** [@rgwozdz](https://discuss.elastic.co/u/rgwozdz)\
**Replies:** 4\
**Last updated:** [September 14, 2021, 1:30pm UTC](https://discuss.elastic.co/t/geo-shape-size-and-elastic-performance/283920 "2021-09-14T13:30:44Z")

</div>

We have an index that contains about 5 million documents. About 20% will have a geo\_shape field that contains polygon data. I need to support intersect queries on these geo\_shapes. Some of these polygons are very comp…

---

## [Stop token filter how to set whitespace char as stop word in stopwords\_path config file](https://discuss.elastic.co/t/stop-token-filter-how-to-set-whitespace-char-as-stop-word-in-stopwords-path-config-file/282429)

<div class="topic-metadata">

**Author:** [@chenchuangc](https://discuss.elastic.co/u/chenchuangc)\
**Replies:** 2\
**Last updated:** [September 14, 2021, 1:02pm UTC](https://discuss.elastic.co/t/stop-token-filter-how-to-set-whitespace-char-as-stop-word-in-stopwords-path-config-file/282429 "2021-09-14T13:02:52Z")

</div>

Elasticsearch 7.5 thank you for help me ! i want to set the stop word by the stopwords\_path , i set a lot word in the stopwords.txt file , most of the word in the file is effective but only the whitespace char is not e…

---

## [How to calculate the time a request remains in the queue](https://discuss.elastic.co/t/how-to-calculate-the-time-a-request-remains-in-the-queue/284128)

<div class="topic-metadata">

**Author:** [@Higor](https://discuss.elastic.co/u/Higor)\
**Replies:** 2\
**Last updated:** [September 14, 2021, 11:18am UTC](https://discuss.elastic.co/t/how-to-calculate-the-time-a-request-remains-in-the-queue/284128 "2021-09-14T11:18:51Z")

</div>

I need to find some way to calculate how long a request remains in the queue.

---

## [Keyword seem to have disappeared](https://discuss.elastic.co/t/keyword-seem-to-have-disappeared/283685)

<div class="topic-metadata">

**Author:** [@Bibas](https://discuss.elastic.co/u/Bibas)\
**Replies:** 5\
**Last updated:** [September 14, 2021, 9:44am UTC](https://discuss.elastic.co/t/keyword-seem-to-have-disappeared/283685 "2021-09-14T09:44:04Z")

</div>

Hello I have logs coming from my application, in those logs, there is a "coType" field that used to be a text that contains a keyword subfield. For a reason that I ignore (I don't think I changed the conf file in month…

---

## [Not exists query](https://discuss.elastic.co/t/not-exists-query/284052)

<div class="topic-metadata">

**Author:** [@ilgrosso](https://discuss.elastic.co/u/ilgrosso)\
**Replies:** 3\
**Last updated:** [September 14, 2021, 9:40am UTC](https://discuss.elastic.co/t/not-exists-query/284052 "2021-09-14T09:40:50Z")

</div>

Negating the exists query as suggested by docs does not seem to work as I would intend it, at least with Elasticsearch 7.14. When I send GET to /master\_user/\_search with payload { "query": { "bool": { "must…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=574)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=576)
