# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=588

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 589

---

## [Elasticsearch after upgrade on 7.7.0 starts CircuitBreakingExceptions and nodes leaves/rejoin cluster](https://discuss.elastic.co/t/elasticsearch-after-upgrade-on-7-7-0-starts-circuitbreakingexceptions-and-nodes-leaves-rejoin-cluster/282071)

<div class="topic-metadata">

**Author:** [@Jiri\_Petak](https://discuss.elastic.co/u/Jiri_Petak)\
**Replies:** 8\
**Last updated:** [August 23, 2021, 1:45pm UTC](https://discuss.elastic.co/t/elasticsearch-after-upgrade-on-7-7-0-starts-circuitbreakingexceptions-and-nodes-leaves-rejoin-cluster/282071 "2021-08-23T13:45:41Z")

</div>

Hi, we have an issue when performing an upgrade on one of our clusters. We are upgrading elasticsearch from version 6.8.1 to 7.7.0 (we have other clusters on this version). The cluster has 3 master nodes, 5 data nodes a…

---

## [Elasticsearch 7.13 unassigned shard problem](https://discuss.elastic.co/t/elasticsearch-7-13-unassigned-shard-problem/282204)

<div class="topic-metadata">

**Author:** [@mug3n451](https://discuss.elastic.co/u/mug3n451)\
**Replies:** 4\
**Last updated:** [August 23, 2021, 10:26am UTC](https://discuss.elastic.co/t/elasticsearch-7-13-unassigned-shard-problem/282204 "2021-08-23T10:26:07Z")

</div>

Hi, i have i weird problem on elasticsearc 7.13 deployed on kubernetes. Here my configuration: 3 master node 2 date node with heap 8gb and 100gb storage 2 shard and 1 replica index size: eventsched n° doc 3178640…

---

## [ELK data/shard allocation is not happening properly](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784)

<div class="topic-metadata">

**Author:** [@karthik\_kiccha](https://discuss.elastic.co/u/karthik_kiccha)\
**Replies:** 8\
**Last updated:** [August 23, 2021, 10:09am UTC](https://discuss.elastic.co/t/elk-data-shard-allocation-is-not-happening-properly/281784 "2021-08-23T10:09:38Z")

</div>

Hello Team, We have 6 node ELK cluster and all of them are configured to act as master and data node. Out of 6 nodes two nodes are consuming more disk space which is at 93%, other nodes are at 70% to 80%. We have tried …

---

## [Elasticsearch index and clustering](https://discuss.elastic.co/t/elasticsearch-index-and-clustering/282025)

<div class="topic-metadata">

**Author:** [@selin](https://discuss.elastic.co/u/selin)\
**Replies:** 9\
**Last updated:** [August 23, 2021, 9:43am UTC](https://discuss.elastic.co/t/elasticsearch-index-and-clustering/282025 "2021-08-23T09:43:40Z")

</div>

Hi friends, Can i know is it good to have a single index per environment or 1 environment to have 5 index based on team. based on each team they have multiple logs. Besides that i have 3 Elasticsearch cluster, will the …

---

## [Indexes are keep increasing after traffic towards elastic has stoped](https://discuss.elastic.co/t/indexes-are-keep-increasing-after-traffic-towards-elastic-has-stoped/281183)

<div class="topic-metadata">

**Author:** [@John\_Xanthopoulos](https://discuss.elastic.co/u/John_Xanthopoulos)\
**Replies:** 19\
**Last updated:** [August 23, 2021, 6:40am UTC](https://discuss.elastic.co/t/indexes-are-keep-increasing-after-traffic-towards-elastic-has-stoped/281183 "2021-08-23T06:40:31Z")

</div>

After having performed a test with indexing rate of ~30000/sec for couple of hours we noticed the following behavior. After Fluentd has stopped sending data to elasticsearch, four some time there is an ammount of documen…

---

## [Searchable snapshots - cold phase - not working as expected](https://discuss.elastic.co/t/searchable-snapshots-cold-phase-not-working-as-expected/282143)

<div class="topic-metadata">

**Author:** [@Kannappan\_Somu](https://discuss.elastic.co/u/Kannappan_Somu)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 1:44am UTC](https://discuss.elastic.co/t/searchable-snapshots-cold-phase-not-working-as-expected/282143 "2021-08-23T01:44:10Z")

</div>

INDEX TEMPLATE PUT \_template/cold-demo { "index\_patterns": \["cold-demo\*"\], "settings": { "index" : { "lifecycle" : { "name" : "cold\_retention\_prod", "rollover\_alias" : "…

---

## [I think in elasticsearch it shows the size of 10 by default but instead of 10 i want to set the size to total hits value that i am getting after running the query. I am attaching my query Please help me out](https://discuss.elastic.co/t/i-think-in-elasticsearch-it-shows-the-size-of-10-by-default-but-instead-of-10-i-want-to-set-the-size-to-total-hits-value-that-i-am-getting-after-running-the-query-i-am-attaching-my-query-please-help-me-out/282157)

<div class="topic-metadata">

**Author:** [@ashurajchandra](https://discuss.elastic.co/u/ashurajchandra)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 1:39am UTC](https://discuss.elastic.co/t/i-think-in-elasticsearch-it-shows-the-size-of-10-by-default-but-instead-of-10-i-want-to-set-the-size-to-total-hits-value-that-i-am-getting-after-running-the-query-i-am-attaching-my-query-please-help-me-out/282157 "2021-08-23T01:39:40Z")

</div>

GET /\_search { "sort": \[{ "date": { "order": "desc" } }\], "track\_total\_hits": true, "query": { "bool": { "must": \[ { …

---

## [Having 0 shard for cluster elastisearch](https://discuss.elastic.co/t/having-0-shard-for-cluster-elastisearch/282150)

<div class="topic-metadata">

**Author:** [@selin](https://discuss.elastic.co/u/selin)\
**Replies:** 3\
**Last updated:** [August 23, 2021, 1:24am UTC](https://discuss.elastic.co/t/having-0-shard-for-cluster-elastisearch/282150 "2021-08-23T01:24:25Z")

</div>

Hi friend, i have 3 container elasticsearch. I am assuming it should crete 5 shard for each container as 1 index in each container and each container have multiple shard/ When I fired shards api, i getting 0. Please advi…

---

## [Ceph s3 as snapshot and backup](https://discuss.elastic.co/t/ceph-s3-as-snapshot-and-backup/282168)

<div class="topic-metadata">

**Author:** [@Nasri](https://discuss.elastic.co/u/Nasri)\
**Replies:** 1\
**Last updated:** [August 22, 2021, 3:20pm UTC](https://discuss.elastic.co/t/ceph-s3-as-snapshot-and-backup/282168 "2021-08-22T15:20:22Z")

</div>

Hi, I have a s3 bucket created on ceph , when It wants to create repository it shows the following error. { "error": { "root\_cause": \[ { "type": "repository\_verification\_exception", "reason…

---

## [\[ERROR\] Cannot race. Error in race control (Could not register track plugin at /Path/To/My/Track)](https://discuss.elastic.co/t/error-cannot-race-error-in-race-control-could-not-register-track-plugin-at-path-to-my-track/282155)

<div class="topic-metadata">

**Author:** [@kingswan](https://discuss.elastic.co/u/kingswan)\
**Replies:** 1\
**Last updated:** [August 22, 2021, 11:21am UTC](https://discuss.elastic.co/t/error-cannot-race-error-in-race-control-could-not-register-track-plugin-at-path-to-my-track/282155 "2021-08-22T11:21:47Z")

</div>

Hi, I am a new comer of rally. I created a customized track trademark\_multi, before I created track.py file, it worked well. After I created track.py for vary parameter, it cannot work again. Here are the files I crea…

---

## [Elasticsearch Increasing Write rejections](https://discuss.elastic.co/t/elasticsearch-increasing-write-rejections/281882)

<div class="topic-metadata">

**Author:** [@Tombal](https://discuss.elastic.co/u/Tombal)\
**Replies:** 10\
**Last updated:** [August 22, 2021, 2:18am UTC](https://discuss.elastic.co/t/elasticsearch-increasing-write-rejections/281882 "2021-08-22T02:18:51Z")

</div>

Hello, I have 20 node platinum licenced ELK cluster. (Version 7.6.1) Setup is stated as below. 16 data nodes --\> each 64GB memory // 32gb allocated as Xms-Xmx jvm . --\> 8TB disk each 3 master nodes --\> 32gb memory ea…

---

## [A question on Traffic filtering](https://discuss.elastic.co/t/a-question-on-traffic-filtering/282140)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 2\
**Last updated:** [August 21, 2021, 11:02pm UTC](https://discuss.elastic.co/t/a-question-on-traffic-filtering/282140 "2021-08-21T23:02:22Z")

</div>

Hi, I just wanted to check if my understanding is correct on the traffic filtering Suppose someone has put in Traffic filtering via two configured filters: AWS Virtual Private Clouds (VPCs) over AWS PrivateLink filte…

---

## [Populate new field in elastic index using key of the index](https://discuss.elastic.co/t/populate-new-field-in-elastic-index-using-key-of-the-index/279477)

<div class="topic-metadata">

**Author:** [@bipin\_kumar2](https://discuss.elastic.co/u/bipin_kumar2)\
**Replies:** 3\
**Last updated:** [August 21, 2021, 12:09pm UTC](https://discuss.elastic.co/t/populate-new-field-in-elastic-index-using-key-of-the-index/279477 "2021-08-21T12:09:46Z")

</div>

Hi , I have index which of very large size and in populate incremental data into this index by using upsert into hive external table using id of index pointing to elastic index , now i have to add a new field into this…

---

## [The unit elasticsearch.service has entered the 'failed' state with result 'exit-code'](https://discuss.elastic.co/t/the-unit-elasticsearch-service-has-entered-the-failed-state-with-result-exit-code/282129)

<div class="topic-metadata">

**Author:** [@Atif\_Hussain](https://discuss.elastic.co/u/Atif_Hussain)\
**Replies:** 2\
**Last updated:** [August 21, 2021, 7:06am UTC](https://discuss.elastic.co/t/the-unit-elasticsearch-service-has-entered-the-failed-state-with-result-exit-code/282129 "2021-08-21T07:06:59Z")

</div>

After new installation of 7.14, I am getting this error when I try to start the service. Tried different solutions on from this forum without any luck. I am new to Elasticsearch so need help. Following are the logs fr…

---

## [Elasticsearch performance](https://discuss.elastic.co/t/elasticsearch-performance/282119)

<div class="topic-metadata">

**Author:** [@dgastudio](https://discuss.elastic.co/u/dgastudio)\
**Replies:** 1\
**Last updated:** [August 21, 2021, 6:47am UTC](https://discuss.elastic.co/t/elasticsearch-performance/282119 "2021-08-21T06:47:51Z")

</div>

Hello my instance (single node) m6g.large 2cpu 8ram elastic version : 7.14.0 elastic is hiden by nginx proxy when trying to do a batch index operation (about 2000 items in one batch), and, in the same time, i'm doing…

---

## [Master and slave using same index](https://discuss.elastic.co/t/master-and-slave-using-same-index/282084)

<div class="topic-metadata">

**Author:** [@selin](https://discuss.elastic.co/u/selin)\
**Replies:** 6\
**Last updated:** [August 21, 2021, 1:38am UTC](https://discuss.elastic.co/t/master-and-slave-using-same-index/282084 "2021-08-21T01:38:31Z")

</div>

I will use filebeat -\> logstash -\> Elasticsearch cluster I have 2 server filebeat installed. Can i use same index name for the 2 server?

---

## [Cannot reindex due to bad id field(s)](https://discuss.elastic.co/t/cannot-reindex-due-to-bad-id-field-s/280601)

<div class="topic-metadata">

**Author:** [@tasslehawf](https://discuss.elastic.co/u/tasslehawf)\
**Replies:** 2\
**Last updated:** [August 20, 2021, 6:45pm UTC](https://discuss.elastic.co/t/cannot-reindex-due-to-bad-id-field-s/280601 "2021-08-20T18:45:06Z")

</div>

I ran into an issue where we are trying to reindex in order to gain a copy\_to search field. "type": "action\_request\_validation\_exception", "reason": "Validation Failed: 1: id is too long, must be no longer than 512 …

---

## [Tens of GB indexes deleted, no OS space reclaimed](https://discuss.elastic.co/t/tens-of-gb-indexes-deleted-no-os-space-reclaimed/281964)

<div class="topic-metadata">

**Author:** [@sz7443](https://discuss.elastic.co/u/sz7443)\
**Replies:** 4\
**Last updated:** [August 20, 2021, 3:48pm UTC](https://discuss.elastic.co/t/tens-of-gb-indexes-deleted-no-os-space-reclaimed/281964 "2021-08-20T15:48:00Z")

</div>

Hi, I have scouted locals forum for almost half a day but no relevant reply found. I am trying to introduce curator to our ES and I have deleted several 25GB indexes successfully. However, no OS space reclaimed after del…

---

## [Read Elastic snapshot data in azure blob storage](https://discuss.elastic.co/t/read-elastic-snapshot-data-in-azure-blob-storage/282082)

<div class="topic-metadata">

**Author:** [@shadu88](https://discuss.elastic.co/u/shadu88)\
**Replies:** 1\
**Last updated:** [August 20, 2021, 1:36pm UTC](https://discuss.elastic.co/t/read-elastic-snapshot-data-in-azure-blob-storage/282082 "2021-08-20T13:36:21Z")

</div>

Hello Dear Elks, Hope you are doing good!! I have set a ILM policy to store logs to azure blob storage older than 30 days. Now how can I enable searching/reading logs in blob storage? I see the data in blob is not in r…

---

## [ES container in Docker changes the "temp" directory every time the container runs!](https://discuss.elastic.co/t/es-container-in-docker-changes-the-temp-directory-every-time-the-container-runs/281371)

<div class="topic-metadata">

**Author:** [@aza-zil](https://discuss.elastic.co/u/aza-zil)\
**Replies:** 5\
**Last updated:** [August 20, 2021, 2:21pm UTC](https://discuss.elastic.co/t/es-container-in-docker-changes-the-temp-directory-every-time-the-container-runs/281371 "2021-08-20T14:21:06Z")

</div>

I am trying to develope a plugin, it must writes files on a click. After I searched, I found out that I can only write to "temp" folder, is that right? So, in windows, I was able to locate the "temp" folder and everythi…

---

## [Highlighting issue when combine multiword phrase search with Intervals](https://discuss.elastic.co/t/highlighting-issue-when-combine-multiword-phrase-search-with-intervals/282085)

<div class="topic-metadata">

**Author:** [@Yury-Stanevitch](https://discuss.elastic.co/u/Yury-Stanevitch)\
**Replies:** 0\
**Last updated:** [August 20, 2021, 1:53pm UTC](https://discuss.elastic.co/t/highlighting-issue-when-combine-multiword-phrase-search-with-intervals/282085 "2021-08-20T13:53:42Z")

</div>

Hello. I have query which works good from highlighting standpoint: POST index/\_search { "highlight": { "fields": { "attrText\*": { "number\_of\_fragments": 0, "type": "unified" } }, …

---

## [Monitoring java process running in remote server by Elasticsearch](https://discuss.elastic.co/t/monitoring-java-process-running-in-remote-server-by-elasticsearch/282068)

<div class="topic-metadata">

**Author:** [@buulq90](https://discuss.elastic.co/u/buulq90)\
**Replies:** 0\
**Last updated:** [August 20, 2021, 10:55am UTC](https://discuss.elastic.co/t/monitoring-java-process-running-in-remote-server-by-elasticsearch/282068 "2021-08-20T10:55:23Z")

</div>

Hello all, I have the ELK stack with: AWS Elasticsearch & Logstash on EC2 instance. Currently, I want to monitor the java process in the other remote server which running many java process such as: java --proccess1 j…

---

## [One node one primary shard](https://discuss.elastic.co/t/one-node-one-primary-shard/282066)

<div class="topic-metadata">

**Author:** [@terrainc](https://discuss.elastic.co/u/terrainc)\
**Replies:** 0\
**Last updated:** [August 20, 2021, 10:41am UTC](https://discuss.elastic.co/t/one-node-one-primary-shard/282066 "2021-08-20T10:41:56Z")

</div>

I have 6 nodes and 6 primary shards for each index plus replica. I want to be sure that each index primary shard got own node. How I understand, this can be controlled by allocation.balance "cluster.routing.allo…

---

## [Shards balance and homogeneity of their sizes](https://discuss.elastic.co/t/shards-balance-and-homogeneity-of-their-sizes/281661)

<div class="topic-metadata">

**Author:** [@sebastienf](https://discuss.elastic.co/u/sebastienf)\
**Replies:** 7\
**Last updated:** [August 20, 2021, 10:29am UTC](https://discuss.elastic.co/t/shards-balance-and-homogeneity-of-their-sizes/281661 "2021-08-20T10:29:42Z")

</div>

I understood the need of a well balanced ES cluster, with indices made of enough shards (not too much but not too few), but I was wondering if the constancy of the size of shards was important ? Indeed, according the pu…

---

## [Does "retry\_on\_conflict" will handle updating the latest version number before retrying again?](https://discuss.elastic.co/t/does-retry-on-conflict-will-handle-updating-the-latest-version-number-before-retrying-again/281738)

<div class="topic-metadata">

**Author:** [@Vikram\_Golapelliwar](https://discuss.elastic.co/u/Vikram_Golapelliwar)\
**Replies:** 1\
**Last updated:** [August 20, 2021, 9:41am UTC](https://discuss.elastic.co/t/does-retry-on-conflict-will-handle-updating-the-latest-version-number-before-retrying-again/281738 "2021-08-20T09:41:22Z")

</div>

Team, I have been trying to understand how setting retry\_on\_conflict will behave. It is little confusing in the documentation. As per my understanding, below lines suggest that the latest version update will be handle…

---

## [NEST, number of transferred bytes when using compression](https://discuss.elastic.co/t/nest-number-of-transferred-bytes-when-using-compression/281991)

<div class="topic-metadata">

**Author:** [@MPeli](https://discuss.elastic.co/u/MPeli)\
**Replies:** 1\
**Last updated:** [August 20, 2021, 7:56am UTC](https://discuss.elastic.co/t/nest-number-of-transferred-bytes-when-using-compression/281991 "2021-08-20T07:56:06Z")

</div>

Hi, I use the NEST library to index documents. Request are made using a BulkAsync function. I enabled an http compression (gzip). I wonder whether it is possible to find out how many bytes were transferred when making a…

---

## [Ilm policy for existing index](https://discuss.elastic.co/t/ilm-policy-for-existing-index/282036)

<div class="topic-metadata">

**Author:** [@IsAa](https://discuss.elastic.co/u/IsAa)\
**Replies:** 1\
**Last updated:** [August 20, 2021, 5:29am UTC](https://discuss.elastic.co/t/ilm-policy-for-existing-index/282036 "2021-08-20T05:29:08Z")

</div>

Hi Team, I am trying to understand how does ilm policy also setup new indices. I understand that one needs to first setup the ilm policy which is then assigned to a template e.g { "index\_patterns": \["test-\*"\], "t…

---

## [Run Elasticsearch on port other than 9200](https://discuss.elastic.co/t/run-elasticsearch-on-port-other-than-9200/281830)

<div class="topic-metadata">

**Author:** [@mba](https://discuss.elastic.co/u/mba)\
**Replies:** 5\
**Last updated:** [August 19, 2021, 10:12pm UTC](https://discuss.elastic.co/t/run-elasticsearch-on-port-other-than-9200/281830 "2021-08-19T22:12:55Z")

</div>

I want to run elasticsearch on port other than 9200, so I changed http.port=9220 in elasticsearch.yml but still it is running on port number 9200

---

## [Filtering and ordering](https://discuss.elastic.co/t/filtering-and-ordering/282015)

<div class="topic-metadata">

**Author:** [@Sriram8894](https://discuss.elastic.co/u/Sriram8894)\
**Replies:** 2\
**Last updated:** [August 19, 2021, 10:03pm UTC](https://discuss.elastic.co/t/filtering-and-ordering/282015 "2021-08-19T22:03:49Z")

</div>

I would like to know the reason for below case Case 1 : Consider, I have applied a filter on documents and the order of documents in response is 1,2,3,4. Case 2: I have updated a field in the document 2, then If I exec…

---

## [Extration query for each item that has timestamps in each of the last three days](https://discuss.elastic.co/t/extration-query-for-each-item-that-has-timestamps-in-each-of-the-last-three-days/282011)

<div class="topic-metadata">

**Author:** [@Scott\_S](https://discuss.elastic.co/u/Scott_S)\
**Replies:** 0\
**Last updated:** [August 19, 2021, 9:20pm UTC](https://discuss.elastic.co/t/extration-query-for-each-item-that-has-timestamps-in-each-of-the-last-three-days/282011 "2021-08-19T21:20:51Z")

</div>

I'm trying to write an extraction query to get every timestamp for all items only if the item has timestamps in each of the last three days. For context, what I'm doing is tracking tests - if they've executed in each of …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=587)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=589)
