# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=537

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 538

---

## [Sort order case insensitive](https://discuss.elastic.co/t/sort-order-case-insensitive/289882)

<div class="topic-metadata">

**Author:** [@Lyes\_Ouchene](https://discuss.elastic.co/u/Lyes_Ouchene)\
**Replies:** 1\
**Last updated:** [November 23, 2021, 4:21am UTC](https://discuss.elastic.co/t/sort-order-case-insensitive/289882 "2021-11-23T04:21:36Z")

</div>

hello, I already have an index created from logstash and I want to do a sort order case insensitive on a field. I need help. thank you

---

## [Mapper Size Plugin VS real Index Size](https://discuss.elastic.co/t/mapper-size-plugin-vs-real-index-size/289793)

<div class="topic-metadata">

**Author:** [@gneves](https://discuss.elastic.co/u/gneves)\
**Replies:** 3\
**Last updated:** [November 23, 2021, 3:17am UTC](https://discuss.elastic.co/t/mapper-size-plugin-vs-real-index-size/289793 "2021-11-23T03:17:12Z")

</div>

Hello guys, hope you are doing well. Im having a little problem, or not understanding something. My problem is: In order to make a metrics dashboard about index sizes and other metrics, i have enabled Mapper Size Pl…

---

## [Elastic cluster Performance issue](https://discuss.elastic.co/t/elastic-cluster-performance-issue/289703)

<div class="topic-metadata">

**Author:** [@Krishna\_Kumar](https://discuss.elastic.co/u/Krishna_Kumar)\
**Replies:** 2\
**Last updated:** [November 23, 2021, 2:38am UTC](https://discuss.elastic.co/t/elastic-cluster-performance-issue/289703 "2021-11-23T02:38:49Z")

</div>

Hi All, We have a set-up of Pipeline: Beats Agents--\>AWS MSK--\>LogStash--\>Elasticsearch. In which application team sends their application logs through this pipeline. We have 8 AWS ec2 instances which is running on Auto…

---

## [Runtime field with text type and runtime field usage within dynamic\_templates](https://discuss.elastic.co/t/runtime-field-with-text-type-and-runtime-field-usage-within-dynamic-templates/289876)

<div class="topic-metadata">

**Author:** [@vlasami](https://discuss.elastic.co/u/vlasami)\
**Replies:** 0\
**Last updated:** [November 22, 2021, 9:19pm UTC](https://discuss.elastic.co/t/runtime-field-with-text-type-and-runtime-field-usage-within-dynamic-templates/289876 "2021-11-22T21:19:43Z")

</div>

Hi, We've been experimenting with the use of the (query time) runtime fields as a possible solution for the mapping explosion problem we currently see. Found the list of supported types for the runtime fields (Elastics…

---

## [Auto kill queries taking more time](https://discuss.elastic.co/t/auto-kill-queries-taking-more-time/289775)

<div class="topic-metadata">

**Author:** [@sreekanth](https://discuss.elastic.co/u/sreekanth)\
**Replies:** 6\
**Last updated:** [November 22, 2021, 9:02pm UTC](https://discuss.elastic.co/t/auto-kill-queries-taking-more-time/289775 "2021-11-22T21:02:09Z")

</div>

We are using 7.3 ES. Due to few bad queries fired by end user, ES CPU/Memory jumps to very high and impacts all others. We want to know any way to stop those long-running queries and return 429 or some status, so the cli…

---

## [Creating a watcher to compare moving average values](https://discuss.elastic.co/t/creating-a-watcher-to-compare-moving-average-values/289634)

<div class="topic-metadata">

**Author:** [@Luis\_P](https://discuss.elastic.co/u/Luis_P)\
**Replies:** 1\
**Last updated:** [November 22, 2021, 6:13pm UTC](https://discuss.elastic.co/t/creating-a-watcher-to-compare-moving-average-values/289634 "2021-11-22T18:13:23Z")

</div>

Hello there, I'm trying to build a watcher to compare two values for a moving average, one being the latest bucket moving average value and the other the moving average value for a bucket one month earlier (-1 Month off…

---

## [Disk capacity for elasticsearch](https://discuss.elastic.co/t/disk-capacity-for-elasticsearch/289816)

<div class="topic-metadata">

**Author:** [@Kapila](https://discuss.elastic.co/u/Kapila)\
**Replies:** 4\
**Last updated:** [November 22, 2021, 4:25pm UTC](https://discuss.elastic.co/t/disk-capacity-for-elasticsearch/289816 "2021-11-22T16:25:37Z")

</div>

I want to ship my application log files into Elasticsearch and trying to come-up with a capacity plan for Elasticsearch. Let's say if I have 1 GB log file, how much disk space I need for Elasticsearch to store log conte…

---

## [Elasticsearch plugin-install don't use the proper Java version](https://discuss.elastic.co/t/elasticsearch-plugin-install-dont-use-the-proper-java-version/289269)

<div class="topic-metadata">

**Author:** [@Jeremy\_Gachet](https://discuss.elastic.co/u/Jeremy_Gachet)\
**Replies:** 4\
**Last updated:** [November 22, 2021, 12:50pm UTC](https://discuss.elastic.co/t/elasticsearch-plugin-install-dont-use-the-proper-java-version/289269 "2021-11-22T12:50:28Z")

</div>

Hello, I try to install the OpenNlp plugin on my local machine with the command bin/elasticsearch-plugin install https://github.com/spinscale/elasticsearch-ingest-opennlp/releases/download/7.15.2.1/ingest-opennlp-7.15.…

---

## [Can transform with init, map, combine, reduce emit multiple documents?](https://discuss.elastic.co/t/can-transform-with-init-map-combine-reduce-emit-multiple-documents/289563)

<div class="topic-metadata">

**Author:** [@HansPeterSloot](https://discuss.elastic.co/u/HansPeterSloot)\
**Replies:** 9\
**Last updated:** [November 22, 2021, 12:26pm UTC](https://discuss.elastic.co/t/can-transform-with-init-map-combine-reduce-emit-multiple-documents/289563 "2021-11-22T12:26:34Z")

</div>

Hi, In an index we have multiple documents for sequential steps that are part of a single transaction. We need to calculate the elapsed times for each step. Instead of emitting 1 document with all timings for all step…

---

## [Few questions on running elasticsearch with free license](https://discuss.elastic.co/t/few-questions-on-running-elasticsearch-with-free-license/289801)

<div class="topic-metadata">

**Author:** [@prat1](https://discuss.elastic.co/u/prat1)\
**Replies:** 2\
**Last updated:** [November 22, 2021, 12:08pm UTC](https://discuss.elastic.co/t/few-questions-on-running-elasticsearch-with-free-license/289801 "2021-11-22T12:08:40Z")

</div>

Hi Team, Is there any limit on the number of GB of logs per day, say in filebeat processing of GBs of data or in logstash ingestion or any limit on elasticsearch storage of GBs of data in free license of Elasticsearch? …

---

## [How to install custom plugin from s3 locations in Kubernetes Elasticsearch(ECK)?](https://discuss.elastic.co/t/how-to-install-custom-plugin-from-s3-locations-in-kubernetes-elasticsearch-eck/289781)

<div class="topic-metadata">

**Author:** [@manu\_john](https://discuss.elastic.co/u/manu_john)\
**Replies:** 0\
**Last updated:** [November 22, 2021, 8:11am UTC](https://discuss.elastic.co/t/how-to-install-custom-plugin-from-s3-locations-in-kubernetes-elasticsearch-eck/289781 "2021-11-22T08:11:52Z")

</div>

How to install a custom plugin from s3 locations in Kubernetes Elasticsearch(ECK)?

---

## [Why we can not edit transform after creating](https://discuss.elastic.co/t/why-we-can-not-edit-transform-after-creating/289764)

<div class="topic-metadata">

**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\
**Replies:** 1\
**Last updated:** [November 22, 2021, 7:12am UTC](https://discuss.elastic.co/t/why-we-can-not-edit-transform-after-creating/289764 "2021-11-22T07:12:27Z")

</div>

Hi every body! I want to edit transform jobs after creation, but according to the Elasticsearch documents, we can edit only some restricted fields. is there a way to edit trasnform scripts? like group by section? or a…

---

## [Ignore\_malformed broken for geo\_shape](https://discuss.elastic.co/t/ignore-malformed-broken-for-geo-shape/289771)

<div class="topic-metadata">

**Author:** [@corndog](https://discuss.elastic.co/u/corndog)\
**Replies:** 4\
**Last updated:** [November 22, 2021, 3:48am UTC](https://discuss.elastic.co/t/ignore-malformed-broken-for-geo-shape/289771 "2021-11-22T03:48:49Z")

</div>

I have set mappings for my index as such: "geometry": { "type": "geo\_shape", "ignore\_malformed": true } When I Bulk POST documents, 1 fails due to malformed geometry. I have set the "ignore\_malformed" parameter…

---

## [Fetch 1M records using aggregation in a single call](https://discuss.elastic.co/t/fetch-1m-records-using-aggregation-in-a-single-call/289399)

<div class="topic-metadata">

**Author:** [@Sreejith\_Ms](https://discuss.elastic.co/u/Sreejith_Ms)\
**Replies:** 1\
**Last updated:** [November 22, 2021, 12:20am UTC](https://discuss.elastic.co/t/fetch-1m-records-using-aggregation-in-a-single-call/289399 "2021-11-22T00:20:57Z")

</div>

We have to create some reports based on nearly 100M data and its requires aggregation and the result will be nearly 5M records. So, Can I use Elasticsearch for this report generation and fetch up to 5M records in a sing…

---

## [Lifecycle error](https://discuss.elastic.co/t/lifecycle-error/289533)

<div class="topic-metadata">

**Author:** [@mrchile](https://discuss.elastic.co/u/mrchile)\
**Replies:** 0\
**Last updated:** [November 18, 2021, 6:48am UTC](https://discuss.elastic.co/t/lifecycle-error/289533 "2021-11-18T06:48:33Z")

</div>

No rollover info found for \[name\_index-%{+YYYY.MM.dd}-000001\] with rollover target \[index-alias\], the index has not yet rolled over with that target. The next day I get this error. On the first day of operation, no error…

---

## [Changing Unique Key of Elastic Search Index (Id column)](https://discuss.elastic.co/t/changing-unique-key-of-elastic-search-index-id-column/289582)

<div class="topic-metadata">

**Author:** [@amey\_kulkarni](https://discuss.elastic.co/u/amey_kulkarni)\
**Replies:** 1\
**Last updated:** [November 22, 2021, 12:12am UTC](https://discuss.elastic.co/t/changing-unique-key-of-elastic-search-index-id-column/289582 "2021-11-22T00:12:05Z")

</div>

We have a requirement to set value of id column (unique key) of an index to values coming from data (values of couple of columns from data). Id column value is set for each document by default. We want to override it wi…

---

## [ERROR: policy for index failed on step \[{"phase":"hot","action":"rollover","name":"check-rollover-ready"}\]](https://discuss.elastic.co/t/error-policy-for-index-failed-on-step-phase-hot-action-rollover-name-check-rollover-ready/289676)

<div class="topic-metadata">

**Author:** [@marti1](https://discuss.elastic.co/u/marti1)\
**Replies:** 0\
**Last updated:** [November 19, 2021, 10:49am UTC](https://discuss.elastic.co/t/error-policy-for-index-failed-on-step-phase-hot-action-rollover-name-check-rollover-ready/289676 "2021-11-19T10:49:35Z")

</div>

Hi, I just set up a new cluster, and I'm getting this error. Timestamp Level Type Message Component November 19, 2021 10:32:57 AM INFO Server policy \[metricbeat\] for index \[metricbeat-7.15.2-2021.11.18-000001\] …

---

## [Kibana a new nodes does not get listed but the total number of nodes is correct](https://discuss.elastic.co/t/kibana-a-new-nodes-does-not-get-listed-but-the-total-number-of-nodes-is-correct/289736)

<div class="topic-metadata">

**Author:** [@luigius](https://discuss.elastic.co/u/luigius)\
**Replies:** 0\
**Last updated:** [November 20, 2021, 5:55am UTC](https://discuss.elastic.co/t/kibana-a-new-nodes-does-not-get-listed-but-the-total-number-of-nodes-is-correct/289736 "2021-11-20T05:55:16Z")

</div>

Hi, I added a new node to an elastic cluster with a master node (hot) and a warm node. The cluster status is green and shows 3 nodes. Elastic is on all machine 7.15.2 the nodes are monitor (master hot), monitor-1 (wa…

---

## [Persisting latest state in separated index](https://discuss.elastic.co/t/persisting-latest-state-in-separated-index/289628)

<div class="topic-metadata">

**Author:** [@nestor1](https://discuss.elastic.co/u/nestor1)\
**Replies:** 1\
**Last updated:** [November 21, 2021, 11:39pm UTC](https://discuss.elastic.co/t/persisting-latest-state-in-separated-index/289628 "2021-11-21T23:39:30Z")

</div>

I have stream of data like this: userid: 1, taskid: 1, start\_time: 01:00:00, completed: 10 userid: 1, taskid: 1, start\_time: 02:00:00, completed: 30 userid: 1, taskid: 1, start\_time: 03:00:00, completed: 70 userid: 1, t…

---

## [Configuring SSL with Letsencrypt and sym links](https://discuss.elastic.co/t/configuring-ssl-with-letsencrypt-and-sym-links/289241)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 8\
**Last updated:** [November 21, 2021, 8:30pm UTC](https://discuss.elastic.co/t/configuring-ssl-with-letsencrypt-and-sym-links/289241 "2021-11-21T20:30:47Z")

</div>

I am setting up and Elasticsearch server on a system that uses letsencrypt certificates. The certificates and keys live under /etc/letsencrypt. There are several applications that need to access those key and rather th…

---

## [Questions about using must, should words together and Turkish char problem](https://discuss.elastic.co/t/questions-about-using-must-should-words-together-and-turkish-char-problem/289755)

<div class="topic-metadata">

**Author:** [@aox](https://discuss.elastic.co/u/aox)\
**Replies:** 1\
**Last updated:** [November 20, 2021, 9:06pm UTC](https://discuss.elastic.co/t/questions-about-using-must-should-words-together-and-turkish-char-problem/289755 "2021-11-20T21:06:05Z")

</div>

Hello I am using Elasticsearch-oss-7.10.2-1.x86\_64. I have 2 questions: Question 1) I want to combine this query results: GET /turkish\_example/\_search { "query": { "bool": { "should": \[ { "simple\_q…

---

## [How much clusters must I use in elastic stack?](https://discuss.elastic.co/t/how-much-clusters-must-i-use-in-elastic-stack/289735)

<div class="topic-metadata">

**Author:** [@sidharth\_vijayakumar](https://discuss.elastic.co/u/sidharth_vijayakumar)\
**Replies:** 1\
**Last updated:** [November 20, 2021, 7:10pm UTC](https://discuss.elastic.co/t/how-much-clusters-must-i-use-in-elastic-stack/289735 "2021-11-20T19:10:27Z")

</div>

I am confused which approach would be better having single cluster with 12 nodes or having 3 cluster with 4 nodes each in elastic stack. What are the advantages and disadvantages of single cluster? Does elastic charge me…

---

## [I am confused on backup and restore process, can someone please help?](https://discuss.elastic.co/t/i-am-confused-on-backup-and-restore-process-can-someone-please-help/289729)

<div class="topic-metadata">

**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\
**Replies:** 2\
**Last updated:** [November 20, 2021, 4:05am UTC](https://discuss.elastic.co/t/i-am-confused-on-backup-and-restore-process-can-someone-please-help/289729 "2021-11-20T04:05:14Z")

</div>

Hi Team, I have single node elastic cluster and my indices are getting created everyday. I do close them manually every after 120 days. So once index is closed would it be possible to take a a backup of those? Or is the…

---

## [Faile to start Elasticsearch 7.12.1](https://discuss.elastic.co/t/faile-to-start-elasticsearch-7-12-1/289718)

<div class="topic-metadata">

**Author:** [@tranha31](https://discuss.elastic.co/u/tranha31)\
**Replies:** 2\
**Last updated:** [November 20, 2021, 1:27am UTC](https://discuss.elastic.co/t/faile-to-start-elasticsearch-7-12-1/289718 "2021-11-20T01:27:05Z")

</div>

I install vietnamese-analysis for Elasticsearch 7.12.1. But when I restart Elasticsearch, I get the following error: \[2021-11-20T01:56:57,505\]\[ERROR\]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[dell-Precision-M4800…

---

## [Elasticsearch Synonyms - can phrases be used?](https://discuss.elastic.co/t/elasticsearch-synonyms-can-phrases-be-used/289723)

<div class="topic-metadata">

**Author:** [@pmono](https://discuss.elastic.co/u/pmono)\
**Replies:** 0\
**Last updated:** [November 19, 2021, 11:08pm UTC](https://discuss.elastic.co/t/elasticsearch-synonyms-can-phrases-be-used/289723 "2021-11-19T23:08:08Z")

</div>

Howdy, is it possible to use Phrase Synonyms for indexing? We had issues on ES 7.8 where it would crash indexing. We recently switched to 7.13.2. Are there any changes in terms of synonyms? Can phrases be used? Examp…

---

## [Tuning queries](https://discuss.elastic.co/t/tuning-queries/289721)

<div class="topic-metadata">

**Author:** [@Nick\_Hatfield](https://discuss.elastic.co/u/Nick_Hatfield)\
**Replies:** 0\
**Last updated:** [November 19, 2021, 10:50pm UTC](https://discuss.elastic.co/t/tuning-queries/289721 "2021-11-19T22:50:38Z")

</div>

Hey gang is there anyone that can help me with an Elasticsearch query? I'm trying to make the query more efficient by returning only unique hits. My query is structured like this currently: { "query": { "bool":…

---

## [How to monitor events in chain or to detect if transaction was completed or not](https://discuss.elastic.co/t/how-to-monitor-events-in-chain-or-to-detect-if-transaction-was-completed-or-not/289596)

<div class="topic-metadata">

**Author:** [@sagarseth](https://discuss.elastic.co/u/sagarseth)\
**Replies:** 1\
**Last updated:** [November 19, 2021, 9:08pm UTC](https://discuss.elastic.co/t/how-to-monitor-events-in-chain-or-to-detect-if-transaction-was-completed-or-not/289596 "2021-11-19T21:08:54Z")

</div>

Hello Friends, lets imagine i have following state , i get a message ordered timeStamp1,transactionA,Status\_ordered I want to check if for this transaction if the order was delivered in the next 15 mins or not,, if no…

---

## [Apply best\_compression to save disk space](https://discuss.elastic.co/t/apply-best-compression-to-save-disk-space/289705)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 2\
**Last updated:** [November 19, 2021, 7:27pm UTC](https://discuss.elastic.co/t/apply-best-compression-to-save-disk-space/289705 "2021-11-19T19:27:41Z")

</div>

Hi All, We are struggling with disk space issues on the Elasticsearch nodes. I came across the best\_compression option and the suggested way is as follows using dev tools: 1. Close all indices: POST \_all/\_close 2. A…

---

## [Painless max script size limit?](https://discuss.elastic.co/t/painless-max-script-size-limit/289707)

<div class="topic-metadata">

**Author:** [@Matt\_McGovern](https://discuss.elastic.co/u/Matt_McGovern)\
**Replies:** 2\
**Last updated:** [November 19, 2021, 5:58pm UTC](https://discuss.elastic.co/t/painless-max-script-size-limit/289707 "2021-11-19T17:58:14Z")

</div>

It used to be that the total size of a painless stored script was 16384, from a hard-coded system limit I've seen referenced before as MAXIMUM\_SOURCE\_LENGTH = 16384. I've run into the limit within the last few years and…

---

## [Can't find Pinned Search in Java high level rest client](https://discuss.elastic.co/t/cant-find-pinned-search-in-java-high-level-rest-client/289715)

<div class="topic-metadata">

**Author:** [@sutty100](https://discuss.elastic.co/u/sutty100)\
**Replies:** 0\
**Last updated:** [November 19, 2021, 5:40pm UTC](https://discuss.elastic.co/t/cant-find-pinned-search-in-java-high-level-rest-client/289715 "2021-11-19T17:40:56Z")

</div>

I can't seem to find in the Java High level rest client (7.15.2) the pinned search query type. It is not in the QueryBuilders object, am I missing something here or is this just not included in the high level rest client…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=536)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=538)
