# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=758

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 759

---

## [Can't move ES indexes to another disk](https://discuss.elastic.co/t/cant-move-es-indexes-to-another-disk/256165)

<div class="topic-metadata">

**Author:** [@sourcedump](https://discuss.elastic.co/u/sourcedump)\
**Replies:** 2\
**Last updated:** [November 23, 2020, 2:19pm UTC](https://discuss.elastic.co/t/cant-move-es-indexes-to-another-disk/256165 "2020-11-23T14:19:19Z")

</div>

Hello everyone! I have an ES 6.1.3 installation that works perfectly, but now the disk where the indexes are stored (we can call it 'Disk A' with path '/data-ephemeral') is full and we can't make it larger. So I've dec…

---

## [Scripted Field URL](https://discuss.elastic.co/t/scripted-field-url/256360)

<div class="topic-metadata">

**Author:** [@nagabhushan.tr](https://discuss.elastic.co/u/nagabhushan.tr)\
**Replies:** 0\
**Last updated:** [November 23, 2020, 1:34pm UTC](https://discuss.elastic.co/t/scripted-field-url/256360 "2020-11-23T13:34:26Z")

</div>

I have a scripted field (URL type) which i use to navigate to APM on kibana from a dashboard. Is there a way i can capture time range from dashboard and pass it to scripted field, so when i navigate to APM, selected dash…

---

## [Too many dynamic script compilations with stored script](https://discuss.elastic.co/t/too-many-dynamic-script-compilations-with-stored-script/256354)

<div class="topic-metadata">

**Author:** [@cwinkler](https://discuss.elastic.co/u/cwinkler)\
**Replies:** 0\
**Last updated:** [November 23, 2020, 12:46pm UTC](https://discuss.elastic.co/t/too-many-dynamic-script-compilations-with-stored-script/256354 "2020-11-23T12:46:50Z")

</div>

With Elasticsearch 7.10 we are getting the following error when using a stored script. ElasticsearchException\[Elasticsearch exception \[type=general\_script\_exception, reason=Failed to compile stored script \[updateMessage…

---

## [What does max\_docs do in context of \_delete\_by\_query](https://discuss.elastic.co/t/what-does-max-docs-do-in-context-of-delete-by-query/256317)

<div class="topic-metadata">

**Author:** [@vangogh94](https://discuss.elastic.co/u/vangogh94)\
**Replies:** 3\
**Last updated:** [November 23, 2020, 10:53am UTC](https://discuss.elastic.co/t/what-does-max-docs-do-in-context-of-delete-by-query/256317 "2020-11-23T10:53:41Z")

</div>

Hi, Looking at the documentation for \_delete\_by\_query API, there is a parameter called "max\_docs". From what i see it was added to documentation in 7.3. This same parameter is shown on \_reindex API documentation and ha…

---

## [Elasticsearch Transform Document ID](https://discuss.elastic.co/t/elasticsearch-transform-document-id/256192)

<div class="topic-metadata">

**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\
**Replies:** 1\
**Last updated:** [November 23, 2020, 9:40am UTC](https://discuss.elastic.co/t/elasticsearch-transform-document-id/256192 "2020-11-23T09:40:46Z")

</div>

When we use the transform API to transform our data into a new index, is there a way for us to set the document ID? (I think currently the default setting is randomly assigned some string as the document ID)

---

## [Alerting Webhook Action force don't use proxy](https://discuss.elastic.co/t/alerting-webhook-action-force-dont-use-proxy/256331)

<div class="topic-metadata">

**Author:** [@usrigp](https://discuss.elastic.co/u/usrigp)\
**Replies:** 0\
**Last updated:** [November 23, 2020, 9:38am UTC](https://discuss.elastic.co/t/alerting-webhook-action-force-dont-use-proxy/256331 "2020-11-23T09:38:20Z")

</div>

Hi, We need to force a Webhook Action don't use the proxy. We know we can config a webhook action using proxy.host and proxy.port. Are there any way to force it doesn't use a proxy (ignoring proxy configured on the se…

---

## [Nodes fall out of the cluster es 7.9.1](https://discuss.elastic.co/t/nodes-fall-out-of-the-cluster-es-7-9-1/256309)

<div class="topic-metadata">

**Author:** [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)\
**Replies:** 2\
**Last updated:** [November 23, 2020, 9:25am UTC](https://discuss.elastic.co/t/nodes-fall-out-of-the-cluster-es-7-9-1/256309 "2020-11-23T09:25:58Z")

</div>

Hello, we have the following problem: nodes can periodically fall out of the cluster \[2020-11-19T09:00:37,415\]\[INFO \]\[o.e.c.s.MasterService \] \[h1-es03\] node-left\[{h1-es02}{qgmMV2UbT-ScN9uRr6YM8g}{klj1K8UMRHGtYpYozIuq…

---

## [Need to remove two Node out of three node Elasticsearch clusters](https://discuss.elastic.co/t/need-to-remove-two-node-out-of-three-node-elasticsearch-clusters/256101)

<div class="topic-metadata">

**Author:** [@SumanUk](https://discuss.elastic.co/u/SumanUk)\
**Replies:** 4\
**Last updated:** [November 23, 2020, 9:13am UTC](https://discuss.elastic.co/t/need-to-remove-two-node-out-of-three-node-elasticsearch-clusters/256101 "2020-11-23T09:13:33Z")

</div>

Hi Team, Need guidelines for how to remove two Nodes out of three Node in Elastic Cluster without data loss we have install Elasticsearch in single node but it has connected three node which is early install still it's…

---

## [Http.max\_header\_size](https://discuss.elastic.co/t/http-max-header-size/256318)

<div class="topic-metadata">

**Author:** [@thetell75](https://discuss.elastic.co/u/thetell75)\
**Replies:** 2\
**Last updated:** [November 23, 2020, 8:24am UTC](https://discuss.elastic.co/t/http-max-header-size/256318 "2020-11-23T08:24:40Z")

</div>

Hello everybody, I have an issue with User having to many groups on Microsoft Azure. As we do authenticate through openid on Azure. I saw a Problem with Header Size. So I tried to increase the Header\_Size from 8KB to 1…

---

## [Can we store two Elastic search indices in different data directory](https://discuss.elastic.co/t/can-we-store-two-elastic-search-indices-in-different-data-directory/256221)

<div class="topic-metadata">

**Author:** [@Vivek\_Sagar](https://discuss.elastic.co/u/Vivek_Sagar)\
**Replies:** 4\
**Last updated:** [November 23, 2020, 6:20am UTC](https://discuss.elastic.co/t/can-we-store-two-elastic-search-indices-in-different-data-directory/256221 "2020-11-23T06:20:06Z")

</div>

Can we have multiple indices in different data paths in elastic search? In my application, I want to separate index to keep sensitive data in dm-crypted volume and others on non encrypted volume. So separate indices for …

---

## [Length of a field - Multi-line](https://discuss.elastic.co/t/length-of-a-field-multi-line/256300)

<div class="topic-metadata">

**Author:** [@bevano](https://discuss.elastic.co/u/bevano)\
**Replies:** 0\
**Last updated:** [November 23, 2020, 4:48am UTC](https://discuss.elastic.co/t/length-of-a-field-multi-line/256300 "2020-11-23T04:48:20Z")

</div>

Hi All, Need some help with writing a query. I have a field called receipttext (mapped as a text and keyword) and it contains data that spans over multiple lines (eg. think of a receipt that you get from a purchase). I…

---

## [Format email in the Alerting and Actions](https://discuss.elastic.co/t/format-email-in-the-alerting-and-actions/254505)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 1\
**Last updated:** [November 23, 2020, 1:33am UTC](https://discuss.elastic.co/t/format-email-in-the-alerting-and-actions/254505 "2020-11-23T01:33:24Z")

</div>

Hi all, I want to format the mail that when SIEM or system monitor send mail there will be some information that i can see so i dont really have to access SIEM app to see them. From what i know the watcher has that for…

---

## [Index Lifecycle Policies vs Rollup Jobs](https://discuss.elastic.co/t/index-lifecycle-policies-vs-rollup-jobs/256290)

<div class="topic-metadata">

**Author:** [@lamp123432](https://discuss.elastic.co/u/lamp123432)\
**Replies:** 1\
**Last updated:** [November 23, 2020, 12:14am UTC](https://discuss.elastic.co/t/index-lifecycle-policies-vs-rollup-jobs/256290 "2020-11-23T00:14:28Z")

</div>

Hello, Can someone explain the main differences between Index Lifecycle Policies vs Rollup Jobs? Thank you!

---

## [Watcher that outputs the total number of snapshots in a repository](https://discuss.elastic.co/t/watcher-that-outputs-the-total-number-of-snapshots-in-a-repository/256244)

<div class="topic-metadata">

**Author:** [@mwise29](https://discuss.elastic.co/u/mwise29)\
**Replies:** 0\
**Last updated:** [November 21, 2020, 10:09pm UTC](https://discuss.elastic.co/t/watcher-that-outputs-the-total-number-of-snapshots-in-a-repository/256244 "2020-11-21T22:09:48Z")

</div>

How do I get the total number of snapshots from a repository with this input? I've tried ctx.payload.hits and ctx.payload.hits.value but the value is blank. Any help would be greatly appreciated. "input" : { "ht…

---

## [Kibana add wrong duplicate values](https://discuss.elastic.co/t/kibana-add-wrong-duplicate-values/256256)

<div class="topic-metadata">

**Author:** [@Mohammad\_Mousavi](https://discuss.elastic.co/u/Mohammad_Mousavi)\
**Replies:** 1\
**Last updated:** [November 22, 2020, 11:55pm UTC](https://discuss.elastic.co/t/kibana-add-wrong-duplicate-values/256256 "2020-11-22T23:55:27Z")

</div>

Hi, This is a sample from discovery section in kibana. It happens only some times that values are duplicate. The exact log in Grok Debugger looks fine. Whys this is happening? I've added this line to logstash but not…

---

## [Group\_concat aggragation](https://discuss.elastic.co/t/group-concat-aggragation/256285)

<div class="topic-metadata">

**Author:** [@chupacabra](https://discuss.elastic.co/u/chupacabra)\
**Replies:** 0\
**Last updated:** [November 22, 2020, 9:15pm UTC](https://discuss.elastic.co/t/group-concat-aggragation/256285 "2020-11-22T21:15:40Z")

</div>

Hello everybody. I am new to elasticsearch and I would like to create a group\_concat aggregation. But I don't know how. Can someone help me please. The example data: POST /example\_measures/\_bulk {"index":{"\_id"…

---

## [ILM in kubernetes](https://discuss.elastic.co/t/ilm-in-kubernetes/255603)

<div class="topic-metadata">

**Author:** [@Armen\_Khachikyan](https://discuss.elastic.co/u/Armen_Khachikyan)\
**Replies:** 4\
**Last updated:** [November 22, 2020, 8:09pm UTC](https://discuss.elastic.co/t/ilm-in-kubernetes/255603 "2020-11-22T20:09:24Z")

</div>

community I need your help, I am using ELK like 3 months, and now I need to add ILM policy in elasticsearch pod in kubernetes with curl -XPUT -u username:password http://localhost:9200/\_ilm/policy/name --header "Conte…

---

## [Elasticsearch 7.9.3 upgrade - GC issues](https://discuss.elastic.co/t/elasticsearch-7-9-3-upgrade-gc-issues/256257)

<div class="topic-metadata">

**Author:** [@Lior\_Yakobov](https://discuss.elastic.co/u/Lior_Yakobov)\
**Replies:** 3\
**Last updated:** [November 22, 2020, 2:34pm UTC](https://discuss.elastic.co/t/elasticsearch-7-9-3-upgrade-gc-issues/256257 "2020-11-22T14:34:02Z")

</div>

Hello, I have started the upgrade process to Elasticsearch-7.9.3 and I see that although I was using CMS GC before, and G1GC configurations are commented out, the instance starts and logs indicates that G1GC is used. W…

---

## [Add parameter "include\_type\_name":true in index settings block](https://discuss.elastic.co/t/add-parameter-include-type-name-true-in-index-settings-block/256078)

<div class="topic-metadata">

**Author:** [@Tamil\_Selvan](https://discuss.elastic.co/u/Tamil_Selvan)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 6:52pm UTC](https://discuss.elastic.co/t/add-parameter-include-type-name-true-in-index-settings-block/256078 "2020-11-20T18:52:07Z")

</div>

In ES version 7.9.3, the include\_type\_name is defaulted to false, need to make it true, Need to pass include\_type\_name=true in request URL Is there is another way without passing in the request url

---

## [Elasticsearch: "high" CPU usage every 6 minutes for one minute](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-every-6-minutes-for-one-minute/256235)

<div class="topic-metadata">

**Author:** [@oicfar](https://discuss.elastic.co/u/oicfar)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 8:03pm UTC](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-every-6-minutes-for-one-minute/256235 "2020-11-21T20:03:43Z")

</div>

Hi, I'm running ELK Stack 7.10.0 (elasticsearch, filebeat, kibana, logstash) on the same server. And since two days elasticsearch is doing something every 6 minutes for one minute. The CPU usage is not high, but it's li…

---

## [SearchTemplate issue Java API](https://discuss.elastic.co/t/searchtemplate-issue-java-api/256185)

<div class="topic-metadata">

**Author:** [@Mombasa](https://discuss.elastic.co/u/Mombasa)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 7:57pm UTC](https://discuss.elastic.co/t/searchtemplate-issue-java-api/256185 "2020-11-20T19:57:45Z")

</div>

I'm stuck with a SearchTemplate request, until now I've been able to write queries thru the QueryBuilder and execute them calling the "search" method of the RestHighLevelClient java client, but when I try to execute the …

---

## [WARN#011\[elasticsearch\]#011elasticsearch/client.go:408#011Cannot index event publisher.Event](https://discuss.elastic.co/t/warn-011-elasticsearch-011elasticsearch-client-go-408-011cannot-index-event-publisher-event/254608)

<div class="topic-metadata">

**Author:** [@oicfar](https://discuss.elastic.co/u/oicfar)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 4:52pm UTC](https://discuss.elastic.co/t/warn-011-elasticsearch-011elasticsearch-client-go-408-011cannot-index-event-publisher-event/254608 "2020-11-21T16:52:50Z")

</div>

Hi, ES is flooting syslog. Nov 7 13:57:04 nuc-mini-server filebeat\[757\]: 2020-11-07T13:57:04.044+0100#011WARN#011\[elasticsearch\]#011elasticsearch/client.go:408#011Cannot index event publisher.Event{Content:beat.Event{…

---

## [How does ES stores the geopoints or location of an entry?](https://discuss.elastic.co/t/how-does-es-stores-the-geopoints-or-location-of-an-entry/256230)

<div class="topic-metadata">

**Author:** [@HseinBitar](https://discuss.elastic.co/u/HseinBitar)\
**Replies:** 0\
**Last updated:** [November 21, 2020, 3:09pm UTC](https://discuss.elastic.co/t/how-does-es-stores-the-geopoints-or-location-of-an-entry/256230 "2020-11-21T15:09:14Z")

</div>

I need to return nearest 10 results with score above a threshold that I specify. I do have the location of every entry, as a geopoint with latitude and longitude. I doubt a geospatial index would be useful for such a …

---

## [How to search text field for list of "terms" / "keywords"](https://discuss.elastic.co/t/how-to-search-text-field-for-list-of-terms-keywords/256218)

<div class="topic-metadata">

**Author:** [@msta](https://discuss.elastic.co/u/msta)\
**Replies:** 0\
**Last updated:** [November 21, 2020, 11:50am UTC](https://discuss.elastic.co/t/how-to-search-text-field-for-list-of-terms-keywords/256218 "2020-11-21T11:50:29Z")

</div>

Hi ES Community, We have a set of text-documents indexed, and their primary field is an analyzed version of their text (stored in a text field). We want to exact or partial match any of a long list of keywords in the te…

---

## [Unable to load an index with more than 2.1 B documents](https://discuss.elastic.co/t/unable-to-load-an-index-with-more-than-2-1-b-documents/256211)

<div class="topic-metadata">

**Author:** [@amir\_veyseh](https://discuss.elastic.co/u/amir_veyseh)\
**Replies:** 10\
**Last updated:** [November 21, 2020, 10:43am UTC](https://discuss.elastic.co/t/unable-to-load-an-index-with-more-than-2-1-b-documents/256211 "2020-11-21T10:43:54Z")

</div>

I stopped the elasticSearch service and restarted it. Now, one of the indices cannot be loaded. Here's the status of the indeices: yellow open test-index \_taPEhm3ReSwCYjb1Y5hQA 1 1 3 0 7.5kb …

---

## [Stack Monitoring shows "No monitoring data found"](https://discuss.elastic.co/t/stack-monitoring-shows-no-monitoring-data-found/254502)

<div class="topic-metadata">

**Author:** [@kavier](https://discuss.elastic.co/u/kavier)\
**Replies:** 6\
**Last updated:** [November 21, 2020, 4:21am UTC](https://discuss.elastic.co/t/stack-monitoring-shows-no-monitoring-data-found/254502 "2020-11-21T04:21:26Z")

</div>

Hi all, Our Single Node Elastic Stack's Stack Monitoring was working all along and stopped working suddenly. We've took a look at https://github.com/elastic/kibana/issues/33760 but not much information obtained too. W…

---

## [How to migrate elastic version 5.6.5?](https://discuss.elastic.co/t/how-to-migrate-elastic-version-5-6-5/255313)

<div class="topic-metadata">

**Author:** [@balainit](https://discuss.elastic.co/u/balainit)\
**Replies:** 6\
**Last updated:** [November 21, 2020, 4:14am UTC](https://discuss.elastic.co/t/how-to-migrate-elastic-version-5-6-5/255313 "2020-11-21T04:14:20Z")

</div>

Hi everyone, how to migrate 57 nodes and 58 nodes to the new one, the data volume is 1T, thank you all

---

## [ES 7.10 ignores analyzer in "as\_you\_type" fields](https://discuss.elastic.co/t/es-7-10-ignores-analyzer-in-as-you-type-fields/256113)

<div class="topic-metadata">

**Author:** [@\_ZN3val](https://discuss.elastic.co/u/_ZN3val)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 10:06pm UTC](https://discuss.elastic.co/t/es-7-10-ignores-analyzer-in-as-you-type-fields/256113 "2020-11-20T22:06:14Z")

</div>

Hello, Since an upgrade from 7.9 to 7.10, ES tokenizes "as\_you\_type" fields with a "simple" analyzer differently, causing less results to be returned. While this analyzer should split on any non-letter, it stopped split…

---

## [Group by and sum](https://discuss.elastic.co/t/group-by-and-sum/256190)

<div class="topic-metadata">

**Author:** [@Giovanni\_Di\_Lembo](https://discuss.elastic.co/u/Giovanni_Di_Lembo)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 9:20pm UTC](https://discuss.elastic.co/t/group-by-and-sum/256190 "2020-11-20T21:20:16Z")

</div>

hi all and sorry for my poor english I tried with no success to create an aggregation query that group hits by a field "category" and get a sum of field "eventCount". Please help

---

## [QueueResizingEsThreadPoolExecutor exception](https://discuss.elastic.co/t/queueresizingesthreadpoolexecutor-exception/256189)

<div class="topic-metadata">

**Author:** [@Igor\_Domshchikov](https://discuss.elastic.co/u/Igor_Domshchikov)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 9:04pm UTC](https://discuss.elastic.co/t/queueresizingesthreadpoolexecutor-exception/256189 "2020-11-20T21:04:28Z")

</div>

At some point during 35k endurance load test of my java web app which fetches static data from Elasticsearch, I am start getting following elasticsearch exception: Caused by: org.elasticsearch.common.util.concurrent.EsR…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=757)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=759)
