# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=784

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 785

---

## [Elasticsearch connection idle timeout](https://discuss.elastic.co/t/elasticsearch-connection-idle-timeout/252283)

<div class="topic-metadata">

**Author:** [@lnitin](https://discuss.elastic.co/u/lnitin)\
**Replies:** 7\
**Last updated:** [October 16, 2020, 6:44pm UTC](https://discuss.elastic.co/t/elasticsearch-connection-idle-timeout/252283 "2020-10-16T18:44:58Z")

</div>

Hello, Elasticsearch server is rejecting any communication after certain amount of time interval if there is no activity from source server and connection is getting lost.? Can connection be open at all times, Is there …

---

## [Elasticsearch-hadoop spark connector unable to connect/write using out-of-box ES server setup, & default library settings](https://discuss.elastic.co/t/elasticsearch-hadoop-spark-connector-unable-to-connect-write-using-out-of-box-es-server-setup-default-library-settings/251981)

<div class="topic-metadata">

**Author:** [@Chris\_Bedford](https://discuss.elastic.co/u/Chris_Bedford)\
**Replies:** 3\
**Last updated:** [October 16, 2020, 5:52pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-spark-connector-unable-to-connect-write-using-out-of-box-es-server-setup-default-library-settings/251981 "2020-10-16T17:52:29Z")

</div>

I had some problems using the Elasticsearch connector for Spark described here: https://www.elastic.co/guide/en/elasticsearch/hadoop/master/spark.html. I could not even get the examples on their page working with a plain…

---

## [BUG assigning ILM policy to \_index\_template](https://discuss.elastic.co/t/bug-assigning-ilm-policy-to-index-template/252034)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 4\
**Last updated:** [October 16, 2020, 5:06pm UTC](https://discuss.elastic.co/t/bug-assigning-ilm-policy-to-index-template/252034 "2020-10-16T17:06:27Z")

</div>

How I can assign ILM Policy to \_index\_template I found this tutorial: I have version 7.9 and in older version (\_template) there was a button add policy to index template in recent version 7.9 \_index\_template is not…

---

## [Search\_phase\_execution\_exception all shards failed (filebeat + netflow)](https://discuss.elastic.co/t/search-phase-execution-exception-all-shards-failed-filebeat-netflow/252372)

<div class="topic-metadata">

**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 4:56pm UTC](https://discuss.elastic.co/t/search-phase-execution-exception-all-shards-failed-filebeat-netflow/252372 "2020-10-16T16:56:17Z")

</div>

Hello , I know it is a well known issue , but after looking on others solutions can not solve it. Im running filebeat with netflow module. It was working ok , but now I have this meesage on discover kibana interface: …

---

## [Alphabetically sorting + aggregation ElasticSearch](https://discuss.elastic.co/t/alphabetically-sorting-aggregation-elasticsearch/251414)

<div class="topic-metadata">

**Author:** [@het](https://discuss.elastic.co/u/het)\
**Replies:** 8\
**Last updated:** [October 16, 2020, 4:34pm UTC](https://discuss.elastic.co/t/alphabetically-sorting-aggregation-elasticsearch/251414 "2020-10-16T16:34:13Z")

</div>

Hi team, I am using aggregation to get grouped records. I am not able to sort the buckets. Dummy Data : { "\_index": "testing-aggregation", "\_type": "employee", "\_id": "emp001\_local000000000000001", "\_s…

---

## [Large composite agg + sorting](https://discuss.elastic.co/t/large-composite-agg-sorting/252126)

<div class="topic-metadata">

**Author:** [@joropito](https://discuss.elastic.co/u/joropito)\
**Replies:** 7\
**Last updated:** [October 16, 2020, 4:19pm UTC](https://discuss.elastic.co/t/large-composite-agg-sorting/252126 "2020-10-16T16:19:21Z")

</div>

Composite aggregation doesn't work very well with bucket\_sort aggregation. I know this was talked and explained lot of times. My scenario works with a composite aggregation on few fields, some metrics inside (max, min,…

---

## [Date formatting yyyy.MM.dd](https://discuss.elastic.co/t/date-formatting-yyyy-mm-dd/251588)

<div class="topic-metadata">

**Author:** [@VeeT](https://discuss.elastic.co/u/VeeT)\
**Replies:** 6\
**Last updated:** [October 16, 2020, 3:26pm UTC](https://discuss.elastic.co/t/date-formatting-yyyy-mm-dd/251588 "2020-10-16T15:26:27Z")

</div>

I have a Date input in yyyy.MM.dd format but is getting converted to yyyy.MM.dd HH:mm:ss.ZZZ with the time getting set to "20:00:00.000". For example, the Date in put is "2020.10.09" but it's getting displayed in Kiban…

---

## [How to add "null" value in elastic search field if data is empty?](https://discuss.elastic.co/t/how-to-add-null-value-in-elastic-search-field-if-data-is-empty/247886)

<div class="topic-metadata">

**Author:** [@rifas\_ali\_pbi](https://discuss.elastic.co/u/rifas_ali_pbi)\
**Replies:** 3\
**Last updated:** [October 16, 2020, 3:26pm UTC](https://discuss.elastic.co/t/how-to-add-null-value-in-elastic-search-field-if-data-is-empty/247886 "2020-10-16T15:26:25Z")

</div>

---

## [Use an analyzer and a normalizer at the same time on the same field?](https://discuss.elastic.co/t/use-an-analyzer-and-a-normalizer-at-the-same-time-on-the-same-field/252356)

<div class="topic-metadata">

**Author:** [@Nicolas\_Rey](https://discuss.elastic.co/u/Nicolas_Rey)\
**Replies:** 3\
**Last updated:** [October 16, 2020, 2:51pm UTC](https://discuss.elastic.co/t/use-an-analyzer-and-a-normalizer-at-the-same-time-on-the-same-field/252356 "2020-10-16T14:51:15Z")

</div>

Hi, for some reason, if need to query (prefix) with an insensitive case on a text field, but I would like to keep the advantage of the tokenisation made by the default Analyzer on the same field, is it possible ? Examp…

---

## [How put 2 scripts in a watcher](https://discuss.elastic.co/t/how-put-2-scripts-in-a-watcher/252350)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 5\
**Last updated:** [October 16, 2020, 2:21pm UTC](https://discuss.elastic.co/t/how-put-2-scripts-in-a-watcher/252350 "2020-10-16T14:21:08Z")

</div>

hello how can i put 2 scripts in an alert? i have one that is from "ctx.payload.time\_triggered" and the other is for "metric.agg". i need help with this... { "trigger": { "schedule": { "interval": "1h" }…

---

## [Regarding Ingestion Exception](https://discuss.elastic.co/t/regarding-ingestion-exception/252230)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 2\
**Last updated:** [October 16, 2020, 2:09pm UTC](https://discuss.elastic.co/t/regarding-ingestion-exception/252230 "2020-10-16T14:09:08Z")

</div>

Hi, I'm seeing an exception during ingestion. Ingestion rates have fallen to very low rates for no apparent reason. Would appreciate some input here: \[2020-10-15T15:46:51,605\]\[WARN \]\[o.e.x.m.e.l.LocalExporter\] \[node-A\]…

---

## [Watcher with field query error](https://discuss.elastic.co/t/watcher-with-field-query-error/252059)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 1\
**Last updated:** [October 16, 2020, 1:59pm UTC](https://discuss.elastic.co/t/watcher-with-field-query-error/252059 "2020-10-16T13:59:52Z")

</div>

hello, I have a problem with a watcher, I need to find a field and is equal to the value I specify, but I get that is an unknown field and I need the "monitor.name.keyword" is equal to "01-1-CAV30328203-DATOS-PPAL-2.7G-9…

---

## [Trigger schedule without time intervals](https://discuss.elastic.co/t/trigger-schedule-without-time-intervals/252267)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 1\
**Last updated:** [October 16, 2020, 1:58pm UTC](https://discuss.elastic.co/t/trigger-schedule-without-time-intervals/252267 "2020-10-16T13:58:42Z")

</div>

hello, how can I make the trigger schedule run once and not have any time interval but only run once and already. { "trigger": { "schedule": { "interval": "1h" } }, "input": { "search": { "…

---

## [Watcher execution error](https://discuss.elastic.co/t/watcher-execution-error/252105)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 0\
**Last updated:** [October 14, 2020, 9:17pm UTC](https://discuss.elastic.co/t/watcher-execution-error/252105 "2020-10-14T21:17:07Z")

</div>

Good day I have a problem running a watcher, I get an execution error. { "watch\_id": "\_inlined\_", "node": "ELuSGxpSRICZb2ZHJp4paA", "state": "failed", "user": "elastic", "status": { "state": { "activ…

---

## [Watcher execution error](https://discuss.elastic.co/t/watcher-execution-error/252104)

<div class="topic-metadata">

**Author:** [@victor.vera](https://discuss.elastic.co/u/victor.vera)\
**Replies:** 1\
**Last updated:** [October 16, 2020, 1:56pm UTC](https://discuss.elastic.co/t/watcher-execution-error/252104 "2020-10-16T13:56:12Z")

</div>

Good day I have a problem running a watcher, I get an execution error. { "watch\_id": "\_inlined\_", "node": "ELuSGxpSRICZb2ZHJp4paA", "state": "failed", "user": "elastic", "status": { "state": { "activ…

---

## [Watcher's condition](https://discuss.elastic.co/t/watchers-condition/252268)

<div class="topic-metadata">

**Author:** [@victor.vera](https://discuss.elastic.co/u/victor.vera)\
**Replies:** 0\
**Last updated:** [October 15, 2020, 8:30pm UTC](https://discuss.elastic.co/t/watchers-condition/252268 "2020-10-15T20:30:35Z")

</div>

Hi, I need help in a watcher's condition: I don't know if a for or a while is useful: I need the following: I have a variable "summary.down" with two values 0 and 1, so I need it to be executed infinitely and when it ch…

---

## [Prefix query insensitive case : normalizer or analyzer ? (nest inside)](https://discuss.elastic.co/t/prefix-query-insensitive-case-normalizer-or-analyzer-nest-inside/252255)

<div class="topic-metadata">

**Author:** [@Nicolas\_Rey](https://discuss.elastic.co/u/Nicolas_Rey)\
**Replies:** 2\
**Last updated:** [October 16, 2020, 1:53pm UTC](https://discuss.elastic.co/t/prefix-query-insensitive-case-normalizer-or-analyzer-nest-inside/252255 "2020-10-16T13:53:43Z")

</div>

Hi, I get hard time to figure out which kind of settings should I use, my needs are basics, I got a text field (literally a phrase) that I should be able to query using a prefix ("start with") in an insensitive way. i…

---

## [Timestamp does not take the time zone](https://discuss.elastic.co/t/timestamp-does-not-take-the-time-zone/252082)

<div class="topic-metadata">

**Author:** [@victor.vera](https://discuss.elastic.co/u/victor.vera)\
**Replies:** 1\
**Last updated:** [October 16, 2020, 1:49pm UTC](https://discuss.elastic.co/t/timestamp-does-not-take-the-time-zone/252082 "2020-10-16T13:49:16Z")

</div>

I have a problem with the time stamp, I have the correct date, but the time is wrong, I have like 5 hours in advance, the date is correct but I do not know why I have another time of execution, I put the time zone but it…

---

## [I wanted to get some recommendations on tiered storage for Elasticsearch, I'm growing an on-premise instance and I'm looking at different options](https://discuss.elastic.co/t/i-wanted-to-get-some-recommendations-on-tiered-storage-for-elasticsearch-im-growing-an-on-premise-instance-and-im-looking-at-different-options/252357)

<div class="topic-metadata">

**Author:** [@Archie\_Crawford](https://discuss.elastic.co/u/Archie_Crawford)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 1:47pm UTC](https://discuss.elastic.co/t/i-wanted-to-get-some-recommendations-on-tiered-storage-for-elasticsearch-im-growing-an-on-premise-instance-and-im-looking-at-different-options/252357 "2020-10-16T13:47:59Z")

</div>

I wanted to get some recommendations on tiered storage for elasitcsearch, Im growing an on-premise instance and Im looking at different options.

---

## [How put 2 scripts in a watcher](https://discuss.elastic.co/t/how-put-2-scripts-in-a-watcher/252351)

<div class="topic-metadata">

**Author:** [@victor.vera](https://discuss.elastic.co/u/victor.vera)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 1:29pm UTC](https://discuss.elastic.co/t/how-put-2-scripts-in-a-watcher/252351 "2020-10-16T13:29:56Z")

</div>

hello how can i put 2 scripts in an alert? i have one that is from "ctx.payload.time\_triggered" and the other is for "metric.agg". i need help with this... { "trigger": { "schedule": { "interval": "1h" }…

---

## [Best way to tag a large amount of documents](https://discuss.elastic.co/t/best-way-to-tag-a-large-amount-of-documents/252211)

<div class="topic-metadata">

**Author:** [@LurenzZ](https://discuss.elastic.co/u/LurenzZ)\
**Replies:** 3\
**Last updated:** [October 16, 2020, 12:36pm UTC](https://discuss.elastic.co/t/best-way-to-tag-a-large-amount-of-documents/252211 "2020-10-16T12:36:24Z")

</div>

Hi all, This is my first question topic :slight\_smile: Me and my colleagues are trying to figure out the best way to manage tags on a bunch of documents. Our scenario is, many several devices that send data to elastic…

---

## [3-nodes License, Adding Unlicensed Nodes to the Cluster](https://discuss.elastic.co/t/3-nodes-license-adding-unlicensed-nodes-to-the-cluster/252122)

<div class="topic-metadata">

**Author:** [@lamp123432](https://discuss.elastic.co/u/lamp123432)\
**Replies:** 3\
**Last updated:** [October 16, 2020, 12:34pm UTC](https://discuss.elastic.co/t/3-nodes-license-adding-unlicensed-nodes-to-the-cluster/252122 "2020-10-16T12:34:38Z")

</div>

Hello, I want to purchase a 3-nodes license. What will happen if I add unlicensed data nodes to the cluster? Will commercial features be enabled for some nodes or indices, but not for others?

---

## [Looking for examples of the native minhash being used for near duplicate detection](https://discuss.elastic.co/t/looking-for-examples-of-the-native-minhash-being-used-for-near-duplicate-detection/252336)

<div class="topic-metadata">

**Author:** [@Ola\_Gustafsson1](https://discuss.elastic.co/u/Ola_Gustafsson1)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 11:20am UTC](https://discuss.elastic.co/t/looking-for-examples-of-the-native-minhash-being-used-for-near-duplicate-detection/252336 "2020-10-16T11:20:02Z")

</div>

Following the documentation examples, I have mapped a text field for minhashing of shingles. Using it in a more-like-this query does work, but, as the documentation says, I'd like to use it for Jaccard similarity and ret…

---

## [Delete by Query and Refresh Interval](https://discuss.elastic.co/t/delete-by-query-and-refresh-interval/251633)

<div class="topic-metadata">

**Author:** [@gavinlee](https://discuss.elastic.co/u/gavinlee)\
**Replies:** 6\
**Last updated:** [October 16, 2020, 8:54am UTC](https://discuss.elastic.co/t/delete-by-query-and-refresh-interval/251633 "2020-10-16T08:54:44Z")

</div>

Hi, I have a situation where I take the following steps retrieve lock delete by query refresh insert documents release lock These steps could happen in quick succession. The delete by query is supposed to find all the…

---

## [ES busy : Hot thread and xpack.monitoring.exporter full errors](https://discuss.elastic.co/t/es-busy-hot-thread-and-xpack-monitoring-exporter-full-errors/252090)

<div class="topic-metadata">

**Author:** [@Beuhlet\_Reseau](https://discuss.elastic.co/u/Beuhlet_Reseau)\
**Replies:** 9\
**Last updated:** [October 16, 2020, 8:27am UTC](https://discuss.elastic.co/t/es-busy-hot-thread-and-xpack-monitoring-exporter-full-errors/252090 "2020-10-16T08:27:32Z")

</div>

Hello, I see many errors in hot thread API. Overview Version: 5.5.1 Uptime: 13 days Nodes: 60 Disk Available: 247TB / 413TB (59.74%) JVM Heap: 68.38% (1TB / 2TB) Indices: 2,857 Documents: 24,414,223,409 Disk Usage:…

---

## [Slow force merge after 7.5.0 -\> 7.9.1 upgrade](https://discuss.elastic.co/t/slow-force-merge-after-7-5-0-7-9-1-upgrade/252311)

<div class="topic-metadata">

**Author:** [@Dmitry1](https://discuss.elastic.co/u/Dmitry1)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 7:30am UTC](https://discuss.elastic.co/t/slow-force-merge-after-7-5-0-7-9-1-upgrade/252311 "2020-10-16T07:30:29Z")

</div>

Hello, I've upgraded elastic from 7.5.0 -\> 7.9.1 and notice, that force merge time for my daily index increased more than twice! I don't change any setting. Script do force merge like this : set this index parameters: …

---

## [Geo Distance Search on Geo Shape with distance returned](https://discuss.elastic.co/t/geo-distance-search-on-geo-shape-with-distance-returned/252212)

<div class="topic-metadata">

**Author:** [@DavidBokor](https://discuss.elastic.co/u/DavidBokor)\
**Replies:** 5\
**Last updated:** [October 16, 2020, 6:21am UTC](https://discuss.elastic.co/t/geo-distance-search-on-geo-shape-with-distance-returned/252212 "2020-10-16T06:21:26Z")

</div>

Based on the discussion here it looks like searching by distance on a geo shape field is supported as of v7.7.0. I'm using 7.9 and getting an error. I have two indices, one points and one polygons. I have no problem doi…

---

## [6-nodes cluster with uneven disk space](https://discuss.elastic.co/t/6-nodes-cluster-with-uneven-disk-space/252290)

<div class="topic-metadata">

**Author:** [@lamp123432](https://discuss.elastic.co/u/lamp123432)\
**Replies:** 0\
**Last updated:** [October 16, 2020, 3:42am UTC](https://discuss.elastic.co/t/6-nodes-cluster-with-uneven-disk-space/252290 "2020-10-16T03:42:34Z")

</div>

Hello, I have 6 nodes in my cluster as follows: 2x 10TB disk space (masters + data nodes) 4x 100TB disk space (data nodes only) Most of my data is sent to the 2 masters with 10TB, will Elasticsearch make use of the re…

---

## [Upgrade Elasticsearch](https://discuss.elastic.co/t/upgrade-elasticsearch/250491)

<div class="topic-metadata">

**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\
**Replies:** 9\
**Last updated:** [October 16, 2020, 1:33am UTC](https://discuss.elastic.co/t/upgrade-elasticsearch/250491 "2020-10-16T01:33:28Z")

</div>

Hello Team, Currently we are using Elasticsaerch 6.4 and all the other stack part like kibana, logstash and beats also have versio 6.4 But now we want to use the some security feature like Role-based access control for…

---

## [Watcher, Transform UTC timestamp on the payload to local time](https://discuss.elastic.co/t/watcher-transform-utc-timestamp-on-the-payload-to-local-time/252281)

<div class="topic-metadata">

**Author:** [@victor.vera](https://discuss.elastic.co/u/victor.vera)\
**Replies:** 0\
**Last updated:** [October 15, 2020, 10:23pm UTC](https://discuss.elastic.co/t/watcher-transform-utc-timestamp-on-the-payload-to-local-time/252281 "2020-10-15T22:23:46Z")

</div>

I'm trying to convert the time to my local time, but I get an error, I need to send to the mail the real time which is GMT-5 America/Bogota { "trigger": { "schedule": { "interval": "1h" } }, "input":…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=783)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=785)
