# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=697 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 698 --- ## [Aggregation - Multiplication of multiple nested fields and sum](https://discuss.elastic.co/t/aggregation-multiplication-of-multiple-nested-fields-and-sum/265199)
**Author:** [@krishnapss](https://discuss.elastic.co/u/krishnapss)\ **Replies:** 0\ **Last updated:** [February 23, 2021, 11:50am UTC](https://discuss.elastic.co/t/aggregation-multiplication-of-multiple-nested-fields-and-sum/265199 "2021-02-23T11:50:40Z")
Hi, Could you please help me to solve this problem. Really appreciate your help. I want to multiply and sum of two properties (or fields). One is from main object and another one is from nested object. History object c… --- ## [Elasticsearch WARN : Failed to update shard information for ClusterInfoUpdateJob within 15s timeout](https://discuss.elastic.co/t/elasticsearch-warn-failed-to-update-shard-information-for-clusterinfoupdatejob-within-15s-timeout/265192)
**Author:** [@Farzad\_Ebrahimi](https://discuss.elastic.co/u/Farzad_Ebrahimi)\ **Replies:** 0\ **Last updated:** [February 23, 2021, 11:06am UTC](https://discuss.elastic.co/t/elasticsearch-warn-failed-to-update-shard-information-for-clusterinfoupdatejob-within-15s-timeout/265192 "2021-02-23T11:06:27Z")
Hi every one, i am running elasticsearch 7.10 on windows server 2016. elasticsearch installed as a service and worked well. but in elastic logs i see this warnings: \[2021-02-23T13:12:06,472\]\[WARN \]\[o.e.c.InternalCluste… --- ## [High availability of system indices: how-to mitigate system index failures](https://discuss.elastic.co/t/high-availability-of-system-indices-how-to-mitigate-system-index-failures/265082)
**Author:** [@bertr](https://discuss.elastic.co/u/bertr)\ **Replies:** 5\ **Last updated:** [February 23, 2021, 10:23am UTC](https://discuss.elastic.co/t/high-availability-of-system-indices-how-to-mitigate-system-index-failures/265082 "2021-02-23T10:23:10Z")
I notice that system indices in Elasticsearch have "index.number\_of\_replicas": "0" and this cannot be updated. Is there a reason why this cannot be set to 1 (or more) and how safe is it to have no replicas for system ind… --- ## [Sorting based on scripted metrics aggregation](https://discuss.elastic.co/t/sorting-based-on-scripted-metrics-aggregation/262384)
**Author:** [@Abbass](https://discuss.elastic.co/u/Abbass)\ **Replies:** 2\ **Last updated:** [February 23, 2021, 9:45am UTC](https://discuss.elastic.co/t/sorting-based-on-scripted-metrics-aggregation/262384 "2021-02-23T09:45:25Z")
Hello! I faced a limitation on sorting buckets of a term aggrigation, based on a scripted metrics sub aggregation values. This issue clearly states that it is not possible to do this in elasticsearch. However, i mana… --- ## [Elasticsearch terms query is very slow?](https://discuss.elastic.co/t/elasticsearch-terms-query-is-very-slow/265169)
**Author:** [@Karthick\_K](https://discuss.elastic.co/u/Karthick_K)\ **Replies:** 5\ **Last updated:** [February 23, 2021, 9:24am UTC](https://discuss.elastic.co/t/elasticsearch-terms-query-is-very-slow/265169 "2021-02-23T09:24:25Z")
Elasticsearch cluster Master node : 1 (16cpus, 128GB RAM) - 32GB is allocated for HEAP Data nodes : 6 (each node 16cpus, 128GB RAM) - 32GB is allocated for HEAP for all nodes Indices : 9 Total documents : 48,826,456… --- ## [Query to return a result set bounded by a fixed number of zeros (no rainfall)](https://discuss.elastic.co/t/query-to-return-a-result-set-bounded-by-a-fixed-number-of-zeros-no-rainfall/264992)
**Author:** [@rosselton](https://discuss.elastic.co/u/rosselton)\ **Replies:** 3\ **Last updated:** [February 23, 2021, 9:03am UTC](https://discuss.elastic.co/t/query-to-return-a-result-set-bounded-by-a-fixed-number-of-zeros-no-rainfall/264992 "2021-02-23T09:03:05Z")
I'm using ES to store rainfall data from a weather API that updates every 10 minutes. I'm trying to write a query to return a set of records where a spell of dry weather ( 30 consecutive rain values in the range of 0 to … --- ## [Update items in a rolled-over index](https://discuss.elastic.co/t/update-items-in-a-rolled-over-index/265087)
**Author:** [@Jorge\_Ruiz](https://discuss.elastic.co/u/Jorge_Ruiz)\ **Replies:** 6\ **Last updated:** [February 23, 2021, 8:37am UTC](https://discuss.elastic.co/t/update-items-in-a-rolled-over-index/265087 "2021-02-23T08:37:51Z")
Hi there! A quick and simple question related to rolled-over indexes. Is it a good approach to have a rollover index if, eventually, we want to update items that belong to an already completed index (rolled-over)? As f… --- ## [Terminate\_after with aggregation](https://discuss.elastic.co/t/terminate-after-with-aggregation/265179)
**Author:** [@dobkum](https://discuss.elastic.co/u/dobkum)\ **Replies:** 0\ **Last updated:** [February 23, 2021, 8:32am UTC](https://discuss.elastic.co/t/terminate-after-with-aggregation/265179 "2021-02-23T08:32:52Z")
I want to know how aggregation behaves when combined with terminate\_after. Is it that first the aggregations are performed from records belonging to all shards and then terminate\_after setting are applied or first the… --- ## [Transformed index is missing data](https://discuss.elastic.co/t/transformed-index-is-missing-data/264725)
**Author:** [@kazuki](https://discuss.elastic.co/u/kazuki)\ **Replies:** 3\ **Last updated:** [February 23, 2021, 8:20am UTC](https://discuss.elastic.co/t/transformed-index-is-missing-data/264725 "2021-02-23T08:20:53Z")
We have a transform that creates aggregation based on userId and clientID from a source index and write to a destination index. We've noticed the destination index is missing data it should have even after waiting 10+ mi… --- ## [Memory lock check on Elastic Cloud](https://discuss.elastic.co/t/memory-lock-check-on-elastic-cloud/264867)
**Author:** [@val](https://discuss.elastic.co/u/val)\ **Replies:** 7\ **Last updated:** [February 23, 2021, 7:41am UTC](https://discuss.elastic.co/t/memory-lock-check-on-elastic-cloud/264867 "2021-02-23T07:41:52Z")
I'm curious how it is possible that a cluster on Elastic Cloud passes the memory lock bootstrap check even though the memory doesn't seem to be locked. Here is the mlockall state on all nodes GET \_nodes?filter\_path=\*\*.… --- ## [Java high-level REST client fails to connect over https](https://discuss.elastic.co/t/java-high-level-rest-client-fails-to-connect-over-https/264911)
**Author:** [@shivkumar.chelwa](https://discuss.elastic.co/u/shivkumar.chelwa)\ **Replies:** 1\ **Last updated:** [February 23, 2021, 3:44am UTC](https://discuss.elastic.co/t/java-high-level-rest-client-fails-to-connect-over-https/264911 "2021-02-23T03:44:10Z")
Hi, I am trying to connect Elastic over https using high-level REST client. But the clients fails with below exception. java.io.IOException: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter m… --- ## [Permissions on $ES\_HOME](https://discuss.elastic.co/t/permissions-on-es-home/265142)
**Author:** [@zellamsee](https://discuss.elastic.co/u/zellamsee)\ **Replies:** 1\ **Last updated:** [February 23, 2021, 2:19am UTC](https://discuss.elastic.co/t/permissions-on-es-home/265142 "2021-02-23T02:19:07Z")
Hello, We've installed the elasticsearch on linux via the .tar.gz archive. I was wondering what the permissions on this $ES\_HOME directory and it's subdirectories are suppose to be? I have set up and elasticsearch us… --- ## [Watcher webhook acked](https://discuss.elastic.co/t/watcher-webhook-acked/265137)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 11:45pm UTC](https://discuss.elastic.co/t/watcher-webhook-acked/265137 "2021-02-22T23:45:19Z")
Hi! guys i need your help with this... I am using the webhook api in a watcher, in my elasticcloud, but I get the following error: { "watch\_id": "aeffa60d-1eca-40c6-a35d-4dcfc7e450f7", "node": "ELuSGxpSRICZb2ZHJp4… --- ## [Active Directory user authentication](https://discuss.elastic.co/t/active-directory-user-authentication/265053)
**Author:** [@AayushPatel](https://discuss.elastic.co/u/AayushPatel)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 11:31pm UTC](https://discuss.elastic.co/t/active-directory-user-authentication/265053 "2021-02-22T23:31:21Z")
Hi, we need to use Elasticsearch authentication for our users in DC (Active Directory). Due to the instructs in link below: https://www.elastic.co/guide/en/elasticsearch/reference/7.11/active-directory-realm.html I a… --- ## [How to move data in a ingest node to data node](https://discuss.elastic.co/t/how-to-move-data-in-a-ingest-node-to-data-node/265102)
**Author:** [@testsemd\_email](https://discuss.elastic.co/u/testsemd_email)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 11:25pm UTC](https://discuss.elastic.co/t/how-to-move-data-in-a-ingest-node-to-data-node/265102 "2021-02-22T23:25:26Z")
Hi, I have a cluster with 4 nodes. node1-master node2-master node3-ingest noode4-data Now ingest node fully filled with data and can not start elasticsearch service. I want to move data from ingest node to the dat… --- ## [Having trouble with field mappings types](https://discuss.elastic.co/t/having-trouble-with-field-mappings-types/265109)
**Author:** [@lostsoul352](https://discuss.elastic.co/u/lostsoul352)\ **Replies:** 4\ **Last updated:** [February 22, 2021, 10:56pm UTC](https://discuss.elastic.co/t/having-trouble-with-field-mappings-types/265109 "2021-02-22T22:56:46Z")
ELK stack 7.11 I'm having some trouble getting my field mappings types. This is a snippet of my logstash configuration which I've added to include some new fields into an index. if \[log\_message\] =~ /TP status:/… --- ## [Using Ultrawarm storage on AWS ElasticSearch](https://discuss.elastic.co/t/using-ultrawarm-storage-on-aws-elasticsearch/265121)
**Author:** [@codejunkie78](https://discuss.elastic.co/u/codejunkie78)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 10:44pm UTC](https://discuss.elastic.co/t/using-ultrawarm-storage-on-aws-elasticsearch/265121 "2021-02-22T22:44:36Z")
I have a long lived index on ElasticSearch for eg. events which is not partitioned by time. I can store about 3 months data in hot storage. After that I want to move it to warm. If I migrate the entire index to warm, do … --- ## [Field length and average field lengths BM25](https://discuss.elastic.co/t/field-length-and-average-field-lengths-bm25/265105)
**Author:** [@d3v3lop3r](https://discuss.elastic.co/u/d3v3lop3r)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 7:39pm UTC](https://discuss.elastic.co/t/field-length-and-average-field-lengths-bm25/265105 "2021-02-22T19:39:36Z")
I dont quite understand the forumula of the BM25 explained here: What is menat by the field length? --- ## [Pipeline: field \[evidence\] not present as part of path \[threatintel.evidence\]](https://discuss.elastic.co/t/pipeline-field-evidence-not-present-as-part-of-path-threatintel-evidence/263008)
**Author:** [@remote](https://discuss.elastic.co/u/remote)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 6:14pm UTC](https://discuss.elastic.co/t/pipeline-field-evidence-not-present-as-part-of-path-threatintel-evidence/263008 "2021-02-22T18:14:10Z")
Hi, I have an issue when trying to ingest data from a CSV file via Logstash to Elasticsearch. My data contains a nested JSON object (array) that I want to properly parse using the JSON processor in the ingest pipeline. … --- ## [Elastic search migration from 6.4 to 7.10](https://discuss.elastic.co/t/elastic-search-migration-from-6-4-to-7-10/265091)
**Author:** [@jerin](https://discuss.elastic.co/u/jerin)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 5:44pm UTC](https://discuss.elastic.co/t/elastic-search-migration-from-6-4-to-7-10/265091 "2021-02-22T17:44:14Z")
Hello team , By seeing the upgrade strategy from ELK docs I can directly upgrade from 6.4 to 7.10 but if I do so I am facing an issue "incompatible version " is that I need to upgrade from 6.4 to 6.8 and then to 7.10 ? … --- ## [Strings to numerics](https://discuss.elastic.co/t/strings-to-numerics/265090)
**Author:** [@Marc2](https://discuss.elastic.co/u/Marc2)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 4:46pm UTC](https://discuss.elastic.co/t/strings-to-numerics/265090 "2021-02-22T16:46:23Z")
Hello community! I am new at this and my problem is the following: I am trying to use some .csv files to represent data in Kibana, and to do that i am using the code i found on this web: https://alexmarquardt.com/2020/… --- ## [Failed to enable security by setting \[xpack.security.enabled\] to \[true\] in the elasticsearch.yml](https://discuss.elastic.co/t/failed-to-enable-security-by-setting-xpack-security-enabled-to-true-in-the-elasticsearch-yml/264554)
**Author:** [@haithem899](https://discuss.elastic.co/u/haithem899)\ **Replies:** 4\ **Last updated:** [February 22, 2021, 4:08pm UTC](https://discuss.elastic.co/t/failed-to-enable-security-by-setting-xpack-security-enabled-to-true-in-the-elasticsearch-yml/264554 "2021-02-22T16:08:48Z")
Hello, I'm trying to enable security by setting \[xpack.security.enabled\] to \[true\] in the elasticsearch.yml but after this action, the elasticsearch service failed to start. have you any idea to rsolve this issue? thank… --- ## [Mapping use dynamic strict](https://discuss.elastic.co/t/mapping-use-dynamic-strict/264957)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 7\ **Last updated:** [February 22, 2021, 4:03pm UTC](https://discuss.elastic.co/t/mapping-use-dynamic-strict/264957 "2021-02-22T16:03:07Z")
I am trying to test out this feature but not getting what I want for example PUT \_index\_template/sachin\_quick\_test { "index\_patterns": \["sachin\_quick\_test-\*"\], "template": { "settings": { "number\_of\_shard… --- ## [ILM - Index size doubles during shrink process](https://discuss.elastic.co/t/ilm-index-size-doubles-during-shrink-process/265019)
**Author:** [@vee](https://discuss.elastic.co/u/vee)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 3:38pm UTC](https://discuss.elastic.co/t/ilm-index-size-doubles-during-shrink-process/265019 "2021-02-22T15:38:40Z")
Hi - I've noticed the index size when moved from hot to warm phase doubles up before shrinking in size. Just curious to know if this is the expected behavior and if there is a way to avoid the doubling up part of that f… --- ## [How can I index HTML tags](https://discuss.elastic.co/t/how-can-i-index-html-tags/265078)
**Author:** [@peterbe](https://discuss.elastic.co/u/peterbe)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 3:09pm UTC](https://discuss.elastic.co/t/how-can-i-index-html-tags/265078 "2021-02-22T15:09:27Z")
I use the standard tokenizer and I don't use the html\_strip char filter. How can I index HTML tags? In fact, I want to be able to search with and without the \< and \> characters. I.e. a search for \ should match… --- ## [Elastic machine learning on a different node but same server](https://discuss.elastic.co/t/elastic-machine-learning-on-a-different-node-but-same-server/264314)
**Author:** [@Waxman](https://discuss.elastic.co/u/Waxman)\ **Replies:** 5\ **Last updated:** [February 22, 2021, 3:03pm UTC](https://discuss.elastic.co/t/elastic-machine-learning-on-a-different-node-but-same-server/264314 "2021-02-22T15:03:50Z")
Hi, I'm thinking about running two containers: elasticsearch master/data/ingest/ node -\> container A elasticsearch machine learning -\> container B but they must run on the same server. I think there might be two appr… --- ## [Aggregations: sort by mutliple terms](https://discuss.elastic.co/t/aggregations-sort-by-mutliple-terms/265081)
**Author:** [@Douglas\_Leister](https://discuss.elastic.co/u/Douglas_Leister)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 2:38pm UTC](https://discuss.elastic.co/t/aggregations-sort-by-mutliple-terms/265081 "2021-02-22T14:38:04Z")
I have a mapping of businesses, for which I am using an aggregation to calculate average ratings for the businesses grouped by business id. Sorting the aggregation by business id or average rating works fine. My issue… --- ## [Reading from specific index under alias](https://discuss.elastic.co/t/reading-from-specific-index-under-alias/265079)
**Author:** [@b\_bal](https://discuss.elastic.co/u/b_bal)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 2:35pm UTC](https://discuss.elastic.co/t/reading-from-specific-index-under-alias/265079 "2021-02-22T14:35:17Z")
Hello! I have different indices named myindex-. Every night a new index is created(with a different number), so we use an alias(myalias) to keep track of the index that contains the most recent documents. Under that al… --- ## [Help me understand Elasticsearch structure](https://discuss.elastic.co/t/help-me-understand-elasticsearch-structure/264859)
**Author:** [@butaminas](https://discuss.elastic.co/u/butaminas)\ **Replies:** 5\ **Last updated:** [February 22, 2021, 2:31pm UTC](https://discuss.elastic.co/t/help-me-understand-elasticsearch-structure/264859 "2021-02-22T14:31:57Z")
I'm new to Elasticsearch and I've been reading and playing around with it a lot lately but I still can't understand one thing and am hoping to find the answer here. From my understanding, Elasticsearch is not something … --- ## [Elasticsearch not starting after UID and GID change](https://discuss.elastic.co/t/elasticsearch-not-starting-after-uid-and-gid-change/265054)
**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\ **Replies:** 6\ **Last updated:** [February 22, 2021, 2:31pm UTC](https://discuss.elastic.co/t/elasticsearch-not-starting-after-uid-and-gid-change/265054 "2021-02-22T14:31:23Z")
Hello! I have a cluster of 2 nodes and I wanted to do the snapshot by setting up the NFS server and a directory as the repository. I had read that all nodes should have the same UID and GID. Thus, I changed them using co… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=696) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=698)