# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=831

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 832

---

## [What is going to happen for query/indexing requests sent to master node](https://discuss.elastic.co/t/what-is-going-to-happen-for-query-indexing-requests-sent-to-master-node/245475)

<div class="topic-metadata">

**Author:** [@junhuangli](https://discuss.elastic.co/u/junhuangli)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 9:02pm UTC](https://discuss.elastic.co/t/what-is-going-to-happen-for-query-indexing-requests-sent-to-master-node/245475 "2020-08-18T21:02:19Z")

</div>

We have an elastic-search cluster with 3 data nodes and 3 master nodes. When using it, all traffic(query+indexing) are sent to master nodes in round robin right now. After reading docs, I believe we should change it to …

---

## [Is it safe to rename node in ES 6.8?](https://discuss.elastic.co/t/is-it-safe-to-rename-node-in-es-6-8/245482)

<div class="topic-metadata">

**Author:** [@tarkhil](https://discuss.elastic.co/u/tarkhil)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 8:56pm UTC](https://discuss.elastic.co/t/is-it-safe-to-rename-node-in-es-6-8/245482 "2020-08-18T20:56:35Z")

</div>

Hello I've googled on the topic but everything I've found is dated 2015; many things could change since that time. So I'm reasking, is it safe to rename node in 6.8? If the node was already in use, should I do somethin…

---

## [Configure Delete indices based on size index lifecycle management Policy Elastic search](https://discuss.elastic.co/t/configure-delete-indices-based-on-size-index-lifecycle-management-policy-elastic-search/245348)

<div class="topic-metadata">

**Author:** [@Darshan\_Kamat](https://discuss.elastic.co/u/Darshan_Kamat)\
**Replies:** 8\
**Last updated:** [August 18, 2020, 8:39pm UTC](https://discuss.elastic.co/t/configure-delete-indices-based-on-size-index-lifecycle-management-policy-elastic-search/245348 "2020-08-18T20:39:52Z")

</div>

Version : ES 7.6.0 I have elastic search set up with filebeat for pulling up logs and rollover configured with index policy(ILM) . I have 2 phases configured : HOT and DELETE. In the delete phase for index policy there i…

---

## [About Key In Elastic Search](https://discuss.elastic.co/t/about-key-in-elastic-search/245292)

<div class="topic-metadata">

**Author:** [@laritza](https://discuss.elastic.co/u/laritza)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 7:43pm UTC](https://discuss.elastic.co/t/about-key-in-elastic-search/245292 "2020-08-18T19:43:26Z")

</div>

Good morning I have read some articles about Installing Elastic Search because I am new with this tool and when I am installing this software because I am doing step by step for example i am trying putting the url for pu…

---

## [Execution order of multiple indexes during \_reindex call](https://discuss.elastic.co/t/execution-order-of-multiple-indexes-during-reindex-call/244682)

<div class="topic-metadata">

**Author:** [@anitabee](https://discuss.elastic.co/u/anitabee)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 7:32pm UTC](https://discuss.elastic.co/t/execution-order-of-multiple-indexes-during-reindex-call/244682 "2020-08-18T19:32:13Z")

</div>

Hi all :wave:, During \_reindex call, if I specify remote source from multiple indexes, In which order are those indexes going to be processed? I saw in documentation that there was sort option in reindex but it is depr…

---

## [Increasing Throughput Until My Servers Catch Fire](https://discuss.elastic.co/t/increasing-throughput-until-my-servers-catch-fire/244900)

<div class="topic-metadata">

**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\
**Replies:** 19\
**Last updated:** [August 14, 2020, 4:19pm UTC](https://discuss.elastic.co/t/increasing-throughput-until-my-servers-catch-fire/244900 "2020-08-14T16:19:08Z")

</div>

I'm curious about settings that will increase my index rate, at the risk of losing data in the event of hardware corruption or similar. My datanodes are heavily CPU-constrained, so anything I can do to reduce the CPU loa…

---

## [Elastic Search query on multiple fields in terms lookup](https://discuss.elastic.co/t/elastic-search-query-on-multiple-fields-in-terms-lookup/245342)

<div class="topic-metadata">

**Author:** [@santoshk](https://discuss.elastic.co/u/santoshk)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 7:07pm UTC](https://discuss.elastic.co/t/elastic-search-query-on-multiple-fields-in-terms-lookup/245342 "2020-08-18T19:07:52Z")

</div>

Hello experts and fellow elastic enthusiasts, Am a beginner to elastic search and working on writing a search query which filters data from one index by using data from another index (am using terms lookup to achieve it…

---

## [How to get most recent reading from two different documents in an index/machine](https://discuss.elastic.co/t/how-to-get-most-recent-reading-from-two-different-documents-in-an-index-machine/243247)

<div class="topic-metadata">

**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 5:37pm UTC](https://discuss.elastic.co/t/how-to-get-most-recent-reading-from-two-different-documents-in-an-index-machine/243247 "2020-08-18T17:37:51Z")

</div>

I have a machine that sends me temperature metrics that I'm pulling from two different files on that machine with filebeat. I'm trying to get some sort of current status of all the metrics of the machine in a query, and …

---

## [How to manage Security Certificates on native cloud environment?](https://discuss.elastic.co/t/how-to-manage-security-certificates-on-native-cloud-environment/245411)

<div class="topic-metadata">

**Author:** [@Wasantha\_Herath](https://discuss.elastic.co/u/Wasantha_Herath)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 3:21pm UTC](https://discuss.elastic.co/t/how-to-manage-security-certificates-on-native-cloud-environment/245411 "2020-08-18T15:21:21Z")

</div>

Does native elastic cloud - https://www.elastic.co/cloud/ provides facilities to manage certificates files manually as it does on Elastic Cloud Enterprise ? I have launched an elastic cloud using this https://www.elast…

---

## [Getting 404 shard\_not\_found\_exception frequently](https://discuss.elastic.co/t/getting-404-shard-not-found-exception-frequently/245033)

<div class="topic-metadata">

**Author:** [@ravib](https://discuss.elastic.co/u/ravib)\
**Replies:** 3\
**Last updated:** [August 18, 2020, 3:06pm UTC](https://discuss.elastic.co/t/getting-404-shard-not-found-exception-frequently/245033 "2020-08-18T15:06:28Z")

</div>

I have an index with 2 replicas and 1 shard on a 3 node elastic search server (7.6.1). On bulk requests (index) I keep getting shard\_not\_found\_exception, any thoughts?

---

## [Replacing timestamp field null value with constant date value through ingest pipeline](https://discuss.elastic.co/t/replacing-timestamp-field-null-value-with-constant-date-value-through-ingest-pipeline/245409)

<div class="topic-metadata">

**Author:** [@InfiniteDreamer](https://discuss.elastic.co/u/InfiniteDreamer)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 2:17pm UTC](https://discuss.elastic.co/t/replacing-timestamp-field-null-value-with-constant-date-value-through-ingest-pipeline/245409 "2020-08-18T14:17:00Z")

</div>

We want to know the possibilities of replaing a null valued field with connstant value suplied in ingest pipeline. We are pushing data to elasticsearch where we have field salesdate in all docs and it may be null in fe…

---

## [Watermark floodstage not stopping usage of diskspace](https://discuss.elastic.co/t/watermark-floodstage-not-stopping-usage-of-diskspace/245415)

<div class="topic-metadata">

**Author:** [@Darshan\_Kamat](https://discuss.elastic.co/u/Darshan_Kamat)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 1:56pm UTC](https://discuss.elastic.co/t/watermark-floodstage-not-stopping-usage-of-diskspace/245415 "2020-08-18T13:56:14Z")

</div>

I have 1 node cluster where flood stage watermark is breached but it seems ES is still occupying data .Is this correct ? PFB my logs : \[2020-05-30T06:18:44,774\]\[WARN \]\[o.e.c.r.a.DiskThresholdMonitor\] \[elastic\_226\] flo…

---

## [Best method for exact matches only](https://discuss.elastic.co/t/best-method-for-exact-matches-only/245300)

<div class="topic-metadata">

**Author:** [@blewis1337](https://discuss.elastic.co/u/blewis1337)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 1:54pm UTC](https://discuss.elastic.co/t/best-method-for-exact-matches-only/245300 "2020-08-18T13:54:27Z")

</div>

We currently use elastic search for our magento storefront. We are a B2B style company and our customers search for very specific terms and skus when using our site. We have set all our items up with a number of meta\_key…

---

## [Simple watcher syntax help](https://discuss.elastic.co/t/simple-watcher-syntax-help/245426)

<div class="topic-metadata">

**Author:** [@Fredrik\_Cronholm](https://discuss.elastic.co/u/Fredrik_Cronholm)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 1:48pm UTC](https://discuss.elastic.co/t/simple-watcher-syntax-help/245426 "2020-08-18T13:48:07Z")

</div>

Hi! I trying my first watcher, and being a newbie I have trouble with the basics. I'd like to filter out the events for the last 10 minutes, but somewhere I have made (I suppose) a simple syntax error. Anyone can point…

---

## [Unable to install repository-gcs plugin through Kubernetes startup script](https://discuss.elastic.co/t/unable-to-install-repository-gcs-plugin-through-kubernetes-startup-script/245432)

<div class="topic-metadata">

**Author:** [@Vinoth\_Kumarasamy](https://discuss.elastic.co/u/Vinoth_Kumarasamy)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 1:46pm UTC](https://discuss.elastic.co/t/unable-to-install-repository-gcs-plugin-through-kubernetes-startup-script/245432 "2020-08-18T13:46:08Z")

</div>

Hi, We have existing elasticsearch cluster(6 nodes) running on GKE. I am trying to create backup repository for creating backup snapshot https://www.elastic.co/guide/en/elasticsearch/plugins/7.8/repository-gcs.html We …

---

## [Merging transform indices to create new summary index](https://discuss.elastic.co/t/merging-transform-indices-to-create-new-summary-index/244720)

<div class="topic-metadata">

**Author:** [@InfiniteDreamer](https://discuss.elastic.co/u/InfiniteDreamer)\
**Replies:** 5\
**Last updated:** [August 18, 2020, 1:39pm UTC](https://discuss.elastic.co/t/merging-transform-indices-to-create-new-summary-index/244720 "2020-08-18T13:39:36Z")

</div>

we want to create a summary transform index from two main index named salesdata and visitdata respectively,both indices mapping is different where CustomerCode is like primary key present in both index. SalesData index…

---

## [Is there a Multi-node small cluster in Elasticsearch Service (cloud) planned for future?](https://discuss.elastic.co/t/is-there-a-multi-node-small-cluster-in-elasticsearch-service-cloud-planned-for-future/245042)

<div class="topic-metadata">

**Author:** [@ojasp](https://discuss.elastic.co/u/ojasp)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 1:27pm UTC](https://discuss.elastic.co/t/is-there-a-multi-node-small-cluster-in-elasticsearch-service-cloud-planned-for-future/245042 "2020-08-18T13:27:08Z")

</div>

We have a 3-node cluster running on Linux servers with 8GB memory per server. When configuring cluster in elastic cloud, there is no option for multiple nodes until you get to 58GB per node, which is cost-prohibitive for…

---

## [How can a heavily nested JSON data structure be displayed/searched in Elasticsearch](https://discuss.elastic.co/t/how-can-a-heavily-nested-json-data-structure-be-displayed-searched-in-elasticsearch/245423)

<div class="topic-metadata">

**Author:** [@siiman](https://discuss.elastic.co/u/siiman)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 1:08pm UTC](https://discuss.elastic.co/t/how-can-a-heavily-nested-json-data-structure-be-displayed-searched-in-elasticsearch/245423 "2020-08-18T13:08:35Z")

</div>

Hello, everyone, I would like to know in general how a nested JSON data structure can most effectively be imported into Elasticsearch. I have read some posts on this topic and also tried the approaches with parent/chil…

---

## [Sort on term sub aggregation field](https://discuss.elastic.co/t/sort-on-term-sub-aggregation-field/245313)

<div class="topic-metadata">

**Author:** [@imran1](https://discuss.elastic.co/u/imran1)\
**Replies:** 3\
**Last updated:** [August 18, 2020, 11:46am UTC](https://discuss.elastic.co/t/sort-on-term-sub-aggregation-field/245313 "2020-08-18T11:46:35Z")

</div>

Suppose I have the following query: { "aggs": { "distinct\_part": { "terms": { "field": "part", "size": 1000 } }, "aggs": { "distinct\_manufacturer": { "terms": { …

---

## [What makes ES not support rollbacks?](https://discuss.elastic.co/t/what-makes-es-not-support-rollbacks/245392)

<div class="topic-metadata">

**Author:** [@jbaker](https://discuss.elastic.co/u/jbaker)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 11:28am UTC](https://discuss.elastic.co/t/what-makes-es-not-support-rollbacks/245392 "2020-08-18T11:28:29Z")

</div>

A number of documents are clear that it's possible to upgrade from one ES version to the next, but not downgrade. I'm wondering what the causes of this are? I assume there's a necessary forwards compatibility guarantee b…

---

## [Auth to ECK using Azure AAD SAML failing](https://discuss.elastic.co/t/auth-to-eck-using-azure-aad-saml-failing/245275)

<div class="topic-metadata">

**Author:** [@damjank](https://discuss.elastic.co/u/damjank)\
**Replies:** 8\
**Last updated:** [August 18, 2020, 11:00am UTC](https://discuss.elastic.co/t/auth-to-eck-using-azure-aad-saml-failing/245275 "2020-08-18T11:00:46Z")

</div>

Hey guys, I am facing a weird issue. Following this guide as a roadmap: https://discuss.elastic.co/t/sso-azure-ad-setup/230639/2 and mostly https://www.elastic.co/blog/saml-based-single-sign-on-with-elasticsearch-and-az…

---

## [Logstash and Kibana as coordinating nodes - Does it makes senses?](https://discuss.elastic.co/t/logstash-and-kibana-as-coordinating-nodes-does-it-makes-senses/245045)

<div class="topic-metadata">

**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\
**Replies:** 9\
**Last updated:** [August 18, 2020, 10:41am UTC](https://discuss.elastic.co/t/logstash-and-kibana-as-coordinating-nodes-does-it-makes-senses/245045 "2020-08-18T10:41:00Z")

</div>

Hello ! In the following setup, does it makes sense to configure Logstash-Central and Kibana as coordinating nodes ? : Syslog/beats =\> Logstash-satellite =\> Kafka \<= Logstash-central =\> Elasticsearch \<= Kibana If this…

---

## [Getting ConnectionPoolTimeoutException while calling Elastic search cluster](https://discuss.elastic.co/t/getting-connectionpooltimeoutexception-while-calling-elastic-search-cluster/245388)

<div class="topic-metadata">

**Author:** [@itsanviv](https://discuss.elastic.co/u/itsanviv)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 10:17am UTC](https://discuss.elastic.co/t/getting-connectionpooltimeoutexception-while-calling-elastic-search-cluster/245388 "2020-08-18T10:17:06Z")

</div>

Hello, We are getting ConnectionPoolTimeoutException while calling elastic search for update and get query. We are using aws elastic search services. We are using Jest client and configuration are below. public final …

---

## [About Indexing Time](https://discuss.elastic.co/t/about-indexing-time/245212)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 9:47am UTC](https://discuss.elastic.co/t/about-indexing-time/245212 "2020-08-18T09:47:34Z")

</div>

Hi, Can someone confirm/clarify the difference between Index Time (ms) and Latency (ms) in x-pack monitoring? Am I right in thinking that the first measuring the computational processing time of indexing requests. Wher…

---

## [Lowercase normalizer not working](https://discuss.elastic.co/t/lowercase-normalizer-not-working/245286)

<div class="topic-metadata">

**Author:** [@AmitaS](https://discuss.elastic.co/u/AmitaS)\
**Replies:** 5\
**Last updated:** [August 18, 2020, 9:42am UTC](https://discuss.elastic.co/t/lowercase-normalizer-not-working/245286 "2020-08-18T09:42:31Z")

</div>

HI, m trying to do exact search , with case insensitve. I am able to exact search using "keyword" ,but even after adding normalizer. It does not work with case insenisitve.i have to give exact term to search. .Match(m …

---

## [APM Indices growing endlessly despite ILM](https://discuss.elastic.co/t/apm-indices-growing-endlessly-despite-ilm/243846)

<div class="topic-metadata">

**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\
**Replies:** 7\
**Last updated:** [August 18, 2020, 8:55am UTC](https://discuss.elastic.co/t/apm-indices-growing-endlessly-despite-ilm/243846 "2020-08-18T08:55:27Z")

</div>

Our APM indices are growing without bound and extremely large despite a delete aftaer 30 days ILM policy. Each index has a policy attached which say "rollover every 7 days" (which seems to be working) and delete "delete…

---

## [Red Cluster State: failed to create shard, failure IOException\[failed to obtain in-memory shard lock\]](https://discuss.elastic.co/t/red-cluster-state-failed-to-create-shard-failure-ioexception-failed-to-obtain-in-memory-shard-lock/245345)

<div class="topic-metadata">

**Author:** [@Asad.Anwar](https://discuss.elastic.co/u/Asad.Anwar)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 5:07am UTC](https://discuss.elastic.co/t/red-cluster-state-failed-to-create-shard-failure-ioexception-failed-to-obtain-in-memory-shard-lock/245345 "2020-08-18T05:07:05Z")

</div>

Hi Team, We have 8 node cluster, where we noticed 2 shards were unassigned last week. We tried this command GET : /\_cluster/allocation/explain?pretty and got below explanation- { "index": "v20-con\*\*\*\*\*", "shard": 2, …

---

## [Shard Allocation Failed - Even Manually](https://discuss.elastic.co/t/shard-allocation-failed-even-manually/245357)

<div class="topic-metadata">

**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\
**Replies:** 3\
**Last updated:** [August 18, 2020, 8:20am UTC](https://discuss.elastic.co/t/shard-allocation-failed-even-manually/245357 "2020-08-18T08:20:35Z")

</div>

Hey, a few weeks ago we hit the 10k shard limit in our cluster, the problem is solved now but since then we have problems with 256 replica shards which are unassigned. It is also not possible the reassign the shards, se…

---

## [Is there a limit for the msearch?](https://discuss.elastic.co/t/is-there-a-limit-for-the-msearch/245361)

<div class="topic-metadata">

**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\
**Replies:** 5\
**Last updated:** [August 18, 2020, 8:11am UTC](https://discuss.elastic.co/t/is-there-a-limit-for-the-msearch/245361 "2020-08-18T08:11:50Z")

</div>

i tried getting results from elastic\_client.search and elastic\_client.msearch and both returns different amount of results. and elastic\_client.search returns the most accurate result

---

## [Why doesn't Elastic Cloud allow multiple data nodes unless its RAM is the highest?](https://discuss.elastic.co/t/why-doesnt-elastic-cloud-allow-multiple-data-nodes-unless-its-ram-is-the-highest/245367)

<div class="topic-metadata">

**Author:** [@taichi](https://discuss.elastic.co/u/taichi)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 7:57am UTC](https://discuss.elastic.co/t/why-doesnt-elastic-cloud-allow-multiple-data-nodes-unless-its-ram-is-the-highest/245367 "2020-08-18T07:57:48Z")

</div>

I'm new to Elasticsearch, and calculating the price when I use Elastic Cloud. I noticed that I can use multiple data nodes only when I use data nodes with the highest RAM settings. https://cloud.elastic.co/pricing W…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=830)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=832)
