# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=585

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 586

---

## [What's the characteristics and criterion of choosing master and search (kibana) nodes](https://discuss.elastic.co/t/whats-the-characteristics-and-criterion-of-choosing-master-and-search-kibana-nodes/282695)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 5:15pm UTC](https://discuss.elastic.co/t/whats-the-characteristics-and-criterion-of-choosing-master-and-search-kibana-nodes/282695 "2021-08-27T17:15:55Z")

</div>

Hey I am trying to design a cluster in a real use case, it's well-known that when we have more then 5 data nodes, the number of master nodes should be 3 (at least if I am wrong), but I can't decide the characteritics of …

---

## [Joining multiple document within same index with joining the key](https://discuss.elastic.co/t/joining-multiple-document-within-same-index-with-joining-the-key/282680)

<div class="topic-metadata">

**Author:** [@Cap\_Ho](https://discuss.elastic.co/u/Cap_Ho)\
**Replies:** 4\
**Last updated:** [August 27, 2021, 3:40pm UTC](https://discuss.elastic.co/t/joining-multiple-document-within-same-index-with-joining-the-key/282680 "2021-08-27T15:40:17Z")

</div>

Just have an question on query to join multiple document together. For example , i have the following 6 document into same index: { "\_id" : 1, "studentId" : "a11", "class" : "1A", "classNumber" : 11 }, { "\_id" :…

---

## [Is there any way to set number of shards for an Index's replica?(default is 1)](https://discuss.elastic.co/t/is-there-any-way-to-set-number-of-shards-for-an-indexs-replica-default-is-1/282606)

<div class="topic-metadata">

**Author:** [@iti](https://discuss.elastic.co/u/iti)\
**Replies:** 10\
**Last updated:** [August 27, 2021, 3:24pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-set-number-of-shards-for-an-indexs-replica-default-is-1/282606 "2021-08-27T15:24:26Z")

</div>

I am setting the index's shard to something other than 1. (Say 5). I was expecting to have 5 primary shards and 5 replica shards. But what I got is 5 primary shards and 1 replica shard. Is there anyway to set the shard …

---

## [Error watcher with multiple terms and a metric](https://discuss.elastic.co/t/error-watcher-with-multiple-terms-and-a-metric/282604)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 10\
**Last updated:** [August 27, 2021, 3:03pm UTC](https://discuss.elastic.co/t/error-watcher-with-multiple-terms-and-a-metric/282604 "2021-08-27T15:03:19Z")

</div>

Hello, good people. I have a problem with an alert, I get the following error: { "watch\_id": "\_inlined\_", "node": "ELuSGxpSRICZb2ZHJp4paA", "state": "failed", "user": "elastic", "status": { "state": { …

---

## [Python parallel\_bulk, info says no errors, but nothing in index](https://discuss.elastic.co/t/python-parallel-bulk-info-says-no-errors-but-nothing-in-index/282611)

<div class="topic-metadata">

**Author:** [@dreic](https://discuss.elastic.co/u/dreic)\
**Replies:** 1\
**Last updated:** [August 27, 2021, 2:27pm UTC](https://discuss.elastic.co/t/python-parallel-bulk-info-says-no-errors-but-nothing-in-index/282611 "2021-08-27T14:27:11Z")

</div>

Here is the part of my python code. Took me a while to get this working without any errors as I didn't know what was the input structure function was accepting... Anyway here it is: docs = \[ { "Cr…

---

## [Stop words if present in query\_string query behaving different in elastic 6.2 and 7.5](https://discuss.elastic.co/t/stop-words-if-present-in-query-string-query-behaving-different-in-elastic-6-2-and-7-5/282675)

<div class="topic-metadata">

**Author:** [@nishant.saini](https://discuss.elastic.co/u/nishant.saini)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 1:39pm UTC](https://discuss.elastic.co/t/stop-words-if-present-in-query-string-query-behaving-different-in-elastic-6-2-and-7-5/282675 "2021-08-27T13:39:57Z")

</div>

I'm unable to understand why the below query is behaving differently in the two versions. { "query": { "bool": { "must": \[ { "query\_string": { "query": "(field1:\\"best\\"^300 AND…

---

## [Term aggregation on all document](https://discuss.elastic.co/t/term-aggregation-on-all-document/282665)

<div class="topic-metadata">

**Author:** [@glefloch](https://discuss.elastic.co/u/glefloch)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 12:23pm UTC](https://discuss.elastic.co/t/term-aggregation-on-all-document/282665 "2021-08-27T12:23:52Z")

</div>

Hi, I'm working with Elasticsearch and I would like to be able to do something like: Grouping documents into a bucket depending on a field Computing on an other field Using a percentile\_bucket aggregation to get the r…

---

## [The rebalance tasks keeps going and not stop](https://discuss.elastic.co/t/the-rebalance-tasks-keeps-going-and-not-stop/282619)

<div class="topic-metadata">

**Author:** [@casterQ](https://discuss.elastic.co/u/casterQ)\
**Replies:** 8\
**Last updated:** [August 27, 2021, 6:56am UTC](https://discuss.elastic.co/t/the-rebalance-tasks-keeps-going-and-not-stop/282619 "2021-08-27T06:56:20Z")

</div>

version ：7.10.2 i add a dataNode to cluster，and then the rebalance tasks started... but a week has passed，rebalance keeps going now and not only for new dataNode。 i found this situation exists for GET \_cat/recovery?v …

---

## [How to start with API's](https://discuss.elastic.co/t/how-to-start-with-apis/282511)

<div class="topic-metadata">

**Author:** [@uk642](https://discuss.elastic.co/u/uk642)\
**Replies:** 3\
**Last updated:** [August 27, 2021, 1:16am UTC](https://discuss.elastic.co/t/how-to-start-with-apis/282511 "2021-08-27T01:16:24Z")

</div>

I have installed Elastic search, logstash and kibana on localhost. I have uploaded sample data using logstash using a configuration file and I can view the data in Kibana dashboard. I want to create a search engine. How…

---

## [Index Boost along with sort not working](https://discuss.elastic.co/t/index-boost-along-with-sort-not-working/282582)

<div class="topic-metadata">

**Author:** [@nileshsoor](https://discuss.elastic.co/u/nileshsoor)\
**Replies:** 1\
**Last updated:** [August 26, 2021, 3:32pm UTC](https://discuss.elastic.co/t/index-boost-along-with-sort-not-working/282582 "2021-08-26T15:32:29Z")

</div>

I have a query, which will fired against 2 indices A & B. Results from index A is more important than B. ES version : 7.8.0 Query:: { "query": { "terms": { "id": \["a5af38bf-63ac-4e26-af25-68044ffea298","a5…

---

## [Disable Warnings about TLSv1.0, TLSv1.1 and SSLv3](https://discuss.elastic.co/t/disable-warnings-about-tlsv1-0-tlsv1-1-and-sslv3/282375)

<div class="topic-metadata">

**Author:** [@shaheer.siddiqui](https://discuss.elastic.co/u/shaheer.siddiqui)\
**Replies:** 3\
**Last updated:** [August 26, 2021, 3:53pm UTC](https://discuss.elastic.co/t/disable-warnings-about-tlsv1-0-tlsv1-1-and-sslv3/282375 "2021-08-26T15:53:15Z")

</div>

I am currently running a ES7.10.2 with XPACK enabled on Linux servers. I was able to configure and run ES with no issues however I keep getting the following warns "Client requested protocol TLSv1 is not enabled or suppo…

---

## [Manual Snapshot restore failed](https://discuss.elastic.co/t/manual-snapshot-restore-failed/282590)

<div class="topic-metadata">

**Author:** [@hassan\_elferga](https://discuss.elastic.co/u/hassan_elferga)\
**Replies:** 1\
**Last updated:** [August 26, 2021, 3:40pm UTC](https://discuss.elastic.co/t/manual-snapshot-restore-failed/282590 "2021-08-26T15:40:54Z")

</div>

We are trying a scenario for migrating one ES domain to a new one. We have followed the steps as per the following article https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/es-managedomains-snapshot…

---

## [Does it make sense to separate rarely used documents for faster performance?](https://discuss.elastic.co/t/does-it-make-sense-to-separate-rarely-used-documents-for-faster-performance/282550)

<div class="topic-metadata">

**Author:** [@Yoan\_Arnaudov](https://discuss.elastic.co/u/Yoan_Arnaudov)\
**Replies:** 1\
**Last updated:** [August 26, 2021, 3:34pm UTC](https://discuss.elastic.co/t/does-it-make-sense-to-separate-rarely-used-documents-for-faster-performance/282550 "2021-08-26T15:34:38Z")

</div>

I'm designing a system which will have ~2M documents and 95% percent of the queries will be targeted against 40-50k documents. Documents in the system have two states bool fields active and inactive. I have ~50k in the…

---

## [Remove duplicate / multiple data records in Elastic](https://discuss.elastic.co/t/remove-duplicate-multiple-data-records-in-elastic/282569)

<div class="topic-metadata">

**Author:** [@cf4455](https://discuss.elastic.co/u/cf4455)\
**Replies:** 1\
**Last updated:** [August 26, 2021, 3:33pm UTC](https://discuss.elastic.co/t/remove-duplicate-multiple-data-records-in-elastic/282569 "2021-08-26T15:33:08Z")

</div>

Hi, due to an error in the program that writes data records to the Elastic, there are now a lot of entries in our Elastic, all with exactly the same value in the "time" attribute. For example, there are 50 data records i…

---

## [Failing cluster](https://discuss.elastic.co/t/failing-cluster/282474)

<div class="topic-metadata">

**Author:** [@dusatvoj](https://discuss.elastic.co/u/dusatvoj)\
**Replies:** 3\
**Last updated:** [August 26, 2021, 1:41pm UTC](https://discuss.elastic.co/t/failing-cluster/282474 "2021-08-26T13:41:10Z")

</div>

Hello, I have a problem with my elasticsearch cluster. (ES 7.14.0) I have virtualized cluster with setup like: elk-node-1 (master, small ssd storage, hot data, ingester, ...) elk-node-2 (warm data, cold data) NumberO…

---

## [Searchable snapshot action - in cold phase restores the index to random data tier instead of only cold data tier](https://discuss.elastic.co/t/searchable-snapshot-action-in-cold-phase-restores-the-index-to-random-data-tier-instead-of-only-cold-data-tier/282154)

<div class="topic-metadata">

**Author:** [@Kannappan\_Somu](https://discuss.elastic.co/u/Kannappan_Somu)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 1:19pm UTC](https://discuss.elastic.co/t/searchable-snapshot-action-in-cold-phase-restores-the-index-to-random-data-tier-instead-of-only-cold-data-tier/282154 "2021-08-26T13:19:46Z")

</div>

Searchable snapshot action - in cold phase restores the index to random data tier instead of only cold data tier as the searchable snapshot action ignores all the allocation filters and sets the default one as "index.rou…

---

## [PKI pull full dn not just cn](https://discuss.elastic.co/t/pki-pull-full-dn-not-just-cn/282508)

<div class="topic-metadata">

**Author:** [@sam3546](https://discuss.elastic.co/u/sam3546)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 1:10pm UTC](https://discuss.elastic.co/t/pki-pull-full-dn-not-just-cn/282508 "2021-08-26T13:10:28Z")

</div>

So i have a pki realm that passes auth to an ldap realm but the pki realm uses a usernam\_pattern attribute to pull the cn from the pki but i want the whole dn returning and passing to the ldap realm. e.g PKI; CN=VVVVV…

---

## [Modify index.routing.allocation.total\_shards\_per\_node by ILM when going to WARM](https://discuss.elastic.co/t/modify-index-routing-allocation-total-shards-per-node-by-ilm-when-going-to-warm/282551)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 3\
**Last updated:** [August 26, 2021, 12:53pm UTC](https://discuss.elastic.co/t/modify-index-routing-allocation-total-shards-per-node-by-ilm-when-going-to-warm/282551 "2021-08-26T12:53:45Z")

</div>

I have set "index.routing.allocation.total\_shards\_per\_node" :1 in index template for index with 6 primary shards. Because it is index intensive ETL and having shards on different nodes gives best performance results. …

---

## [Cant seem to install plugin with elasticsearch](https://discuss.elastic.co/t/cant-seem-to-install-plugin-with-elasticsearch/282086)

<div class="topic-metadata">

**Author:** [@cctk](https://discuss.elastic.co/u/cctk)\
**Replies:** 7\
**Last updated:** [August 26, 2021, 12:52pm UTC](https://discuss.elastic.co/t/cant-seem-to-install-plugin-with-elasticsearch/282086 "2021-08-26T12:52:58Z")

</div>

HI , I am having issues with Elasticsearch-plugin command or maybe elasticsearch in general. I have tried countless ways and can't seem to find out the issue. when I install the plugin ./elasticsearch-plugin install r…

---

## [Unable to refer lang-mustache plug to parse mustache template in custom plugin](https://discuss.elastic.co/t/unable-to-refer-lang-mustache-plug-to-parse-mustache-template-in-custom-plugin/282573)

<div class="topic-metadata">

**Author:** [@Akshayyha\_Krishnamur](https://discuss.elastic.co/u/Akshayyha_Krishnamur)\
**Replies:** 0\
**Last updated:** [August 26, 2021, 12:20pm UTC](https://discuss.elastic.co/t/unable-to-refer-lang-mustache-plug-to-parse-mustache-template-in-custom-plugin/282573 "2021-08-26T12:20:46Z")

</div>

This post is with reference to Unable to start Elastic search when i delete jar from lang-mustache and place it in lib I faced the same issue in es 7.9.0 and the fix was to have the lang-mustache jar in modules folder a…

---

## [Can't Join 3rd Node to Cluster](https://discuss.elastic.co/t/cant-join-3rd-node-to-cluster/282413)

<div class="topic-metadata">

**Author:** [@frustrated23](https://discuss.elastic.co/u/frustrated23)\
**Replies:** 3\
**Last updated:** [August 26, 2021, 12:21pm UTC](https://discuss.elastic.co/t/cant-join-3rd-node-to-cluster/282413 "2021-08-26T12:21:49Z")

</div>

Hi Everyone, I am trying to setup a 3 node cluster. I am running each ES node in a docker container on a separate physical host. I was able to setup es01 as the initial member, add the second node es02 however when addi…

---

## [Elastic Search query](https://discuss.elastic.co/t/elastic-search-query/282562)

<div class="topic-metadata">

**Author:** [@chris.aw](https://discuss.elastic.co/u/chris.aw)\
**Replies:** 1\
**Last updated:** [August 26, 2021, 10:57am UTC](https://discuss.elastic.co/t/elastic-search-query/282562 "2021-08-26T10:57:51Z")

</div>

Hi guys! I've come across this UX (as shown below). Just wondering if elastic search can support the same results as well. I believe it is identifying by keywords

---

## [How to manage data retention time in ElasticSearch](https://discuss.elastic.co/t/how-to-manage-data-retention-time-in-elasticsearch/282541)

<div class="topic-metadata">

**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 9:25am UTC](https://discuss.elastic.co/t/how-to-manage-data-retention-time-in-elasticsearch/282541 "2021-08-26T09:25:21Z")

</div>

Hello to all! I'm using Logastash to send syslog data to ElasticSearch and I'm browsing it using Kibana. I have 2 questions regarding log backup: I would like to keep this data for at least 1 year before it is deleted…

---

## [Stack monitoring page not loading](https://discuss.elastic.co/t/stack-monitoring-page-not-loading/282389)

<div class="topic-metadata">

**Author:** [@Ramalakshmi](https://discuss.elastic.co/u/Ramalakshmi)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 9:05am UTC](https://discuss.elastic.co/t/stack-monitoring-page-not-loading/282389 "2021-08-26T09:05:54Z")

</div>

Hi, Metricbeat beat installed in elasticsearch master nodes and enable the modules for elasticsearch but when opening the stack monitoring page it's not loading cluster info, Please help me out. Thank you

---

## [Set up error transaction percentage alert email](https://discuss.elastic.co/t/set-up-error-transaction-percentage-alert-email/282210)

<div class="topic-metadata">

**Author:** [@helloworld3112](https://discuss.elastic.co/u/helloworld3112)\
**Replies:** 3\
**Last updated:** [August 26, 2021, 7:56am UTC](https://discuss.elastic.co/t/set-up-error-transaction-percentage-alert-email/282210 "2021-08-26T07:56:07Z")

</div>

Hi all, I have data with the following structure: I need an alert email every 30 seconds to count the number of each Name have ErrorCode in list \[001, 002, 003\] and the percentage of each Name to the total (all of Er…

---

## [Provide order of ids and retrieve docs in the provided order](https://discuss.elastic.co/t/provide-order-of-ids-and-retrieve-docs-in-the-provided-order/282535)

<div class="topic-metadata">

**Author:** [@voldemort02](https://discuss.elastic.co/u/voldemort02)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 5:52am UTC](https://discuss.elastic.co/t/provide-order-of-ids-and-retrieve-docs-in-the-provided-order/282535 "2021-08-26T05:52:17Z")

</div>

I have I have order of ids, \[1, 4, 2, 5\] and some filters { match: {...} } and I want the resulting documents to be returned in the order \[1, 4, 2, 5\]. What would be the best way to achieve this? Sample document: { …

---

## [Configure proxy for Elasticsearch](https://discuss.elastic.co/t/configure-proxy-for-elasticsearch/282479)

<div class="topic-metadata">

**Author:** [@etrpchevska](https://discuss.elastic.co/u/etrpchevska)\
**Replies:** 0\
**Last updated:** [August 25, 2021, 11:01am UTC](https://discuss.elastic.co/t/configure-proxy-for-elasticsearch/282479 "2021-08-25T11:01:22Z")

</div>

Hello! We have an Elasticsearch setup running in on-prem data center as a Kubernetes application. I would like to configure SAML realm for SSO login to the cluster and Kibana, but in order to get authenticated to the Id…

---

## [Approx sizing for indexes and shard counts per data node](https://discuss.elastic.co/t/approx-sizing-for-indexes-and-shard-counts-per-data-node/282524)

<div class="topic-metadata">

**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Replies:** 1\
**Last updated:** [August 25, 2021, 10:08pm UTC](https://discuss.elastic.co/t/approx-sizing-for-indexes-and-shard-counts-per-data-node/282524 "2021-08-25T22:08:45Z")

</div>

I know what I'm asking can be subjective but I'm wondering if I have say 5 data nodes with access to 29gb Ram in the JVM (64gb of physical ram), with 5 data nodes, what is the best way to estimate when I need to add a ne…

---

## [Impact of default indices refresh time on Bulk Indexing](https://discuss.elastic.co/t/impact-of-default-indices-refresh-time-on-bulk-indexing/282441)

<div class="topic-metadata">

**Author:** [@Pathak18](https://discuss.elastic.co/u/Pathak18)\
**Replies:** 8\
**Last updated:** [August 25, 2021, 10:05pm UTC](https://discuss.elastic.co/t/impact-of-default-indices-refresh-time-on-bulk-indexing/282441 "2021-08-25T22:05:21Z")

</div>

Hi Group, During Bulk Indexing, when the index.refresh\_interval defaults to 1sec and RefreshPolicy set to NONE. Query: In my case - Save Bulk Request runs in batches with 1k records in each batch. Out of 1k records, su…

---

## [Snapshot and restore](https://discuss.elastic.co/t/snapshot-and-restore/282516)

<div class="topic-metadata">

**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\
**Replies:** 2\
**Last updated:** [August 25, 2021, 9:15pm UTC](https://discuss.elastic.co/t/snapshot-and-restore/282516 "2021-08-25T21:15:10Z")

</div>

Hello all, As per the documentation about registering a snapshot repository, first, I am supposed to add following to elasticsearch.yml file. i understand that I can store backup on my network drive which would be th…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=584)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=586)
