# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=732

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 733

---

## [Respect bootstrapNewHistoryUUID option when restoring from snapshot](https://discuss.elastic.co/t/respect-bootstrapnewhistoryuuid-option-when-restoring-from-snapshot/259498)

<div class="topic-metadata">

**Author:** [@asce0705](https://discuss.elastic.co/u/asce0705)\
**Replies:** 9\
**Last updated:** [January 4, 2021, 12:23pm UTC](https://discuss.elastic.co/t/respect-bootstrapnewhistoryuuid-option-when-restoring-from-snapshot/259498 "2021-01-04T12:23:09Z")

</div>

Shall we enable bootstrapNewHistoryUUID option in SnapshotRecoverySource, which disable bootstraping new history uuid of the primary shard index when set false. In some environment, the primary shard may be restored fro…

---

## [Perform boolean operation on result sets of two queries](https://discuss.elastic.co/t/perform-boolean-operation-on-result-sets-of-two-queries/260083)

<div class="topic-metadata">

**Author:** [@tejas1\_shah](https://discuss.elastic.co/u/tejas1_shah)\
**Replies:** 0\
**Last updated:** [January 4, 2021, 11:20am UTC](https://discuss.elastic.co/t/perform-boolean-operation-on-result-sets-of-two-queries/260083 "2021-01-04T11:20:48Z")

</div>

Hello, I am creating a solution based on elastic search based on user inputs for a text. The results are to be shown in 3 groups - one group containing the exact match, second group containing only the stemmed results …

---

## [ILM policy - why isn't it deleting?](https://discuss.elastic.co/t/ilm-policy-why-isnt-it-deleting/259483)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 3\
**Last updated:** [January 4, 2021, 11:03am UTC](https://discuss.elastic.co/t/ilm-policy-why-isnt-it-deleting/259483 "2021-01-04T11:03:55Z")

</div>

Indices are building up instead of being deleted. Here's the policy: GET \_ilm/policy/packetbeat { "packetbeat" : { "version" : 6, "modified\_date" : "2020-12-21T12:30:41.023Z", "policy" : { "phases" :…

---

## [Error while trying to Install elasticsearch on Azure as self service](https://discuss.elastic.co/t/error-while-trying-to-install-elasticsearch-on-azure-as-self-service/258236)

<div class="topic-metadata">

**Author:** [@tal.paz](https://discuss.elastic.co/u/tal.paz)\
**Replies:** 13\
**Last updated:** [January 4, 2021, 10:21am UTC](https://discuss.elastic.co/t/error-while-trying-to-install-elasticsearch-on-azure-as-self-service/258236 "2021-01-04T10:21:50Z")

</div>

Hi, I am trying to install the elasticserach as self service in Azure portal. Using the following link: https://azuremarketplace.microsoft.com/en-us/marketplace/apps/elastic.elasticsearch?tab=Overview After configurin…

---

## [Elasticsearch shows Circuit Breaking Exception](https://discuss.elastic.co/t/elasticsearch-shows-circuit-breaking-exception/259872)

<div class="topic-metadata">

**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\
**Replies:** 5\
**Last updated:** [January 4, 2021, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-shows-circuit-breaking-exception/259872 "2021-01-04T07:19:28Z")

</div>

We have Elasticsearch deployed in a Kubernetes cluster as a 3 node (all 3 are Master and Data). Recently we are facing issue with Elasticsearch Circuit breaking excpetion and only 2 nodes are reporting to the Cluster. A…

---

## [Getting TransportError: TransportError(500, 'exception', 'java.io.OptionalDataException' while posting to AWS managed elastic stack](https://discuss.elastic.co/t/getting-transporterror-transporterror-500-exception-java-io-optionaldataexception-while-posting-to-aws-managed-elastic-stack/257713)

<div class="topic-metadata">

**Author:** [@yackoa](https://discuss.elastic.co/u/yackoa)\
**Replies:** 12\
**Last updated:** [January 4, 2021, 6:41am UTC](https://discuss.elastic.co/t/getting-transporterror-transporterror-500-exception-java-io-optionaldataexception-while-posting-to-aws-managed-elastic-stack/257713 "2021-01-04T06:41:46Z")

</div>

I am getting 'occasional' 500 Transport errors on AWS managed ES stack when posting JSONS from our python based lambdas. This was working flawlessly until today's upgrade to ES 7.9. We have tried increasing the cluster …

---

## [Search elements inside nested fields](https://discuss.elastic.co/t/search-elements-inside-nested-fields/260056)

<div class="topic-metadata">

**Author:** [@Asheesh\_Bhuria](https://discuss.elastic.co/u/Asheesh_Bhuria)\
**Replies:** 0\
**Last updated:** [January 4, 2021, 6:28am UTC](https://discuss.elastic.co/t/search-elements-inside-nested-fields/260056 "2021-01-04T06:28:16Z")

</div>

Hi, I have field which stores an array of objects. Each object contains a key on the basis of which we need to perform search operation and get the list of the matched terms only. We have achieved this using a combinati…

---

## [Unable to connect via token through the API](https://discuss.elastic.co/t/unable-to-connect-via-token-through-the-api/259597)

<div class="topic-metadata">

**Author:** [@JSmithOner](https://discuss.elastic.co/u/JSmithOner)\
**Replies:** 1\
**Last updated:** [January 4, 2021, 5:56am UTC](https://discuss.elastic.co/t/unable-to-connect-via-token-through-the-api/259597 "2021-01-04T05:56:41Z")

</div>

Hello Elasticsearch community, I'm using google cloud functions as backend and using a simple angular HttpClient to connect via the API to my google cloud elasticsearch endpoint. At first when I tried to connect I got …

---

## [How to speed up the segment merging](https://discuss.elastic.co/t/how-to-speed-up-the-segment-merging/260044)

<div class="topic-metadata">

**Author:** [@chemboking](https://discuss.elastic.co/u/chemboking)\
**Replies:** 0\
**Last updated:** [January 4, 2021, 1:44am UTC](https://discuss.elastic.co/t/how-to-speed-up-the-segment-merging/260044 "2021-01-04T01:44:57Z")

</div>

I don't understand why merging a 8GB(total) shard into one 3GB segment shard should take about 6 minutes, while all the indicators(io/cpu/memory/gc) of the machine(ssd/32 cores/30GB jvm/64GB total/swap disabled) are very…

---

## [Filebeat harvester started but not sending logs to logstash / kibana](https://discuss.elastic.co/t/filebeat-harvester-started-but-not-sending-logs-to-logstash-kibana/260030)

<div class="topic-metadata">

**Author:** [@Eden\_Corbin](https://discuss.elastic.co/u/Eden_Corbin)\
**Replies:** 7\
**Last updated:** [January 4, 2021, 12:04am UTC](https://discuss.elastic.co/t/filebeat-harvester-started-but-not-sending-logs-to-logstash-kibana/260030 "2021-01-04T00:04:13Z")

</div>

I'm certainly missing something in my configuration. I'm running a full docker setup, and can access Kibana and view indexes, including some logs I manually sent to logstash, I'm working on adding filebeat, docker logs s…

---

## [Aggregation](https://discuss.elastic.co/t/aggregation/260038)

<div class="topic-metadata">

**Author:** [@Uri\_Parush](https://discuss.elastic.co/u/Uri_Parush)\
**Replies:** 1\
**Last updated:** [January 3, 2021, 6:06pm UTC](https://discuss.elastic.co/t/aggregation/260038 "2021-01-03T18:06:18Z")

</div>

Hi, I'm trying to understand how to create an aggregation query for tag distribution. Record example: { @timestamp: {iso time} , record\_type: {string}, record\_data: {string}, tags: \[ {key: {string}, value: {string…

---

## [Problem while using shrink api](https://discuss.elastic.co/t/problem-while-using-shrink-api/260025)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 0\
**Last updated:** [January 2, 2021, 7:47pm UTC](https://discuss.elastic.co/t/problem-while-using-shrink-api/260025 "2021-01-02T19:47:11Z")

</div>

I was following this doc for decreasing shards but GET /\_cluster/allocation/explain shows "explanation" : """node does not match index setting \[index.routing.allocation.require\] filters \[\_name:"ed1"\]""" I want to shrin…

---

## [Get last document string value in each bucket](https://discuss.elastic.co/t/get-last-document-string-value-in-each-bucket/260013)

<div class="topic-metadata">

**Author:** [@Metheny](https://discuss.elastic.co/u/Metheny)\
**Replies:** 1\
**Last updated:** [January 2, 2021, 4:43pm UTC](https://discuss.elastic.co/t/get-last-document-string-value-in-each-bucket/260013 "2021-01-02T16:43:27Z")

</div>

I have a reports index and I need to count the number of reports per-user that have a specific string (keyword) field value in their last document (sorted by time) in some time range. I tried bucketing by user -\> top (1…

---

## [Wildcard filter on a Windows path](https://discuss.elastic.co/t/wildcard-filter-on-a-windows-path/258035)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 3\
**Last updated:** [January 2, 2021, 3:48pm UTC](https://discuss.elastic.co/t/wildcard-filter-on-a-windows-path/258035 "2021-01-02T15:48:17Z")

</div>

Hello, I'm trying to create a wildcard filter that filters on paths starting with c:\\git\* But: { "query": { "wildcard": { "process.working\_directory": { "value": "c:\\\\git\\\\\*" } } } } i…

---

## [Snapshots: State: Partial failure (?)](https://discuss.elastic.co/t/snapshots-state-partial-failure/260018)

<div class="topic-metadata">

**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\
**Replies:** 1\
**Last updated:** [January 2, 2021, 12:59pm UTC](https://discuss.elastic.co/t/snapshots-state-partial-failure/260018 "2021-01-02T12:59:12Z")

</div>

Hello, Example of a snapshot error in Elasticsearch: Global cluster state was stored, but at least one shard wasn't stored successfully... Shards: 10 Failed Shards: 2 From what I understand, the system in this cas…

---

## [Delete unsued dynamic mapping Fields](https://discuss.elastic.co/t/delete-unsued-dynamic-mapping-fields/260000)

<div class="topic-metadata">

**Author:** [@hzarrabi](https://discuss.elastic.co/u/hzarrabi)\
**Replies:** 1\
**Last updated:** [January 1, 2021, 9:04pm UTC](https://discuss.elastic.co/t/delete-unsued-dynamic-mapping-fields/260000 "2021-01-01T21:04:49Z")

</div>

Hi all, First of all I wish you a Happy New Year. I have some unused fields which were created by dynamic mapping. Is there any way to remove them from Index-mapping ? Best Regards

---

## [Automatic replications factor](https://discuss.elastic.co/t/automatic-replications-factor/259996)

<div class="topic-metadata">

**Author:** [@Itay\_Bittan](https://discuss.elastic.co/u/Itay_Bittan)\
**Replies:** 0\
**Last updated:** [January 1, 2021, 2:05pm UTC](https://discuss.elastic.co/t/automatic-replications-factor/259996 "2021-01-01T14:05:35Z")

</div>

Hi, I wonder if there is a feature for dynamically changing the replication\_factor of each index. We have an Elasticseach cluster with hundreds of indices as part of our recommendations engine. Each index represents a …

---

## [Elasticsearch remote cluster authentication](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication/259991)

<div class="topic-metadata">

**Author:** [@xxlaila](https://discuss.elastic.co/u/xxlaila)\
**Replies:** 1\
**Last updated:** [January 1, 2021, 12:32pm UTC](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication/259991 "2021-01-01T12:32:04Z")

</div>

Elasticsearch 7.8. Independent account authentication is configured between the two clusters, xpack.security.enabled : true xpack.security.transport . ssl.enabled : true xpack.security.transport . ssl.verificatio…

---

## [Has\_child not working as expected inside has\_parent](https://discuss.elastic.co/t/has-child-not-working-as-expected-inside-has-parent/259992)

<div class="topic-metadata">

**Author:** [@Waseem\_Farooqui](https://discuss.elastic.co/u/Waseem_Farooqui)\
**Replies:** 0\
**Last updated:** [January 1, 2021, 12:11pm UTC](https://discuss.elastic.co/t/has-child-not-working-as-expected-inside-has-parent/259992 "2021-01-01T12:11:35Z")

</div>

I have a parent child relationship in my elasticsearch 7.9 where I am having the car as a parent type and it has multiple child types like honda, suzuki, volvo now I want to have a child of type volvo and parent type is …

---

## [Data A first delete then index but version conflict](https://discuss.elastic.co/t/data-a-first-delete-then-index-but-version-conflict/259988)

<div class="topic-metadata">

**Author:** [@kai1](https://discuss.elastic.co/u/kai1)\
**Replies:** 1\
**Last updated:** [January 1, 2021, 9:49am UTC](https://discuss.elastic.co/t/data-a-first-delete-then-index-but-version-conflict/259988 "2021-01-01T09:49:38Z")

</div>

hello, everybody: I have a problem. I don\`t know why. Es(version is 6.3.2) index name is \[index\_1\]. Data A in index\_1, and version is 100 (version type is external). First, I Delete data A and search data A does not …

---

## [Watcher Assistance](https://discuss.elastic.co/t/watcher-assistance/259919)

<div class="topic-metadata">

**Author:** [@PinkElephant](https://discuss.elastic.co/u/PinkElephant)\
**Replies:** 2\
**Last updated:** [January 1, 2021, 5:10am UTC](https://discuss.elastic.co/t/watcher-assistance/259919 "2021-01-01T05:10:19Z")

</div>

Am trying to loop through a particular aggregation bucket-by-bucket and check if its corresponding key matches the value of ctx.payload.second.hits.hits.0.\_source.host.hostname. If it matches (and the hits total is \> 0 …

---

## [Help reindexing to new index](https://discuss.elastic.co/t/help-reindexing-to-new-index/259932)

<div class="topic-metadata">

**Author:** [@jtillman2020](https://discuss.elastic.co/u/jtillman2020)\
**Replies:** 9\
**Last updated:** [December 31, 2020, 9:48pm UTC](https://discuss.elastic.co/t/help-reindexing-to-new-index/259932 "2020-12-31T21:48:54Z")

</div>

I have a logstash .conf file whos outputs originally look like this: if "PAN-OS\_config" in \[tags\] { elasticsearch { index =\> "config" hosts =\> \["localhost:9200"\] } This created indexes in Elasti…

---

## [What is ram.percent and heap.percent](https://discuss.elastic.co/t/what-is-ram-percent-and-heap-percent/259954)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 1\
**Last updated:** [December 31, 2020, 9:33pm UTC](https://discuss.elastic.co/t/what-is-ram-percent-and-heap-percent/259954 "2020-12-31T21:33:31Z")

</div>

GET /\_cat/nodes?v&pretty ip heap.percent ram.percent cpu load\_1m load\_5m load\_15m node.role master name XX.XX.XX.XX 73 99 30 2.06 1.60 1.10 d - ed1 XX.XX.XX.XX …

---

## [Instructions on Installing ELK stack from Source Code (github)](https://discuss.elastic.co/t/instructions-on-installing-elk-stack-from-source-code-github/259976)

<div class="topic-metadata">

**Author:** [@austinsonger](https://discuss.elastic.co/u/austinsonger)\
**Replies:** 1\
**Last updated:** [December 31, 2020, 9:30pm UTC](https://discuss.elastic.co/t/instructions-on-installing-elk-stack-from-source-code-github/259976 "2020-12-31T21:30:28Z")

</div>

IS there instructions somewhere how to install ELK stack from source code?

---

## [Fresh Install if ELK 7.10 floods deprecation log](https://discuss.elastic.co/t/fresh-install-if-elk-7-10-floods-deprecation-log/259821)

<div class="topic-metadata">

**Author:** [@JSylvia007](https://discuss.elastic.co/u/JSylvia007)\
**Replies:** 8\
**Last updated:** [December 31, 2020, 4:38pm UTC](https://discuss.elastic.co/t/fresh-install-if-elk-7-10-floods-deprecation-log/259821 "2020-12-31T16:38:49Z")

</div>

A fresh install of ELK 7.10 fills the deprecation log once Kibana is installed. \[2020-12-29T14:12:46,624\]\[DEPRECATION\]\[o.e.d.a.a.i.a.g.TransportGetAliasesAction\] \[app01\] this request accesses system indices: \[.kibana\_1\]…

---

## [How can I calculate score using More-like-this in script score](https://discuss.elastic.co/t/how-can-i-calculate-score-using-more-like-this-in-script-score/259949)

<div class="topic-metadata">

**Author:** [@111424](https://discuss.elastic.co/u/111424)\
**Replies:** 0\
**Last updated:** [December 31, 2020, 9:59am UTC](https://discuss.elastic.co/t/how-can-i-calculate-score-using-more-like-this-in-script-score/259949 "2020-12-31T09:59:55Z")

</div>

Hi. I'm writing a query for searching engine. I want to calculate the score using cosine similarity(between image feature vectors) and tfidf. So, I used "function\_score" to calculate weighted sum of more-like-this sc…

---

## [How to calculate Shard size](https://discuss.elastic.co/t/how-to-calculate-shard-size/259945)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 2\
**Last updated:** [December 31, 2020, 9:20am UTC](https://discuss.elastic.co/t/how-to-calculate-shard-size/259945 "2020-12-31T09:20:12Z")

</div>

i don't know how to calculate shard size suppose we have 2499 shards and 443 indices and its data size 650gb

---

## [Sharding for hidden index in elasticsearch](https://discuss.elastic.co/t/sharding-for-hidden-index-in-elasticsearch/259941)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 5\
**Last updated:** [December 31, 2020, 9:13am UTC](https://discuss.elastic.co/t/sharding-for-hidden-index-in-elasticsearch/259941 "2020-12-31T09:13:47Z")

</div>

Hidden index like .kibana,.monitoring-logstash-7,.kibana-event-log-7,.kibana\_task\_manager\_2 etc do we need to really care about sharding of these indices like we create 3 shards for winlogbeat 3 shards for packetbeat and…

---

## [Elasticsearch Cross Cluster Search Implementation](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-implementation/259708)

<div class="topic-metadata">

**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Replies:** 14\
**Last updated:** [December 31, 2020, 8:44am UTC](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-implementation/259708 "2020-12-31T08:44:28Z")

</div>

Hello Team I am using Elasticsearch version 7.8.0. I am having two clusters : a. Local cluster b. remote cluster. Remote Cluster has Authentication implemented with CA Certificates generated for himself. Similarly …

---

## [Elasticsearch configure the client to trust this certificate](https://discuss.elastic.co/t/elasticsearch-configure-the-client-to-trust-this-certificate/259710)

<div class="topic-metadata">

**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Replies:** 9\
**Last updated:** [December 31, 2020, 8:37am UTC](https://discuss.elastic.co/t/elasticsearch-configure-the-client-to-trust-this-certificate/259710 "2020-12-31T08:37:10Z")

</div>

Hi Team I am using Elasticsearch Version 7.8.0 I have generated CA Certificate and keys using "elasticsearch-certutil" utility. These certificates are in format PKCS#12. Could you please help me in configure the clie…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=731)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=733)
