# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1205

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1206

---

## [Restrict suggestions to provide data from an desired index while using stored searches](https://discuss.elastic.co/t/restrict-suggestions-to-provide-data-from-an-desired-index-while-using-stored-searches/286498)

<div class="topic-metadata">

**Author:** [@pcvijayvignesh](https://discuss.elastic.co/u/pcvijayvignesh)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 1:24pm UTC](https://discuss.elastic.co/t/restrict-suggestions-to-provide-data-from-an-desired-index-while-using-stored-searches/286498 "2021-10-12T13:24:44Z")

</div>

We are using stored searches to perform queries, sort, agregations, and suggestions across a predefined index. Previously, we were not able to restrict the sort to certain indexes, so when we do a sort it searched acros…

---

## [Filebeat doesn't harvest folder structure](https://discuss.elastic.co/t/filebeat-doesnt-harvest-folder-structure/286374)

<div class="topic-metadata">

**Author:** [@luka.klaric](https://discuss.elastic.co/u/luka.klaric)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 12:55pm UTC](https://discuss.elastic.co/t/filebeat-doesnt-harvest-folder-structure/286374 "2021-10-12T12:55:35Z")

</div>

I am having the issue that filebeat (7.8) somehow 'ingores' my folder structure. This is the part of the filebeat.yml related to the folder structure: - type: log paths: - "/folder1/folder2/folder3/log…

---

## [Metricbeat openmetrics module ignores 'metrics\_path' parameter](https://discuss.elastic.co/t/metricbeat-openmetrics-module-ignores-metrics-path-parameter/286495)

<div class="topic-metadata">

**Author:** [@AuroraBorealis](https://discuss.elastic.co/u/AuroraBorealis)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 1:00pm UTC](https://discuss.elastic.co/t/metricbeat-openmetrics-module-ignores-metrics-path-parameter/286495 "2021-10-12T13:00:21Z")

</div>

Hello, I use Metricbeat 7.15 to collect metrics from a JBoss EAP application server. The applicaion-specific metrics are available at: http://localhost:10090/metrics/application I configured the openmetrics module like…

---

## [What are the docker-compose equivalent environment variables for this?](https://discuss.elastic.co/t/what-are-the-docker-compose-equivalent-environment-variables-for-this/286486)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 12:20pm UTC](https://discuss.elastic.co/t/what-are-the-docker-compose-equivalent-environment-variables-for-this/286486 "2021-10-12T12:20:26Z")

</div>

I'm trying to set up kibana (running as docker via compose) to have anonymous user auth for a few iframes that we are using. I do not wish to mount kibana.yml in compose. I would want to use the env variables to get the…

---

## [ElasticSearch 7.11 - how to reproduce function with NEST?](https://discuss.elastic.co/t/elasticsearch-7-11-how-to-reproduce-function-with-nest/286487)

<div class="topic-metadata">

**Author:** [@Vadym\_Romanenko](https://discuss.elastic.co/u/Vadym_Romanenko)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 12:08pm UTC](https://discuss.elastic.co/t/elasticsearch-7-11-how-to-reproduce-function-with-nest/286487 "2021-10-12T12:08:24Z")

</div>

Good day for everyone! I'm trying to reproduce generation of function that increases score for documents with specific values. This is original part of the query that was created in ES console: "query": { "funct…

---

## [Metric and drop filter not working together](https://discuss.elastic.co/t/metric-and-drop-filter-not-working-together/286380)

<div class="topic-metadata">

**Author:** [@Rakesh\_Partapsing](https://discuss.elastic.co/u/Rakesh_Partapsing)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 12:07pm UTC](https://discuss.elastic.co/t/metric-and-drop-filter-not-working-together/286380 "2021-10-12T12:07:05Z")

</div>

Hi, I would like throttle events using the logstash-filter-throttle plugin. After that to create a logstash-filter-metric to push it to prometheus using graphite exporter. And finally drop the events that are marked by …

---

## [How to replace field values from json external file?](https://discuss.elastic.co/t/how-to-replace-field-values-from-json-external-file/286475)

<div class="topic-metadata">

**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Replies:** 7\
**Last updated:** [October 12, 2021, 12:01pm UTC](https://discuss.elastic.co/t/how-to-replace-field-values-from-json-external-file/286475 "2021-10-12T12:01:36Z")

</div>

I am getting messages from RabbitMQ with field name ResponseCode. Response code consist of short codes like , 00, 01, 02 and so on. I want to replace those values will full form. I have another json key:values pair file …

---

## [How can I filtering of child aggs on parent agg's key（date\_histogram.key\_as\_string）](https://discuss.elastic.co/t/how-can-i-filtering-of-child-aggs-on-parent-aggs-key-date-histogram-key-as-string/286483)

<div class="topic-metadata">

**Author:** [@chenbihao](https://discuss.elastic.co/u/chenbihao)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 11:33am UTC](https://discuss.elastic.co/t/how-can-i-filtering-of-child-aggs-on-parent-aggs-key-date-histogram-key-as-string/286483 "2021-10-12T11:33:51Z")

</div>

I want to Change filter.range.exitTime.lte:"2021-08" to date\_histogram.key\_as\_string How do i make it GET /workerentryexitrecord/\_search { "size": 0, "query": { "bool": { "must": \[ { "m…

---

## [Restore data from archive snapshot](https://discuss.elastic.co/t/restore-data-from-archive-snapshot/286372)

<div class="topic-metadata">

**Author:** [@Nazarenko](https://discuss.elastic.co/u/Nazarenko)\
**Replies:** 4\
**Last updated:** [October 12, 2021, 11:14am UTC](https://discuss.elastic.co/t/restore-data-from-archive-snapshot/286372 "2021-10-12T11:14:27Z")

</div>

Hello everyone! I have some problems with restore my data from snapshot. Firstly, i created local repositories and create a policy, afther that, i successfully create snapshot. Secondly i make archive with content of …

---

## [.net Auto Authentication](https://discuss.elastic.co/t/net-auto-authentication/286180)

<div class="topic-metadata">

**Author:** [@prabha\_karan](https://discuss.elastic.co/u/prabha_karan)\
**Replies:** 1\
**Last updated:** [October 12, 2021, 10:53am UTC](https://discuss.elastic.co/t/net-auto-authentication/286180 "2021-10-12T10:53:00Z")

</div>

Hi ,i want to use dashboard inside in our web application .so, i pasted iframe inside Html.it rendered in browser with kibana login page. but after entered login credentials it again shows the login page.how to rectify t…

---

## [Percentage calculation in kibana using json Inputs](https://discuss.elastic.co/t/percentage-calculation-in-kibana-using-json-inputs/286442)

<div class="topic-metadata">

**Author:** [@Nijanthan](https://discuss.elastic.co/u/Nijanthan)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 10:48am UTC](https://discuss.elastic.co/t/percentage-calculation-in-kibana-using-json-inputs/286442 "2021-10-12T10:48:27Z")

</div>

How to calculate the failure percentage in kibana using the json inputs ? The kql query for success is statusCode:200 nd for failure is NOT STATUSCODE:200. I need to calculate the (failure/total)×100. I'm using kiban…

---

## [Not getting exact number of documents after reindexing the index](https://discuss.elastic.co/t/not-getting-exact-number-of-documents-after-reindexing-the-index/286116)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 1\
**Last updated:** [October 12, 2021, 10:33am UTC](https://discuss.elastic.co/t/not-getting-exact-number-of-documents-after-reindexing-the-index/286116 "2021-10-12T10:33:04Z")

</div>

I am reindexing some indices.After the completion of reindex process,i saw that destination index has not the exact number of documents as compared to source index. POST \_reindex?max\_docs=1614914&wait\_for\_completion=fal…

---

## [What are the major difference between ElasticSearch and OpenSearch?](https://discuss.elastic.co/t/what-are-the-major-difference-between-elasticsearch-and-opensearch/286464)

<div class="topic-metadata">

**Author:** [@spzala](https://discuss.elastic.co/u/spzala)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 10:27am UTC](https://discuss.elastic.co/t/what-are-the-major-difference-between-elasticsearch-and-opensearch/286464 "2021-10-12T10:27:35Z")

</div>

We are planning to leverage OpenSearch for the XDR kind of project. We want to leverage most of the major features like Alerting, Detection, Machine Learning for Anomaly Detection, etc. So, I want to know that, are the…

---

## [Visualizing across Distinct Indices](https://discuss.elastic.co/t/visualizing-across-distinct-indices/286394)

<div class="topic-metadata">

**Author:** [@gaganb](https://discuss.elastic.co/u/gaganb)\
**Replies:** 4\
**Last updated:** [October 12, 2021, 10:25am UTC](https://discuss.elastic.co/t/visualizing-across-distinct-indices/286394 "2021-10-12T10:25:06Z")

</div>

Hi all, I wanted to visualize data from two distinct indexes that do not share a common substring. Let's say I have Index A and Index B, both distinct names with no same substring. Both indexes have one common element…

---

## [\[Error\] Failed to execute query phase org.elasticsearch.transport.RemoteTransportException](https://discuss.elastic.co/t/error-failed-to-execute-query-phase-org-elasticsearch-transport-remotetransportexception/286467)

<div class="topic-metadata">

**Author:** [@lional700](https://discuss.elastic.co/u/lional700)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 10:15am UTC](https://discuss.elastic.co/t/error-failed-to-execute-query-phase-org-elasticsearch-transport-remotetransportexception/286467 "2021-10-12T10:15:53Z")

</div>

Dear Community, We are currently at the learning stage of Elasticsearch. We are using Bitbucket Data Centre in a cluster of 5 servers and installed Elasticsearch "7.5.2" in single separated server integrated to Bitbucke…

---

## [ELK Upgradation](https://discuss.elastic.co/t/elk-upgradation/286445)

<div class="topic-metadata">

**Author:** [@sama.sowjanya](https://discuss.elastic.co/u/sama.sowjanya)\
**Replies:** 1\
**Last updated:** [October 12, 2021, 10:04am UTC](https://discuss.elastic.co/t/elk-upgradation/286445 "2021-10-12T10:04:04Z")

</div>

Hi Presently we are using 7.10.2 version of ELK, want to upgrade it to latest version. The main purpose to upgrade is the look of Kibana URL. We are using SaaS instance. 7.10.2 Kibana URL is of more numerical. EX: http…

---

## [Is it possible to relate fields in an index such that highlights are matches across fields?](https://discuss.elastic.co/t/is-it-possible-to-relate-fields-in-an-index-such-that-highlights-are-matches-across-fields/286463)

<div class="topic-metadata">

**Author:** [@regitze](https://discuss.elastic.co/u/regitze)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 9:53am UTC](https://discuss.elastic.co/t/is-it-possible-to-relate-fields-in-an-index-such-that-highlights-are-matches-across-fields/286463 "2021-10-12T09:53:46Z")

</div>

Hi I have an index which is constructed in the following way: {'id': 'xxx-xxx', 'text': 'ALICE was beginning to get very tired of sitting by her sister on the bank, and of having nothing to do', 'start': '0:00:01…

---

## [Rename fields inside Kibana in order to filter them in Dashboard](https://discuss.elastic.co/t/rename-fields-inside-kibana-in-order-to-filter-them-in-dashboard/286278)

<div class="topic-metadata">

**Author:** [@qttv](https://discuss.elastic.co/u/qttv)\
**Replies:** 1\
**Last updated:** [October 12, 2021, 9:22am UTC](https://discuss.elastic.co/t/rename-fields-inside-kibana-in-order-to-filter-them-in-dashboard/286278 "2021-10-12T09:22:49Z")

</div>

Good evening, I'm facing with the following issue, working on Kibana version 7.0. I'm creating a Dashboard, where some visualization takes data from an Index and other visualizations takes data from other indexes... Th…

---

## [Filebeat can not get correct logs](https://discuss.elastic.co/t/filebeat-can-not-get-correct-logs/286456)

<div class="topic-metadata">

**Author:** [@Chen\_xa](https://discuss.elastic.co/u/Chen_xa)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 9:13am UTC](https://discuss.elastic.co/t/filebeat-can-not-get-correct-logs/286456 "2021-10-12T09:13:51Z")

</div>

I created a yaml file to deploy filebeat in my cluster. And I configured the right container log path. But when I see the filebeat logs I found out that all containers' ID is not same with the path. Here is my yaml: …

---

## [Send with many filebeat to one beat. "Inputbeat"](https://discuss.elastic.co/t/send-with-many-filebeat-to-one-beat-inputbeat/286221)

<div class="topic-metadata">

**Author:** [@Felix\_Kutscher](https://discuss.elastic.co/u/Felix_Kutscher)\
**Replies:** 7\
**Last updated:** [October 12, 2021, 9:11am UTC](https://discuss.elastic.co/t/send-with-many-filebeat-to-one-beat-inputbeat/286221 "2021-10-12T09:11:09Z")

</div>

Hello, situation: We use Logstash as a forwarder. Many filebeats send to one Logstash. (filebeat--\>forwarder-logstash--\>logstash--\>elastic) But the logstash is only a forwarder and very unstable. Now my question: Is…

---

## [Percentage calculation in kibana using json Inputs](https://discuss.elastic.co/t/percentage-calculation-in-kibana-using-json-inputs/285234)

<div class="topic-metadata">

**Author:** [@Nijanthan](https://discuss.elastic.co/u/Nijanthan)\
**Replies:** 4\
**Last updated:** [October 12, 2021, 9:06am UTC](https://discuss.elastic.co/t/percentage-calculation-in-kibana-using-json-inputs/285234 "2021-10-12T09:06:49Z")

</div>

How to calculate the failure percentage in kibana using the json inputs ? Like the failure is NOT statusCode:200 and success is statusCode:200. I need to calculate (failure/total)\*100

---

## [Regexp not working in nested query](https://discuss.elastic.co/t/regexp-not-working-in-nested-query/286357)

<div class="topic-metadata">

**Author:** [@Ankit\_Anuj](https://discuss.elastic.co/u/Ankit_Anuj)\
**Replies:** 3\
**Last updated:** [October 12, 2021, 9:03am UTC](https://discuss.elastic.co/t/regexp-not-working-in-nested-query/286357 "2021-10-12T09:03:02Z")

</div>

{ "query": { "bool": { "must": \[ { "match": { "testCase.status": "PASS" } }, { "nested": { "path": "testCase.logs", "query": { "regexp": { "testCase.logs.message": { "value": "W.\*R" } } } } } \]…

---

## [Does custom rules influence forecast results?](https://discuss.elastic.co/t/does-custom-rules-influence-forecast-results/286141)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 3\
**Last updated:** [October 12, 2021, 8:54am UTC](https://discuss.elastic.co/t/does-custom-rules-influence-forecast-results/286141 "2021-10-12T08:54:02Z")

</div>

Hi, I have a ML job for disk usage in percentage (0 to 100) , I had run a forecast in monday and gave me predictions over the 100% of the usage (193%, 232%, etc). Yesterday I clone the Job and add the custom rule skip …

---

## [A question around to get relevant content By using TF-IDF algorithm](https://discuss.elastic.co/t/a-question-around-to-get-relevant-content-by-using-tf-idf-algorithm/286440)

<div class="topic-metadata">

**Author:** [@Lahu\_Gosavi](https://discuss.elastic.co/u/Lahu_Gosavi)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 7:03am UTC](https://discuss.elastic.co/t/a-question-around-to-get-relevant-content-by-using-tf-idf-algorithm/286440 "2021-10-12T07:03:59Z")

</div>

Hi everyone I am doing a POC on best match document should rank higher basically, we are using the TF-IDF algorithm to rank the documents we are using a multi\_match query to find a document here is the query: { "q…

---

## [Netflow Problem](https://discuss.elastic.co/t/netflow-problem/286435)

<div class="topic-metadata">

**Author:** [@1phoenix](https://discuss.elastic.co/u/1phoenix)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 5:13am UTC](https://discuss.elastic.co/t/netflow-problem/286435 "2021-10-12T05:13:55Z")

</div>

Hello all, I have installed an Elastic Fleet server (self managed) and have deployed Elastic Agents successfully via Fleet. I have the Netflow Integration as part of the agent policy, but it doesn't look to be creating …

---

## [SAML attributes.groups has multiple groups, role mapping does not work](https://discuss.elastic.co/t/saml-attributes-groups-has-multiple-groups-role-mapping-does-not-work/286151)

<div class="topic-metadata">

**Author:** [@iti](https://discuss.elastic.co/u/iti)\
**Replies:** 4\
**Last updated:** [October 12, 2021, 6:21am UTC](https://discuss.elastic.co/t/saml-attributes-groups-has-multiple-groups-role-mapping-does-not-work/286151 "2021-10-12T06:21:11Z")

</div>

I have the following saml response: \<?xml version="1.0" encoding="UTF-8"?\> \<samlp:Response xmlns:samlp="urn:oasis:names:tc:SAML:2.0:protocol" \> \<saml:Issuer xmlns:saml="urn:oasis:names:tc:SAML:2.0:assertion" Format="…

---

## [Need support to restore backup from one instance to another in elastic cloud](https://discuss.elastic.co/t/need-support-to-restore-backup-from-one-instance-to-another-in-elastic-cloud/285892)

<div class="topic-metadata">

**Author:** [@skp](https://discuss.elastic.co/u/skp)\
**Replies:** 3\
**Last updated:** [October 12, 2021, 5:36am UTC](https://discuss.elastic.co/t/need-support-to-restore-backup-from-one-instance-to-another-in-elastic-cloud/285892 "2021-10-12T05:36:20Z")

</div>

Hi Team, I need to restore the backup from one instance to another if i give below command its not able to find the snapshot in other instance by the way they have the same repository and restore within the same instanc…

---

## [Find elements in array of nested dictionaries](https://discuss.elastic.co/t/find-elements-in-array-of-nested-dictionaries/286431)

<div class="topic-metadata">

**Author:** [@niato](https://discuss.elastic.co/u/niato)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 4:21am UTC](https://discuss.elastic.co/t/find-elements-in-array-of-nested-dictionaries/286431 "2021-10-12T04:21:02Z")

</div>

I'm struggling to find a way to get documents meeting specific criteria in an index that looks like this: { "products": \[ { "name": "product 1", "defects": { "packaging": { "desc": ".…

---

## [Logstash write to kafka's nonexistent topic, but no errors/warns in debug log](https://discuss.elastic.co/t/logstash-write-to-kafkas-nonexistent-topic-but-no-errors-warns-in-debug-log/286193)

<div class="topic-metadata">

**Author:** [@silbertmonaphia](https://discuss.elastic.co/u/silbertmonaphia)\
**Replies:** 12\
**Last updated:** [October 12, 2021, 3:50am UTC](https://discuss.elastic.co/t/logstash-write-to-kafkas-nonexistent-topic-but-no-errors-warns-in-debug-log/286193 "2021-10-12T03:50:11Z")

</div>

Description: Logstash writes event to kafka, but I forgot to create topic on kafka. And then I check logstash logs, but I can't find any error or warn messages in logs. Is this a bug of logstash 5.5 that logstash isn't …

---

## [Elapsed time filter is not calculating the time correctly](https://discuss.elastic.co/t/elapsed-time-filter-is-not-calculating-the-time-correctly/286418)

<div class="topic-metadata">

**Author:** [@Indigo\_Star](https://discuss.elastic.co/u/Indigo_Star)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 3:12am UTC](https://discuss.elastic.co/t/elapsed-time-filter-is-not-calculating-the-time-correctly/286418 "2021-10-12T03:12:00Z")

</div>

Hi, I am using an elapsed time plugin, as per the documentation the elapsed-time is calculated in seconds. I am calculating the values on a unique field basis "seq". Here is what i am getting, In the snapshot the second…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1204)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1206)
