# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1193

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1194

---

## [Add new button to visualizations' top navbar](https://discuss.elastic.co/t/add-new-button-to-visualizations-top-navbar/286931)

<div class="topic-metadata">

**Author:** [@aza-zil](https://discuss.elastic.co/u/aza-zil)\
**Replies:** 2\
**Last updated:** [October 21, 2021, 7:08am UTC](https://discuss.elastic.co/t/add-new-button-to-visualizations-top-navbar/286931 "2021-10-21T07:08:07Z")

</div>

I am creating a Kibana plugin, and I want to add a new plugin, so I need to add a button on the top navbar of the visualization pages. I have two questions: 1- how do I add the button? 2- how can I access the data/requ…

---

## [Filebeat crashed when processing messages from sqs queue](https://discuss.elastic.co/t/filebeat-crashed-when-processing-messages-from-sqs-queue/285145)

<div class="topic-metadata">

**Author:** [@pingz](https://discuss.elastic.co/u/pingz)\
**Replies:** 2\
**Last updated:** [October 21, 2021, 6:43am UTC](https://discuss.elastic.co/t/filebeat-crashed-when-processing-messages-from-sqs-queue/285145 "2021-10-21T06:43:57Z")

</div>

Hi: I am running filebeat 7.15.0 to process S3 object creation event messages from AWS SQS. The queue is configured to receive AWS ELB log files. After a few minutes, filebeat 7.15.0 crashed with the following error. T…

---

## [Timestamp filter logstash](https://discuss.elastic.co/t/timestamp-filter-logstash/287199)

<div class="topic-metadata">

**Author:** [@Paveltest](https://discuss.elastic.co/u/Paveltest)\
**Replies:** 4\
**Last updated:** [October 21, 2021, 6:07am UTC](https://discuss.elastic.co/t/timestamp-filter-logstash/287199 "2021-10-21T06:07:10Z")

</div>

I am trying to display the time from the message log, but the load time from logstash is coming out. The message looks like this: 9.17.20.121 - - \[11/Oct/2021:00:00:24 +0300\] 0.474 0.072 "POST /api/?AppType=1&AppVersi…

---

## [CentOS 7: Failed to Update Elasticsearch 7 with yum](https://discuss.elastic.co/t/centos-7-failed-to-update-elasticsearch-7-with-yum/287197)

<div class="topic-metadata">

**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\
**Replies:** 2\
**Last updated:** [October 21, 2021, 5:40am UTC](https://discuss.elastic.co/t/centos-7-failed-to-update-elasticsearch-7-with-yum/287197 "2021-10-21T05:40:12Z")

</div>

Elasticsearch version ( bin/elasticsearch --version ): Version: 7.10.0, Build: default/rpm/51e9d6f22758d0374a0f3f5c6e8f3a7997850f96/2020-11-09T21:30:33.964949Z, JVM: 15.0.1 JVM version ( java -version ): openjdk versi…

---

## [Does http\_poller input plugin respond to backpressure from Logstash?](https://discuss.elastic.co/t/does-http-poller-input-plugin-respond-to-backpressure-from-logstash/287241)

<div class="topic-metadata">

**Author:** [@jhettich](https://discuss.elastic.co/u/jhettich)\
**Replies:** 0\
**Last updated:** [October 21, 2021, 2:10am UTC](https://discuss.elastic.co/t/does-http-poller-input-plugin-respond-to-backpressure-from-logstash/287241 "2021-10-21T02:10:54Z")

</div>

When using Logstash with a persistent queue, will the http\_poller input plugin pause polling for new data if the Logstash queue is blocked?

---

## [Dynamic fields name within grok match](https://discuss.elastic.co/t/dynamic-fields-name-within-grok-match/287150)

<div class="topic-metadata">

**Author:** [@paska](https://discuss.elastic.co/u/paska)\
**Replies:** 2\
**Last updated:** [October 21, 2021, 2:52am UTC](https://discuss.elastic.co/t/dynamic-fields-name-within-grok-match/287150 "2021-10-21T02:52:41Z")

</div>

Hello. I'm wanted to use dynamic fields name within grok match. But I couldn't find any information about it and about correct syntax. First of all I'm getting field, which depends on field log.file.path grok { mat…

---

## [Not sure where my indexes are being deleted](https://discuss.elastic.co/t/not-sure-where-my-indexes-are-being-deleted/287180)

<div class="topic-metadata">

**Author:** [@davman](https://discuss.elastic.co/u/davman)\
**Replies:** 2\
**Last updated:** [October 21, 2021, 2:50am UTC](https://discuss.elastic.co/t/not-sure-where-my-indexes-are-being-deleted/287180 "2021-10-21T02:50:32Z")

</div>

Hey there, I inherited a system form a previous admin. I want to see the policy assigned to a certain index pattern for deletion. I know they are being deleted I just cant seem to tie the pattern to an ILM. Can someo…

---

## [Transform error: "could not start transform, not a transform node"](https://discuss.elastic.co/t/transform-error-could-not-start-transform-not-a-transform-node/287187)

<div class="topic-metadata">

**Author:** [@AmrIbra](https://discuss.elastic.co/u/AmrIbra)\
**Replies:** 1\
**Last updated:** [October 20, 2021, 11:55pm UTC](https://discuss.elastic.co/t/transform-error-could-not-start-transform-not-a-transform-node/287187 "2021-10-20T23:55:47Z")

</div>

I'm getting this error every time I try to start a transform. What could be the reason for that?

---

## [Multiple elastic search in kibana](https://discuss.elastic.co/t/multiple-elastic-search-in-kibana/287176)

<div class="topic-metadata">

**Author:** [@mangeshs](https://discuss.elastic.co/u/mangeshs)\
**Replies:** 2\
**Last updated:** [October 20, 2021, 11:49pm UTC](https://discuss.elastic.co/t/multiple-elastic-search-in-kibana/287176 "2021-10-20T23:49:56Z")

</div>

I have two Elasticsearch running and single kibana I want to point both to single kibana kibana.yml elasticsearch.hosts: \["http://localhost:9200","http://localhost:9201"\] any other changes to made?

---

## [Node fails even after start/restart and it is not joining the cluster](https://discuss.elastic.co/t/node-fails-even-after-start-restart-and-it-is-not-joining-the-cluster/287201)

<div class="topic-metadata">

**Author:** [@RamyaE](https://discuss.elastic.co/u/RamyaE)\
**Replies:** 1\
**Last updated:** [October 20, 2021, 11:48pm UTC](https://discuss.elastic.co/t/node-fails-even-after-start-restart-and-it-is-not-joining-the-cluster/287201 "2021-10-20T23:48:25Z")

</div>

Hi, I have tried to diagnose as much as I can, I have a three node cluster in that one of my node went down and it is not recovering from failed status, I have tried to stop/start it but it keep on hitting and maintainin…

---

## [Filebeat command .\\filebeat.exe setup -e throwing error while parsing kibana response](https://discuss.elastic.co/t/filebeat-command-filebeat-exe-setup-e-throwing-error-while-parsing-kibana-response/287151)

<div class="topic-metadata">

**Author:** [@vijayebpzr](https://discuss.elastic.co/u/vijayebpzr)\
**Replies:** 1\
**Last updated:** [October 20, 2021, 11:06pm UTC](https://discuss.elastic.co/t/filebeat-command-filebeat-exe-setup-e-throwing-error-while-parsing-kibana-response/287151 "2021-10-20T23:06:51Z")

</div>

I am trying to ship some logfiles from my system to a remote ELK cluster. While I try to exec ute the command .\\filebeat.exe setup -e , I am getting the below error. 2 021-10-20T03:34:26.007+0200 ERROR instance/be…

---

## [Document ID Scope when Index Life Cycle Management is in play and index patterns](https://discuss.elastic.co/t/document-id-scope-when-index-life-cycle-management-is-in-play-and-index-patterns/287132)

<div class="topic-metadata">

**Author:** [@Ben\_Hunsberger](https://discuss.elastic.co/u/Ben_Hunsberger)\
**Replies:** 4\
**Last updated:** [October 20, 2021, 11:04pm UTC](https://discuss.elastic.co/t/document-id-scope-when-index-life-cycle-management-is-in-play-and-index-patterns/287132 "2021-10-20T23:04:28Z")

</div>

Using the BULK api and the index action on each entry. Suppose I have an index pattern "myindex-\*". ILM is in play creating "myindex-00001", "myindex-00002", etc.... Day one a document is POSTed to the rollover alias …

---

## [Filebeat Module's Yaml Config Issue](https://discuss.elastic.co/t/filebeat-modules-yaml-config-issue/287231)

<div class="topic-metadata">

**Author:** [@Cassie\_Danaher](https://discuss.elastic.co/u/Cassie_Danaher)\
**Replies:** 3\
**Last updated:** [October 20, 2021, 9:58pm UTC](https://discuss.elastic.co/t/filebeat-modules-yaml-config-issue/287231 "2021-10-20T21:58:17Z")

</div>

I was under the impression that I could use filebeats keystore, to hold security information and then call those variables in the config file. When I try to do that it throws an error "mapping values are not allowed in …

---

## [TSVB Visualization Sum Aggregration](https://discuss.elastic.co/t/tsvb-visualization-sum-aggregration/287078)

<div class="topic-metadata">

**Author:** [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\
**Replies:** 3\
**Last updated:** [October 20, 2021, 9:52pm UTC](https://discuss.elastic.co/t/tsvb-visualization-sum-aggregration/287078 "2021-10-20T21:52:20Z")

</div>

Hi, I am using the TSVB Visualization to calculate the sum of CPU and memory assigned to the number of virtual machines. When I change the timestamp from the last 24 hours to the last 48 hours, the sum becomes double. B…

---

## [Elasticsearch is running but it does not connect when the public ip is given in browser](https://discuss.elastic.co/t/elasticsearch-is-running-but-it-does-not-connect-when-the-public-ip-is-given-in-browser/287040)

<div class="topic-metadata">

**Author:** [@spo](https://discuss.elastic.co/u/spo)\
**Replies:** 10\
**Last updated:** [October 20, 2021, 9:09pm UTC](https://discuss.elastic.co/t/elasticsearch-is-running-but-it-does-not-connect-when-the-public-ip-is-given-in-browser/287040 "2021-10-20T21:09:04Z")

</div>

browser error when accessing Elasticsearch Elasticsearch.yml file: # ======================== Elasticsearch Configuration ========================= # # NOTE: Elasticsearch comes with reasonable defaults for most set…

---

## [Kibana search profiler accuracy](https://discuss.elastic.co/t/kibana-search-profiler-accuracy/286770)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 3\
**Last updated:** [October 20, 2021, 8:06pm UTC](https://discuss.elastic.co/t/kibana-search-profiler-accuracy/286770 "2021-10-20T20:06:29Z")

</div>

I am debugging a long query and encountered below observation. The actual query takes 4.976 seconds. But the kibana search profiler states the search takes only 23.416 ms and aggregation takes 574.025 ms cumulatively e…

---

## [Problem using http\_poller to get access token from AppDynamics OAUTH API](https://discuss.elastic.co/t/problem-using-http-poller-to-get-access-token-from-appdynamics-oauth-api/287006)

<div class="topic-metadata">

**Author:** [@byoungman](https://discuss.elastic.co/u/byoungman)\
**Replies:** 1\
**Last updated:** [October 20, 2021, 7:58pm UTC](https://discuss.elastic.co/t/problem-using-http-poller-to-get-access-token-from-appdynamics-oauth-api/287006 "2021-10-20T19:58:17Z")

</div>

I am using the http\_poller input filter to get an outh access token from AppDynamics that I will then use to pass to the http filter plugin to retrieve AppDynamics REST API metric data to insert into Elasticsearch. My l…

---

## [Problem securing entire stack](https://discuss.elastic.co/t/problem-securing-entire-stack/286778)

<div class="topic-metadata">

**Author:** [@jceddy](https://discuss.elastic.co/u/jceddy)\
**Replies:** 13\
**Last updated:** [October 20, 2021, 7:42pm UTC](https://discuss.elastic.co/t/problem-securing-entire-stack/286778 "2021-10-20T19:42:27Z")

</div>

I have been trying to secure communications within (and connections to) my elastic stack, and am running into issues. I will just go through my configuration and what I've done so far. I have three servers (let's call t…

---

## [Error while loading \`logstash-core-plugin-api.gemspec\`: load error: psych -- java.lang.RuntimeException: BUG: we can not copy embedded jar to temp directory](https://discuss.elastic.co/t/error-while-loading-logstash-core-plugin-api-gemspec-load-error-psych-java-lang-runtimeexception-bug-we-can-not-copy-embedded-jar-to-temp-directory/287232)

<div class="topic-metadata">

**Author:** [@rajdevworks](https://discuss.elastic.co/u/rajdevworks)\
**Replies:** 0\
**Last updated:** [October 20, 2021, 7:32pm UTC](https://discuss.elastic.co/t/error-while-loading-logstash-core-plugin-api-gemspec-load-error-psych-java-lang-runtimeexception-bug-we-can-not-copy-embedded-jar-to-temp-directory/287232 "2021-10-20T19:32:28Z")

</div>

When I try to ingest with logstash and if the given directory contains tar.gz files, it fails with following error. When the same logs are ingested with logstash and the given log directory doesn't contain tar.gz files,…

---

## [Scripted Fields in Kibana Not Working as Expected](https://discuss.elastic.co/t/scripted-fields-in-kibana-not-working-as-expected/287221)

<div class="topic-metadata">

**Author:** [@alecm](https://discuss.elastic.co/u/alecm)\
**Replies:** 1\
**Last updated:** [October 20, 2021, 6:30pm UTC](https://discuss.elastic.co/t/scripted-fields-in-kibana-not-working-as-expected/287221 "2021-10-20T18:30:53Z")

</div>

Hi, I'm new to Kibana and am testing out scripted fields functionality. I've used them a few times in the past, but am running into strange issues today. Documents in my dataset contain a text key \[classification\_info\].…

---

## [How to set default index-pattern for different users](https://discuss.elastic.co/t/how-to-set-default-index-pattern-for-different-users/287207)

<div class="topic-metadata">

**Author:** [@mcosta](https://discuss.elastic.co/u/mcosta)\
**Replies:** 8\
**Last updated:** [October 20, 2021, 5:57pm UTC](https://discuss.elastic.co/t/how-to-set-default-index-pattern-for-different-users/287207 "2021-10-20T17:57:03Z")

</div>

Hi all, I have user-A with access to index-A and user-B with access to index-B. Both use Kibana to visualize data and there are two index-patterns defined (one for each index). As far as I know, I can only set one inde…

---

## [Search for a field across multiple indices](https://discuss.elastic.co/t/search-for-a-field-across-multiple-indices/286274)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 9\
**Last updated:** [October 20, 2021, 5:28pm UTC](https://discuss.elastic.co/t/search-for-a-field-across-multiple-indices/286274 "2021-10-20T17:28:16Z")

</div>

Hi All, We have ELK 7.6.2 stack running with number of indices in place. One of the fields in the indices is called requestID which has a unique value e.g. 1-01-TV-PCVEFOW6JXMZSMEVUZBWXPWRFFMPEIG10411767701@1-21506255#…

---

## [Logstash - unable to install amazon\_es - NoMethodError](https://discuss.elastic.co/t/logstash-unable-to-install-amazon-es-nomethoderror/287224)

<div class="topic-metadata">

**Author:** [@GaneshKannan](https://discuss.elastic.co/u/GaneshKannan)\
**Replies:** 0\
**Last updated:** [October 20, 2021, 4:23pm UTC](https://discuss.elastic.co/t/logstash-unable-to-install-amazon-es-nomethoderror/287224 "2021-10-20T16:23:37Z")

</div>

I'm trying to install amazon\_es in an AWS EC2 linux instance (x64). But getting an error called Resolving mixin dependencies NoMethodError: undefined method \`error' for #\<Gem::PlatformMismatch:0x2203fa4c\> And when I …

---

## [Runtime Fields with subnested fields](https://discuss.elastic.co/t/runtime-fields-with-subnested-fields/287218)

<div class="topic-metadata">

**Author:** [@rreverol](https://discuss.elastic.co/u/rreverol)\
**Replies:** 0\
**Last updated:** [October 20, 2021, 3:44pm UTC](https://discuss.elastic.co/t/runtime-fields-with-subnested-fields/287218 "2021-10-20T15:44:21Z")

</div>

I have the following doc mapping { "mappings": { "security": { "properties": { "id": { "type": "keyword" }, "trades": { "type": "nested", "properties": {…

---

## [Cross cluster replication connection issue](https://discuss.elastic.co/t/cross-cluster-replication-connection-issue/286150)

<div class="topic-metadata">

**Author:** [@cctk](https://discuss.elastic.co/u/cctk)\
**Replies:** 1\
**Last updated:** [October 11, 2021, 12:28am UTC](https://discuss.elastic.co/t/cross-cluster-replication-connection-issue/286150 "2021-10-11T00:28:25Z")

</div>

HI , Im having an issue with connecting to a remote cluster. first I tried to connect one node of es to another node and that was fine. I am implementing the same steps I took to connect to remote clusters before but …

---

## [Clarification on "Collect Agent Logs" setting for Elastic Agent Policies](https://discuss.elastic.co/t/clarification-on-collect-agent-logs-setting-for-elastic-agent-policies/287021)

<div class="topic-metadata">

**Author:** [@nemhods](https://discuss.elastic.co/u/nemhods)\
**Replies:** 4\
**Last updated:** [October 20, 2021, 3:20pm UTC](https://discuss.elastic.co/t/clarification-on-collect-agent-logs-setting-for-elastic-agent-policies/287021 "2021-10-20T15:20:29Z")

</div>

Hey, I'm wondering how the "Collect Agent Logs" setting works for Elastic Agent. In the past I made the experience that when selecting both "Collect Agent Logs" and "Collect Agent Metrics", it would cause massive amounts…

---

## [Beats cuses high CPU loads when send data](https://discuss.elastic.co/t/beats-cuses-high-cpu-loads-when-send-data/287211)

<div class="topic-metadata">

**Author:** [@Alvaro\_Eixea](https://discuss.elastic.co/u/Alvaro_Eixea)\
**Replies:** 0\
**Last updated:** [October 20, 2021, 2:56pm UTC](https://discuss.elastic.co/t/beats-cuses-high-cpu-loads-when-send-data/287211 "2021-10-20T14:56:00Z")

</div>

HI, I found that when packetbeat send data to Elasticsearch, CPU loads increases and host freeze. Can I control when the beat send data to Elasticsearch? I mean, Can I have the beats send the data at 04:00, by examp…

---

## [How to open debug ES index write log (index slow log is too simple)](https://discuss.elastic.co/t/how-to-open-debug-es-index-write-log-index-slow-log-is-too-simple/287208)

<div class="topic-metadata">

**Author:** [@dalei2019](https://discuss.elastic.co/u/dalei2019)\
**Replies:** 0\
**Last updated:** [October 20, 2021, 2:29pm UTC](https://discuss.elastic.co/t/how-to-open-debug-es-index-write-log-index-slow-log-is-too-simple/287208 "2021-10-20T14:29:20Z")

</div>

Use slow log, I can find the index result when error occur. PUT /xxx/\_settings { "index.indexing.slowlog.threshold.index.warn": "0s", "index.indexing.slowlog.threshold.index.info": "0s", "index.indexing.slowlog.th…

---

## [PKI chain realms](https://discuss.elastic.co/t/pki-chain-realms/287126)

<div class="topic-metadata">

**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\
**Replies:** 4\
**Last updated:** [October 20, 2021, 1:49pm UTC](https://discuss.elastic.co/t/pki-chain-realms/287126 "2021-10-20T13:49:06Z")

</div>

I want to add two PKI authentication realms in order to map each one to a specific role-mapping. I know I can create a realm chain, but I'm in need of help with setting up my secondary PKI realm using the OU name. For ex…

---

## [Check if a pipeline is running with the monitoring APIs?](https://discuss.elastic.co/t/check-if-a-pipeline-is-running-with-the-monitoring-apis/286022)

<div class="topic-metadata">

**Author:** [@nico127](https://discuss.elastic.co/u/nico127)\
**Replies:** 3\
**Last updated:** [October 20, 2021, 1:38pm UTC](https://discuss.elastic.co/t/check-if-a-pipeline-is-running-with-the-monitoring-apis/286022 "2021-10-20T13:38:11Z")

</div>

Is there a way to know if a pipeline has failed with the monitoring APIs - or any other API? My issue is that the file output plugin "freezes" when the target volume is full. Hence, I want my log rotator to check if a p…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1192)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1194)
