# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1672

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1673

---

## [Custom Realm create roles dynamically using an external microservice for document level security](https://discuss.elastic.co/t/custom-realm-create-roles-dynamically-using-an-external-microservice-for-document-level-security/273190)

<div class="topic-metadata">

**Author:** [@pablomartinez](https://discuss.elastic.co/u/pablomartinez)\
**Replies:** 3\
**Last updated:** [May 19, 2021, 4:19am UTC](https://discuss.elastic.co/t/custom-realm-create-roles-dynamically-using-an-external-microservice-for-document-level-security/273190 "2021-05-19T04:19:37Z")

</div>

Hello everyone. I'm trying to implement a custom role provider that each time the user is logged in, I can be able to create the role(s) for this particular user using an external http microservice that based on the use…

---

## [Wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add - no response loading for long time](https://discuss.elastic.co/t/wget-qo-https-artifacts-elastic-co-gpg-key-elasticsearch-sudo-apt-key-add-no-response-loading-for-long-time/273230)

<div class="topic-metadata">

**Author:** [@Rahul\_Ravichandran](https://discuss.elastic.co/u/Rahul_Ravichandran)\
**Replies:** 2\
**Last updated:** [May 19, 2021, 1:52am UTC](https://discuss.elastic.co/t/wget-qo-https-artifacts-elastic-co-gpg-key-elasticsearch-sudo-apt-key-add-no-response-loading-for-long-time/273230 "2021-05-19T01:52:44Z")

</div>

Hey guys Im trying to install logstash and the very first command is wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add - as given in the steps to install in this link Installing Logstash…

---

## [Can we send a query with ignorable field to Elasticsearch?](https://discuss.elastic.co/t/can-we-send-a-query-with-ignorable-field-to-elasticsearch/272975)

<div class="topic-metadata">

**Author:** [@Anonymous\_Soul](https://discuss.elastic.co/u/Anonymous_Soul)\
**Replies:** 4\
**Last updated:** [May 19, 2021, 2:18am UTC](https://discuss.elastic.co/t/can-we-send-a-query-with-ignorable-field-to-elasticsearch/272975 "2021-05-19T02:18:44Z")

</div>

Hi Team, Suppose we are a team with 100 other teams querying our cluster, either through Kibana or Elasticsearch APIs Can we identify those with a special field like a uniqueID specific to one team but those fields are…

---

## [How can transfer Fail2ban logs going to Kibana](https://discuss.elastic.co/t/how-can-transfer-fail2ban-logs-going-to-kibana/273252)

<div class="topic-metadata">

**Author:** [@ememman29](https://discuss.elastic.co/u/ememman29)\
**Replies:** 2\
**Last updated:** [May 19, 2021, 2:14am UTC](https://discuss.elastic.co/t/how-can-transfer-fail2ban-logs-going-to-kibana/273252 "2021-05-19T02:14:25Z")

</div>

Hello i have a problem on how i going to transfer my fail2ban logs going to kibana visualization i already installed the filebeat log shipper on my server where fail2ban is installed but the problem is only the message i…

---

## [Problem upgrading to 7.12.1](https://discuss.elastic.co/t/problem-upgrading-to-7-12-1/273353)

<div class="topic-metadata">

**Author:** [@Jerry\_Hoffmeister](https://discuss.elastic.co/u/Jerry_Hoffmeister)\
**Replies:** 4\
**Last updated:** [May 19, 2021, 2:14am UTC](https://discuss.elastic.co/t/problem-upgrading-to-7-12-1/273353 "2021-05-19T02:14:24Z")

</div>

Hi, I'm upgrading a single node, dev instance of elasticsearch running 6.4.2 to 7.12.1 as the first step in getting ready to upgrade our prod cluster. I was able to upgrade from 6.4.2 -\> 6.8.15 without issue but on upg…

---

## [Visualisation: Term, field not in list](https://discuss.elastic.co/t/visualisation-term-field-not-in-list/273116)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 4\
**Last updated:** [May 19, 2021, 1:43am UTC](https://discuss.elastic.co/t/visualisation-term-field-not-in-list/273116 "2021-05-19T01:43:09Z")

</div>

I am trying to make a standard time on x axis stacked bar chart but when I try and split the bar the on a term the field I want to use is not listed. here is a sample raw record (trimmed for brevity). Important fields…

---

## [Add read-only user for Kibana Canvas](https://discuss.elastic.co/t/add-read-only-user-for-kibana-canvas/273235)

<div class="topic-metadata">

**Author:** [@saintjohn](https://discuss.elastic.co/u/saintjohn)\
**Replies:** 3\
**Last updated:** [May 19, 2021, 1:40am UTC](https://discuss.elastic.co/t/add-read-only-user-for-kibana-canvas/273235 "2021-05-19T01:40:41Z")

</div>

Hi Experts, I'm trying to add an user which is granted only for read-only right to Kibana Canvas for security purpose. I'm using Kibana as well as Elastic Search v7.11.1 with Basic License. Based on the instruction, I…

---

## [ES Index Insert-Update Issues](https://discuss.elastic.co/t/es-index-insert-update-issues/272989)

<div class="topic-metadata">

**Author:** [@vikramnr](https://discuss.elastic.co/u/vikramnr)\
**Replies:** 2\
**Last updated:** [May 19, 2021, 1:30am UTC](https://discuss.elastic.co/t/es-index-insert-update-issues/272989 "2021-05-19T01:30:05Z")

</div>

We have an index which updated every 5th minutes and at that 5th min the same index is updated six times for different sets of columns.We are using upsert to update and insert, if the value is not present. We also have \_…

---

## [Regarding the security of the ELK stack docker images](https://discuss.elastic.co/t/regarding-the-security-of-the-elk-stack-docker-images/272895)

<div class="topic-metadata">

**Author:** [@signum](https://discuss.elastic.co/u/signum)\
**Replies:** 2\
**Last updated:** [May 19, 2021, 1:14am UTC](https://discuss.elastic.co/t/regarding-the-security-of-the-elk-stack-docker-images/272895 "2021-05-19T01:14:06Z")

</div>

Hi, I am trying out the docker version of the ELK stack, and have noted that when I scan it using trivy / "docker scan", it is showing some OS related vulnerabilities for libraries such curl etc. Can I understand if thes…

---

## [Specifying endpoint for performing reading/writing operations](https://discuss.elastic.co/t/specifying-endpoint-for-performing-reading-writing-operations/273304)

<div class="topic-metadata">

**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\
**Replies:** 1\
**Last updated:** [May 19, 2021, 1:13am UTC](https://discuss.elastic.co/t/specifying-endpoint-for-performing-reading-writing-operations/273304 "2021-05-19T01:13:07Z")

</div>

Assuming we are trying to perform a read and/or a write operation on an es cluster reachable at https://my-es-cluster Assuming this cluster is deployed on kubernetes and we have a way to directly reach a master service…

---

## [Kibana Watcher - Using it to calculate a percentage of two result values](https://discuss.elastic.co/t/kibana-watcher-using-it-to-calculate-a-percentage-of-two-result-values/273305)

<div class="topic-metadata">

**Author:** [@Zooka94](https://discuss.elastic.co/u/Zooka94)\
**Replies:** 0\
**Last updated:** [May 18, 2021, 2:45pm UTC](https://discuss.elastic.co/t/kibana-watcher-using-it-to-calculate-a-percentage-of-two-result-values/273305 "2021-05-18T14:45:19Z")

</div>

I am trying to use a watcher to parse email event data, we have a field that will state if the email delivery is successful/delayed/ failed. I want to know if it is possible to calculate the percentage of failed message…

---

## [A little confused about JAVA requirement to install ES 6.8.15 in a clean Ubuntu 18.04 server](https://discuss.elastic.co/t/a-little-confused-about-java-requirement-to-install-es-6-8-15-in-a-clean-ubuntu-18-04-server/273306)

<div class="topic-metadata">

**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Replies:** 2\
**Last updated:** [May 19, 2021, 1:11am UTC](https://discuss.elastic.co/t/a-little-confused-about-java-requirement-to-install-es-6-8-15-in-a-clean-ubuntu-18-04-server/273306 "2021-05-19T01:11:45Z")

</div>

I'm about to install ES 6.8.15 on a CLEAN ubuntu 18.04 server. I know I need JAVA, the question is when i stood up a clean VM with Ubuntu 18.04, It DOES NOT have any JAVA installed at all. So I'm going to have to insta…

---

## [7.12 Kibana - pass URL in action to email/PagerDuty](https://discuss.elastic.co/t/7-12-kibana-pass-url-in-action-to-email-pagerduty/272514)

<div class="topic-metadata">

**Author:** [@tslattery](https://discuss.elastic.co/u/tslattery)\
**Replies:** 2\
**Last updated:** [May 18, 2021, 11:08pm UTC](https://discuss.elastic.co/t/7-12-kibana-pass-url-in-action-to-email-pagerduty/272514 "2021-05-18T23:08:34Z")

</div>

Is it possible to pass a URL in alert information from Kibana to an event management system (email or PagerDuty at this time)? Thanks!

---

## [Gauge vusualization](https://discuss.elastic.co/t/gauge-vusualization/272912)

<div class="topic-metadata">

**Author:** [@DivinLobo](https://discuss.elastic.co/u/DivinLobo)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 10:12pm UTC](https://discuss.elastic.co/t/gauge-vusualization/272912 "2021-05-18T22:12:46Z")

</div>

I've recently started trying out Elasticsearch and Kibana and I am trying out the Gauge graph I am taking the average value of a field and set up the custom ranges like so. I would Like to Know if it is possible t…

---

## [Grok patterns with quotation marks](https://discuss.elastic.co/t/grok-patterns-with-quotation-marks/273003)

<div class="topic-metadata">

**Author:** [@qttv](https://discuss.elastic.co/u/qttv)\
**Replies:** 17\
**Last updated:** [May 18, 2021, 10:01pm UTC](https://discuss.elastic.co/t/grok-patterns-with-quotation-marks/273003 "2021-05-18T22:01:48Z")

</div>

Good Evening, I'm trying to extrapolate some fields from the following log message: { "message": "Throw: Il prodotto estratto non è presente tra quelli del menu a tendina in fase di emissione della proposta", "level":…

---

## [ProblemChild Getting Started question](https://discuss.elastic.co/t/problemchild-getting-started-question/273338)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [May 18, 2021, 9:51pm UTC](https://discuss.elastic.co/t/problemchild-getting-started-question/273338 "2021-05-18T21:51:32Z")

</div>

Hello, Just read through ProblemChild: Detecting living-off-the-land attacks using the Elastic Stack | Elastic Blog which all seems super interesting. So.. Forgive me for my noobish questions.. But I was wondering how…

---

## [Showing image in markdown with api call](https://discuss.elastic.co/t/showing-image-in-markdown-with-api-call/272906)

<div class="topic-metadata">

**Author:** [@DILIP\_SHARMA](https://discuss.elastic.co/u/DILIP_SHARMA)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 9:34pm UTC](https://discuss.elastic.co/t/showing-image-in-markdown-with-api-call/272906 "2021-05-18T21:34:41Z")

</div>

hi i am trying to show s3 images in Kibana markdown if i direct pass image URL like below , its showing image without any issue - !\[test\](imageurl) But i m using signed URL , for that i m passing API path in markdown …

---

## [Kibana Plugin Idea: Custom Alert Connector](https://discuss.elastic.co/t/kibana-plugin-idea-custom-alert-connector/272846)

<div class="topic-metadata">

**Author:** [@Thomas\_Vaudry-Read](https://discuss.elastic.co/u/Thomas_Vaudry-Read)\
**Replies:** 1\
**Last updated:** [May 18, 2021, 8:51pm UTC](https://discuss.elastic.co/t/kibana-plugin-idea-custom-alert-connector/272846 "2021-05-18T20:51:52Z")

</div>

Hi, I have been looking into alerting on Kibana, but only the internal connectors are available on the basic license. Is it possible to develop a custom connector for the alerting to action on a different endpoint? For…

---

## [How to fit data from unchangeable source into ECS?](https://discuss.elastic.co/t/how-to-fit-data-from-unchangeable-source-into-ecs/273126)

<div class="topic-metadata">

**Author:** [@TheGerd](https://discuss.elastic.co/u/TheGerd)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 8:07pm UTC](https://discuss.elastic.co/t/how-to-fit-data-from-unchangeable-source-into-ecs/273126 "2021-05-18T20:07:27Z")

</div>

Hello. I am used to the very basic concepts of Elasticsearch but now facing an issue where I don't know how to proceed. I am indexing data in a fixed format and I am not able to change the format at the source. Now I wa…

---

## [APM Span mappings keep getting back to defaults](https://discuss.elastic.co/t/apm-span-mappings-keep-getting-back-to-defaults/273119)

<div class="topic-metadata">

**Author:** [@Rodrigo\_Jimenez](https://discuss.elastic.co/u/Rodrigo_Jimenez)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 6:44pm UTC](https://discuss.elastic.co/t/apm-span-mappings-keep-getting-back-to-defaults/273119 "2021-05-18T18:44:32Z")

</div>

Hi!, I'm running the ElasticStack v7.11.1. Lately I had the need to start indexing a couple of request header values that came to some APM logs I'm collecting. To do that I had to mark the http.request.headers object as…

---

## [Disabling controls in dashboard](https://discuss.elastic.co/t/disabling-controls-in-dashboard/273027)

<div class="topic-metadata">

**Author:** [@Alexandre.Bernier](https://discuss.elastic.co/u/Alexandre.Bernier)\
**Replies:** 4\
**Last updated:** [May 18, 2021, 5:15pm UTC](https://discuss.elastic.co/t/disabling-controls-in-dashboard/273027 "2021-05-18T17:15:23Z")

</div>

Hello there, I'm running the stack 7.10 and I would like to know if there is a way to disable a control in a dashboard? Since we can't pre-filter a control (issue #17301) to display a single value or exclude differents…

---

## [Grokparsefailure on logstash](https://discuss.elastic.co/t/grokparsefailure-on-logstash/273047)

<div class="topic-metadata">

**Author:** [@srk1](https://discuss.elastic.co/u/srk1)\
**Replies:** 8\
**Last updated:** [May 18, 2021, 5:12pm UTC](https://discuss.elastic.co/t/grokparsefailure-on-logstash/273047 "2021-05-18T17:12:29Z")

</div>

Hi ES users, i'm trying to send a simple log using filebeat on to ES via logstash and i'm experiencing grokparsefailure errors on kibana. Can someone please assist on what type of grok filter needs to be used? Below is t…

---

## [Duplicate logstash-\*](https://discuss.elastic.co/t/duplicate-logstash/271474)

<div class="topic-metadata">

**Author:** [@Bency\_Mathew](https://discuss.elastic.co/u/Bency_Mathew)\
**Replies:** 2\
**Last updated:** [May 18, 2021, 4:27pm UTC](https://discuss.elastic.co/t/duplicate-logstash/271474 "2021-05-18T16:27:59Z")

</div>

f there are two pattern's with same name, say for example logstash- (deafult)\* logstash-\* field\_id shows up in logstash- (\* default ) FieldID shows up in logstash-\* (Once we delete the non-default index logstash-\* …

---

## [Notifications:banner](https://discuss.elastic.co/t/notifications-banner/273259)

<div class="topic-metadata">

**Author:** [@Bency\_Mathew](https://discuss.elastic.co/u/Bency_Mathew)\
**Replies:** 1\
**Last updated:** [May 18, 2021, 4:23pm UTC](https://discuss.elastic.co/t/notifications-banner/273259 "2021-05-18T16:23:09Z")

</div>

Adding notifications:banner to kibana.yml.j2 file fails notifications.banner: "Steps to raise a \[Wiki access request for Kibana \](Wiki URL)

---

## [Multi\_terms aggregation gives me an error](https://discuss.elastic.co/t/multi-terms-aggregation-gives-me-an-error/272328)

<div class="topic-metadata">

**Author:** [@pmsearcher](https://discuss.elastic.co/u/pmsearcher)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 4:13pm UTC](https://discuss.elastic.co/t/multi-terms-aggregation-gives-me-an-error/272328 "2021-05-18T16:13:31Z")

</div>

Hello ! I'm trying to use ElasticSearch v. 7.11.1 on Windows 10. I don't know how to make multi\_terms aggregation work. This query: { "aggs": { "test\_agg": { "multi\_terms": { "terms": \[{ "…

---

## [Monitoring of an application on a tomcat](https://discuss.elastic.co/t/monitoring-of-an-application-on-a-tomcat/271047)

<div class="topic-metadata">

**Author:** [@Nigmur](https://discuss.elastic.co/u/Nigmur)\
**Replies:** 8\
**Last updated:** [May 18, 2021, 4:03pm UTC](https://discuss.elastic.co/t/monitoring-of-an-application-on-a-tomcat/271047 "2021-05-18T16:03:53Z")

</div>

Hi everyone, I am having issues in monitoring a java application inside a tomcat. I am monitoring the tomcat with a java agent and i see everything correctly. But when i install an application on it it seems that i can'…

---

## [Elastic endpoint is not sending to TLS protected cluster](https://discuss.elastic.co/t/elastic-endpoint-is-not-sending-to-tls-protected-cluster/273080)

<div class="topic-metadata">

**Author:** [@Bert\_Colemont](https://discuss.elastic.co/u/Bert_Colemont)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 3:52pm UTC](https://discuss.elastic.co/t/elastic-endpoint-is-not-sending-to-tls-protected-cluster/273080 "2021-05-18T15:52:18Z")

</div>

Hi all, I have managed to setup an elastic cluster with 3 nodes. Kibana is running on node-1 Now I installed the elastic endpoint agent to my windows machine. .\\elastic-agent.exe install -f --kibana-url=http://elasti…

---

## [Listen loop error: #\<IOError: closed stream\>](https://discuss.elastic.co/t/listen-loop-error-ioerror-closed-stream/273314)

<div class="topic-metadata">

**Author:** [@Carlos\_Velasquez](https://discuss.elastic.co/u/Carlos_Velasquez)\
**Replies:** 0\
**Last updated:** [May 18, 2021, 3:49pm UTC](https://discuss.elastic.co/t/listen-loop-error-ioerror-closed-stream/273314 "2021-05-18T15:49:51Z")

</div>

Hi, When I start the logstash (manual invocation), I receive the folowing error. the version i'm using is 7.12.1 and Centos 8 Operating System: CentOS Linux 8 CPE OS Name: cpe:/o:centos:centos:8 K…

---

## [Replay rule on old index dates](https://discuss.elastic.co/t/replay-rule-on-old-index-dates/272857)

<div class="topic-metadata">

**Author:** [@priamai](https://discuss.elastic.co/u/priamai)\
**Replies:** 9\
**Last updated:** [May 18, 2021, 2:56pm UTC](https://discuss.elastic.co/t/replay-rule-on-old-index-dates/272857 "2021-05-18T14:56:34Z")

</div>

Hi there, I have 90 days worth of windows event logs (partitioned per day) and a set of rules that I want to apply on those days. I noticed that when I activate a rule it can only go forward in time, is there a way to …

---

## [Logstash: формирование @timestamp, используя имя файла лога и данные самого лога](https://discuss.elastic.co/t/logstash-timestamp/273303)

<div class="topic-metadata">

**Author:** [@lkfmasd](https://discuss.elastic.co/u/lkfmasd)\
**Replies:** 1\
**Last updated:** [May 18, 2021, 2:55pm UTC](https://discuss.elastic.co/t/logstash-timestamp/273303 "2021-05-18T14:55:26Z")

</div>

Добрый день. На текущий момент поле @timestamp формируется, исходя из даты, когда данные были переданы в elastic. Подскажите пожалуйста, как в logstash полностью сформировать @timestamp при условии, что каждый файл лог…

[Previous page](https://discuss.elastic.co/latest.md?page=1671)

[Next page](https://discuss.elastic.co/latest.md?page=1673)
