# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1632

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1633

---

## [Logstash configuration advice needed](https://discuss.elastic.co/t/logstash-configuration-advice-needed/259376)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 12:17pm UTC](https://discuss.elastic.co/t/logstash-configuration-advice-needed/259376 "2020-12-22T12:17:08Z")

</div>

Dears, I need your advice in case of configuration of Logstash. Currently the configuration looks like this one: cat /etc/logstash/conf.d/logstash.conf input { beats { port =\> 5044 ssl =\> true ssl\_certif…

---

## [Displaying numbers as 1M,1B,1K in kibana](https://discuss.elastic.co/t/displaying-numbers-as-1m-1b-1k-in-kibana/259227)

<div class="topic-metadata">

**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\
**Replies:** 6\
**Last updated:** [December 22, 2020, 12:12pm UTC](https://discuss.elastic.co/t/displaying-numbers-as-1m-1b-1k-in-kibana/259227 "2020-12-22T12:12:37Z")

</div>

Hi Team, I'm are using Visual builder to show some metrices over the time, as these number are very big I have customized the format as "0.0a" It shows the number in proper format ,but the issue is with the abbreviati…

---

## [Logstash replace string and insert new line](https://discuss.elastic.co/t/logstash-replace-string-and-insert-new-line/259377)

<div class="topic-metadata">

**Author:** [@Muhammad\_Faisal](https://discuss.elastic.co/u/Muhammad_Faisal)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 11:49am UTC](https://discuss.elastic.co/t/logstash-replace-string-and-insert-new-line/259377 "2020-12-22T11:49:35Z")

</div>

hi guys, need to replace all occurrences of | with newline in field , gsub does not accept \\n or \\r...any idea as it will replace it with actual \\n mutate { gsub =\> \[ "message", "|", "\\n" \]}\`

---

## [Unable to parse the mule logs in logstash](https://discuss.elastic.co/t/unable-to-parse-the-mule-logs-in-logstash/259265)

<div class="topic-metadata">

**Author:** [@vinodkumar](https://discuss.elastic.co/u/vinodkumar)\
**Replies:** 10\
**Last updated:** [December 22, 2020, 7:31am UTC](https://discuss.elastic.co/t/unable-to-parse-the-mule-logs-in-logstash/259265 "2020-12-22T07:31:57Z")

</div>

Hi Team, I am trying to parse the mule application logs logstash, tried different options but unable to achieve it. My sample logs: 2020-12-18 10:27:10,666 \[\[hl7v2-ORU-message-processor-api\].hl7v2-fhir-api-flowsFlow.s…

---

## [Path "/usr/share/logstash/data" must be a writable directory -- Most secure way to make it so?](https://discuss.elastic.co/t/path-usr-share-logstash-data-must-be-a-writable-directory-most-secure-way-to-make-it-so/259338)

<div class="topic-metadata">

**Author:** [@danibe](https://discuss.elastic.co/u/danibe)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 7:38am UTC](https://discuss.elastic.co/t/path-usr-share-logstash-data-must-be-a-writable-directory-most-secure-way-to-make-it-so/259338 "2020-12-22T07:38:56Z")

</div>

Running '/usr/share/logstash/bin/logstash' as root works perfectly but obviously is not the recommended long term mode of use. So, I did: chown -R logstash:logstash conf.d chmod -R 775 /usr/share/logstash/data sudo use…

---

## [Elastic Maps Displaying Numbers in the format of Thousand separator (,)](https://discuss.elastic.co/t/elastic-maps-displaying-numbers-in-the-format-of-thousand-separator/259224)

<div class="topic-metadata">

**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 11:32am UTC](https://discuss.elastic.co/t/elastic-maps-displaying-numbers-in-the-format-of-thousand-separator/259224 "2020-12-22T11:32:23Z")

</div>

Hi Team, Is there anyway to make Thousands separator with commas in Maps? It will be easy for an user to catch the numbers without counting digits. Unfortunately in version 7.9 Maps doesn't show digits with commas. …

---

## [Does the .tar.gz archive include the systemd module?](https://discuss.elastic.co/t/does-the-tar-gz-archive-include-the-systemd-module/259372)

<div class="topic-metadata">

**Author:** [@JDP](https://discuss.elastic.co/u/JDP)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 11:20am UTC](https://discuss.elastic.co/t/does-the-tar-gz-archive-include-the-systemd-module/259372 "2020-12-22T11:20:58Z")

</div>

Hi all, I have a working installation of Elasticsearch 7.10.1 on Debian 10.7, which was installed via the tar.gz archive into /opt/elasticseach, however I'm having trouble using systemd to control startup\\shutdown. Bec…

---

## [How to hide inspect option from the visualization](https://discuss.elastic.co/t/how-to-hide-inspect-option-from-the-visualization/259223)

<div class="topic-metadata">

**Author:** [@anjali28](https://discuss.elastic.co/u/anjali28)\
**Replies:** 8\
**Last updated:** [December 22, 2020, 11:15am UTC](https://discuss.elastic.co/t/how-to-hide-inspect-option-from-the-visualization/259223 "2020-12-22T11:15:32Z")

</div>

\-I have created a dashboard in default space. -Created a role with read only permission and given access the role to a user. -When i login from user , i see the dashboard in read only mode but if we can hide the "OPTIO…

---

## [Search template inclusion](https://discuss.elastic.co/t/search-template-inclusion/259374)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 11:15am UTC](https://discuss.elastic.co/t/search-template-inclusion/259374 "2020-12-22T11:15:15Z")

</div>

We use several search templates with the same query: { ... } section. I'm wondering, if it is possible to store that part as another template and include it in the main ones? Thanks!

---

## [Elastic Maps - Drill Down option to another dashboard](https://discuss.elastic.co/t/elastic-maps-drill-down-option-to-another-dashboard/259226)

<div class="topic-metadata">

**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 11:14am UTC](https://discuss.elastic.co/t/elastic-maps-drill-down-option-to-another-dashboard/259226 "2020-12-22T11:14:08Z")

</div>

Hi Team, In current version of kibana ,maps doesn't have an option of drilldown to another page. This is a great feature which gives more insights to user if it gives drilldown option. We have an use case to display g…

---

## [\[Filebeat\] Redis Cluster support](https://discuss.elastic.co/t/filebeat-redis-cluster-support/259107)

<div class="topic-metadata">

**Author:** [@Henrikaya](https://discuss.elastic.co/u/Henrikaya)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 10:42am UTC](https://discuss.elastic.co/t/filebeat-redis-cluster-support/259107 "2020-12-22T10:42:04Z")

</div>

Hi Beats team, My company is planning to move from Redis "classic" (single instance) to Redis Cluster very soon, which is used in our platform for business usages, but also for logging purposes with Filebeat. When tryi…

---

## [Painless Script Caching Question](https://discuss.elastic.co/t/painless-script-caching-question/259361)

<div class="topic-metadata">

**Author:** [@Arthur\_Zheng](https://discuss.elastic.co/u/Arthur_Zheng)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 10:14am UTC](https://discuss.elastic.co/t/painless-script-caching-question/259361 "2020-12-22T10:14:17Z")

</div>

We are using es 7.1. We have an error “Too many dynamic script compilations within”。 It can be fixed by increase some params： script.context.$CONTEXT.max\_compilations\_rate My question is ： Es 7.1 Supports a monitori…

---

## [Decode kafka message](https://discuss.elastic.co/t/decode-kafka-message/259355)

<div class="topic-metadata">

**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 9:47am UTC](https://discuss.elastic.co/t/decode-kafka-message/259355 "2020-12-22T09:47:13Z")

</div>

Hi there i have a logstash config like this: input{ kafka { bootstrap\_servers =\> "localhost:9092" topics =\> \["xx"\] client\_id =\> "v1" group\_id =\> "v1-g" } } out…

---

## [Index health status coming as 'red\*'](https://discuss.elastic.co/t/index-health-status-coming-as-red/259049)

<div class="topic-metadata">

**Author:** [@NinjaMonkey](https://discuss.elastic.co/u/NinjaMonkey)\
**Replies:** 7\
**Last updated:** [December 22, 2020, 9:27am UTC](https://discuss.elastic.co/t/index-health-status-coming-as-red/259049 "2020-12-22T09:27:39Z")

</div>

Using ES 6.5.4 I am using NEST query that basically looks for cat indices for my client and gets health status for all the indices. The expected health statuses are green, yellow and red. However, for one of my lower e…

---

## [Login directly to a certain dashboard](https://discuss.elastic.co/t/login-directly-to-a-certain-dashboard/259317)

<div class="topic-metadata">

**Author:** [@Amphagory](https://discuss.elastic.co/u/Amphagory)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 9:17am UTC](https://discuss.elastic.co/t/login-directly-to-a-certain-dashboard/259317 "2020-12-22T09:17:50Z")

</div>

Hello, I know you can set in Kibana.yml to login directly to the dashboard page. I was wondering if you can specify a particular dashboard name or something similar? I have several spaces with each with a dashboard of…

---

## [Kibana did not load properly while connecting with VPN](https://discuss.elastic.co/t/kibana-did-not-load-properly-while-connecting-with-vpn/259343)

<div class="topic-metadata">

**Author:** [@adiel\_siman\_tov](https://discuss.elastic.co/u/adiel_siman_tov)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 9:10am UTC](https://discuss.elastic.co/t/kibana-did-not-load-properly-while-connecting-with-vpn/259343 "2020-12-22T09:10:29Z")

</div>

Hi I'm using Kibana 7.2.0 on K8S behind AWS load balancer, and it works fine till yesterday. Usually I'm connecting with my work VPN to Kibana, but from yesterday it just show the error: 'Kibana did not load properly'…

---

## [Integer field behaving as string](https://discuss.elastic.co/t/integer-field-behaving-as-string/259280)

<div class="topic-metadata">

**Author:** [@wissam](https://discuss.elastic.co/u/wissam)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 9:08am UTC](https://discuss.elastic.co/t/integer-field-behaving-as-string/259280 "2020-12-22T09:08:33Z")

</div>

Hi, I'm facing a weird problem with field types in Elasticsearch (7.5.3). I have a field of type "integer" (explicitly mapped), but every time I try to update it via a painless script by doing ctx.\_source.myfield += 1,…

---

## [Canvas kibana visualization filter](https://discuss.elastic.co/t/canvas-kibana-visualization-filter/259288)

<div class="topic-metadata">

**Author:** [@probson](https://discuss.elastic.co/u/probson)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 8:45am UTC](https://discuss.elastic.co/t/canvas-kibana-visualization-filter/259288 "2020-12-22T08:45:11Z")

</div>

Hi, Is it possible to add filters to Kibana visualizations within Canvas? We create reports for customers and it would be useful to create the generic visualizations, create reports for each customer and and the filter …

---

## [Change limit on max. number of spaces for Elastic Cloud SaaS deployment](https://discuss.elastic.co/t/change-limit-on-max-number-of-spaces-for-elastic-cloud-saas-deployment/259344)

<div class="topic-metadata">

**Author:** [@sharmashrayansh](https://discuss.elastic.co/u/sharmashrayansh)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 8:44am UTC](https://discuss.elastic.co/t/change-limit-on-max-number-of-spaces-for-elastic-cloud-saas-deployment/259344 "2020-12-22T08:44:52Z")

</div>

Hello, We are evaluating Elastic's managed cloud service for a big project. We would like to assign a personal Kibana Space for each user. We would have approx. 20k users. I created a trial account with Elastic and Ki…

---

## [Login from external application to kibana](https://discuss.elastic.co/t/login-from-external-application-to-kibana/259336)

<div class="topic-metadata">

**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 8:12am UTC](https://discuss.elastic.co/t/login-from-external-application-to-kibana/259336 "2020-12-22T08:12:51Z")

</div>

Hi, I need help for login from external application to Kibana with the same credentials . I don't want my application users to login again in kibana. My Application user's login credentials are saved in postgresql. Ple…

---

## [Sending metadata with external users](https://discuss.elastic.co/t/sending-metadata-with-external-users/258551)

<div class="topic-metadata">

**Author:** [@mahi2](https://discuss.elastic.co/u/mahi2)\
**Replies:** 4\
**Last updated:** [December 22, 2020, 7:53am UTC](https://discuss.elastic.co/t/sending-metadata-with-external-users/258551 "2020-12-22T07:53:17Z")

</div>

Hi, I have a scenario where the OpenID Connect users (external users) login to elastic search cloud. Is there a way to send some metadata along with the external user using an API ? To explain clearly, I've given an ex…

---

## [Retrieving keys from logstash-keystore externally](https://discuss.elastic.co/t/retrieving-keys-from-logstash-keystore-externally/259342)

<div class="topic-metadata">

**Author:** [@mahi2](https://discuss.elastic.co/u/mahi2)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 7:51am UTC](https://discuss.elastic.co/t/retrieving-keys-from-logstash-keystore-externally/259342 "2020-12-22T07:51:55Z")

</div>

Hi I need to retrieve keys in logstash-keystore externally. Currently it only allows to retrieve it from logstash using config file. I'd like to know if there is a way to get it from cmd line or maybe any way other th…

---

## [Creating alert for custom dashboard](https://discuss.elastic.co/t/creating-alert-for-custom-dashboard/259105)

<div class="topic-metadata">

**Author:** [@lokeshbabloo](https://discuss.elastic.co/u/lokeshbabloo)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 7:49am UTC](https://discuss.elastic.co/t/creating-alert-for-custom-dashboard/259105 "2020-12-22T07:49:41Z")

</div>

Hi I am having a dashboard like this I want to create an alert for the partcular panel " Log messages with error" , so that i can get an email alert if the "Error " occurs in that panel. is there any way to do that?

---

## [My cluster stopped ingesting due to low disk space but beats did not seem to recover all missed events](https://discuss.elastic.co/t/my-cluster-stopped-ingesting-due-to-low-disk-space-but-beats-did-not-seem-to-recover-all-missed-events/258210)

<div class="topic-metadata">

**Author:** [@netfire](https://discuss.elastic.co/u/netfire)\
**Replies:** 1\
**Last updated:** [December 22, 2020, 6:52am UTC](https://discuss.elastic.co/t/my-cluster-stopped-ingesting-due-to-low-disk-space-but-beats-did-not-seem-to-recover-all-missed-events/258210 "2020-12-22T06:52:51Z")

</div>

Newbie here. I had an event the other day due to not minding my index lifecycle policies. The cluster went yellow as there were unallocated shards (seemed like shards had moved completely off the first node to hit the di…

---

## [Filebeat IBMMQ module logs](https://discuss.elastic.co/t/filebeat-ibmmq-module-logs/257499)

<div class="topic-metadata">

**Author:** [@ajesh](https://discuss.elastic.co/u/ajesh)\
**Replies:** 6\
**Last updated:** [December 22, 2020, 6:28am UTC](https://discuss.elastic.co/t/filebeat-ibmmq-module-logs/257499 "2020-12-22T06:28:49Z")

</div>

Hi Team, We are trying to integrate IBMMQ logs to elasticsearch using filebeat and its default ibmmq module. We are able to see the logs getting send to the elasticsearch from the filebeat debug logs. But we are unable…

---

## [ElasticSearch \`Search\` Usage Metrics and total queries count](https://discuss.elastic.co/t/elasticsearch-search-usage-metrics-and-total-queries-count/259335)

<div class="topic-metadata">

**Author:** [@sb\_chat\_v1](https://discuss.elastic.co/u/sb_chat_v1)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 6:28am UTC](https://discuss.elastic.co/t/elasticsearch-search-usage-metrics-and-total-queries-count/259335 "2020-12-22T06:28:20Z")

</div>

We have a use-case which requires us to maintain count of total search queries. We need to do this on an index or index-alias basis and for this we are passing in a custom stats-group (as part of the \_search request). No…

---

## [Last value is not advancing after manual modification of the file](https://discuss.elastic.co/t/last-value-is-not-advancing-after-manual-modification-of-the-file/259333)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 0\
**Last updated:** [December 22, 2020, 6:21am UTC](https://discuss.elastic.co/t/last-value-is-not-advancing-after-manual-modification-of-the-file/259333 "2020-12-22T06:21:11Z")

</div>

Hi, after manipulating the last value file, its not moving forward in time anymore, this is my last value file --- !ruby/object:DateTime '2020-12-18 20:39:46.000000000 Z' and it seems that is writing duplicates every t…

---

## [Canvas kibana](https://discuss.elastic.co/t/canvas-kibana/259230)

<div class="topic-metadata">

**Author:** [@salma\_widiarti](https://discuss.elastic.co/u/salma_widiarti)\
**Replies:** 4\
**Last updated:** [December 22, 2020, 5:52am UTC](https://discuss.elastic.co/t/canvas-kibana/259230 "2020-12-22T05:52:25Z")

</div>

Hi all, I want to create data like this in canvas kibana And this is my query essql SELECT (labels.money::int) as a FROM "apm-\*" WHERE labels.status = 'PAID' When I preview the result the data type is already numer…

---

## [Search rejection when a shard relocation is complete](https://discuss.elastic.co/t/search-rejection-when-a-shard-relocation-is-complete/258829)

<div class="topic-metadata">

**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 3:44am UTC](https://discuss.elastic.co/t/search-rejection-when-a-shard-relocation-is-complete/258829 "2020-12-22T03:44:22Z")

</div>

There was a rare issue when I tried to add several data nodes to my online ES cluster yesterday. When the new data nodes joined to the cluster, it began to rebalance shards to these new data nodes. Most of the shard re…

---

## [Elastic agent fleet enrollment with Nginx authentication help](https://discuss.elastic.co/t/elastic-agent-fleet-enrollment-with-nginx-authentication-help/259311)

<div class="topic-metadata">

**Author:** [@jgarcia](https://discuss.elastic.co/u/jgarcia)\
**Replies:** 6\
**Last updated:** [December 22, 2020, 1:13am UTC](https://discuss.elastic.co/t/elastic-agent-fleet-enrollment-with-nginx-authentication-help/259311 "2020-12-22T01:13:17Z")

</div>

I setup an ELK stack server along with Nginx. I am trying to make use of the Elastic Agent Fleet enrollment so that I can utilize the endpoint security and do some digging. However, I noticed that if I try to enroll an a…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1631)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1633)
