# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1628

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1629

---

## [Logstash doesnt update the data when mongodb data gets updated](https://discuss.elastic.co/t/logstash-doesnt-update-the-data-when-mongodb-data-gets-updated/259562)

<div class="topic-metadata">

**Author:** [@Siddhanta\_Das](https://discuss.elastic.co/u/Siddhanta_Das)\
**Replies:** 1\
**Last updated:** [December 25, 2020, 8:42am UTC](https://discuss.elastic.co/t/logstash-doesnt-update-the-data-when-mongodb-data-gets-updated/259562 "2020-12-25T08:42:18Z")

</div>

I am using this configuration input{ mongodb{ uri=\>"mongodb://localhost:27017/ebyat" placeholder\_db\_dir =\> "/opt/logstash-mongodb/" placeholder\_db\_name =\> "logstash\_sqlite.db" collection =\> "amenities" batch\_size =\>…

---

## [Grok pattern to match multiple results](https://discuss.elastic.co/t/grok-pattern-to-match-multiple-results/259605)

<div class="topic-metadata">

**Author:** [@Minor\_Vargas](https://discuss.elastic.co/u/Minor_Vargas)\
**Replies:** 1\
**Last updated:** [December 25, 2020, 8:29am UTC](https://discuss.elastic.co/t/grok-pattern-to-match-multiple-results/259605 "2020-12-25T08:29:14Z")

</div>

Hi guys, I need to match the first line of each log and maybe store it in an array and prepend some metadata at the beginning of each line.. I have a grok pattern that's matching only the first result and ignores the re…

---

## [Line chart canvas visualization](https://discuss.elastic.co/t/line-chart-canvas-visualization/259466)

<div class="topic-metadata">

**Author:** [@salma\_widiarti](https://discuss.elastic.co/u/salma_widiarti)\
**Replies:** 2\
**Last updated:** [December 25, 2020, 5:54am UTC](https://discuss.elastic.co/t/line-chart-canvas-visualization/259466 "2020-12-25T05:54:24Z")

</div>

Hi all, I have data like this And this is my query SELECT substring(labels.tanggal,1,4) as date1, SUM(labels.money::int) as a FROM "apm-\*" WHERE labels.status = 'PAID' GROUP BY date1 But why when I make a visualiza…

---

## [Grok pattern to add some metadata to every log](https://discuss.elastic.co/t/grok-pattern-to-add-some-metadata-to-every-log/259432)

<div class="topic-metadata">

**Author:** [@Minor\_Vargas](https://discuss.elastic.co/u/Minor_Vargas)\
**Replies:** 1\
**Last updated:** [December 23, 2020, 6:48am UTC](https://discuss.elastic.co/t/grok-pattern-to-add-some-metadata-to-every-log/259432 "2020-12-23T06:48:39Z")

</div>

Hello all, I wrote a grok pattern that matches the beginning of each log line (Writing table data). I need to take the timestamp that I already matched and append it at the beginning of each log line. I'm facing 2 issue…

---

## [Index Management Tab is not visible after updating to 7.9.1](https://discuss.elastic.co/t/index-management-tab-is-not-visible-after-updating-to-7-9-1/259418)

<div class="topic-metadata">

**Author:** [@oskrdt](https://discuss.elastic.co/u/oskrdt)\
**Replies:** 6\
**Last updated:** [December 24, 2020, 6:01pm UTC](https://discuss.elastic.co/t/index-management-tab-is-not-visible-after-updating-to-7-9-1/259418 "2020-12-24T18:01:51Z")

</div>

Hi, I'm working with Elasticsearch and Kibana on Power PC docker containers. I'm using the Dockerfiles from ppc64le/build-scripts repository to create the container images, which use the source code on GitHub from the e…

---

## [How Resubscribe watcher email](https://discuss.elastic.co/t/how-resubscribe-watcher-email/259598)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 4\
**Last updated:** [December 24, 2020, 5:49pm UTC](https://discuss.elastic.co/t/how-resubscribe-watcher-email/259598 "2020-12-24T17:49:41Z")

</div>

how can i re-subscribe my mail to the watcher alerts, it no longer notifies me when an event happens in a watcher, i accidentally gave it in unsubscribed, but now i don't know how to re-subscribe my mail to get the alert…

---

## [Snapshot Policy Based on Data Phase](https://discuss.elastic.co/t/snapshot-policy-based-on-data-phase/259595)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 5\
**Last updated:** [December 24, 2020, 5:46pm UTC](https://discuss.elastic.co/t/snapshot-policy-based-on-data-phase/259595 "2020-12-24T17:46:17Z")

</div>

Hi All, I was wondering if it's possible to create snapshot policies that include/exclude indices based on their phase? I wasn't able to find any documentation on this and didn't see any posts about it. The use case I …

---

## [ERR\_TOO\_MANY\_REDIRECTS 302 with ELK Operator 7.10.0](https://discuss.elastic.co/t/err-too-many-redirects-302-with-elk-operator-7-10-0/259504)

<div class="topic-metadata">

**Author:** [@inforedaster](https://discuss.elastic.co/u/inforedaster)\
**Replies:** 6\
**Last updated:** [December 24, 2020, 5:11pm UTC](https://discuss.elastic.co/t/err-too-many-redirects-302-with-elk-operator-7-10-0/259504 "2020-12-24T17:11:15Z")

</div>

hello, i have an Elastick stack elasticsearch and kibana 7.10.0 using elk operator in kubernetes Whene i make the link https://monitoring.cloudapp.azure.com/kibana i have this redirection : https://monitoring.cloudap…

---

## [How to add Len dashboards to canvas](https://discuss.elastic.co/t/how-to-add-len-dashboards-to-canvas/259494)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 8\
**Last updated:** [December 23, 2020, 4:59pm UTC](https://discuss.elastic.co/t/how-to-add-len-dashboards-to-canvas/259494 "2020-12-23T16:59:15Z")

</div>

Hello, I have created a dashboards using Len to display the new users created in my different AD, and the name of the machine where they have been created, I added some filters and the final result look like that: Th…

---

## [Filebeat-logstash issue](https://discuss.elastic.co/t/filebeat-logstash-issue/259576)

<div class="topic-metadata">

**Author:** [@mustafa.husny](https://discuss.elastic.co/u/mustafa.husny)\
**Replies:** 2\
**Last updated:** [December 24, 2020, 12:55pm UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576 "2020-12-24T12:55:57Z")

</div>

I am using ELK 7.6.2 I have three piplines first for the heartbeat second for the tcp to forward logs from QRadar Third is for filebeat I am receiving logs from heartbeat and qradar, but when I installed filebeat on…

---

## [Is there any way to configure HTTPS without X-Pack](https://discuss.elastic.co/t/is-there-any-way-to-configure-https-without-x-pack/259588)

<div class="topic-metadata">

**Author:** [@Shubham](https://discuss.elastic.co/u/Shubham)\
**Replies:** 1\
**Last updated:** [December 24, 2020, 12:38pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-configure-https-without-x-pack/259588 "2020-12-24T12:38:40Z")

</div>

Is there any way to configure HTTPS in ES cluster without using x-pack ? I'm using 5.4 version. I know it is doable freely in 6.8+ but any lead with 5.4 version ?

---

## [Filter logstash with grok not work](https://discuss.elastic.co/t/filter-logstash-with-grok-not-work/259324)

<div class="topic-metadata">

**Author:** [@eebor](https://discuss.elastic.co/u/eebor)\
**Replies:** 5\
**Last updated:** [December 24, 2020, 12:31pm UTC](https://discuss.elastic.co/t/filter-logstash-with-grok-not-work/259324 "2020-12-24T12:31:10Z")

</div>

anyone can help, i want to filter my log this is my log {Level:info Time:2020-12-03 12:14:28.203517503 +0700 WIB m=+18300.336235694 LoggerName: somefield Message://app/snmaterialdetail/4550554942/V222FAK-BA341T Caller:…

---

## [Bucket Terms aggregation, top 20 values](https://discuss.elastic.co/t/bucket-terms-aggregation-top-20-values/259031)

<div class="topic-metadata">

**Author:** [@grra](https://discuss.elastic.co/u/grra)\
**Replies:** 7\
**Last updated:** [December 24, 2020, 11:09am UTC](https://discuss.elastic.co/t/bucket-terms-aggregation-top-20-values/259031 "2020-12-24T11:09:47Z")

</div>

Hi, on my Buckets I have the Terms aggregation, with a field of the type number. I need the 20 biggest values of that field - in ascending order. Is it possible to order the Terms ascending and then take the last 20 …

---

## [Logstash filter plugin needs certificate with dns name](https://discuss.elastic.co/t/logstash-filter-plugin-needs-certificate-with-dns-name/259281)

<div class="topic-metadata">

**Author:** [@Moni\_Kherajani](https://discuss.elastic.co/u/Moni_Kherajani)\
**Replies:** 13\
**Last updated:** [December 24, 2020, 10:48am UTC](https://discuss.elastic.co/t/logstash-filter-plugin-needs-certificate-with-dns-name/259281 "2020-12-24T10:48:05Z")

</div>

Hi i tried to configure security in elkstack and wanted a common certificate in all nodes environments but logstash fillter plugin needs dns name to speicified else wont work, any other solution?

---

## [Enrich documents with another json file](https://discuss.elastic.co/t/enrich-documents-with-another-json-file/259004)

<div class="topic-metadata">

**Author:** [@anon42972578](https://discuss.elastic.co/u/anon42972578)\
**Replies:** 1\
**Last updated:** [December 24, 2020, 10:47am UTC](https://discuss.elastic.co/t/enrich-documents-with-another-json-file/259004 "2020-12-24T10:47:57Z")

</div>

Hello, we have a server with logfiles in directories: /xxx/log1/ - test-1.log - test-2.log - enrich-log1.json /xxx/log2/ - test-1.log - test-2.log - enrich-log2.json and so on.... the json file "enrich-log\*.json" ha…

---

## [Winlogbeat unable to keep up with AD security logs](https://discuss.elastic.co/t/winlogbeat-unable-to-keep-up-with-ad-security-logs/259582)

<div class="topic-metadata">

**Author:** [@zhumphries](https://discuss.elastic.co/u/zhumphries)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 10:39am UTC](https://discuss.elastic.co/t/winlogbeat-unable-to-keep-up-with-ad-security-logs/259582 "2020-12-24T10:39:49Z")

</div>

Hello. We have recently started using winlogbeat to collect security logs from the Domain Controllers but winlogbeat is struggling to keep up with the required ingest rate. The server in question is generating approx 30…

---

## [Strange memory leak ElasticSearch](https://discuss.elastic.co/t/strange-memory-leak-elasticsearch/258814)

<div class="topic-metadata">

**Author:** [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)\
**Replies:** 20\
**Last updated:** [December 24, 2020, 10:33am UTC](https://discuss.elastic.co/t/strange-memory-leak-elasticsearch/258814 "2020-12-24T10:33:32Z")

</div>

Hi, we have a cluster of ES. Our Heap is 31 Gb on each node. Total RAM 128 Gb on each node. And our RAM fills up over time and starts to run out, it that time we get faults of cluster. We see that "cached" constantly …

---

## [Creating watcher script if particular value ina field occurs more than five times in five minutes interval of time](https://discuss.elastic.co/t/creating-watcher-script-if-particular-value-ina-field-occurs-more-than-five-times-in-five-minutes-interval-of-time/259340)

<div class="topic-metadata">

**Author:** [@lokeshbabloo](https://discuss.elastic.co/u/lokeshbabloo)\
**Replies:** 8\
**Last updated:** [December 24, 2020, 10:06am UTC](https://discuss.elastic.co/t/creating-watcher-script-if-particular-value-ina-field-occurs-more-than-five-times-in-five-minutes-interval-of-time/259340 "2020-12-24T10:06:24Z")

</div>

Hi can anyone help how can we create a watcher script for the below requirement I having a field called "log\_message" contaning the below message Failed to load TermRecord for TermID= here the terminal id can be any …

---

## [Intermittent search querying issues](https://discuss.elastic.co/t/intermittent-search-querying-issues/259471)

<div class="topic-metadata">

**Author:** [@Sajjan\_Kumar\_Jain](https://discuss.elastic.co/u/Sajjan_Kumar_Jain)\
**Replies:** 8\
**Last updated:** [December 24, 2020, 9:25am UTC](https://discuss.elastic.co/t/intermittent-search-querying-issues/259471 "2020-12-24T09:25:06Z")

</div>

Hi, We are using elastic search in our backend hosted on AWS. And our backend is in Java. We have seen a pattern where queries start failing for a brief period of time with the following error: cannot write time value …

---

## [Error while using ssl with basic authorization](https://discuss.elastic.co/t/error-while-using-ssl-with-basic-authorization/258839)

<div class="topic-metadata">

**Author:** [@loker](https://discuss.elastic.co/u/loker)\
**Replies:** 4\
**Last updated:** [December 24, 2020, 9:19am UTC](https://discuss.elastic.co/t/error-while-using-ssl-with-basic-authorization/258839 "2020-12-24T09:19:58Z")

</div>

Hello, Here is my config: - module: couchdb metricsets: \["server"\] period: 10s hosts: \["https://xxx.xxxx.xxx.xxx:6984/\_node/\_local/\_stats"\] ssl.verification\_mode: "none" username: xxxxx password: xxxxx I w…

---

## [Filebeat Fortinet module can't run](https://discuss.elastic.co/t/filebeat-fortinet-module-cant-run/258541)

<div class="topic-metadata">

**Author:** [@aloalo2242](https://discuss.elastic.co/u/aloalo2242)\
**Replies:** 5\
**Last updated:** [December 24, 2020, 9:10am UTC](https://discuss.elastic.co/t/filebeat-fortinet-module-cant-run/258541 "2020-12-24T09:10:34Z")

</div>

Hi, I'm trying to ship Fortigate300E Log to my Elasticstack with topo: Fortigate syslog port 514 -\> Filebeat (fortinet module) -\> Elasticsearch -\> Kibana. I have 2 question: First, is it possible? And when I run fileb…

---

## [Filebeat O365 Module Through proxy](https://discuss.elastic.co/t/filebeat-o365-module-through-proxy/259570)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 9:10am UTC](https://discuss.elastic.co/t/filebeat-o365-module-through-proxy/259570 "2020-12-24T09:10:20Z")

</div>

Hi all I have a problems with using the o365 module in filebeat. In our network in order to reach internet we need to go through a proxy server, and it is because of that the filebeat module cannot connect to the o365 …

---

## [Systemd version conflict / bug on journalbeat](https://discuss.elastic.co/t/systemd-version-conflict-bug-on-journalbeat/259569)

<div class="topic-metadata">

**Author:** [@DenizParlak](https://discuss.elastic.co/u/DenizParlak)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 9:06am UTC](https://discuss.elastic.co/t/systemd-version-conflict-bug-on-journalbeat/259569 "2020-12-24T09:06:16Z")

</div>

Hi all, Our journalbeat deployed on the Kubernetes cluster and stopped shipping logs to the elasticsearch via logstash suddenly. We got this error message first: /var/log/journal/ec28d502b342fad1a4d44d3a101845cf/system…

---

## [Accessing Elasticsearch index from flutter mobile app](https://discuss.elastic.co/t/accessing-elasticsearch-index-from-flutter-mobile-app/259567)

<div class="topic-metadata">

**Author:** [@Aimn\_Blbol](https://discuss.elastic.co/u/Aimn_Blbol)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 8:46am UTC](https://discuss.elastic.co/t/accessing-elasticsearch-index-from-flutter-mobile-app/259567 "2020-12-24T08:46:57Z")

</div>

I have created users Elasticsearch index in the Google Cloud Platform to integrate firestore cloud functions with Elasticsearch so that when a user is created / updated / deleted, the change will be reflected in the Elas…

---

## [Logstash takes all the collections from mongodb that has the collection string](https://discuss.elastic.co/t/logstash-takes-all-the-collections-from-mongodb-that-has-the-collection-string/259564)

<div class="topic-metadata">

**Author:** [@Siddhanta\_Das](https://discuss.elastic.co/u/Siddhanta_Das)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 8:25am UTC](https://discuss.elastic.co/t/logstash-takes-all-the-collections-from-mongodb-that-has-the-collection-string/259564 "2020-12-24T08:25:20Z")

</div>

I have a issue with the collection string in config file input. I have two collection with "properties" and "favourite\_properties". When I run the mongo conf file it retrive both the collection but I wan only one input{…

---

## [Pass multiple values(500 more ) in kibana dashboard](https://discuss.elastic.co/t/pass-multiple-values-500-more-in-kibana-dashboard/259463)

<div class="topic-metadata">

**Author:** [@jeff\_arthur](https://discuss.elastic.co/u/jeff_arthur)\
**Replies:** 2\
**Last updated:** [December 24, 2020, 7:39am UTC](https://discuss.elastic.co/t/pass-multiple-values-500-more-in-kibana-dashboard/259463 "2020-12-24T07:39:18Z")

</div>

Hi, How can i pass multiple values in kibana dashboard - 'add filter' - 'is one of' ? I have a txt file with 500 values ​​in it.

---

## [Remove outdated java present in Elasticsearch installation](https://discuss.elastic.co/t/remove-outdated-java-present-in-elasticsearch-installation/259553)

<div class="topic-metadata">

**Author:** [@Darshan\_Parab](https://discuss.elastic.co/u/Darshan_Parab)\
**Replies:** 0\
**Last updated:** [December 24, 2020, 6:47am UTC](https://discuss.elastic.co/t/remove-outdated-java-present-in-elasticsearch-installation/259553 "2020-12-24T06:47:45Z")

</div>

Hi, We are running Elasticsearch 7.9.1 in our environment. We have been reported that there is outdated java version installed at path /usr/share/elasticsearch/jdk. Though we are not using it to run Elasticsearch. But t…

---

## [Kibana stops working once winlogbeat starts](https://discuss.elastic.co/t/kibana-stops-working-once-winlogbeat-starts/259500)

<div class="topic-metadata">

**Author:** [@SSP](https://discuss.elastic.co/u/SSP)\
**Replies:** 2\
**Last updated:** [December 24, 2020, 5:25am UTC](https://discuss.elastic.co/t/kibana-stops-working-once-winlogbeat-starts/259500 "2020-12-24T05:25:45Z")

</div>

Hello, I'm new to the whole ELK stack, followed the setup instructions/guidance and installed on CentOS 8. Java, NGINX, Elasticsearch, Kibana and logstash installed successfully, I'm able to reach the kibana web interf…

---

## [Merging indices from old server](https://discuss.elastic.co/t/merging-indices-from-old-server/259420)

<div class="topic-metadata">

**Author:** [@alfredoCo](https://discuss.elastic.co/u/alfredoCo)\
**Replies:** 3\
**Last updated:** [December 24, 2020, 5:24am UTC](https://discuss.elastic.co/t/merging-indices-from-old-server/259420 "2020-12-24T05:24:21Z")

</div>

Hello, I need to merge the data of an index from the old server into the new one. The data has been accumulating over a month now in the new server. should I copy the data via a script? or there is a build in functiona…

---

## [Elasticsearch 7.8.1， shards allocation failed](https://discuss.elastic.co/t/elasticsearch-7-8-1-shards-allocation-failed/259352)

<div class="topic-metadata">

**Author:** [@wzhanw](https://discuss.elastic.co/u/wzhanw)\
**Replies:** 5\
**Last updated:** [December 24, 2020, 5:23am UTC](https://discuss.elastic.co/t/elasticsearch-7-8-1-shards-allocation-failed/259352 "2020-12-24T05:23:34Z")

</div>

Hi all, I'm running the ealsticsearch 7.8.1 single node cluster on my server, I got a critical error when the logstash insert document to the es. I tried to clean up the data directory and restarted the es, the error …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1627)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1629)
