# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1711

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1712

---

## [No monitoring data found](https://discuss.elastic.co/t/no-monitoring-data-found/271008)

<div class="topic-metadata">

**Author:** [@Chris\_Gatihi](https://discuss.elastic.co/u/Chris_Gatihi)\
**Replies:** 8\
**Last updated:** [April 27, 2021, 5:41am UTC](https://discuss.elastic.co/t/no-monitoring-data-found/271008 "2021-04-27T05:41:03Z")

</div>

Hi, I'm running on version 7.11.1 and I'm getting a "No monitoring data found" when I navigate to stack monitoring in Kibana. Kibana can access my Elasticsearch cluster just fine when going through the dev tools consol…

---

## [TSVB - Gauage - Bucket Script 오류 문의 (Top Hit)](https://discuss.elastic.co/t/tsvb-gauage-bucket-script-top-hit/268296)

<div class="topic-metadata">

**Author:** [@KANG](https://discuss.elastic.co/u/KANG)\
**Replies:** 4\
**Last updated:** [April 27, 2021, 5:10am UTC](https://discuss.elastic.co/t/tsvb-gauage-bucket-script-top-hit/268296 "2021-04-27T05:10:31Z")

</div>

안녕하세요. Gauage를 활용하여 메모리 사용률을 Kibana에서 시각화 하려고합니다. TSVB 활용 중 오류가 발생하여 해결방법에 대해 문의드립니다. \[구현내용\] 메모리 사용률(%) 메모리 사용량(memutilization) / 전체 메모리량(totalmem) \* 100 \[설정내용\] TSVB - Gauage - Metris 1번 Aggregation : Top Hit - t…

---

## [Fetch Agent Status](https://discuss.elastic.co/t/fetch-agent-status/271313)

<div class="topic-metadata">

**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\
**Replies:** 4\
**Last updated:** [April 27, 2021, 5:04am UTC](https://discuss.elastic.co/t/fetch-agent-status/271313 "2021-04-27T05:04:49Z")

</div>

Dear Team, Currently, we have a requirement to fetch the agent status from all servers, is there any way to fetch the agent status from all servers (Windows & Linux) and save it in elasticsearch. Please help me.!!! Th…

---

## [How to create a rollover policy in ILM which automatically moves historical indices into warm node and keeps last 2 quarter indices in hot nodes](https://discuss.elastic.co/t/how-to-create-a-rollover-policy-in-ilm-which-automatically-moves-historical-indices-into-warm-node-and-keeps-last-2-quarter-indices-in-hot-nodes/270957)

<div class="topic-metadata">

**Author:** [@sagar7645](https://discuss.elastic.co/u/sagar7645)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 4:49am UTC](https://discuss.elastic.co/t/how-to-create-a-rollover-policy-in-ilm-which-automatically-moves-historical-indices-into-warm-node-and-keeps-last-2-quarter-indices-in-hot-nodes/270957 "2021-04-27T04:49:53Z")

</div>

Hi Team, I am using elasticsearch 7.9 need to create a rollover ILM policy to keep historical indices in warm node and last 2 quarter indices on hot node. Can you please suggest me how to do that in a ILM policy. Is it…

---

## [Workaround to Dynamic Index Names When Ussing ILM Policy](https://discuss.elastic.co/t/workaround-to-dynamic-index-names-when-ussing-ilm-policy/271311)

<div class="topic-metadata">

**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 4:40am UTC](https://discuss.elastic.co/t/workaround-to-dynamic-index-names-when-ussing-ilm-policy/271311 "2021-04-27T04:40:32Z")

</div>

I apologize if this has been asked a lot, but I did a lot of reading and I'm still not quite clear. For instance: https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#\_writing\_to\_differen…

---

## [How to speed up the segment merging at night?](https://discuss.elastic.co/t/how-to-speed-up-the-segment-merging-at-night/271267)

<div class="topic-metadata">

**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\
**Replies:** 2\
**Last updated:** [April 27, 2021, 3:22am UTC](https://discuss.elastic.co/t/how-to-speed-up-the-segment-merging-at-night/271267 "2021-04-27T03:22:16Z")

</div>

The ES version is 7.11.1 I use ilm to manage my log indices hot phase: rollover warm phase (12 hours from rollover): forcemerge、read only、data allocation cold phase (5 days from rollover): freeze delete phase(10 day…

---

## [Unable to create a transform that uses "min"](https://discuss.elastic.co/t/unable-to-create-a-transform-that-uses-min/271309)

<div class="topic-metadata">

**Author:** [@Sam\_Critchley](https://discuss.elastic.co/u/Sam_Critchley)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 3:12am UTC](https://discuss.elastic.co/t/unable-to-create-a-transform-that-uses-min/271309 "2021-04-27T03:12:00Z")

</div>

I'm trying to create a transform that aggregates on min of a date field. This field is mapped in the index like so: "event\_time": { "type": "date", "format": "yyyy-MM-dd HH:mm:ss.nnnnnn" }, I…

---

## [Last query date for an index](https://discuss.elastic.co/t/last-query-date-for-an-index/270861)

<div class="topic-metadata">

**Author:** [@danielibars](https://discuss.elastic.co/u/danielibars)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 2:56am UTC](https://discuss.elastic.co/t/last-query-date-for-an-index/270861 "2021-04-27T02:56:48Z")

</div>

Hi There! I'm trying to create a rule either ILM or programmatically to remove unused indices I'm interested on deleting an index that hasn't been queried in more than 30 days, the index contains static data (html page…

---

## [Kibana performance tuning](https://discuss.elastic.co/t/kibana-performance-tuning/271152)

<div class="topic-metadata">

**Author:** [@ARDiver86](https://discuss.elastic.co/u/ARDiver86)\
**Replies:** 2\
**Last updated:** [April 27, 2021, 2:20am UTC](https://discuss.elastic.co/t/kibana-performance-tuning/271152 "2021-04-27T02:20:03Z")

</div>

We are having pretty bad performance in our new environment we setup with one Kibana server and two Elasticsearch nodes. We followed the best practices and adjusted the heap size to 31GB for both values, disabled swappin…

---

## [Logs disappeared after running applications for a few hours - ELK stack](https://discuss.elastic.co/t/logs-disappeared-after-running-applications-for-a-few-hours-elk-stack/271050)

<div class="topic-metadata">

**Author:** [@District](https://discuss.elastic.co/u/District)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 1:50am UTC](https://discuss.elastic.co/t/logs-disappeared-after-running-applications-for-a-few-hours-elk-stack/271050 "2021-04-27T01:50:39Z")

</div>

Hi, we are using ELK stack for monitoring our applications. However, it's been quite weird to us that logs kept disappearing after a few hours in kibana. The pattern was like: Deployed applications -\> logs appeared in …

---

## [Issue with elasticsearch backup using GCS](https://discuss.elastic.co/t/issue-with-elasticsearch-backup-using-gcs/271239)

<div class="topic-metadata">

**Author:** [@722826c085cfc824006d](https://discuss.elastic.co/u/722826c085cfc824006d)\
**Replies:** 0\
**Last updated:** [April 26, 2021, 10:01am UTC](https://discuss.elastic.co/t/issue-with-elasticsearch-backup-using-gcs/271239 "2021-04-26T10:01:12Z")

</div>

We are running ES cluster as kuberntes pods in google cloud environment. We are planning to trigger the snapshots and need to store the data GCS bucket. As part of snapshot, we are creating the rep0, but the repo creat…

---

## [Replication of shards with more nodes vs parallel cluster](https://discuss.elastic.co/t/replication-of-shards-with-more-nodes-vs-parallel-cluster/271035)

<div class="topic-metadata">

**Author:** [@nchalise](https://discuss.elastic.co/u/nchalise)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 1:35am UTC](https://discuss.elastic.co/t/replication-of-shards-with-more-nodes-vs-parallel-cluster/271035 "2021-04-27T01:35:36Z")

</div>

To reduce/mitigate downtime which approach is better and why? doubling the data/client nodes and having replication on the shards OR is it worth considering parallel clusters with a load balancer on the client nodes. Pl…

---

## [Ubuntu system log parsing](https://discuss.elastic.co/t/ubuntu-system-log-parsing/271293)

<div class="topic-metadata">

**Author:** [@Guncixx](https://discuss.elastic.co/u/Guncixx)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 1:30am UTC](https://discuss.elastic.co/t/ubuntu-system-log-parsing/271293 "2021-04-27T01:30:35Z")

</div>

Hi, I’m new to Elastic and trying to explore it’s security capabilities. For the testing purpose I set up some VMs and installed elastic agent to collect logs. I then tried to generate some successful and some unsuccess…

---

## [Snapshot and Repository on local machine in elastic cloud enterprise](https://discuss.elastic.co/t/snapshot-and-repository-on-local-machine-in-elastic-cloud-enterprise/271237)

<div class="topic-metadata">

**Author:** [@Kushi\_K](https://discuss.elastic.co/u/Kushi_K)\
**Replies:** 0\
**Last updated:** [April 26, 2021, 9:43am UTC](https://discuss.elastic.co/t/snapshot-and-repository-on-local-machine-in-elastic-cloud-enterprise/271237 "2021-04-26T09:43:29Z")

</div>

Hi, How to create local repository in Elastic Cloud Enterprise without using Minio. I want to store backups on my local machine using Elastic Cloud Enterprise.

---

## [Deleted field, result is successfull, but field is still there](https://discuss.elastic.co/t/deleted-field-result-is-successfull-but-field-is-still-there/271287)

<div class="topic-metadata">

**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 12:53am UTC](https://discuss.elastic.co/t/deleted-field-result-is-successfull-but-field-is-still-there/271287 "2021-04-27T00:53:45Z")

</div>

Hi, I am using Kibana for interacting with my indices. I have a field in \_source: '\_nisc\_AC' which I am trying to delete in the following way: POST grch38\_test\_\_wes\_\_grch38/\_update\_by\_query?conflicts=proceed { "scr…

---

## [Unable To Connect To theRemote Cluster](https://discuss.elastic.co/t/unable-to-connect-to-theremote-cluster/271210)

<div class="topic-metadata">

**Author:** [@yahooljy](https://discuss.elastic.co/u/yahooljy)\
**Replies:** 2\
**Last updated:** [April 27, 2021, 12:41am UTC](https://discuss.elastic.co/t/unable-to-connect-to-theremote-cluster/271210 "2021-04-27T00:41:00Z")

</div>

Hi there ! I Set up basic security for the Elastic Stack plus secured HTTPS traffic . and then my kibana can connect to the local cluster successfully . But there is something wrong with the connection between the localc…

---

## [Alerting on failed detection rules](https://discuss.elastic.co/t/alerting-on-failed-detection-rules/271300)

<div class="topic-metadata">

**Author:** [@Oliver2](https://discuss.elastic.co/u/Oliver2)\
**Replies:** 1\
**Last updated:** [April 27, 2021, 12:28am UTC](https://discuss.elastic.co/t/alerting-on-failed-detection-rules/271300 "2021-04-27T00:28:53Z")

</div>

Is it possible to create alerts based on detections rules that have failed for any reason. Ideally, it would fire into the detection queue?

---

## [Using filebeat, cannot read json log to custom index](https://discuss.elastic.co/t/using-filebeat-cannot-read-json-log-to-custom-index/270914)

<div class="topic-metadata">

**Author:** [@thuynh](https://discuss.elastic.co/u/thuynh)\
**Replies:** 2\
**Last updated:** [April 26, 2021, 9:47pm UTC](https://discuss.elastic.co/t/using-filebeat-cannot-read-json-log-to-custom-index/270914 "2021-04-26T21:47:34Z")

</div>

Index template already created. It runs but doesn''t tell me any error and can't see new index which should be call "fb-message-7.12.0-yyyy.mm.dd" I notice other issues i'm missing the param to indicate this is a custo…

---

## [Pie chart w/ data from two diff indexes](https://discuss.elastic.co/t/pie-chart-w-data-from-two-diff-indexes/271199)

<div class="topic-metadata">

**Author:** [@azulgrana](https://discuss.elastic.co/u/azulgrana)\
**Replies:** 4\
**Last updated:** [April 26, 2021, 9:13pm UTC](https://discuss.elastic.co/t/pie-chart-w-data-from-two-diff-indexes/271199 "2021-04-26T21:13:49Z")

</div>

Hi team, I have a use case where I need to graph on a single pie chart data from two different indexes. The feel that I need chart exists on both indexes and has the same name. So my question is, is it possible to creat…

---

## [Methods to loadbalance on logstash from Input data stream to Filter section](https://discuss.elastic.co/t/methods-to-loadbalance-on-logstash-from-input-data-stream-to-filter-section/271292)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 2\
**Last updated:** [April 26, 2021, 9:09pm UTC](https://discuss.elastic.co/t/methods-to-loadbalance-on-logstash-from-input-data-stream-to-filter-section/271292 "2021-04-26T21:09:13Z")

</div>

I'm looking for methods to loadbalance on logstash or elasticsearch . The requirement is that i have decently large log files with thousands of lines, while logstash is perfectly processing the log file as expected, i wa…

---

## [Json filter problème de brackets](https://discuss.elastic.co/t/json-filter-probleme-de-brackets/271024)

<div class="topic-metadata">

**Author:** [@Yahya\_Bouzoubaa](https://discuss.elastic.co/u/Yahya_Bouzoubaa)\
**Replies:** 12\
**Last updated:** [April 26, 2021, 8:27pm UTC](https://discuss.elastic.co/t/json-filter-probleme-de-brackets/271024 "2021-04-26T20:27:10Z")

</div>

Bonjour, J'ai une question en lien avec le parsing d'un JSON à l'aide du filtre JSON. J'ai appliqué le filter JSON pour parser un bout de message de type JSON. Le JSON en question est de ce format : { " ResponseHead…

---

## [Replace @timestamp with actual timestamp from log file with two different formats](https://discuss.elastic.co/t/replace-timestamp-with-actual-timestamp-from-log-file-with-two-different-formats/271264)

<div class="topic-metadata">

**Author:** [@kommineni24](https://discuss.elastic.co/u/kommineni24)\
**Replies:** 5\
**Last updated:** [April 26, 2021, 8:25pm UTC](https://discuss.elastic.co/t/replace-timestamp-with-actual-timestamp-from-log-file-with-two-different-formats/271264 "2021-04-26T20:25:38Z")

</div>

Hi, I am trying to index my mail-relay log files to Elastic search. All the log entries are being indexed into a field named message . @timestamp field shows the time the entry was indexed and not the timestamp from the…

---

## [Suricata module question](https://discuss.elastic.co/t/suricata-module-question/271286)

<div class="topic-metadata">

**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\
**Replies:** 2\
**Last updated:** [April 26, 2021, 6:41pm UTC](https://discuss.elastic.co/t/suricata-module-question/271286 "2021-04-26T18:41:55Z")

</div>

Hi! In my setup, the "eve" log files are separated by category. Using the Suricata module, how can I send both eve files to elastic? is it possible to use the example below? - module: suricata eve: enabled: true…

---

## [Metricbeat \> Module PostgreSQL \> wrong mapping of blk\_read\_time and blk\_write\_time](https://discuss.elastic.co/t/metricbeat-module-postgresql-wrong-mapping-of-blk-read-time-and-blk-write-time/270722)

<div class="topic-metadata">

**Author:** [@fabski](https://discuss.elastic.co/u/fabski)\
**Replies:** 2\
**Last updated:** [April 26, 2021, 5:50pm UTC](https://discuss.elastic.co/t/metricbeat-module-postgresql-wrong-mapping-of-blk-read-time-and-blk-write-time/270722 "2021-04-26T17:50:48Z")

</div>

Hi, I think there is a bug in the PostgreSQL module of Metricbeat. According to beats/metricbeat/module/postgresql/database/data.go, the following fields are mapped as Integer: "blocks": s.Object{ ... "time": s…

---

## [App-Search vs Ent-Search difference in filter](https://discuss.elastic.co/t/app-search-vs-ent-search-difference-in-filter/254019)

<div class="topic-metadata">

**Author:** [@Rudolf1](https://discuss.elastic.co/u/Rudolf1)\
**Replies:** 3\
**Last updated:** [April 26, 2021, 5:34pm UTC](https://discuss.elastic.co/t/app-search-vs-ent-search-difference-in-filter/254019 "2021-04-26T17:34:45Z")

</div>

Hello, I'm a newbie in those topics, and really need to understand why the behavior in App-Search and Ent-Search is different in the case of empty string used in the filter. Example: When I use the filter in the query…

---

## [Timestamp](https://discuss.elastic.co/t/timestamp/271206)

<div class="topic-metadata">

**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\
**Replies:** 2\
**Last updated:** [April 26, 2021, 5:13pm UTC](https://discuss.elastic.co/t/timestamp/271206 "2021-04-26T17:13:21Z")

</div>

Hello everyone, I am trying to use timestamp from my log file instead of the timestamp when my logs were processed. in order to do that, I am using dissect processor and Timestamp processor together as below. processor…

---

## [Improving fingerprint filter performance](https://discuss.elastic.co/t/improving-fingerprint-filter-performance/270573)

<div class="topic-metadata">

**Author:** [@vasu01](https://discuss.elastic.co/u/vasu01)\
**Replies:** 4\
**Last updated:** [April 26, 2021, 5:12pm UTC](https://discuss.elastic.co/t/improving-fingerprint-filter-performance/270573 "2021-04-26T17:12:23Z")

</div>

We are using the logstash fingerprint filter to avoid duplicate data in elasticsearch. But the data ingestion is taking more time. For Example - A file having ~15000-20000 rows takes approx 2~3 hours to load. Only two f…

---

## [\[Docker\] Using old data folder not working](https://discuss.elastic.co/t/docker-using-old-data-folder-not-working/271280)

<div class="topic-metadata">

**Author:** [@Bo-Wyatt](https://discuss.elastic.co/u/Bo-Wyatt)\
**Replies:** 3\
**Last updated:** [April 26, 2021, 4:59pm UTC](https://discuss.elastic.co/t/docker-using-old-data-folder-not-working/271280 "2021-04-26T16:59:38Z")

</div>

Hello, for some issues my Docker container with Elasticsearch has been re-created, this came with the lost of all my indexes (i have two nodes in my cluster and since the container was recreated, the cluster ID was gener…

---

## [Elastic Cloud Output not working Tshoot](https://discuss.elastic.co/t/elastic-cloud-output-not-working-tshoot/270465)

<div class="topic-metadata">

**Author:** [@Leon21](https://discuss.elastic.co/u/Leon21)\
**Replies:** 5\
**Last updated:** [April 26, 2021, 4:29pm UTC](https://discuss.elastic.co/t/elastic-cloud-output-not-working-tshoot/270465 "2021-04-26T16:29:45Z")

</div>

Hi I'm trying to push my events from a filebeat module into elastic cloud but could not find them into ES in my filebeat\* indexes. filebeat module gets events from a tcp socket (filebeat listen to it successfully) and …

---

## [Event correlation query not generating detection alerts](https://discuss.elastic.co/t/event-correlation-query-not-generating-detection-alerts/271224)

<div class="topic-metadata">

**Author:** [@Nil\_Battey\_Sannata](https://discuss.elastic.co/u/Nil_Battey_Sannata)\
**Replies:** 3\
**Last updated:** [April 26, 2021, 4:10pm UTC](https://discuss.elastic.co/t/event-correlation-query-not-generating-detection-alerts/271224 "2021-04-26T16:10:43Z")

</div>

This is prebuilt detection rule with event correlation. If I am executing query manually then it showing the correct hits. But this is not generating any alerts. Same story with every rule with event correlation.…

[Previous page](https://discuss.elastic.co/latest.md?page=1710)

[Next page](https://discuss.elastic.co/latest.md?page=1712)
