# Latest

**URL:** https://discuss.elastic.co/latest.md?page=59

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 60

---

## [Reading files from ZIP folder using logstash](https://discuss.elastic.co/t/reading-files-from-zip-folder-using-logstash/382345)

<div class="topic-metadata">

**Author:** [@venkatkumar229](https://discuss.elastic.co/u/venkatkumar229)\
**Replies:** 5\
**Last updated:** [October 3, 2025, 12:23pm UTC](https://discuss.elastic.co/t/reading-files-from-zip-folder-using-logstash/382345 "2025-10-03T12:23:30Z")

</div>

Hi Team, I wanted to read the files from a zipped folder on the server is it possible to read them using logstash. If yes could you please let me know the procedure. Logstash version: 8.18.1

---

## [Heatmap visualization with ES|QL ignores/randomizes sorting on 2nd dimension](https://discuss.elastic.co/t/heatmap-visualization-with-es-ql-ignores-randomizes-sorting-on-2nd-dimension/382271)

<div class="topic-metadata">

**Author:** [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Replies:** 2\
**Last updated:** [October 3, 2025, 12:12pm UTC](https://discuss.elastic.co/t/heatmap-visualization-with-es-ql-ignores-randomizes-sorting-on-2nd-dimension/382271 "2025-10-03T12:12:20Z")

</div>

Hey, I have an ESQL query like this: FROM data | EVAL month\_of\_year = DATE\_EXTRACT("month\_of\_year", date), hour\_of\_day = DATE\_EXTRACT("HOUR\_OF\_DAY", date) | STATS AVG(value) BY month\_of\_year, hour\_of\_day | SORT h…

---

## [Elastic Agent Uninstall](https://discuss.elastic.co/t/elastic-agent-uninstall/382360)

<div class="topic-metadata">

**Author:** [@Matteo\_Damiano\_Zocco](https://discuss.elastic.co/u/Matteo_Damiano_Zocco)\
**Replies:** 0\
**Last updated:** [October 1, 2025, 3:07pm UTC](https://discuss.elastic.co/t/elastic-agent-uninstall/382360 "2025-10-01T15:07:32Z")

</div>

Hello Community. I’m working on the training lab and I’m trying to configure the elastic agent with the Fleet. Unfortunately I’m stuck on: (elastic) elastic@ip-172-31-46-39:/usr/bin$ sudo /opt/Elastic/Agent/elastic-ag…

---

## [Deploying a Persistent Fleet Server on the Same Docker Network as Elasticsearch and Kibana Containers](https://discuss.elastic.co/t/deploying-a-persistent-fleet-server-on-the-same-docker-network-as-elasticsearch-and-kibana-containers/382387)

<div class="topic-metadata">

**Author:** [@Simriti\_Bundhoo](https://discuss.elastic.co/u/Simriti_Bundhoo)\
**Replies:** 0\
**Last updated:** [October 3, 2025, 3:56am UTC](https://discuss.elastic.co/t/deploying-a-persistent-fleet-server-on-the-same-docker-network-as-elasticsearch-and-kibana-containers/382387 "2025-10-03T03:56:33Z")

</div>

Hi everyone, I’m trying to deploy a persistent Fleet Server in Docker, ensuring it runs on the same Docker network as my Elasticsearch and Kibana containers. Both Elasticsearch and Kibana are already up and running in s…

---

## [Repeating the Same Directive inside mutate](https://discuss.elastic.co/t/repeating-the-same-directive-inside-mutate/382385)

<div class="topic-metadata">

**Author:** [@Evan2](https://discuss.elastic.co/u/Evan2)\
**Replies:** 1\
**Last updated:** [October 3, 2025, 12:37am UTC](https://discuss.elastic.co/t/repeating-the-same-directive-inside-mutate/382385 "2025-10-03T00:37:57Z")

</div>

I’ve been given the below advice from our Copilot instance. Can you please confirm its authenticity? I have a few Logstash pipelines using multiple remove\_field directives and need to know if I should instead be using m…

---

## [Filebeat: connection to Elasticsearch OK but no documents indexed](https://discuss.elastic.co/t/filebeat-connection-to-elasticsearch-ok-but-no-documents-indexed/382285)

<div class="topic-metadata">

**Author:** [@decibel83](https://discuss.elastic.co/u/decibel83)\
**Replies:** 9\
**Last updated:** [October 2, 2025, 2:57pm UTC](https://discuss.elastic.co/t/filebeat-connection-to-elasticsearch-ok-but-no-documents-indexed/382285 "2025-10-02T14:57:11Z")

</div>

Hi everyone, I’m facing an issue with Filebeat 8.19.3 on Debian 12 (Bookworm). Symptoms Filebeat starts without errors and connects successfully to Elasticsearch: Connection to backoff(elasticsearch(https://\<ES\_HOST\>…

---

## [Windows Logs via Elastic Agent](https://discuss.elastic.co/t/windows-logs-via-elastic-agent/382350)

<div class="topic-metadata">

**Author:** [@Sam11](https://discuss.elastic.co/u/Sam11)\
**Replies:** 7\
**Last updated:** [October 2, 2025, 2:18pm UTC](https://discuss.elastic.co/t/windows-logs-via-elastic-agent/382350 "2025-10-02T14:18:19Z")

</div>

Hello, I am facing an issue with Windows logs when using Elastic Agent: the logs are not being sent to Kibana. However, Winlogbeat works correctly and is able to send the logs. This is my elastic-agent configuration a…

---

## [Using custom script engine in Elasticclient 8](https://discuss.elastic.co/t/using-custom-script-engine-in-elasticclient-8/382197)

<div class="topic-metadata">

**Author:** [@priyankaMS](https://discuss.elastic.co/u/priyankaMS)\
**Replies:** 2\
**Last updated:** [October 2, 2025, 12:36pm UTC](https://discuss.elastic.co/t/using-custom-script-engine-in-elasticclient-8/382197 "2025-10-02T12:36:08Z")

</div>

Hello We are updating our code from NEST to elastic client. We have a custom written script engine in Java for indexing documents to elasticsearch. But we realised in elasticclient there is no way to pass script names w…

---

## [Where is behavioral analytics?](https://discuss.elastic.co/t/where-is-behavioral-analytics/379203)

<div class="topic-metadata">

**Author:** [@Sami\_Jan](https://discuss.elastic.co/u/Sami_Jan)\
**Replies:** 5\
**Last updated:** [October 2, 2025, 8:19am UTC](https://discuss.elastic.co/t/where-is-behavioral-analytics/379203 "2025-10-02T08:19:25Z")

</div>

I am using Elastic cloud and want to follow this tutorial: Get started with Behavioral Analytics | Elasticsearch Guide \[8.18\] | Elastic but i can't find "Search -\> Behavioural Analytics"

---

## [Metricbeat vs elastic agent](https://discuss.elastic.co/t/metricbeat-vs-elastic-agent/376663)

<div class="topic-metadata">

**Author:** [@Dth\_Revan](https://discuss.elastic.co/u/Dth_Revan)\
**Replies:** 2\
**Last updated:** [October 2, 2025, 7:56am UTC](https://discuss.elastic.co/t/metricbeat-vs-elastic-agent/376663 "2025-10-02T07:56:26Z")

</div>

Hello, everyone! Not so long ago i decided to try elastic agent+system integration instead of metricbeat with system module (which i have used for a very long time). the problem i faced is i can't make SOME graphs in gr…

---

## [Elasticsearch upgrade admission webhook error elastic-es-validation-v1.k8s.elastic.co](https://discuss.elastic.co/t/elasticsearch-upgrade-admission-webhook-error-elastic-es-validation-v1-k8s-elastic-co/382367)

<div class="topic-metadata">

**Author:** [@astingengo](https://discuss.elastic.co/u/astingengo)\
**Replies:** 0\
**Last updated:** [October 2, 2025, 6:56am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-admission-webhook-error-elastic-es-validation-v1-k8s-elastic-co/382367 "2025-10-02T06:56:27Z")

</div>

Hi there, I’m having elasticsearch deployed inside Kubernetes (v1.32.7) Operator version was 2.16.1 and stack version 0.4.0 Upgraded them to 3.1.0 and 0.14.1 and now having below error on operator and ES not deployed …

---

## [Cannot install elastic agent on window server](https://discuss.elastic.co/t/cannot-install-elastic-agent-on-window-server/382364)

<div class="topic-metadata">

**Author:** [@Hoai\_Thanh\_Do](https://discuss.elastic.co/u/Hoai_Thanh_Do)\
**Replies:** 0\
**Last updated:** [October 2, 2025, 12:38am UTC](https://discuss.elastic.co/t/cannot-install-elastic-agent-on-window-server/382364 "2025-10-02T00:38:09Z")

</div>

Hi All, I'm new to Elastic and recently attempted to install Elastic Agent on my Azure VMs. Unfortunately, the installation failed. One strange thing I noticed is that although the result indicates failure, the Elastic …

---

## [CSV Processor (Ingest pipelines): Tab Separator](https://discuss.elastic.co/t/csv-processor-ingest-pipelines-tab-separator/382361)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 4\
**Last updated:** [October 1, 2025, 8:23pm UTC](https://discuss.elastic.co/t/csv-processor-ingest-pipelines-tab-separator/382361 "2025-10-01T20:23:43Z")

</div>

Is there a way for CSV processor to accept TSV?

---

## [Elastic Agent not sending kubernetes.pod.name field](https://discuss.elastic.co/t/elastic-agent-not-sending-kubernetes-pod-name-field/382351)

<div class="topic-metadata">

**Author:** [@babban](https://discuss.elastic.co/u/babban)\
**Replies:** 0\
**Last updated:** [October 1, 2025, 12:09pm UTC](https://discuss.elastic.co/t/elastic-agent-not-sending-kubernetes-pod-name-field/382351 "2025-10-01T12:09:45Z")

</div>

Hi, We have elastic agent APM server configured on application. Since the last upgrade the fields “kubernetes.pod.name”/”host.name”/”host.hostname”, none of these fields are being produced. We have the flow where, the …

---

## [Dealing with nested fields from aggregations](https://discuss.elastic.co/t/dealing-with-nested-fields-from-aggregations/382346)

<div class="topic-metadata">

**Author:** [@Sam\_Moss](https://discuss.elastic.co/u/Sam_Moss)\
**Replies:** 0\
**Last updated:** [October 1, 2025, 9:54am UTC](https://discuss.elastic.co/t/dealing-with-nested-fields-from-aggregations/382346 "2025-10-01T09:54:34Z")

</div>

I am trying to build a central inventory index pulling data from a variety of different places, this means that there are a few aggregations on the way to the final index, which leads to lovely field names such as “wmi.w…

---

## [Elastic Security Threat Match rule](https://discuss.elastic.co/t/elastic-security-threat-match-rule/382281)

<div class="topic-metadata">

**Author:** [@lduvnjak](https://discuss.elastic.co/u/lduvnjak)\
**Replies:** 5\
**Last updated:** [October 1, 2025, 9:30am UTC](https://discuss.elastic.co/t/elastic-security-threat-match-rule/382281 "2025-10-01T09:30:09Z")

</div>

I have a couple of questions about how threat match rules work in Elasticsearch, which I feel the documentation does not cover very well. The question is about the Custom query parameter, the frequency, and the addition…

---

## [How to check Elasticsearch license history or past activations (Platinum/Enterprise)?](https://discuss.elastic.co/t/how-to-check-elasticsearch-license-history-or-past-activations-platinum-enterprise/382323)

<div class="topic-metadata">

**Author:** [@Musab\_Dogan](https://discuss.elastic.co/u/Musab_Dogan)\
**Replies:** 2\
**Last updated:** [October 1, 2025, 4:54am UTC](https://discuss.elastic.co/t/how-to-check-elasticsearch-license-history-or-past-activations-platinum-enterprise/382323 "2025-10-01T04:54:11Z")

</div>

Five years ago, one of my customers purchased an Elastic license. The renewal date has now arrived, and they asked me to verify the current license status of their clusters. When I checked, all clusters with GET /\_licens…

---

## [\[BUG\] A replica shard in POST\_RECOVERY state, when promoted to primary, will be stuck](https://discuss.elastic.co/t/bug-a-replica-shard-in-post-recovery-state-when-promoted-to-primary-will-be-stuck/382333)

<div class="topic-metadata">

**Author:** [@Govind\_Balaji\_S](https://discuss.elastic.co/u/Govind_Balaji_S)\
**Replies:** 1\
**Last updated:** [September 30, 2025, 9:16pm UTC](https://discuss.elastic.co/t/bug-a-replica-shard-in-post-recovery-state-when-promoted-to-primary-will-be-stuck/382333 "2025-09-30T21:16:17Z")

</div>

EDIT: I think I mixed up ShardRoutingState and IndexShardState. I think this introduced a bug - A replica can be promoted and started in one cluster state update by bleskes · Pull Request #32042 · elastic/elasticsearch …

---

## [Help with upgrade assistant api command](https://discuss.elastic.co/t/help-with-upgrade-assistant-api-command/382331)

<div class="topic-metadata">

**Author:** [@dominbdg](https://discuss.elastic.co/u/dominbdg)\
**Replies:** 1\
**Last updated:** [September 30, 2025, 8:13pm UTC](https://discuss.elastic.co/t/help-with-upgrade-assistant-api-command/382331 "2025-09-30T20:13:47Z")

</div>

Hello, I have issue, from curl I need to go to upgrade assistant api, from documentation it is: /api/upgrade\_assistant/status my command for that from curl is: curl -XGET -k -uelastic:"$(bin/elasticsearch-keystore…

---

## [How to add a webhook connector with its body to all existing Elastic detection rules automatically?](https://discuss.elastic.co/t/how-to-add-a-webhook-connector-with-its-body-to-all-existing-elastic-detection-rules-automatically/382212)

<div class="topic-metadata">

**Author:** [@Omar\_Medhat](https://discuss.elastic.co/u/Omar_Medhat)\
**Replies:** 1\
**Last updated:** [September 30, 2025, 4:38pm UTC](https://discuss.elastic.co/t/how-to-add-a-webhook-connector-with-its-body-to-all-existing-elastic-detection-rules-automatically/382212 "2025-09-30T16:38:39Z")

</div>

I created a webhook connector, and I want to add it to all of my installed detection rules without having to manually edit each rule’s actions section one by one. Is there a way to add it to all of them automatically? Es…

---

## [SQL\_input lack of documentation and non working integration (version 9.1.4)](https://discuss.elastic.co/t/sql-input-lack-of-documentation-and-non-working-integration-version-9-1-4/382326)

<div class="topic-metadata">

**Author:** [@dao](https://discuss.elastic.co/u/dao)\
**Replies:** 0\
**Last updated:** [September 30, 2025, 3:11pm UTC](https://discuss.elastic.co/t/sql-input-lack-of-documentation-and-non-working-integration-version-9-1-4/382326 "2025-09-30T15:11:47Z")

</div>

I am trying to log all the new lines coming from a postgres database. I want to use the SQL\_input integration, but I cannot achieve what I want. The documentation is not complete, so that I cannot figure out how to do. H…

---

## [Aggregated sorted search with top hits and paging - items missing](https://discuss.elastic.co/t/aggregated-sorted-search-with-top-hits-and-paging-items-missing/382225)

<div class="topic-metadata">

**Author:** [@irkallacz](https://discuss.elastic.co/u/irkallacz)\
**Replies:** 6\
**Last updated:** [September 30, 2025, 2:34pm UTC](https://discuss.elastic.co/t/aggregated-sorted-search-with-top-hits-and-paging-items-missing/382225 "2025-09-30T14:34:11Z")

</div>

My intend is to have paged list of all categories presented by cheapest product, sorted by price. I have search terms aggregation by product category, sorted by min aggregation on price: "aggs": { "count":{"car…

---

## [Using fields outside ECS for exceptions in rules](https://discuss.elastic.co/t/using-fields-outside-ecs-for-exceptions-in-rules/381522)

<div class="topic-metadata">

**Author:** [@Ruslan\_Hafizov](https://discuss.elastic.co/u/Ruslan_Hafizov)\
**Replies:** 4\
**Last updated:** [September 30, 2025, 1:57pm UTC](https://discuss.elastic.co/t/using-fields-outside-ecs-for-exceptions-in-rules/381522 "2025-09-30T13:57:46Z")

</div>

Good time of day. I have a rule that creates an alert and I need to add an exception to it. Within the request, describing this exception will be problematic, as it will inflate the size of the request. So I decided to u…

---

## [Best practices for preprocessing data and monitoring resource usage in predefined ML jobs (security:host)](https://discuss.elastic.co/t/best-practices-for-preprocessing-data-and-monitoring-resource-usage-in-predefined-ml-jobs-security-host/382324)

<div class="topic-metadata">

**Author:** [@ilyes](https://discuss.elastic.co/u/ilyes)\
**Replies:** 0\
**Last updated:** [September 30, 2025, 1:53pm UTC](https://discuss.elastic.co/t/best-practices-for-preprocessing-data-and-monitoring-resource-usage-in-predefined-ml-jobs-security-host/382324 "2025-09-30T13:53:25Z")

</div>

This category relates to the Enterprise Search set of products - App Search, Site Search and Workplace Search. If your question relates to core Elasticsearch functionality, please head over to the Elastic Stack \> Elasti…

---

## [No rollover with data stream lifecycle](https://discuss.elastic.co/t/no-rollover-with-data-stream-lifecycle/382165)

<div class="topic-metadata">

**Author:** [@mikehaertl](https://discuss.elastic.co/u/mikehaertl)\
**Replies:** 12\
**Last updated:** [September 30, 2025, 1:51pm UTC](https://discuss.elastic.co/t/no-rollover-with-data-stream-lifecycle/382165 "2025-09-30T13:51:56Z")

</div>

For testing purposes I’ve configured a lifecycle on a data stream with a retention time of 1h. But the backing index does not get rolled over. According to this doc Data stream lifecycle settings in Elasticsearch | Refe…

---

## [Understanding time\_in\_millis for ingest pipeline running embeddings](https://discuss.elastic.co/t/understanding-time-in-millis-for-ingest-pipeline-running-embeddings/382249)

<div class="topic-metadata">

**Author:** [@gueri](https://discuss.elastic.co/u/gueri)\
**Replies:** 2\
**Last updated:** [September 30, 2025, 1:32pm UTC](https://discuss.elastic.co/t/understanding-time-in-millis-for-ingest-pipeline-running-embeddings/382249 "2025-09-30T13:32:32Z")

</div>

Hi, I try to figured out the meaning of time\_in\_millis field about my ingest pipelines running embeddings. time\_in\_millis (integer) Total time, in milliseconds, spent preprocessing documents in the ingest pipeline. I…

---

## [Best practices for preprocessing data and monitoring resource usage in predefined ML jobs (security:host)](https://discuss.elastic.co/t/best-practices-for-preprocessing-data-and-monitoring-resource-usage-in-predefined-ml-jobs-security-host/382320)

<div class="topic-metadata">

**Author:** [@ilyes](https://discuss.elastic.co/u/ilyes)\
**Replies:** 0\
**Last updated:** [September 30, 2025, 1:31pm UTC](https://discuss.elastic.co/t/best-practices-for-preprocessing-data-and-monitoring-resource-usage-in-predefined-ml-jobs-security-host/382320 "2025-09-30T13:31:32Z")

</div>

Question 1: I am planning to use the predefined ML job from the security:host module. To avoid overloading the ML model with too much data, what would be the best approach in terms of data preprocessing? Should I fir…

---

## [Dasboards and dataviews](https://discuss.elastic.co/t/dasboards-and-dataviews/382274)

<div class="topic-metadata">

**Author:** [@Buzz](https://discuss.elastic.co/u/Buzz)\
**Replies:** 2\
**Last updated:** [September 30, 2025, 1:26pm UTC](https://discuss.elastic.co/t/dasboards-and-dataviews/382274 "2025-09-30T13:26:45Z")

</div>

Hello, i have a question about dashboards delivered with Windows integration. I have created multiple new indexes and assign separate policies. example: agent-security-logs-yyyy.mm.dd - retention 365days agent-applic…

---

## [After renewing certificates, Kibana shows multiple expiry dates (2028 vs 2125)](https://discuss.elastic.co/t/after-renewing-certificates-kibana-shows-multiple-expiry-dates-2028-vs-2125/382306)

<div class="topic-metadata">

**Author:** [@LimSuyun](https://discuss.elastic.co/u/LimSuyun)\
**Replies:** 1\
**Last updated:** [September 30, 2025, 1:25pm UTC](https://discuss.elastic.co/t/after-renewing-certificates-kibana-shows-multiple-expiry-dates-2028-vs-2125/382306 "2025-09-30T13:25:43Z")

</div>

We have currently set up 3 Elasticsearch clusters with master nodes on 1.1.1.10, 1.1.1.11, and 1.1.1.12. Since the certificates had expired, we generated new ones. On the master node (1.1.1.10), we created http.p12, tra…

---

## [Custom File stream Integration - Network Shares](https://discuss.elastic.co/t/custom-file-stream-integration-network-shares/382288)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 1\
**Last updated:** [September 29, 2025, 5:49pm UTC](https://discuss.elastic.co/t/custom-file-stream-integration-network-shares/382288 "2025-09-29T17:49:18Z")

</div>

Hello, I am using v1.2.0 of the Custom Logs (Filestream). Normally this integration works for collecting from a local folder, but I can’t seem to grab the logs from a network share. My first assumption is that perhaps …

[Previous page](https://discuss.elastic.co/latest.md?page=58)

[Next page](https://discuss.elastic.co/latest.md?page=60)
