# Latest

**URL:** https://discuss.elastic.co/latest.md?page=111

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 112

---

## [Duplicate Traces in APM Observability after upgrade to kibana 8.16.5 from 8.16.2](https://discuss.elastic.co/t/duplicate-traces-in-apm-observability-after-upgrade-to-kibana-8-16-5-from-8-16-2/376712)

<div class="topic-metadata">

**Author:** [@VVK](https://discuss.elastic.co/u/VVK)\
**Replies:** 7\
**Last updated:** [April 25, 2025, 2:34pm UTC](https://discuss.elastic.co/t/duplicate-traces-in-apm-observability-after-upgrade-to-kibana-8-16-5-from-8-16-2/376712 "2025-04-25T14:34:10Z")

</div>

Kibana version: Kibana upgraded to 8.16.5 from 8.16.2 in self managed Observability Elasticsearch version: 8.16.5 APM Server version: apm-server:8.16.2 APM Agent language and version: Java / elastic-apm.version: 1…

---

## [Installation of Elastic Agents on Non-Persistent VDI Machines](https://discuss.elastic.co/t/installation-of-elastic-agents-on-non-persistent-vdi-machines/377504)

<div class="topic-metadata">

**Author:** [@SaigaGentil](https://discuss.elastic.co/u/SaigaGentil)\
**Replies:** 1\
**Last updated:** [April 25, 2025, 2:01pm UTC](https://discuss.elastic.co/t/installation-of-elastic-agents-on-non-persistent-vdi-machines/377504 "2025-04-25T14:01:04Z")

</div>

Hello, We have a use case where we'd like to monitor hundreds of Citrix VDI desktops. Those are machines that are regularly rebooted and are built based on an image that's prebuilt... We have 1 image that is pushed to …

---

## [How to find saved object invalid relations](https://discuss.elastic.co/t/how-to-find-saved-object-invalid-relations/377522)

<div class="topic-metadata">

**Author:** [@JimJ](https://discuss.elastic.co/u/JimJ)\
**Replies:** 0\
**Last updated:** [April 25, 2025, 1:55pm UTC](https://discuss.elastic.co/t/how-to-find-saved-object-invalid-relations/377522 "2025-04-25T13:55:25Z")

</div>

I have a problem with saved objects and their relationships. One dashboard has some invalid relations. In Kibana "Saved Objects" panel, I can see objects' relationships. The invalid relationship's objects are all inde…

---

## [Dynamic watcher/alerting without creating multiple watches](https://discuss.elastic.co/t/dynamic-watcher-alerting-without-creating-multiple-watches/377432)

<div class="topic-metadata">

**Author:** [@Rukmangadha\_Ajay](https://discuss.elastic.co/u/Rukmangadha_Ajay)\
**Replies:** 0\
**Last updated:** [April 23, 2025, 11:47am UTC](https://discuss.elastic.co/t/dynamic-watcher-alerting-without-creating-multiple-watches/377432 "2025-04-23T11:47:18Z")

</div>

Hi all, I’m using Elasticsearch (with Kibana) to log IBM ACE message flow exceptions, and I’ve already built pipelines to successfully index logs. Now, I need to configure a Watcher to send email alerts based on specifi…

---

## [Problem with calculating flow with ELK with filebeat](https://discuss.elastic.co/t/problem-with-calculating-flow-with-elk-with-filebeat/377519)

<div class="topic-metadata">

**Author:** [@Komeyl\_Pouya](https://discuss.elastic.co/u/Komeyl_Pouya)\
**Replies:** 0\
**Last updated:** [April 25, 2025, 11:38am UTC](https://discuss.elastic.co/t/problem-with-calculating-flow-with-elk-with-filebeat/377519 "2025-04-25T11:38:07Z")

</div>

hi The problem I have with this service is that it does not calculate flow accurately. Flow is received, but filebeat and its dashboards show it extremely low and cannot be understood by any standard.

---

## [Logstash error](https://discuss.elastic.co/t/logstash-error/377282)

<div class="topic-metadata">

**Author:** [@sreya\_14](https://discuss.elastic.co/u/sreya_14)\
**Replies:** 3\
**Last updated:** [April 25, 2025, 10:01am UTC](https://discuss.elastic.co/t/logstash-error/377282 "2025-04-25T10:01:39Z")

</div>

I am getting below error in logstash log Apr 18 12:24:19 pldevelk03 logstash\[12013\]: ERROR: Failed to parse YAML file "/etc/logstash/logstash.yml". Please confirm if the YAML structure is valid (e.g. look for Apr 18 12:…

---

## [Unable to load connector in Kibana](https://discuss.elastic.co/t/unable-to-load-connector-in-kibana/375605)

<div class="topic-metadata">

**Author:** [@premk](https://discuss.elastic.co/u/premk)\
**Replies:** 2\
**Last updated:** [April 25, 2025, 8:29am UTC](https://discuss.elastic.co/t/unable-to-load-connector-in-kibana/375605 "2025-04-25T08:29:05Z")

</div>

Kibana gives error as "Unable to load connector" as and when Connector feature is accessed. Enabled the debug logs also, it doesn't give much information. Only log entry as "\[2025-03-09T13:35:00.161+04:00\]\[ERROR\]\[http\] 5…

---

## [When the pod is initially started, filebeat is unable to carry some kubernetes metadata data such as the podname and image id fields](https://discuss.elastic.co/t/when-the-pod-is-initially-started-filebeat-is-unable-to-carry-some-kubernetes-metadata-data-such-as-the-podname-and-image-id-fields/377509)

<div class="topic-metadata">

**Author:** [@zhaobiao666](https://discuss.elastic.co/u/zhaobiao666)\
**Replies:** 0\
**Last updated:** [April 25, 2025, 7:19am UTC](https://discuss.elastic.co/t/when-the-pod-is-initially-started-filebeat-is-unable-to-carry-some-kubernetes-metadata-data-such-as-the-podname-and-image-id-fields/377509 "2025-04-25T07:19:05Z")

</div>

When using Filebeat to collect container logs, I noticed that the logs from the container's standard output at startup do not include certain Kubernetes metadata fields (e.g., pod name, image ID). These fields only appea…

---

## [ElasticSearch indices](https://discuss.elastic.co/t/elasticsearch-indices/377506)

<div class="topic-metadata">

**Author:** [@newmember](https://discuss.elastic.co/u/newmember)\
**Replies:** 1\
**Last updated:** [April 25, 2025, 12:39am UTC](https://discuss.elastic.co/t/elasticsearch-indices/377506 "2025-04-25T00:39:40Z")

</div>

I checked the indices on a host that I have been given access too. There are only 2 indices I want to continue to use. Where did all these other indices come from, did ES install then as default clearly many dont have …

---

## [Duplicate indexing behavior without \_id](https://discuss.elastic.co/t/duplicate-indexing-behavior-without-id/377501)

<div class="topic-metadata">

**Author:** [@csanadpoda](https://discuss.elastic.co/u/csanadpoda)\
**Replies:** 1\
**Last updated:** [April 24, 2025, 9:07pm UTC](https://discuss.elastic.co/t/duplicate-indexing-behavior-without-id/377501 "2025-04-24T21:07:06Z")

</div>

If I were to index documents without specifying a fixed \_id, when duplicate documents appear, would they be created as duplicate entries in the index, or would ES recognize that there's already the same entry in the inde…

---

## [Implementing Relative Score Fusion for Hybrid Search in Elasticsearch](https://discuss.elastic.co/t/implementing-relative-score-fusion-for-hybrid-search-in-elasticsearch/364408)

<div class="topic-metadata">

**Author:** [@ayubSubhaniya](https://discuss.elastic.co/u/ayubSubhaniya)\
**Replies:** 3\
**Last updated:** [April 24, 2025, 7:50pm UTC](https://discuss.elastic.co/t/implementing-relative-score-fusion-for-hybrid-search-in-elasticsearch/364408 "2025-04-24T19:50:05Z")

</div>

Hello Elasticsearch Community, I'm interested in implementing Relative Score Fusion (RSF) directly in Elasticsearch to combine BM25 and kNN search results with weighted rankings based on query length or type. I want to …

---

## [APM Agent Monitoring](https://discuss.elastic.co/t/apm-agent-monitoring/377499)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 6:14pm UTC](https://discuss.elastic.co/t/apm-agent-monitoring/377499 "2025-04-24T18:14:48Z")

</div>

Hello, Is there a way to monitor or check on the status of an apm agent? For example, a service might not be producing any traffic so no metrics are reported in, is there a way to check if the apm agent is okay and ope…

---

## [Persist ESQL rows after applying AVG and STD\_DEV](https://discuss.elastic.co/t/persist-esql-rows-after-applying-avg-and-std-dev/377497)

<div class="topic-metadata">

**Author:** [@O\_O\_O](https://discuss.elastic.co/u/O_O_O)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 5:01pm UTC](https://discuss.elastic.co/t/persist-esql-rows-after-applying-avg-and-std-dev/377497 "2025-04-24T17:01:10Z")

</div>

If I need to calculate the standard deviation (STD\_DEV) for each row (using a number column from the row), how do I do that? I currently have the snippet below: FROM logs-\* | WHERE event.code == "4768" AND field1 == "v…

---

## [Services UI (Custom Information/Description)](https://discuss.elastic.co/t/services-ui-custom-information-description/377496)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 4:44pm UTC](https://discuss.elastic.co/t/services-ui-custom-information-description/377496 "2025-04-24T16:44:40Z")

</div>

Hello, Is there a way to display metadata information about the service in APM' Services UI or within each Service view? I want to add like very visibile description or something to help identify what the service is to …

---

## [The upgrading of the Elastic Core on premise environment (Kibana, Logstash and Elastic Cluster) from 7.17.28 to 8.17, any recommendations?](https://discuss.elastic.co/t/the-upgrading-of-the-elastic-core-on-premise-environment-kibana-logstash-and-elastic-cluster-from-7-17-28-to-8-17-any-recommendations/377465)

<div class="topic-metadata">

**Author:** [@carbon](https://discuss.elastic.co/u/carbon)\
**Replies:** 4\
**Last updated:** [April 24, 2025, 3:15pm UTC](https://discuss.elastic.co/t/the-upgrading-of-the-elastic-core-on-premise-environment-kibana-logstash-and-elastic-cluster-from-7-17-28-to-8-17-any-recommendations/377465 "2025-04-24T15:15:03Z")

</div>

The upgrading of the Elastic Core on premise environment (Kibana, Logstash and Elastic Cluster with 3 nodes) from 7.17.28 to 8.17, any recommendations?

---

## [ Help Integrating Wazuh, MISP, and Logstash into a Preventive Security Analysis Module](https://discuss.elastic.co/t/help-integrating-wazuh-misp-and-logstash-into-a-preventive-security-analysis-module/377493)

<div class="topic-metadata">

**Author:** [@Nouaman\_Ahmamcha](https://discuss.elastic.co/u/Nouaman_Ahmamcha)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 2:34pm UTC](https://discuss.elastic.co/t/help-integrating-wazuh-misp-and-logstash-into-a-preventive-security-analysis-module/377493 "2025-04-24T14:34:57Z")

</div>

Hi everyone, I'm currently working on a preventive security analysis module as part of a project, and I'm integrating the following components: Wazuh for SIEM and endpoint monitoring (running via Docker) MISP for thre…

---

## [Partial snapshot](https://discuss.elastic.co/t/partial-snapshot/377473)

<div class="topic-metadata">

**Author:** [@Farheen](https://discuss.elastic.co/u/Farheen)\
**Replies:** 6\
**Last updated:** [April 24, 2025, 2:03pm UTC](https://discuss.elastic.co/t/partial-snapshot/377473 "2025-04-24T14:03:11Z")

</div>

Why the snapshots of indices has been created as partially restored?

---

## [Nested fields Issues - Remove / rename](https://discuss.elastic.co/t/nested-fields-issues-remove-rename/377447)

<div class="topic-metadata">

**Author:** [@sai\_ravi\_shankar](https://discuss.elastic.co/u/sai_ravi_shankar)\
**Replies:** 3\
**Last updated:** [April 24, 2025, 1:09pm UTC](https://discuss.elastic.co/t/nested-fields-issues-remove-rename/377447 "2025-04-24T13:09:55Z")

</div>

Hi, Can someone help me on the below issue. I have a nested object where i am unable to rename or remove such fields. Below is the format of such field. test.test1.test2.test3.test4.test5 It has 4 objects and 1 field…

---

## [Firewall logs to different Datastream by type](https://discuss.elastic.co/t/firewall-logs-to-different-datastream-by-type/377211)

<div class="topic-metadata">

**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\
**Replies:** 22\
**Last updated:** [April 24, 2025, 12:57pm UTC](https://discuss.elastic.co/t/firewall-logs-to-different-datastream-by-type/377211 "2025-04-24T12:57:39Z")

</div>

I am using the integration “Fortinet FortiGate Firewall Logs”. To date it is working correctly, but I have been asked to ingest the UTM type logs in a different Datastream and I really have no idea how to do this using …

---

## [Sometimes no documents are returned in Elasticsearch](https://discuss.elastic.co/t/sometimes-no-documents-are-returned-in-elasticsearch/377425)

<div class="topic-metadata">

**Author:** [@Sushmita\_Gupta](https://discuss.elastic.co/u/Sushmita_Gupta)\
**Replies:** 6\
**Last updated:** [April 24, 2025, 12:57pm UTC](https://discuss.elastic.co/t/sometimes-no-documents-are-returned-in-elasticsearch/377425 "2025-04-24T12:57:28Z")

</div>

Hi, I'm using Elasticsearch and I’ve noticed something strange. For some queries, I get no documents back, even though I have set top\_k = 4. What’s confusing is that sometimes the same query does return results, but oth…

---

## [Error connecting to Kibana: fail to get the Kibana version](https://discuss.elastic.co/t/error-connecting-to-kibana-fail-to-get-the-kibana-version/376903)

<div class="topic-metadata">

**Author:** [@lundi](https://discuss.elastic.co/u/lundi)\
**Replies:** 7\
**Last updated:** [April 24, 2025, 12:26pm UTC](https://discuss.elastic.co/t/error-connecting-to-kibana-fail-to-get-the-kibana-version/376903 "2025-04-24T12:26:39Z")

</div>

I get an error after trying to load the dashboards from Filebeat into Kibana. filebeat setup --dashboards Loading dashboards (Kibana must be running and reachable) Exiting: error connecting to Kibana: fail to get the Ki…

---

## [Logstash preserve source ip](https://discuss.elastic.co/t/logstash-preserve-source-ip/377463)

<div class="topic-metadata">

**Author:** [@omoroka](https://discuss.elastic.co/u/omoroka)\
**Replies:** 6\
**Last updated:** [April 24, 2025, 12:17pm UTC](https://discuss.elastic.co/t/logstash-preserve-source-ip/377463 "2025-04-24T12:17:29Z")

</div>

Hi, I have a logstash server running on linux and this server is collecting logs from various devices like storages, switches, firewalls etc. All device send logs to the logstash servers 514 port, most of them is fine …

---

## [Is it possible to access detailed Elastic Agent metrics via API or local socket?](https://discuss.elastic.co/t/is-it-possible-to-access-detailed-elastic-agent-metrics-via-api-or-local-socket/377456)

<div class="topic-metadata">

**Author:** [@iTiago](https://discuss.elastic.co/u/iTiago)\
**Replies:** 1\
**Last updated:** [April 24, 2025, 11:51am UTC](https://discuss.elastic.co/t/is-it-possible-to-access-detailed-elastic-agent-metrics-via-api-or-local-socket/377456 "2025-04-24T11:51:57Z")

</div>

I'm investigating the possibility of connecting directly to the Elastic Agent (without going through Elasticsearch/Fleet) to monitor the behavior of each active source/configuration in real time and with greater granular…

---

## [Guidance on architectural decision making](https://discuss.elastic.co/t/guidance-on-architectural-decision-making/377484)

<div class="topic-metadata">

**Author:** [@billie007711](https://discuss.elastic.co/u/billie007711)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 10:01am UTC](https://discuss.elastic.co/t/guidance-on-architectural-decision-making/377484 "2025-04-24T10:01:40Z")

</div>

I want to move logs from Cloudwatch logs ====\> SELF MANAGED ELASTIC SEARCH CLUSTER The volume of log is 5TB/day Option1: I use aws-forwarder plugin provided by Elasticsearch Option2 I use this flow Cloudwatch log…

---

## [X509 certificate signed by unknown authority error, even with --insecure flag](https://discuss.elastic.co/t/x509-certificate-signed-by-unknown-authority-error-even-with-insecure-flag/377467)

<div class="topic-metadata">

**Author:** [@nmcc1212](https://discuss.elastic.co/u/nmcc1212)\
**Replies:** 3\
**Last updated:** [April 24, 2025, 6:57am UTC](https://discuss.elastic.co/t/x509-certificate-signed-by-unknown-authority-error-even-with-insecure-flag/377467 "2025-04-24T06:57:14Z")

</div>

Hi, I am installing the elastic agent with sudo ./elastic-agent install --url=https://\<FLEET URL\> --enrollment-token=\<token\> --insecure In the output of sudo elastic-agent inspect there is ssl: renegotiation: neve…

---

## [Analysis of ES 7.16 Memory Consumption: Multiple Factors Leading to Memory Surge and the Mystery of 9GB Memory Stuck in GC and Optimization Exploration](https://discuss.elastic.co/t/analysis-of-es-7-16-memory-consumption-multiple-factors-leading-to-memory-surge-and-the-mystery-of-9gb-memory-stuck-in-gc-and-optimization-exploration/377472)

<div class="topic-metadata">

**Author:** [@zhangzhihua](https://discuss.elastic.co/u/zhangzhihua)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 3:45am UTC](https://discuss.elastic.co/t/analysis-of-es-7-16-memory-consumption-multiple-factors-leading-to-memory-surge-and-the-mystery-of-9gb-memory-stuck-in-gc-and-optimization-exploration/377472 "2025-04-24T03:45:07Z")

</div>

The recent memory consumption of JVM is as follows: The green area has optimized space for resident memory ES的Heap内存基本上被Segment Memory、Filter Cache、Field Data Cache、Bulk Queue、Indexing Buffer、Cluster State Buffer、各类…

---

## [Security Case Management Based on Parent Tenant & Subsidiary](https://discuss.elastic.co/t/security-case-management-based-on-parent-tenant-subsidiary/377471)

<div class="topic-metadata">

**Author:** [@kulisiber](https://discuss.elastic.co/u/kulisiber)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 2:37am UTC](https://discuss.elastic.co/t/security-case-management-based-on-parent-tenant-subsidiary/377471 "2025-04-24T02:37:08Z")

</div>

Hi everyone, I have a case like the following, I monitor the parent company as well as the subsidiary. I've created 2 different tenants. What if I want to display all the cases that are made specifically from the "Secur…

---

## [Filtered Fleet Agents Show in other spaces](https://discuss.elastic.co/t/filtered-fleet-agents-show-in-other-spaces/377419)

<div class="topic-metadata">

**Author:** [@kulisiber](https://discuss.elastic.co/u/kulisiber)\
**Replies:** 2\
**Last updated:** [April 24, 2025, 1:54am UTC](https://discuss.elastic.co/t/filtered-fleet-agents-show-in-other-spaces/377419 "2025-04-24T01:54:32Z")

</div>

Hi everyone, Can I display the fleet agents that have been filtered specifically for that space in the Management \>\> Fleet menu. Please advise. Thanks before

---

## [Reindexing to new index after doing some filter](https://discuss.elastic.co/t/reindexing-to-new-index-after-doing-some-filter/377469)

<div class="topic-metadata">

**Author:** [@kulisiber](https://discuss.elastic.co/u/kulisiber)\
**Replies:** 0\
**Last updated:** [April 24, 2025, 1:49am UTC](https://discuss.elastic.co/t/reindexing-to-new-index-after-doing-some-filter/377469 "2025-04-24T01:49:40Z")

</div>

I would like to ask about ingest pipeline in Elastic SIEM. I'm a newbie here, sorry if I have a lot of questions. How to reindex from default index .kibana\_alerting\_cases\_8.15.0\_001 to a new index after filtering? I've …

---

## [Filebeat not sending all the logs to the output file](https://discuss.elastic.co/t/filebeat-not-sending-all-the-logs-to-the-output-file/377468)

<div class="topic-metadata">

**Author:** [@MelasticSan](https://discuss.elastic.co/u/MelasticSan)\
**Replies:** 0\
**Last updated:** [April 23, 2025, 11:16pm UTC](https://discuss.elastic.co/t/filebeat-not-sending-all-the-logs-to-the-output-file/377468 "2025-04-23T23:16:46Z")

</div>

There are a couple of files in /opt/logs/\*.0 and the file beat reads them properly but does not print all the lines and sends them to the output file . Is there a problem with my matching ? How can I make sure everythin…

[Previous page](https://discuss.elastic.co/latest.md?page=110)

[Next page](https://discuss.elastic.co/latest.md?page=112)
