# Latest

**URL:** https://discuss.elastic.co/latest.md?page=154

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 155

---

## [Controls drag drop position feature missing in elasticsearch version 8.16.1](https://discuss.elastic.co/t/controls-drag-drop-position-feature-missing-in-elasticsearch-version-8-16-1/373759)

<div class="topic-metadata">

**Author:** [@mittal\_rawal1](https://discuss.elastic.co/u/mittal_rawal1)\
**Replies:** 1\
**Last updated:** [January 29, 2025, 12:39pm UTC](https://discuss.elastic.co/t/controls-drag-drop-position-feature-missing-in-elasticsearch-version-8-16-1/373759 "2025-01-29T12:39:52Z")

</div>

I have migrated my dashboard from 8.1.0 version to 8.16.1 and in this i was using controls which is deprecated, and now new controls are there but i am not able to move controls below the dashboard header. here i wan…

---

## [Elasticsearch input size not working](https://discuss.elastic.co/t/elasticsearch-input-size-not-working/373818)

<div class="topic-metadata">

**Author:** [@Amit\_Saini](https://discuss.elastic.co/u/Amit_Saini)\
**Replies:** 0\
**Last updated:** [January 29, 2025, 12:23pm UTC](https://discuss.elastic.co/t/elasticsearch-input-size-not-working/373818 "2025-01-29T12:23:48Z")

</div>

Hi Team, I'm working on an incremental data pipeline using Logstash. I'm using the Elasticsearch input plugin to retrieve the last processed document from an index. I intend to store the relevant field from this documen…

---

## [Need to send query in my data view on 2 separate document](https://discuss.elastic.co/t/need-to-send-query-in-my-data-view-on-2-separate-document/373792)

<div class="topic-metadata">

**Author:** [@ermisma](https://discuss.elastic.co/u/ermisma)\
**Replies:** 3\
**Last updated:** [January 29, 2025, 10:05am UTC](https://discuss.elastic.co/t/need-to-send-query-in-my-data-view-on-2-separate-document/373792 "2025-01-29T10:05:45Z")

</div>

Hi, I’m working with a Dataview where I’m querying to extract specific information from raw data for my use case. The issue I’m facing is that I have multiple documents, and some of the fields I need to query are not in…

---

## [Painless script outputs literal "key" field](https://discuss.elastic.co/t/painless-script-outputs-literal-key-field/373800)

<div class="topic-metadata">

**Author:** [@Henning\_Oden](https://discuss.elastic.co/u/Henning_Oden)\
**Replies:** 0\
**Last updated:** [January 29, 2025, 8:03am UTC](https://discuss.elastic.co/t/painless-script-outputs-literal-key-field/373800 "2025-01-29T08:03:48Z")

</div>

I have a Painless script I run in a Script processor in an Ingest Pipeline which moves fields from within a temporary jsonPayload field to the document root. The source looks like this (field names redacted for safety): …

---

## [Backup and Restore](https://discuss.elastic.co/t/backup-and-restore/373796)

<div class="topic-metadata">

**Author:** [@Moni\_Hazarika](https://discuss.elastic.co/u/Moni_Hazarika)\
**Replies:** 0\
**Last updated:** [January 29, 2025, 5:09am UTC](https://discuss.elastic.co/t/backup-and-restore/373796 "2025-01-29T05:09:10Z")

</div>

Hi Team, We have 2 variants of Elasticsearch clusters in our organisation. We have the ES cloud platinum license for some use cases while for others we have our own self-hosted ES clusters for some valid reasons. For …

---

## [If FSCrawler stops mid-scan, will it restart from scratch?](https://discuss.elastic.co/t/if-fscrawler-stops-mid-scan-will-it-restart-from-scratch/373787)

<div class="topic-metadata">

**Author:** [@syoo](https://discuss.elastic.co/u/syoo)\
**Replies:** 3\
**Last updated:** [January 29, 2025, 1:15am UTC](https://discuss.elastic.co/t/if-fscrawler-stops-mid-scan-will-it-restart-from-scratch/373787 "2025-01-29T01:15:27Z")

</div>

As a newcomer to Elasticsearch, I want to index a large filesystem (100TB) with FSCrawler. I’ve heard that if the initial scan is interrupted, FSCrawler might re-scan everything from the beginning. What’s the best stra…

---

## [Elastic agent input filtering](https://discuss.elastic.co/t/elastic-agent-input-filtering/373711)

<div class="topic-metadata">

**Author:** [@Mohit\_Verma1](https://discuss.elastic.co/u/Mohit_Verma1)\
**Replies:** 0\
**Last updated:** [January 27, 2025, 10:12am UTC](https://discuss.elastic.co/t/elastic-agent-input-filtering/373711 "2025-01-27T10:12:17Z")

</div>

I want to filter the input during elasticsearch intergration with agent policy . Means i want only to collect the log.level == Error. How to do it in fleet server.

---

## [Logstash pushing event to older index](https://discuss.elastic.co/t/logstash-pushing-event-to-older-index/373730)

<div class="topic-metadata">

**Author:** [@devops\_training](https://discuss.elastic.co/u/devops_training)\
**Replies:** 10\
**Last updated:** [January 28, 2025, 8:37pm UTC](https://discuss.elastic.co/t/logstash-pushing-event-to-older-index/373730 "2025-01-28T20:37:29Z")

</div>

\[2025-01-27T11:17:59,721\]\[INFO \]\[logstash.outputs.elastic\]\[main\]\[160e296c5399e510649e9432dfb7810d3b2916f58b5ee2e872c7b33dd0983a64\] Retrying failed action {:status=\>429, :action=\>\["index", {:\_id=\>"a01a2730453bbd683e5db277…

---

## [Multiple unmapped / unknow Elastic Agent log fields](https://discuss.elastic.co/t/multiple-unmapped-unknow-elastic-agent-log-fields/360653)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 3\
**Last updated:** [January 28, 2025, 7:54pm UTC](https://discuss.elastic.co/t/multiple-unmapped-unknow-elastic-agent-log-fields/360653 "2025-01-28T19:54:45Z")

</div>

Hello, I noticed a lot of Elastic Agent log fields have a question mark and seem unmapped. Imho it would be useful if we can aggregate on these fields. Could the mapping please be updated so these fields can be used pro…

---

## [Controls - Adding Links?](https://discuss.elastic.co/t/controls-adding-links/373785)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [January 28, 2025, 5:25pm UTC](https://discuss.elastic.co/t/controls-adding-links/373785 "2025-01-28T17:25:44Z")

</div>

Hello, With the use of Controls, we can have the user select an option from a list (granted you have a data view). Is it possible to have hyperlinks or links to other dashboard using Controls (drop down)? I have al…

---

## [Valid values for service.state](https://discuss.elastic.co/t/valid-values-for-service-state/373766)

<div class="topic-metadata">

**Author:** [@kelunik](https://discuss.elastic.co/u/kelunik)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 5:07pm UTC](https://discuss.elastic.co/t/valid-values-for-service-state/373766 "2025-01-28T17:07:16Z")

</div>

I have (long-running) processes that have a starting, running and shutdown phase. I want to filter logs to only show the running phase. I looked at ECS and found service.state as a field that might be suitable, however, …

---

## [Filebeat not collecting logs from Kubernetes pods in specified namespace](https://discuss.elastic.co/t/filebeat-not-collecting-logs-from-kubernetes-pods-in-specified-namespace/373589)

<div class="topic-metadata">

**Author:** [@paolovalladolid](https://discuss.elastic.co/u/paolovalladolid)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 3:33pm UTC](https://discuss.elastic.co/t/filebeat-not-collecting-logs-from-kubernetes-pods-in-specified-namespace/373589 "2025-01-28T15:33:19Z")

</div>

We have a pod running in a namespace called ceo-qa1. We tried to configure the manifest file to run Filebeat in the ceo-qa1 namespace. However we are not seeing the expected index .ds-logs-ceo-api\* in Kibana Dev Tools…

---

## [Storage in Frozen nodes on Elastic Cloud](https://discuss.elastic.co/t/storage-in-frozen-nodes-on-elastic-cloud/373770)

<div class="topic-metadata">

**Author:** [@yago82](https://discuss.elastic.co/u/yago82)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 3:22pm UTC](https://discuss.elastic.co/t/storage-in-frozen-nodes-on-elastic-cloud/373770 "2025-01-28T15:22:57Z")

</div>

Hi, Can anyone clarify what the storage of Frozen nodes on Elastic Cloud refers to? Is it the local storage of the node itself, or does it represent the storage used by the repository for searchable snapshots (e.g., S3)…

---

## [Webhook Body for Machine Learning Alerts](https://discuss.elastic.co/t/webhook-body-for-machine-learning-alerts/373416)

<div class="topic-metadata">

**Author:** [@catarina](https://discuss.elastic.co/u/catarina)\
**Replies:** 2\
**Last updated:** [January 28, 2025, 3:04pm UTC](https://discuss.elastic.co/t/webhook-body-for-machine-learning-alerts/373416 "2025-01-28T15:04:33Z")

</div>

Hello Elastic Community, I’ve set up an advanced Machine Learning job to detect anomalies in user logins, with 6 detectors focusing on unusual source.ip, country, hostname, hour, and time of the week per user. I create…

---

## [Metric or legacy lens does not apply dashboard context filter](https://discuss.elastic.co/t/metric-or-legacy-lens-does-not-apply-dashboard-context-filter/373707)

<div class="topic-metadata">

**Author:** [@j-nash](https://discuss.elastic.co/u/j-nash)\
**Replies:** 4\
**Last updated:** [January 28, 2025, 2:36pm UTC](https://discuss.elastic.co/t/metric-or-legacy-lens-does-not-apply-dashboard-context-filter/373707 "2025-01-28T14:36:28Z")

</div>

Hello, I'm creating a dashboard in Kibana to visualize some metrics, and I'm encountering an issue with the date selector. The date selector works perfectly for most visualizations, but when I use either the "legacy" l…

---

## [Elastic Agent vs System integration](https://discuss.elastic.co/t/elastic-agent-vs-system-integration/373771)

<div class="topic-metadata">

**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 2:31pm UTC](https://discuss.elastic.co/t/elastic-agent-vs-system-integration/373771 "2025-01-28T14:31:37Z")

</div>

In my ELK stack deployment I have for most agent policies the System integration set with the "Collect metrics from System instances" enabled as can be seen below: Recently I saw that there is a setting to enable log…

---

## [Synthetics and APM integration](https://discuss.elastic.co/t/synthetics-and-apm-integration/373769)

<div class="topic-metadata">

**Author:** [@vharish0596](https://discuss.elastic.co/u/vharish0596)\
**Replies:** 0\
**Last updated:** [January 28, 2025, 2:00pm UTC](https://discuss.elastic.co/t/synthetics-and-apm-integration/373769 "2025-01-28T14:00:05Z")

</div>

In the advanced options of synthetics there an option to choose APM service name. However few things are not clear like Let's say I have a service in APM running in two environments with the same name, to which envi…

---

## [Storage differentiation. Multiple nodes on single host?](https://discuss.elastic.co/t/storage-differentiation-multiple-nodes-on-single-host/373719)

<div class="topic-metadata">

**Author:** [@catn0b0t](https://discuss.elastic.co/u/catn0b0t)\
**Replies:** 7\
**Last updated:** [January 28, 2025, 12:15pm UTC](https://discuss.elastic.co/t/storage-differentiation-multiple-nodes-on-single-host/373719 "2025-01-28T12:15:27Z")

</div>

We have hosts with both nvme storage and sata storage. Currently we run a single elasticsearch instance on each host and to keep performance up we only use the nvme storage. Now, we would like to start using the sata-dis…

---

## [Disable SSL and HTTP security](https://discuss.elastic.co/t/disable-ssl-and-http-security/373753)

<div class="topic-metadata">

**Author:** [@Oyuka](https://discuss.elastic.co/u/Oyuka)\
**Replies:** 9\
**Last updated:** [January 28, 2025, 11:21am UTC](https://discuss.elastic.co/t/disable-ssl-and-http-security/373753 "2025-01-28T11:21:24Z")

</div>

Hello, Why isn't a new index being created? I think this error related HTTP and SSL security in my elasticsearch.yml. The second picture is security configuration in elasticsearch.yml. When i disable them kibana doesn'…

---

## [How to create an alert when apm agent stops working?](https://discuss.elastic.co/t/how-to-create-an-alert-when-apm-agent-stops-working/373618)

<div class="topic-metadata">

**Author:** [@krishnannair87](https://discuss.elastic.co/u/krishnannair87)\
**Replies:** 3\
**Last updated:** [January 28, 2025, 10:01am UTC](https://discuss.elastic.co/t/how-to-create-an-alert-when-apm-agent-stops-working/373618 "2025-01-28T10:01:24Z")

</div>

I have multiple elastic apm java agent deployed and i need to create an alert when it stops working. I see one topic relevant to this but I still want to check what is the configuration of alert in case we enable health …

---

## [How to Filter and Group Values by Type in an Array Nested Field in Kibana](https://discuss.elastic.co/t/how-to-filter-and-group-values-by-type-in-an-array-nested-field-in-kibana/373643)

<div class="topic-metadata">

**Author:** [@Shell\_Dias](https://discuss.elastic.co/u/Shell_Dias)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 8:35am UTC](https://discuss.elastic.co/t/how-to-filter-and-group-values-by-type-in-an-array-nested-field-in-kibana/373643 "2025-01-28T08:35:00Z")

</div>

How can I filter and group a field from a document? Inside the document, I have a field with an array of type and values. I would like to filter by type X and group only the values related to it in Kibana.

---

## [Sometimes, span.db.statement is ignored in span detail](https://discuss.elastic.co/t/sometimes-span-db-statement-is-ignored-in-span-detail/372981)

<div class="topic-metadata">

**Author:** [@at\_andreas](https://discuss.elastic.co/u/at_andreas)\
**Replies:** 1\
**Last updated:** [January 28, 2025, 6:41am UTC](https://discuss.elastic.co/t/sometimes-span-db-statement-is-ignored-in-span-detail/372981 "2025-01-28T06:41:38Z")

</div>

Why is the database statement (span.db.statement) sometimes displayed and sometimes not? Neither in the ‘Span details’ nor in custom dashboards. But when i discover the span, i see an \_ignored-Tag and also the db.stateme…

---

## [Elastic Agent output to Azure Event Hub](https://discuss.elastic.co/t/elastic-agent-output-to-azure-event-hub/373752)

<div class="topic-metadata">

**Author:** [@linuschewpet](https://discuss.elastic.co/u/linuschewpet)\
**Replies:** 0\
**Last updated:** [January 28, 2025, 3:36am UTC](https://discuss.elastic.co/t/elastic-agent-output-to-azure-event-hub/373752 "2025-01-28T03:36:37Z")

</div>

Recently I have seen a post on Elastic Agent new output to kafka Would the output be doable with Azure Event Hub since its technically kafka as well.

---

## [Delete my account](https://discuss.elastic.co/t/delete-my-account/373749)

<div class="topic-metadata">

**Author:** [@anon17415294](https://discuss.elastic.co/u/anon17415294)\
**Replies:** 8\
**Last updated:** [January 28, 2025, 3:30am UTC](https://discuss.elastic.co/t/delete-my-account/373749 "2025-01-28T03:30:46Z")

</div>

I need help deleting my account on discuss.elastic.co. Can someone help?

---

## [Move default elastic data/index storage to a newly created volume](https://discuss.elastic.co/t/move-default-elastic-data-index-storage-to-a-newly-created-volume/373658)

<div class="topic-metadata">

**Author:** [@ermisma](https://discuss.elastic.co/u/ermisma)\
**Replies:** 7\
**Last updated:** [January 27, 2025, 10:50pm UTC](https://discuss.elastic.co/t/move-default-elastic-data-index-storage-to-a-newly-created-volume/373658 "2025-01-27T22:50:33Z")

</div>

We have successfully deployed ELK and it's up and running. We've created a new volume and attached it to the VM hosting the ELK stack. Our goal is to store all data, including indices, on this newly mounted volume. To d…

---

## [Cross Cluster Replication: To find overall time taken for data replication](https://discuss.elastic.co/t/cross-cluster-replication-to-find-overall-time-taken-for-data-replication/373750)

<div class="topic-metadata">

**Author:** [@lochinvar](https://discuss.elastic.co/u/lochinvar)\
**Replies:** 0\
**Last updated:** [January 27, 2025, 10:50pm UTC](https://discuss.elastic.co/t/cross-cluster-replication-to-find-overall-time-taken-for-data-replication/373750 "2025-01-27T22:50:28Z")

</div>

Hi All, I have done CCR setup and was able to get the existing data replicated from leader to follower. Working on to know the overall time taken to replicate the data from leader to follower. I ran "\_ccr/stats" to gat…

---

## [How to configure elastic stack, i want to migrate from Prometheus to elastic](https://discuss.elastic.co/t/how-to-configure-elastic-stack-i-want-to-migrate-from-prometheus-to-elastic/373395)

<div class="topic-metadata">

**Author:** [@vagharsh](https://discuss.elastic.co/u/vagharsh)\
**Replies:** 7\
**Last updated:** [January 27, 2025, 9:50pm UTC](https://discuss.elastic.co/t/how-to-configure-elastic-stack-i-want-to-migrate-from-prometheus-to-elastic/373395 "2025-01-27T21:50:52Z")

</div>

hi everyone, i am using elastic/eck-stack helm chart, my helm values are posted below, i want to migrate away from my current prometheus monitoring solution but since my environment is using servicemonitors and pod mon…

---

## [Elastic Data at Rest Encryption](https://discuss.elastic.co/t/elastic-data-at-rest-encryption/373746)

<div class="topic-metadata">

**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\
**Replies:** 1\
**Last updated:** [January 27, 2025, 8:39pm UTC](https://discuss.elastic.co/t/elastic-data-at-rest-encryption/373746 "2025-01-27T20:39:48Z")

</div>

Is there Data at rest Encryption on self-hosted Elasticsearch ? If so how can i achieve this

---

## [Elastic-agent-complete:\>=8.16.0 chowns NSSDB](https://discuss.elastic.co/t/elastic-agent-complete-8-16-0-chowns-nssdb/371556)

<div class="topic-metadata">

**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\
**Replies:** 3\
**Last updated:** [January 27, 2025, 8:35pm UTC](https://discuss.elastic.co/t/elastic-agent-complete-8-16-0-chowns-nssdb/371556 "2025-01-27T20:35:12Z")

</div>

I am having an issue with elastic-agent-complete:8.16.1. We use self-signed certs on many of the internal sites we monitor, so I have to add these certs to the nssdb, however they need to be chown'd to elastic-agent:ela…

---

## [Elastic APM Agent vs Elastic Distribution of OpenTelemetry roadmap and support](https://discuss.elastic.co/t/elastic-apm-agent-vs-elastic-distribution-of-opentelemetry-roadmap-and-support/373731)

<div class="topic-metadata">

**Author:** [@Marchelune](https://discuss.elastic.co/u/Marchelune)\
**Replies:** 3\
**Last updated:** [January 27, 2025, 8:09pm UTC](https://discuss.elastic.co/t/elastic-apm-agent-vs-elastic-distribution-of-opentelemetry-roadmap-and-support/373731 "2025-01-27T20:09:56Z")

</div>

Hi! I have a roadmap question on the APM nodeJS agent (although it's probably a question in general). I wrote and maintain some custom (internal) packages to instrument nodejs apps to better track transactions from an u…

[Previous page](https://discuss.elastic.co/latest.md?page=153)

[Next page](https://discuss.elastic.co/latest.md?page=155)
