# Latest

**URL:** https://discuss.elastic.co/latest.md?page=162

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 163

---

## [Solace transactions are not visible in open open-telementry traces](https://discuss.elastic.co/t/solace-transactions-are-not-visible-in-open-open-telementry-traces/373061)

<div class="topic-metadata">

**Author:** [@nishatalreja](https://discuss.elastic.co/u/nishatalreja)\
**Replies:** 3\
**Last updated:** [January 15, 2025, 10:08am UTC](https://discuss.elastic.co/t/solace-transactions-are-not-visible-in-open-open-telementry-traces/373061 "2025-01-15T10:08:21Z")

</div>

We are not able to see received and sent solace messages in apm traces and transactions: Kibana version:NA Elasticsearch version:1.33.4 APM Server version:1.33.4 APM Agent language and version: Jdk8 Browser version …

---

## [Does roles assigned to nodes affect the disk rebalancing?](https://discuss.elastic.co/t/does-roles-assigned-to-nodes-affect-the-disk-rebalancing/373215)

<div class="topic-metadata">

**Author:** [@mike123](https://discuss.elastic.co/u/mike123)\
**Replies:** 2\
**Last updated:** [January 15, 2025, 9:10am UTC](https://discuss.elastic.co/t/does-roles-assigned-to-nodes-affect-the-disk-rebalancing/373215 "2025-01-15T09:10:20Z")

</div>

I have 10 data nodes of which 3 have additional ML and transform role to it. I could observe that almost all the primary shards are assigned to nodes with ml role assigned to it. And replicas are distributed. This is ca…

---

## [What is the appropriate document size in Elasticsearch？](https://discuss.elastic.co/t/what-is-the-appropriate-document-size-in-elasticsearch/358191)

<div class="topic-metadata">

**Author:** [@jiankunking](https://discuss.elastic.co/u/jiankunking)\
**Replies:** 1\
**Last updated:** [January 15, 2025, 8:15am UTC](https://discuss.elastic.co/t/what-is-the-appropriate-document-size-in-elasticsearch/358191 "2025-01-15T08:15:26Z")

</div>

// Reduced irrelevant attributes { "code": "product code", "saleIncludeCustomers": \[ // Object { "code": "Customer code", "launchId": "la…

---

## [Elasticsearch Virtual Machine Requirement](https://discuss.elastic.co/t/elasticsearch-virtual-machine-requirement/371345)

<div class="topic-metadata">

**Author:** [@Hendrawns](https://discuss.elastic.co/u/Hendrawns)\
**Replies:** 2\
**Last updated:** [January 15, 2025, 8:13am UTC](https://discuss.elastic.co/t/elasticsearch-virtual-machine-requirement/371345 "2025-01-15T08:13:35Z")

</div>

Hello Everyone, I plan to move the Elasticsearch environment to a virtual machine because the bare metal server that I currently use is always full quickly, so my team decided to migrate to a virtual machine that is easy…

---

## [Why is my dependency showing as unknown](https://discuss.elastic.co/t/why-is-my-dependency-showing-as-unknown/372376)

<div class="topic-metadata">

**Author:** [@arT1](https://discuss.elastic.co/u/arT1)\
**Replies:** 4\
**Last updated:** [January 15, 2025, 7:34am UTC](https://discuss.elastic.co/t/why-is-my-dependency-showing-as-unknown/372376 "2025-01-15T07:34:14Z")

</div>

Elastic Stack 8.13.3 Java agent：apm-agent-attach-cli-1.52.0.jar How does apm-agent obtain dependencies? Why can't this DB get the dependency name?

---

## [Finding number of hits for an index](https://discuss.elastic.co/t/finding-number-of-hits-for-an-index/373197)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 1\
**Last updated:** [January 15, 2025, 2:26am UTC](https://discuss.elastic.co/t/finding-number-of-hits-for-an-index/373197 "2025-01-15T02:26:01Z")

</div>

Hi All, I am trying to determine number of hits that an index experiences in a 24 hours period. I see the number as 87,366,378 for a 24 hour period between Jan 6th and 7th as follows: How can I get this number 87,3…

---

## [Filebeat Microsoft Module - Documents Incomplete](https://discuss.elastic.co/t/filebeat-microsoft-module-documents-incomplete/372900)

<div class="topic-metadata">

**Author:** [@mgotechlock](https://discuss.elastic.co/u/mgotechlock)\
**Replies:** 5\
**Last updated:** [January 14, 2025, 11:50pm UTC](https://discuss.elastic.co/t/filebeat-microsoft-module-documents-incomplete/372900 "2025-01-14T23:50:50Z")

</div>

Posting as FYI. The instructions for the Filebeat Microsoft Module at Microsoft module | Filebeat Reference \[8.17\] | Elastic are incomplete. You need to also add the permissions for the WindowsDefenderATP API \> Alerts \> …

---

## [Elasticsearch Architecture](https://discuss.elastic.co/t/elasticsearch-architecture/373127)

<div class="topic-metadata">

**Author:** [@rolindroy](https://discuss.elastic.co/u/rolindroy)\
**Replies:** 3\
**Last updated:** [January 14, 2025, 11:32pm UTC](https://discuss.elastic.co/t/elasticsearch-architecture/373127 "2025-01-14T23:32:32Z")

</div>

I have set up an Elasticsearch cluster to handle logs from a Kubernetes (K8s) cluster hosting over 500 applications. Retention policies need to be configured per application, with a default retention of 20 days and exten…

---

## [Kibana Discover: configure the default fields shown in results](https://discuss.elastic.co/t/kibana-discover-configure-the-default-fields-shown-in-results/373195)

<div class="topic-metadata">

**Author:** [@jhfrontz](https://discuss.elastic.co/u/jhfrontz)\
**Replies:** 2\
**Last updated:** [January 14, 2025, 11:26pm UTC](https://discuss.elastic.co/t/kibana-discover-configure-the-default-fields-shown-in-results/373195 "2025-01-14T23:26:02Z")

</div>

We have two ELK instances, ostensibly with the same data. One is accessed via a Kibana version 7 interface, one via Kibana 8. The default fields displayed in Discover results differ between the two (see below). I'm unsu…

---

## [Multiline config](https://discuss.elastic.co/t/multiline-config/373203)

<div class="topic-metadata">

**Author:** [@stecino](https://discuss.elastic.co/u/stecino)\
**Replies:** 0\
**Last updated:** [January 14, 2025, 8:48pm UTC](https://discuss.elastic.co/t/multiline-config/373203 "2025-01-14T20:48:28Z")

</div>

Trying to identify log events that start either with \<\<\< or \>\>\> or \[ Would this be correct? multiline.pattern: '^(\<\<\<\<|\>\>\>\>|\])'

---

## [Elastic search trained model inference not working](https://discuss.elastic.co/t/elastic-search-trained-model-inference-not-working/359649)

<div class="topic-metadata">

**Author:** [@likealam](https://discuss.elastic.co/u/likealam)\
**Replies:** 5\
**Last updated:** [January 14, 2025, 8:45pm UTC](https://discuss.elastic.co/t/elastic-search-trained-model-inference-not-working/359649 "2025-01-14T20:45:17Z")

</div>

After importing the text embedding sentence-transformers/msmarco-MiniLM-L12-cos-v5 model to elasticsearch using eland the model infering doesnt work. eland command: eland\_import\_hub\_model --url http://localhost:9200 --…

---

## [Filtering messages in Logstash](https://discuss.elastic.co/t/filtering-messages-in-logstash/373126)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 4\
**Last updated:** [January 14, 2025, 7:49pm UTC](https://discuss.elastic.co/t/filtering-messages-in-logstash/373126 "2025-01-14T19:49:55Z")

</div>

Hi All, The incoming feed (log) to Logstash has parameters which are delimited by ~|~ These are being mutated and split in Logstash as follows. : if \[type\] == "tv\_dmz\_access" { mutate { …

---

## [Elasticsearch Not Freeing Disk Space After Shard Relocation](https://discuss.elastic.co/t/elasticsearch-not-freeing-disk-space-after-shard-relocation/373075)

<div class="topic-metadata">

**Author:** [@09a9373743777d8430c4](https://discuss.elastic.co/u/09a9373743777d8430c4)\
**Replies:** 13\
**Last updated:** [January 14, 2025, 6:54pm UTC](https://discuss.elastic.co/t/elasticsearch-not-freeing-disk-space-after-shard-relocation/373075 "2025-01-14T18:54:40Z")

</div>

We are experiencing an issue where Elasticsearch is not properly freeing up disk space after relocating shards. Specifically, even though the shards are relocated, disk space is not being released as expected. This issue…

---

## [Sizing a secondary Cluster with Frozen nodes and Searchable Snapshots](https://discuss.elastic.co/t/sizing-a-secondary-cluster-with-frozen-nodes-and-searchable-snapshots/373184)

<div class="topic-metadata">

**Author:** [@yago82](https://discuss.elastic.co/u/yago82)\
**Replies:** 1\
**Last updated:** [January 14, 2025, 6:53pm UTC](https://discuss.elastic.co/t/sizing-a-secondary-cluster-with-frozen-nodes-and-searchable-snapshots/373184 "2025-01-14T18:53:40Z")

</div>

Hi all, I’m working on a solution involving the use of searchable snapshots, and I need some clarification to properly size a second cluster. Here’s the context: I plan to use my production cluster (Platinum license) …

---

## [Iterating over fields with multiple filter processes](https://discuss.elastic.co/t/iterating-over-fields-with-multiple-filter-processes/373187)

<div class="topic-metadata">

**Author:** [@philhagen](https://discuss.elastic.co/u/philhagen)\
**Replies:** 2\
**Last updated:** [January 14, 2025, 6:32pm UTC](https://discuss.elastic.co/t/iterating-over-fields-with-multiple-filter-processes/373187 "2025-01-14T18:32:35Z")

</div>

I run a series of consistent filters over a series of fields that may or may not exist. For consistency and to simplify maintenance, I'd like to do this with one code block instead of multiple repetitive ones. For a sp…

---

## [Crawler conditional document ingest based on modified date](https://discuss.elastic.co/t/crawler-conditional-document-ingest-based-on-modified-date/373193)

<div class="topic-metadata">

**Author:** [@Dhaliwal-BCGOV](https://discuss.elastic.co/u/Dhaliwal-BCGOV)\
**Replies:** 0\
**Last updated:** [January 14, 2025, 5:30pm UTC](https://discuss.elastic.co/t/crawler-conditional-document-ingest-based-on-modified-date/373193 "2025-01-14T17:30:58Z")

</div>

Hi, Only ingest existing pages using crawler if page modified date has been updated.

---

## [Elasticsearch Performance Issues on CapCut Resource Website](https://discuss.elastic.co/t/elasticsearch-performance-issues-on-capcut-resource-website/373130)

<div class="topic-metadata">

**Author:** [@joeroot](https://discuss.elastic.co/u/joeroot)\
**Replies:** 2\
**Last updated:** [January 14, 2025, 4:46pm UTC](https://discuss.elastic.co/t/elasticsearch-performance-issues-on-capcut-resource-website/373130 "2025-01-14T16:46:29Z")

</div>

Hi everyone, I’m running a website focused on CapCut tutorials and resources, and I’ve implemented Elasticsearch for powering the search functionality. However, I’m experiencing significant performance issues: Slow Se…

---

## [Heartbeat roles that are required](https://discuss.elastic.co/t/heartbeat-roles-that-are-required/373189)

<div class="topic-metadata">

**Author:** [@Gong](https://discuss.elastic.co/u/Gong)\
**Replies:** 0\
**Last updated:** [January 14, 2025, 4:00pm UTC](https://discuss.elastic.co/t/heartbeat-roles-that-are-required/373189 "2025-01-14T16:00:18Z")

</div>

Hi, I'm integrating Heartbeat and I've created a user but despite reading the doc's including Grant users access to secured resources | Heartbeat Reference \[8.17\] | Elastic and scribbling a page of notes, I'm still gett…

---

## [Snapshot Lifecycle Lifecyle and Managment Creating issue for rollover](https://discuss.elastic.co/t/snapshot-lifecycle-lifecyle-and-managment-creating-issue-for-rollover/373154)

<div class="topic-metadata">

**Author:** [@kishorkumar](https://discuss.elastic.co/u/kishorkumar)\
**Replies:** 1\
**Last updated:** [January 14, 2025, 2:50pm UTC](https://discuss.elastic.co/t/snapshot-lifecycle-lifecyle-and-managment-creating-issue-for-rollover/373154 "2025-01-14T14:50:53Z")

</div>

Overview i have elasticsearch 8.11 with no replicas right now, only 5 hot nodes and 2 frozen that's it. Here is index lifecycle policy is this PUT \_ilm/policy/ConrainerLogs { "policy": { "phases": { …

---

## [Hiding or Excluding Fields in Filebeat Data Ingestion via MQTT](https://discuss.elastic.co/t/hiding-or-excluding-fields-in-filebeat-data-ingestion-via-mqtt/373166)

<div class="topic-metadata">

**Author:** [@TheNewGuy123](https://discuss.elastic.co/u/TheNewGuy123)\
**Replies:** 0\
**Last updated:** [January 14, 2025, 10:38am UTC](https://discuss.elastic.co/t/hiding-or-excluding-fields-in-filebeat-data-ingestion-via-mqtt/373166 "2025-01-14T10:38:26Z")

</div>

Hi, I'm encountering some challenges while ingesting data using Filebeat with MQTT. My setup involves ingesting data from multiple MQTT topics that follow this naming structure: \<ABBREVIATION\>/\<CITY\_NAME\>/\<SIGNAL\_CODE\> …

---

## [ How to Customize the service.name Field in Elastic Agent](https://discuss.elastic.co/t/how-to-customize-the-service-name-field-in-elastic-agent/373164)

<div class="topic-metadata">

**Author:** [@marload1](https://discuss.elastic.co/u/marload1)\
**Replies:** 0\
**Last updated:** [January 14, 2025, 10:36am UTC](https://discuss.elastic.co/t/how-to-customize-the-service-name-field-in-elastic-agent/373164 "2025-01-14T10:36:22Z")

</div>

Hello, In Elastic Agent, it seems that logs are collected, transformed into documents, and then converted to the Elastic Common Schema (ECS). During this process, the service.name field is populated by parsing the value…

---

## [Startup failure - arch64 - crashes - arm64 - fedora, rocky9, centos9, macbook m4, docker](https://discuss.elastic.co/t/startup-failure-arch64-crashes-arm64-fedora-rocky9-centos9-macbook-m4-docker/371708)

<div class="topic-metadata">

**Author:** [@contactnkm](https://discuss.elastic.co/u/contactnkm)\
**Replies:** 7\
**Last updated:** [January 14, 2025, 10:35am UTC](https://discuss.elastic.co/t/startup-failure-arch64-crashes-arm64-fedora-rocky9-centos9-macbook-m4-docker/371708 "2025-01-14T10:35:49Z")

</div>

Get the following error whenever trying to install and run elasticsearch on aarch64 rocky9.5 or fedora 6.11.4 stdoout: # # A fatal error has been detected by the Java Runtime Environment: # # SIGILL (0x4) at pc=0x0000…

---

## [Nodes going down without any error logs](https://discuss.elastic.co/t/nodes-going-down-without-any-error-logs/373155)

<div class="topic-metadata">

**Author:** [@Naveen\_S1](https://discuss.elastic.co/u/Naveen_S1)\
**Replies:** 1\
**Last updated:** [January 14, 2025, 7:59am UTC](https://discuss.elastic.co/t/nodes-going-down-without-any-error-logs/373155 "2025-01-14T07:59:53Z")

</div>

I have an ES cluster hosted on-prem with around 110 nodes. Each node resides on a 2TB partition. I have to index around 5 set of 250 GB JSON data into the cluster. Each JSON file contains 10,000 docs. I am using a custo…

---

## [Can't make MongoDB connection work in Logstash Filter](https://discuss.elastic.co/t/cant-make-mongodb-connection-work-in-logstash-filter/373144)

<div class="topic-metadata">

**Author:** [@mdschoe](https://discuss.elastic.co/u/mdschoe)\
**Replies:** 2\
**Last updated:** [January 14, 2025, 5:26am UTC](https://discuss.elastic.co/t/cant-make-mongodb-connection-work-in-logstash-filter/373144 "2025-01-14T05:26:14Z")

</div>

I've been fighting this issue for days and keep circling back to the same problem: \[2025-01-13T21:24:32,037\]\[ERROR\]\[logstash.javapipeline \]\[main\] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\*\*\<Sequel::AdapterN…

---

## [Is it safe to set action.auto\_create\_index to false?](https://discuss.elastic.co/t/is-it-safe-to-set-action-auto-create-index-to-false/372809)

<div class="topic-metadata">

**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\
**Replies:** 12\
**Last updated:** [January 14, 2025, 2:20am UTC](https://discuss.elastic.co/t/is-it-safe-to-set-action-auto-create-index-to-false/372809 "2025-01-14T02:20:36Z")

</div>

Hello everyone, We're using Elastic Cloud v8.11.1 and facing a problem where the automatically created index does not have the desired field mapping, so we're considering disable auto create index. while this document …

---

## [GET /\_security/api\_key does not show "role\_descriptors"](https://discuss.elastic.co/t/get-security-api-key-does-not-show-role-descriptors/373029)

<div class="topic-metadata">

**Author:** [@Byungsoo\_Kim](https://discuss.elastic.co/u/Byungsoo_Kim)\
**Replies:** 8\
**Last updated:** [January 14, 2025, 12:52am UTC](https://discuss.elastic.co/t/get-security-api-key-does-not-show-role-descriptors/373029 "2025-01-14T00:52:48Z")

</div>

I am using ES cloud and create api\_key through "API Console" UI on ES cloud. The following is an example of the payload to create an api\_key POST /\_security/api\_key { "name": "midtier-2025", "role\_descriptors": { …

---

## [Index relocation failing at 100% bytes](https://discuss.elastic.co/t/index-relocation-failing-at-100-bytes/372934)

<div class="topic-metadata">

**Author:** [@nisow95612](https://discuss.elastic.co/u/nisow95612)\
**Replies:** 5\
**Last updated:** [January 13, 2025, 11:09pm UTC](https://discuss.elastic.co/t/index-relocation-failing-at-100-bytes/372934 "2025-01-13T23:09:54Z")

</div>

After upgrade from 7.17.23 to 7.17.26 I started seeing patterns like this: ILM starts relocating from warm tier to cold in /\_cat/allocation transfer goes to 100% bp nothing in log of source node error in log of target …

---

## [Tips for managing spikes in data sources](https://discuss.elastic.co/t/tips-for-managing-spikes-in-data-sources/373143)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [January 13, 2025, 9:27pm UTC](https://discuss.elastic.co/t/tips-for-managing-spikes-in-data-sources/373143 "2025-01-13T21:27:12Z")

</div>

Hello, I was wondering what others do to manage a huge increase in events from a particular data source (spikes). I know there's a rate lime processor on elastic agent but is there other mechanisms used? I have heard o…

---

## [Filebeat8.12 cisco module for ise logs is supported or not?](https://discuss.elastic.co/t/filebeat8-12-cisco-module-for-ise-logs-is-supported-or-not/373043)

<div class="topic-metadata">

**Author:** [@Priyanka\_chauhan](https://discuss.elastic.co/u/Priyanka_chauhan)\
**Replies:** 4\
**Last updated:** [January 13, 2025, 8:28pm UTC](https://discuss.elastic.co/t/filebeat8-12-cisco-module-for-ise-logs-is-supported-or-not/373043 "2025-01-13T20:28:35Z")

</div>

I have setup filebeat 8.12 and set kafka input in filebeat input file , since cisco ise logs are coming at kafka topic , ingest pipeline is created for cisco module and filebeat index is created ,ise logs are coming in f…

---

## [Some advice?](https://discuss.elastic.co/t/some-advice/373123)

<div class="topic-metadata">

**Author:** [@catn0b0t](https://discuss.elastic.co/u/catn0b0t)\
**Replies:** 2\
**Last updated:** [January 13, 2025, 6:19pm UTC](https://discuss.elastic.co/t/some-advice/373123 "2025-01-13T18:19:35Z")

</div>

Hi, we have +300 servers that we have enrolled with a fleet-policy. We would like to rollout monitors to these servers to check on uptime of local services. However, we have this going now for 1 service, and it is a bit …

[Previous page](https://discuss.elastic.co/latest.md?page=161)

[Next page](https://discuss.elastic.co/latest.md?page=163)
