# Latest

**URL:** https://discuss.elastic.co/latest.md?page=165

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 166

---

## [File was truncated. Begin reading file from offset 0 multiple time](https://discuss.elastic.co/t/file-was-truncated-begin-reading-file-from-offset-0-multiple-time/371459)

<div class="topic-metadata">

**Author:** [@Mimouz](https://discuss.elastic.co/u/Mimouz)\
**Replies:** 5\
**Last updated:** [January 9, 2025, 9:31am UTC](https://discuss.elastic.co/t/file-was-truncated-begin-reading-file-from-offset-0-multiple-time/371459 "2025-01-09T09:31:04Z")

</div>

Hi, I'm new to the ELK stack and currently exploring its features for log aggregation. We are using tomcat-9 and elk stack 8.5.1 and we faced an issue that the logs are duplicated in Kibana more then 3 or 5 times depen…

---

## [What components come under Enterprise subscription?](https://discuss.elastic.co/t/what-components-come-under-enterprise-subscription/372968)

<div class="topic-metadata">

**Author:** [@searchwithme](https://discuss.elastic.co/u/searchwithme)\
**Replies:** 1\
**Last updated:** [January 9, 2025, 8:08am UTC](https://discuss.elastic.co/t/what-components-come-under-enterprise-subscription/372968 "2025-01-09T08:08:16Z")

</div>

Hi! If I put together an architecture with data nodes, master nodes, kibana, logstash, fleet nodes, ingest nodes - which of these are excluded during the RAM calculation to determine the number of licenses? Please help! …

---

## [How to reference elasticsearch secrets from azure key vault?](https://discuss.elastic.co/t/how-to-reference-elasticsearch-secrets-from-azure-key-vault/372974)

<div class="topic-metadata">

**Author:** [@Bahubalipr](https://discuss.elastic.co/u/Bahubalipr)\
**Replies:** 0\
**Last updated:** [January 9, 2025, 7:23am UTC](https://discuss.elastic.co/t/how-to-reference-elasticsearch-secrets-from-azure-key-vault/372974 "2025-01-09T07:23:57Z")

</div>

We have deployed Elasticsearch in azure Kubernetes service and we are creating Kubernetes secrets for ES authentication since the security xpack is enabled. Is it possible to fetch the secrets from azure key vault for E…

---

## [Grok and special characters in field names](https://discuss.elastic.co/t/grok-and-special-characters-in-field-names/372971)

<div class="topic-metadata">

**Author:** [@Snow](https://discuss.elastic.co/u/Snow)\
**Replies:** 0\
**Last updated:** [January 9, 2025, 6:56am UTC](https://discuss.elastic.co/t/grok-and-special-characters-in-field-names/372971 "2025-01-09T06:56:07Z")

</div>

ES field names are like "dns.question, dns.question.type,dns.answers" (DNS Fields | Elastic Common Schema (ECS) Reference \[8.16\] | Elastic)|" (DNS Fields | Elastic Common Schema (ECS) Reference \[8.16\] | Elastic) but wh…

---

## [An error occurred curl: (52) Empty reply from server](https://discuss.elastic.co/t/an-error-occurred-curl-52-empty-reply-from-server/372965)

<div class="topic-metadata">

**Author:** [@Input\_Studios](https://discuss.elastic.co/u/Input_Studios)\
**Replies:** 1\
**Last updated:** [January 9, 2025, 3:09am UTC](https://discuss.elastic.co/t/an-error-occurred-curl-52-empty-reply-from-server/372965 "2025-01-09T03:09:13Z")

</div>

Good day, a problem arose when requesting the following address: curl -X GET "http://localhost:9200" an error occurs curl: (52) Empty reply from server. The code for connecting to the elasticsearch service is launched fr…

---

## [Dissect first then multiline in filebeat](https://discuss.elastic.co/t/dissect-first-then-multiline-in-filebeat/369748)

<div class="topic-metadata">

**Author:** [@justkind](https://discuss.elastic.co/u/justkind)\
**Replies:** 3\
**Last updated:** [January 8, 2025, 9:50pm UTC](https://discuss.elastic.co/t/dissect-first-then-multiline-in-filebeat/369748 "2025-01-08T21:50:01Z")

</div>

Hi everyone, Any help would be greatly appreciated. We recently upgraded our kubernetes cluster and all logs are now coming in with the new kubernetes CRI log format, that includes a timestamp and the output stream typ…

---

## [Timeout for exporting csv in ES|QL](https://discuss.elastic.co/t/timeout-for-exporting-csv-in-es-ql/372350)

<div class="topic-metadata">

**Author:** [@petition2307](https://discuss.elastic.co/u/petition2307)\
**Replies:** 5\
**Last updated:** [January 8, 2025, 9:35pm UTC](https://discuss.elastic.co/t/timeout-for-exporting-csv-in-es-ql/372350 "2025-01-08T21:35:12Z")

</div>

I'm an Elasticsearch beginner. I have a problem about exporting csv in ES|QL. Environment OS: Debian 12 Elasticsearch Version: 8.15.2 (elasticsearch and kibana) Problem I tried exporting csv and got timeout error. T…

---

## [Logs Not Appearing in Kibana After Instance Refresh Activity](https://discuss.elastic.co/t/logs-not-appearing-in-kibana-after-instance-refresh-activity/372956)

<div class="topic-metadata">

**Author:** [@ErGeek](https://discuss.elastic.co/u/ErGeek)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 8:44pm UTC](https://discuss.elastic.co/t/logs-not-appearing-in-kibana-after-instance-refresh-activity/372956 "2025-01-08T20:44:33Z")

</div>

Our log management pipeline operates as follows: Beats -\> MSK (Kafka) -\> Logstash (hosted in EC2) -\> Elasticsearch -\> Kibana. We handle updates to the Logstash servers through the Instance Refresh activity in AWS. This …

---

## [Synthetic Browser Timings](https://discuss.elastic.co/t/synthetic-browser-timings/372815)

<div class="topic-metadata">

**Author:** [@Yechezkal\_Gutfreund](https://discuss.elastic.co/u/Yechezkal_Gutfreund)\
**Replies:** 0\
**Last updated:** [January 5, 2025, 7:43pm UTC](https://discuss.elastic.co/t/synthetic-browser-timings/372815 "2025-01-05T19:43:44Z")

</div>

We setup a synthetic monitor with a single page HTTP call. Did it for all 10 locations (US, Pacific, Australia, etc.). Question 1: Where can I find authoritative documentation of how DNS, SSL, payload.timings.total, et…

---

## [Cadence of telemetry from ElasticClient](https://discuss.elastic.co/t/cadence-of-telemetry-from-elasticclient/372954)

<div class="topic-metadata">

**Author:** [@Yechezkal\_Gutfreund](https://discuss.elastic.co/u/Yechezkal_Gutfreund)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 6:20pm UTC](https://discuss.elastic.co/t/cadence-of-telemetry-from-elasticclient/372954 "2025-01-08T18:20:34Z")

</div>

We have an ElasticClient (APM, Windows, System) integration running on a win11 box. The windows box does go to sleep after 15 minutes. What is disturbing is that I am seeing the memory charts go to zero for those period…

---

## [LogsDB Without Synthetic \_Source: Storage Savings and Upgrade Risks?](https://discuss.elastic.co/t/logsdb-without-synthetic-source-storage-savings-and-upgrade-risks/372858)

<div class="topic-metadata">

**Author:** [@Behnam.R](https://discuss.elastic.co/u/Behnam.R)\
**Replies:** 5\
**Last updated:** [January 8, 2025, 6:16pm UTC](https://discuss.elastic.co/t/logsdb-without-synthetic-source-storage-savings-and-upgrade-risks/372858 "2025-01-08T18:16:05Z")

</div>

I am currently on Elasticsearch version 8.16 and considering using the LogsDB index mode for its benefits, particularly the improved querying speed and reduced storage footprint with the new sorting feature (up to 20%, b…

---

## [How do i get AWS cloudwatch metrics to elastic for serverless](https://discuss.elastic.co/t/how-do-i-get-aws-cloudwatch-metrics-to-elastic-for-serverless/372669)

<div class="topic-metadata">

**Author:** [@rpeynado1](https://discuss.elastic.co/u/rpeynado1)\
**Replies:** 9\
**Last updated:** [January 8, 2025, 5:26pm UTC](https://discuss.elastic.co/t/how-do-i-get-aws-cloudwatch-metrics-to-elastic-for-serverless/372669 "2025-01-08T17:26:51Z")

</div>

Hello, I am trying to push cloudwatch metrics via sqs to elastic. How do i go about doing this? these are for multiple servers and serverless applications

---

## [Logstash's Elasticsearch filter plugin bottleneck](https://discuss.elastic.co/t/logstashs-elasticsearch-filter-plugin-bottleneck/372666)

<div class="topic-metadata">

**Author:** [@lethargicsnailspider](https://discuss.elastic.co/u/lethargicsnailspider)\
**Replies:** 11\
**Last updated:** [January 8, 2025, 4:34pm UTC](https://discuss.elastic.co/t/logstashs-elasticsearch-filter-plugin-bottleneck/372666 "2025-01-08T16:34:29Z")

</div>

I have a Logstash pipeline set up with multiple Elasticsearch filter plugins to do a lookup of field values ingested via an input filter. Processing and writing the events into Elasticsearch is around 500,000 events per …

---

## [Kibana snapshot restore status not accurate](https://discuss.elastic.co/t/kibana-snapshot-restore-status-not-accurate/372946)

<div class="topic-metadata">

**Author:** [@Dave\_Houser](https://discuss.elastic.co/u/Dave_Houser)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 4:23pm UTC](https://discuss.elastic.co/t/kibana-snapshot-restore-status-not-accurate/372946 "2025-01-08T16:23:07Z")

</div>

Running 8.13. Kibana's Restore Status for a snapshot shows all indexes are complete. But this is not true. If I look at the cluster health it's still yellow, and shards are still being restored. If I refresh cluster hea…

---

## [Heap Allocation Failures on 8.17](https://discuss.elastic.co/t/heap-allocation-failures-on-8-17/372211)

<div class="topic-metadata">

**Author:** [@Evesy](https://discuss.elastic.co/u/Evesy)\
**Replies:** 9\
**Last updated:** [January 8, 2025, 3:20pm UTC](https://discuss.elastic.co/t/heap-allocation-failures-on-8-17/372211 "2025-01-08T15:20:15Z")

</div>

We've had 2 different 8.x clusters running for a number of years without issue however since upgrading to 8.17 (from 8.15.1) a couple of days ago we are seeing frequent heap allocation failures such as below: # # There …

---

## [Parsing 'alerts.all.data'](https://discuss.elastic.co/t/parsing-alerts-all-data/372942)

<div class="topic-metadata">

**Author:** [@Cristina\_Marletta\_Li](https://discuss.elastic.co/u/Cristina_Marletta_Li)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 3:15pm UTC](https://discuss.elastic.co/t/parsing-alerts-all-data/372942 "2025-01-08T15:15:37Z")

</div>

Hi, How to parse (for example via Json Path) the alerts.all.data field to compose the body of the email sent via Action of an alert rule?

---

## [Elastic SIEM - Hardware specs](https://discuss.elastic.co/t/elastic-siem-hardware-specs/372481)

<div class="topic-metadata">

**Author:** [@stephanenm](https://discuss.elastic.co/u/stephanenm)\
**Replies:** 3\
**Last updated:** [January 8, 2025, 2:52pm UTC](https://discuss.elastic.co/t/elastic-siem-hardware-specs/372481 "2025-01-08T14:52:44Z")

</div>

Hello all, I am trying to find some specs stuff to improve a build on a Elastick SIEM full on prem (I know it's time for the cloud computing but I need to make this on premise ^^) So I am trying to find some documentat…

---

## [What is .ent-search-\*-logs-\*,-.ent-search-\*? where is it from?](https://discuss.elastic.co/t/what-is-ent-search-logs-ent-search-where-is-it-from/372873)

<div class="topic-metadata">

**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\
**Replies:** 7\
**Last updated:** [January 8, 2025, 2:43pm UTC](https://discuss.elastic.co/t/what-is-ent-search-logs-ent-search-where-is-it-from/372873 "2025-01-08T14:43:52Z")

</div>

Hi everyone, In everyone of our Elasticsearch instances in Azure, there is a persistent setting entry like below: "action.auto\_create\_index": ".ent-search-\*-logs-\*,-.ent-search-\*,+\*" But nobody remembers/knows who a…

---

## [Recommended field types for writing detections on with lucene](https://discuss.elastic.co/t/recommended-field-types-for-writing-detections-on-with-lucene/372174)

<div class="topic-metadata">

**Author:** [@gbL2k](https://discuss.elastic.co/u/gbL2k)\
**Replies:** 1\
**Last updated:** [January 8, 2025, 2:39pm UTC](https://discuss.elastic.co/t/recommended-field-types-for-writing-detections-on-with-lucene/372174 "2025-01-08T14:39:29Z")

</div>

Hey! What are the recommended types of fields to write detections on with lucene? I want my queries to be case insensitive but still perform exact matching and wildcarding. Searching on text fields with wildcards prod…

---

## [Heap filled up after upgrade to 8.17](https://discuss.elastic.co/t/heap-filled-up-after-upgrade-to-8-17/372932)

<div class="topic-metadata">

**Author:** [@cmoi](https://discuss.elastic.co/u/cmoi)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 10:56am UTC](https://discuss.elastic.co/t/heap-filled-up-after-upgrade-to-8-17/372932 "2025-01-08T10:56:43Z")

</div>

Hi, I have upgraded my cluster from 8.11 to 8.17 and since it keeps crashing due to full heap used. I have upped the heap memory but it did not solve the issue. After some time with heap memory use steady, it starts gro…

---

## [ESQL - fieldnames with slash('/') not supported just removed in kibana](https://discuss.elastic.co/t/esql-fieldnames-with-slash-not-supported-just-removed-in-kibana/372935)

<div class="topic-metadata">

**Author:** [@mortenb123](https://discuss.elastic.co/u/mortenb123)\
**Replies:** 1\
**Last updated:** [January 8, 2025, 1:53pm UTC](https://discuss.elastic.co/t/esql-fieldnames-with-slash-not-supported-just-removed-in-kibana/372935 "2025-01-08T13:53:04Z")

</div>

I have the following fieldnames in index (verified in kibana): python .\\bin\\elkq2.py --getmapping --index='bps-trace-ttl\_7d-8.16.1-rancher2-2025.01.08' fields: @timestamp,@versi…

---

## [Elasticsearch: create a new field based on the value of other fields in a time range](https://discuss.elastic.co/t/elasticsearch-create-a-new-field-based-on-the-value-of-other-fields-in-a-time-range/372929)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 10:13am UTC](https://discuss.elastic.co/t/elasticsearch-create-a-new-field-based-on-the-value-of-other-fields-in-a-time-range/372929 "2025-01-08T10:13:17Z")

</div>

Hi all, I have some data in different timestamps as below image, imaging that the fields are "src label", "src value" "dst label" , "dst value" and timestamp. how can I define a new fields named as "In" based on th…

---

## [Incomplete Data Indexing from Logstash to Elasticsearch: Missing Rows](https://discuss.elastic.co/t/incomplete-data-indexing-from-logstash-to-elasticsearch-missing-rows/372901)

<div class="topic-metadata">

**Author:** [@Zikou](https://discuss.elastic.co/u/Zikou)\
**Replies:** 4\
**Last updated:** [January 8, 2025, 9:38am UTC](https://discuss.elastic.co/t/incomplete-data-indexing-from-logstash-to-elasticsearch-missing-rows/372901 "2025-01-08T09:38:02Z")

</div>

I’m experiencing an issue with incomplete data being indexed from Logstash into Elasticsearch. Despite my SQL query returning 453,237 rows from the database, only 99,000 documents are indexed in Elasticsearch. I’m trying…

---

## [F5 Integration for Telemetry Streaming not working](https://discuss.elastic.co/t/f5-integration-for-telemetry-streaming-not-working/372923)

<div class="topic-metadata">

**Author:** [@Kueppi77](https://discuss.elastic.co/u/Kueppi77)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 9:03am UTC](https://discuss.elastic.co/t/f5-integration-for-telemetry-streaming-not-working/372923 "2025-01-08T09:03:20Z")

</div>

I am using the ELK Stack in Version 8.16.1. On the host I have a configured Elastic Agent 8.16.1 managed by Fleet with an integration for F5 logs to act as an HTTP Endpoint. On the F5 side I have configured everything c…

---

## [Async search performance on coplex aggregations](https://discuss.elastic.co/t/async-search-performance-on-coplex-aggregations/372922)

<div class="topic-metadata">

**Author:** [@Mahdi\_Moazami](https://discuss.elastic.co/u/Mahdi_Moazami)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 8:53am UTC](https://discuss.elastic.co/t/async-search-performance-on-coplex-aggregations/372922 "2025-01-08T08:53:58Z")

</div>

Hello Elastic team, I recently got challenges on a complex aggregation search that when this aggregation is run sequentially by a python script, after some time goes on, it starts receiving circuit breaker errors on sea…

---

## [Threat Intel Without Elastic Agent](https://discuss.elastic.co/t/threat-intel-without-elastic-agent/372834)

<div class="topic-metadata">

**Author:** [@aadityar](https://discuss.elastic.co/u/aadityar)\
**Replies:** 5\
**Last updated:** [January 8, 2025, 8:38am UTC](https://discuss.elastic.co/t/threat-intel-without-elastic-agent/372834 "2025-01-08T08:38:01Z")

</div>

Hi! I'm trying to use Elastic's Threat Intelligence modules without having to use any kind of agents. My elastic server is receiving parsed logs from logstash into specific indices. These indices have the fields 'ip' a…

---

## [ILM with rollovers breaking data integrity](https://discuss.elastic.co/t/ilm-with-rollovers-breaking-data-integrity/369426)

<div class="topic-metadata">

**Author:** [@Kruttika](https://discuss.elastic.co/u/Kruttika)\
**Replies:** 16\
**Last updated:** [January 8, 2025, 8:28am UTC](https://discuss.elastic.co/t/ilm-with-rollovers-breaking-data-integrity/369426 "2025-01-08T08:28:35Z")

</div>

Hello, We have an index where we need to continuously write new docs, run full-text searches and update the matched docs with a flag. The data consists of social media posts and news articles with timestamps. We previo…

---

## [What does slash stand for in a index request?](https://discuss.elastic.co/t/what-does-slash-stand-for-in-a-index-request/372914)

<div class="topic-metadata">

**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\
**Replies:** 2\
**Last updated:** [January 8, 2025, 8:02am UTC](https://discuss.elastic.co/t/what-does-slash-stand-for-in-a-index-request/372914 "2025-01-08T08:02:21Z")

</div>

Maybe a stupid question, I ask because I feel like there could be some concept about ES index that I'm not aware of (and maybe many others don't know either.). So it's worth to ask this question because it can be helpful…

---

## [Is it possible to set task\_id?](https://discuss.elastic.co/t/is-it-possible-to-set-task-id/372919)

<div class="topic-metadata">

**Author:** [@asafalroy](https://discuss.elastic.co/u/asafalroy)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 7:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-set-task-id/372919 "2025-01-08T07:06:20Z")

</div>

Hey! Our team heavily relies on traces and I wondered if there was a way to set the task\_id of the elastic query to be the traceId from the services that made the request for troubleshooting purposes (long running tasks…

---

## [Proxy Configuration for API Monitoring in Heartbeat](https://discuss.elastic.co/t/proxy-configuration-for-api-monitoring-in-heartbeat/372916)

<div class="topic-metadata">

**Author:** [@vikascateina](https://discuss.elastic.co/u/vikascateina)\
**Replies:** 0\
**Last updated:** [January 8, 2025, 6:26am UTC](https://discuss.elastic.co/t/proxy-configuration-for-api-monitoring-in-heartbeat/372916 "2025-01-08T06:26:01Z")

</div>

Hi , I have configured the following settings to monitor APIs through a proxy in Heartbeat to check whether the APIs are up or down. I tested both proxy\_url and HTTP\_PROXY, but neither of them seems to be working as exp…

[Previous page](https://discuss.elastic.co/latest.md?page=164)

[Next page](https://discuss.elastic.co/latest.md?page=166)
