# Latest

**URL:** https://discuss.elastic.co/latest.md?page=85

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 86

---

## [Cannot use Metricbeat Prometheus module to scrape Blackbox Exporter](https://discuss.elastic.co/t/cannot-use-metricbeat-prometheus-module-to-scrape-blackbox-exporter/379862)

<div class="topic-metadata">

**Author:** [@Amit\_Yaari](https://discuss.elastic.co/u/Amit_Yaari)\
**Replies:** 0\
**Last updated:** [July 7, 2025, 10:36am UTC](https://discuss.elastic.co/t/cannot-use-metricbeat-prometheus-module-to-scrape-blackbox-exporter/379862 "2025-07-07T10:36:02Z")

</div>

I am trying to use Metricbeat’s Prometheus module to collect results from the Blackbox Exporter (prom/blackbox-exporter), which probes services using the /probe endpoint. I want to probe internal service health endpoint…

---

## [How to read S3 bucket using filebeat and parse in logstash](https://discuss.elastic.co/t/how-to-read-s3-bucket-using-filebeat-and-parse-in-logstash/379557)

<div class="topic-metadata">

**Author:** [@vijay117](https://discuss.elastic.co/u/vijay117)\
**Replies:** 4\
**Last updated:** [July 7, 2025, 9:44am UTC](https://discuss.elastic.co/t/how-to-read-s3-bucket-using-filebeat-and-parse-in-logstash/379557 "2025-07-07T09:44:54Z")

</div>

Can some one explain how to read the contents of S3 bucket and store in Elasticsearch via logstash

---

## [After upgrading from ES 7, it is easy for a node to be unable to join the cluster for a long time after leaving. Restart the problem node and join it immediately](https://discuss.elastic.co/t/after-upgrading-from-es-7-it-is-easy-for-a-node-to-be-unable-to-join-the-cluster-for-a-long-time-after-leaving-restart-the-problem-node-and-join-it-immediately/373546)

<div class="topic-metadata">

**Author:** [@zcola](https://discuss.elastic.co/u/zcola)\
**Replies:** 14\
**Last updated:** [July 7, 2025, 7:52am UTC](https://discuss.elastic.co/t/after-upgrading-from-es-7-it-is-easy-for-a-node-to-be-unable-to-join-the-cluster-for-a-long-time-after-leaving-restart-the-problem-node-and-join-it-immediately/373546 "2025-07-07T07:52:47Z")

</div>

Versions 8.8.2 or 8.13.2 have this problem. The cluster data size is usually 300-700 tb. The log will be stuck in waiting for local cluster applier for more than ten minutes or one or two minutes. When you restart the p…

---

## [Is data stream backing indices are explicitly created or auto created?](https://discuss.elastic.co/t/is-data-stream-backing-indices-are-explicitly-created-or-auto-created/373490)

<div class="topic-metadata">

**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\
**Replies:** 3\
**Last updated:** [July 7, 2025, 6:25am UTC](https://discuss.elastic.co/t/is-data-stream-backing-indices-are-explicitly-created-or-auto-created/373490 "2025-07-07T06:25:10Z")

</div>

Hi everyone, For example, elastic-cloud-logs-8 is a data stream and its underlying indices are like this .ds-elastic-cloud-logs-8-2025.01.22-016804. So question is: is data stream backing indices are explicitly created…

---

## [Enormous CPU usage spike on Hosts](https://discuss.elastic.co/t/enormous-cpu-usage-spike-on-hosts/379809)

<div class="topic-metadata">

**Author:** [@mertse](https://discuss.elastic.co/u/mertse)\
**Replies:** 2\
**Last updated:** [July 7, 2025, 6:18am UTC](https://discuss.elastic.co/t/enormous-cpu-usage-spike-on-hosts/379809 "2025-07-07T06:18:46Z")

</div>

Hello, we are finalizing our systems now and we're going to start the test license in August. Today after doing some more configurations inside Kibana, I've discovered the Host overview and Metrics overview which didn't…

---

## [Elasticsearch cluster keeps going yellow even with balanced nodes](https://discuss.elastic.co/t/elasticsearch-cluster-keeps-going-yellow-even-with-balanced-nodes/379845)

<div class="topic-metadata">

**Author:** [@Rovmenpaul](https://discuss.elastic.co/u/Rovmenpaul)\
**Replies:** 1\
**Last updated:** [July 7, 2025, 5:37am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-keeps-going-yellow-even-with-balanced-nodes/379845 "2025-07-07T05:37:55Z")

</div>

Hi Everyone, I'm running a small Elasticsearch cluster with three data nodes and one master. Everything was stable for a while, but lately the cluster keeps switching to yellow status randomly throughout the day. When I…

---

## [New logstash installation is not working](https://discuss.elastic.co/t/new-logstash-installation-is-not-working/379824)

<div class="topic-metadata">

**Author:** [@Luis\_Moy](https://discuss.elastic.co/u/Luis_Moy)\
**Replies:** 11\
**Last updated:** [July 6, 2025, 7:29pm UTC](https://discuss.elastic.co/t/new-logstash-installation-is-not-working/379824 "2025-07-06T19:29:50Z")

</div>

Hello I want to install logstash in red hat linux 9. according with this documentation, because i need this specific version. I followed the instructions. downloaded from the github the version, and using jdk 11 from…

---

## [Assistance with Re-taking Lesson](https://discuss.elastic.co/t/assistance-with-re-taking-lesson/379835)

<div class="topic-metadata">

**Author:** [@Dr\_Isaac\_Mewton](https://discuss.elastic.co/u/Dr_Isaac_Mewton)\
**Replies:** 0\
**Last updated:** [July 6, 2025, 6:30pm UTC](https://discuss.elastic.co/t/assistance-with-re-taking-lesson/379835 "2025-07-06T18:30:31Z")

</div>

Course: Elastic Security for SIEM Version: Module 1 Question: I want to re-visit some earlier videos in Module 1. But when I attempt to retake the lesson, I am met with the last page of the Module discussing the CTFd a…

---

## [Elasticsearch index is deleted from application but not removed from disk](https://discuss.elastic.co/t/elasticsearch-index-is-deleted-from-application-but-not-removed-from-disk/379591)

<div class="topic-metadata">

**Author:** [@kuldeep\_gupta](https://discuss.elastic.co/u/kuldeep_gupta)\
**Replies:** 8\
**Last updated:** [July 6, 2025, 5:51pm UTC](https://discuss.elastic.co/t/elasticsearch-index-is-deleted-from-application-but-not-removed-from-disk/379591 "2025-07-06T17:51:05Z")

</div>

I am using elasticsearch version 8.12.0 i deleted some indices from my cluster, but when i checked node stats from stack monitoring tab from kibana what is found Free disk is 1TB and Data is 2.2TB but total disk size is …

---

## [Filebeat's journald input with paths for Podman Logs](https://discuss.elastic.co/t/filebeats-journald-input-with-paths-for-podman-logs/379831)

<div class="topic-metadata">

**Author:** [@alexandrosprey](https://discuss.elastic.co/u/alexandrosprey)\
**Replies:** 0\
**Last updated:** [July 6, 2025, 1:10pm UTC](https://discuss.elastic.co/t/filebeats-journald-input-with-paths-for-podman-logs/379831 "2025-07-06T13:10:58Z")

</div>

I'm trying to spin up log collection on Linux Fedora 42 in docker compose (via podman). Podman doesn't write logs to files, so I chose journalctl filebeat.inputs: - type: journald id: "podman-logs" # explicit…

---

## [Dashboard ES|QL Visualization configuration resets with every query change](https://discuss.elastic.co/t/dashboard-es-ql-visualization-configuration-resets-with-every-query-change/379813)

<div class="topic-metadata">

**Author:** [@allatrue](https://discuss.elastic.co/u/allatrue)\
**Replies:** 2\
**Last updated:** [July 5, 2025, 6:19pm UTC](https://discuss.elastic.co/t/dashboard-es-ql-visualization-configuration-resets-with-every-query-change/379813 "2025-07-05T18:19:11Z")

</div>

Hello everyone, I'm wondering if this is a normal behavior. When I make any change at ES|QL visualization query in a dashboard and click "Run query", the editor resets the visualization configuration, so that I have to …

---

## [Failed to determine the health of the cluster](https://discuss.elastic.co/t/failed-to-determine-the-health-of-the-cluster/379645)

<div class="topic-metadata">

**Author:** [@HarimbolaSantatra](https://discuss.elastic.co/u/HarimbolaSantatra)\
**Replies:** 3\
**Last updated:** [July 5, 2025, 9:02am UTC](https://discuss.elastic.co/t/failed-to-determine-the-health-of-the-cluster/379645 "2025-07-05T09:02:11Z")

</div>

When I run ./elasticsearch-reset-password -i -u elastic --url https://192.168.3.1:9200, it yields: ERROR: Failed to determine the health of the cluster., with exit code 69 But when I remove the --url flag, I get: ERRO…

---

## [Assistance Required to Start Lab in Elastic Security for SIEM (On-Demand)](https://discuss.elastic.co/t/assistance-required-to-start-lab-in-elastic-security-for-siem-on-demand/379578)

<div class="topic-metadata">

**Author:** [@Pabloj](https://discuss.elastic.co/u/Pabloj)\
**Replies:** 3\
**Last updated:** [July 5, 2025, 2:18am UTC](https://discuss.elastic.co/t/assistance-required-to-start-lab-in-elastic-security-for-siem-on-demand/379578 "2025-07-05T02:18:04Z")

</div>

Dear team, I need assistance with starting the lab, as the Challenges section does not display the questions. Instead, it states that the instructor will provide the unlock code. However, I am taking the Elastic Secu…

---

## [Replica shards of newly created indices remain UNASSIGNED](https://discuss.elastic.co/t/replica-shards-of-newly-created-indices-remain-unassigned/379459)

<div class="topic-metadata">

**Author:** [@onel](https://discuss.elastic.co/u/onel)\
**Replies:** 12\
**Last updated:** [July 4, 2025, 7:44pm UTC](https://discuss.elastic.co/t/replica-shards-of-newly-created-indices-remain-unassigned/379459 "2025-07-04T19:44:16Z")

</div>

hello We haven’t experienced this issue before, but recently we noticed that the primary shards of rollover-created indices are allocated normally, while the replica shards always remain in an UNASSIGNED state. We creat…

---

## [The cluster never changes the assigned master node](https://discuss.elastic.co/t/the-cluster-never-changes-the-assigned-master-node/379777)

<div class="topic-metadata">

**Author:** [@Emiliano\_Baum](https://discuss.elastic.co/u/Emiliano_Baum)\
**Replies:** 12\
**Last updated:** [July 4, 2025, 6:30pm UTC](https://discuss.elastic.co/t/the-cluster-never-changes-the-assigned-master-node/379777 "2025-07-04T18:30:39Z")

</div>

The cluster never changes the assigned master node Elasticsearch version 6.8. I have a cluster with 6 data nodes, 3 ingest nodes, and 5 masters (masters only). Over the last few days, the master nodes have been cascadi…

---

## [Encountering an authentication error following the restoration of an Elasticsearch cluster from a Longhorn volume backup](https://discuss.elastic.co/t/encountering-an-authentication-error-following-the-restoration-of-an-elasticsearch-cluster-from-a-longhorn-volume-backup/378047)

<div class="topic-metadata">

**Author:** [@Anand\_Pradeep](https://discuss.elastic.co/u/Anand_Pradeep)\
**Replies:** 1\
**Last updated:** [July 4, 2025, 3:32pm UTC](https://discuss.elastic.co/t/encountering-an-authentication-error-following-the-restoration-of-an-elasticsearch-cluster-from-a-longhorn-volume-backup/378047 "2025-07-04T15:32:34Z")

</div>

Elastic seach is deployed on k8s env using elastic-operator. While trying to restore the old data using longhorn volume restoration method the pods came up and running, however there is an authentication error in the pod…

---

## [Do I need to mount \`elasticsearch-data\` volumeClaimTemplates?](https://discuss.elastic.co/t/do-i-need-to-mount-elasticsearch-data-volumeclaimtemplates/376296)

<div class="topic-metadata">

**Author:** [@khteh](https://discuss.elastic.co/u/khteh)\
**Replies:** 1\
**Last updated:** [July 4, 2025, 3:28pm UTC](https://discuss.elastic.co/t/do-i-need-to-mount-elasticsearch-data-volumeclaimtemplates/376296 "2025-07-04T15:28:33Z")

</div>

According to Volume claim templates | Elastic Cloud on Kubernetes \[2.16\] | Elastic I have declared the volumeClaimTemplates: volumeClaimTemplates: - metadata: name: elasticsearch-data …

---

## [Can't add integrations to fleet agent policies](https://discuss.elastic.co/t/cant-add-integrations-to-fleet-agent-policies/379750)

<div class="topic-metadata">

**Author:** [@pierro78](https://discuss.elastic.co/u/pierro78)\
**Replies:** 3\
**Last updated:** [July 4, 2025, 3:15pm UTC](https://discuss.elastic.co/t/cant-add-integrations-to-fleet-agent-policies/379750 "2025-07-04T15:15:24Z")

</div>

Hey there Did an airgapped installation of Elastic Package Registry Created a new docker instance of kibana with xpack.fleet.registryUrl set to my EPR url (already installed fleet server from a docker-compose instance …

---

## [How to Handle Selective Masking and Reversible Encryption for PII in Elasticsearch Ingestion](https://discuss.elastic.co/t/how-to-handle-selective-masking-and-reversible-encryption-for-pii-in-elasticsearch-ingestion/379807)

<div class="topic-metadata">

**Author:** [@Souvik\_Das](https://discuss.elastic.co/u/Souvik_Das)\
**Replies:** 1\
**Last updated:** [July 4, 2025, 2:18pm UTC](https://discuss.elastic.co/t/how-to-handle-selective-masking-and-reversible-encryption-for-pii-in-elasticsearch-ingestion/379807 "2025-07-04T14:18:47Z")

</div>

Hi Folks, I’m working on a use case where we ingest API response payloads into the Elastic Stack (Logstash → Elasticsearch). The payload contains JSON data with a mix of important application-level information (like res…

---

## [Share your feedback & help improve the Elastic Documentation!](https://discuss.elastic.co/t/share-your-feedback-help-improve-the-elastic-documentation/379812)

<div class="topic-metadata">

**Author:** [@Elizabeth\_ML](https://discuss.elastic.co/u/Elizabeth_ML)\
**Replies:** 0\
**Last updated:** [July 4, 2025, 1:17pm UTC](https://discuss.elastic.co/t/share-your-feedback-help-improve-the-elastic-documentation/379812 "2025-07-04T13:17:35Z")

</div>

Hi folks! I'm Elizabeth, a User Experience (UX) Researcher at Elastic. We're looking for users that frequently use or recently have used the Elastic Documentation to share their experience with us -- we want your unfil…

---

## [Environment Variable as Custom Field - Fleet Policy](https://discuss.elastic.co/t/environment-variable-as-custom-field-fleet-policy/379568)

<div class="topic-metadata">

**Author:** [@karnamonkster](https://discuss.elastic.co/u/karnamonkster)\
**Replies:** 7\
**Last updated:** [July 4, 2025, 1:17pm UTC](https://discuss.elastic.co/t/environment-variable-as-custom-field-fleet-policy/379568 "2025-07-04T13:17:56Z")

</div>

Hi, We are trying to fetch an environment variable to be added as a field for every log message coming in from the server where elastic agent is deployed. Similar to this issue link The Elastic agent deployments are fl…

---

## [ELSER v2 model (version 12.0.0) inference fail for elasticsearch 9.0.3](https://discuss.elastic.co/t/elser-v2-model-version-12-0-0-inference-fail-for-elasticsearch-9-0-3/379776)

<div class="topic-metadata">

**Author:** [@chenlizhao](https://discuss.elastic.co/u/chenlizhao)\
**Replies:** 2\
**Last updated:** [July 4, 2025, 8:41am UTC](https://discuss.elastic.co/t/elser-v2-model-version-12-0-0-inference-fail-for-elasticsearch-9-0-3/379776 "2025-07-04T08:41:53Z")

</div>

I installed elasticsearch 9.0.3 with docker compose file, running on centos7, x86\_64 platform, when I call inference api with: POST \_inference/.elser-2-elasticsearch { "input": "What is Elastic?" } the elasticsearch …

---

## [Add field to filebeat Panos module](https://discuss.elastic.co/t/add-field-to-filebeat-panos-module/379803)

<div class="topic-metadata">

**Author:** [@Lero](https://discuss.elastic.co/u/Lero)\
**Replies:** 0\
**Last updated:** [July 4, 2025, 8:23am UTC](https://discuss.elastic.co/t/add-field-to-filebeat-panos-module/379803 "2025-07-04T08:23:40Z")

</div>

Hi, Using the Panos module for filebeat: the field "threat category" (eg dns-proxy) isn't currently parsed into a dedicated field but is dropped and part of the event.original field. This could be a valuable field for …

---

## [Out of Memory at Beats Input](https://discuss.elastic.co/t/out-of-memory-at-beats-input/376135)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 4\
**Last updated:** [July 4, 2025, 7:54am UTC](https://discuss.elastic.co/t/out-of-memory-at-beats-input/376135 "2025-07-04T07:54:49Z")

</div>

Hi, From time to time we get this error with our logstashes: 2025-03-19T16:13:36,640\]\[INFO \]\[org.logstash.beats.BeatsHandler\]\[beats-input\] \[local: 192.168.16.76:6044, remote: 192.168.15.127:52442\] Handling exception:ja…

---

## [Starting Point to Tune Logstash](https://discuss.elastic.co/t/starting-point-to-tune-logstash/379301)

<div class="topic-metadata">

**Author:** [@yuswanul](https://discuss.elastic.co/u/yuswanul)\
**Replies:** 9\
**Last updated:** [July 4, 2025, 7:10am UTC](https://discuss.elastic.co/t/starting-point-to-tune-logstash/379301 "2025-07-04T07:10:25Z")

</div>

Hi there i have a dedicated logstash machine with 16 cores and 32 Gb RAM and multiple pipelines inside it. There are 3 heavy pipelines(complex filters and high event rate). what is a good starting point to make a globa…

---

## [How to create a webhook](https://discuss.elastic.co/t/how-to-create-a-webhook/379698)

<div class="topic-metadata">

**Author:** [@KaWa](https://discuss.elastic.co/u/KaWa)\
**Replies:** 3\
**Last updated:** [July 4, 2025, 7:08am UTC](https://discuss.elastic.co/t/how-to-create-a-webhook/379698 "2025-07-04T07:08:08Z")

</div>

Dear community, TL;DR: goal: create tickets for SIEM alarms in ticket system path: use webhook with token (generated by ticket system) problem: how to setup a connector I'd like to create a ticket for every SIEM al…

---

## [Logstash stops inputs after update](https://discuss.elastic.co/t/logstash-stops-inputs-after-update/379757)

<div class="topic-metadata">

**Author:** [@Ljapunov](https://discuss.elastic.co/u/Ljapunov)\
**Replies:** 3\
**Last updated:** [July 4, 2025, 7:03am UTC](https://discuss.elastic.co/t/logstash-stops-inputs-after-update/379757 "2025-07-04T07:03:08Z")

</div>

We currently try to update our logstash servers from 8.2.0 to 8.18.x (and later 9.x). In Version 8.18.x we face an issue with logstash. I tried to find the exact version which is failing and found that with 8.11.4 every…

---

## [ECK 8.17.3 can't set replication factor on system indices](https://discuss.elastic.co/t/eck-8-17-3-cant-set-replication-factor-on-system-indices/379697)

<div class="topic-metadata">

**Author:** [@DanielR1](https://discuss.elastic.co/u/DanielR1)\
**Replies:** 1\
**Last updated:** [July 4, 2025, 6:52am UTC](https://discuss.elastic.co/t/eck-8-17-3-cant-set-replication-factor-on-system-indices/379697 "2025-07-04T06:52:44Z")

</div>

Hello! I have deployed a cluster v 8.17.3 using the eck operator, I see all the indices have a replication factor of 0 by default. I have tried to change that using the PUT /.internal.alerts-default.alerts-default-0000…

---

## [Alerting when data stops coming in from variety of sources](https://discuss.elastic.co/t/alerting-when-data-stops-coming-in-from-variety-of-sources/379787)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 2\
**Last updated:** [July 3, 2025, 9:42pm UTC](https://discuss.elastic.co/t/alerting-when-data-stops-coming-in-from-variety-of-sources/379787 "2025-07-03T21:42:46Z")

</div>

Hello, For a specific use case/dashboard, not all data comes from the same data source. I have a use case where there are at least 4 different data sources. The data can come from logs-\* where it must be filtered by fie…

---

## [Kibana server is not ready yet status](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-status/379685)

<div class="topic-metadata">

**Author:** [@rootkai94](https://discuss.elastic.co/u/rootkai94)\
**Replies:** 8\
**Last updated:** [July 3, 2025, 7:32pm UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-status/379685 "2025-07-03T19:32:02Z")

</div>

Hello, I recently enrolled into the Elastic Security SIEM on-demand course and i started the course successfully. But while i reached module 3, i am unable to access Kibana dashboard from Strigo VM's. I keep getting the…

[Previous page](https://discuss.elastic.co/latest.md?page=84)

[Next page](https://discuss.elastic.co/latest.md?page=86)
