# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=187

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 188

---

## [Oracle JDK vulnerability updates](https://discuss.elastic.co/t/oracle-jdk-vulnerability-updates/364846)

<div class="topic-metadata">

**Author:** [@kamalhus123](https://discuss.elastic.co/u/kamalhus123)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 5:30pm UTC](https://discuss.elastic.co/t/oracle-jdk-vulnerability-updates/364846 "2024-08-13T17:30:42Z")

</div>

We have an installed version of Elasticseach which is currently showing a vulnerability identified by Nessus scans identified back on July 2024. Specifically, these are the identified vulnerabilities: CVE-2024-21131,CVE…

---

## [Migrating from self monitoring to elastic agent monitoring](https://discuss.elastic.co/t/migrating-from-self-monitoring-to-elastic-agent-monitoring/364848)

<div class="topic-metadata">

**Author:** [@Abdarrahmane](https://discuss.elastic.co/u/Abdarrahmane)\
**Replies:** 0\
**Last updated:** [August 13, 2024, 4:42pm UTC](https://discuss.elastic.co/t/migrating-from-self-monitoring-to-elastic-agent-monitoring/364848 "2024-08-13T16:42:36Z")

</div>

hello dear community i'm monitoring my cluster using self monitoring but I want to move to monitor my cluster with elastic agent instead my configuration: in every elasticsearch nodes I have xpack.monitoring.collecti…

---

## [Bucket Selector with Top Hits aggregation](https://discuss.elastic.co/t/bucket-selector-with-top-hits-aggregation/364847)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [August 13, 2024, 4:24pm UTC](https://discuss.elastic.co/t/bucket-selector-with-top-hits-aggregation/364847 "2024-08-13T16:24:24Z")

</div>

Hello, I have this query that is aggregates with top hits to retrieve the last doc. I want to use the bucket selector to filter for buckets that match a source field, event.outcome: "failure". I am struggling with the…

---

## [Let's encrypt](https://discuss.elastic.co/t/lets-encrypt/364805)

<div class="topic-metadata">

**Author:** [@Honestabe](https://discuss.elastic.co/u/Honestabe)\
**Replies:** 2\
**Last updated:** [August 13, 2024, 4:13pm UTC](https://discuss.elastic.co/t/lets-encrypt/364805 "2024-08-13T16:13:31Z")

</div>

i have it working with kibana but cant seem to get it to work with my elastic cluster. I succesfuly mounted the share to my wildcard cert and I symlinked the privetkey.pem and fullchain .pem. i used xpack.security.http…

---

## [Password of the Encrypted Key for HTTP Output](https://discuss.elastic.co/t/password-of-the-encrypted-key-for-http-output/364836)

<div class="topic-metadata">

**Author:** [@tepus](https://discuss.elastic.co/u/tepus)\
**Replies:** 2\
**Last updated:** [August 13, 2024, 4:15pm UTC](https://discuss.elastic.co/t/password-of-the-encrypted-key-for-http-output/364836 "2024-08-13T16:15:49Z")

</div>

Dear Elastic Community, The version of the Logstash client is 8.5.3. We're trying to set a Logstash-to-Logstash connection with the following settings in the pipeline of the client: output { http { format =\> jso…

---

## [Question about FSCrawler releases and changelog](https://discuss.elastic.co/t/question-about-fscrawler-releases-and-changelog/364830)

<div class="topic-metadata">

**Author:** [@lengoyvaerts](https://discuss.elastic.co/u/lengoyvaerts)\
**Replies:** 3\
**Last updated:** [August 13, 2024, 2:14pm UTC](https://discuss.elastic.co/t/question-about-fscrawler-releases-and-changelog/364830 "2024-08-13T14:14:53Z")

</div>

First of all, thanks for providing the FSCrawler. Regarding releases and changelog, I was wondering if there is a plan to "officially" release 2.10, and maybe maintaining some kind of release schedule (with major, minor…

---

## [FSCrawler question about password protected Word documents](https://discuss.elastic.co/t/fscrawler-question-about-password-protected-word-documents/359590)

<div class="topic-metadata">

**Author:** [@lengoyvaerts](https://discuss.elastic.co/u/lengoyvaerts)\
**Replies:** 6\
**Last updated:** [August 13, 2024, 12:59pm UTC](https://discuss.elastic.co/t/fscrawler-question-about-password-protected-word-documents/359590 "2024-08-13T12:59:15Z")

</div>

I have a question about the fscrawler Is it possible to crawl password protected Word documents? I came upon this issue on the Github repository, but It doesn't provide much insight outside of a single unit test. I don'…

---

## [Filebeat on Kubernetes, with log rotations](https://discuss.elastic.co/t/filebeat-on-kubernetes-with-log-rotations/364389)

<div class="topic-metadata">

**Author:** [@Dudu\_Edri](https://discuss.elastic.co/u/Dudu_Edri)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 12:46pm UTC](https://discuss.elastic.co/t/filebeat-on-kubernetes-with-log-rotations/364389 "2024-08-13T12:46:30Z")

</div>

Hello everyone, I’m encountering issues with Filebeat in a Kubernetes environment where I don’t have control over the log rotation configuration. Here’s a summary of the setup and the challenges: Log Setup: Filebeat…

---

## [The elasticsearch cluster often turns red,marking and sending shard failed due to \[failed to create shard\]](https://discuss.elastic.co/t/the-elasticsearch-cluster-often-turns-red-marking-and-sending-shard-failed-due-to-failed-to-create-shard/364759)

<div class="topic-metadata">

**Author:** [@xiaxiantao](https://discuss.elastic.co/u/xiaxiantao)\
**Replies:** 9\
**Last updated:** [August 13, 2024, 10:34am UTC](https://discuss.elastic.co/t/the-elasticsearch-cluster-often-turns-red-marking-and-sending-shard-failed-due-to-failed-to-create-shard/364759 "2024-08-13T10:34:51Z")

</div>

continue with the previous issue on GitHub，I found that this problem mostly occurs on one index. An index often shows "failed to obtain in-memory shard lock", resulting in shard unassignment. Both primary and replica sha…

---

## [Elastic Agent cuts the number of logs in the output](https://discuss.elastic.co/t/elastic-agent-cuts-the-number-of-logs-in-the-output/364823)

<div class="topic-metadata">

**Author:** [@Patryk\_Ostrowski](https://discuss.elastic.co/u/Patryk_Ostrowski)\
**Replies:** 0\
**Last updated:** [August 13, 2024, 10:00am UTC](https://discuss.elastic.co/t/elastic-agent-cuts-the-number-of-logs-in-the-output/364823 "2024-08-13T10:00:41Z")

</div>

Hello, I have a problem with elastic agent, the problem also repeats when using filebeat. There are about 70k logs per second coming to the interface (each packet is a separate log for SRX). On the other hand, the agent…

---

## [ES query slows down in high concurrency](https://discuss.elastic.co/t/es-query-slows-down-in-high-concurrency/363267)

<div class="topic-metadata">

**Author:** [@gaorui](https://discuss.elastic.co/u/gaorui)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 8:31am UTC](https://discuss.elastic.co/t/es-query-slows-down-in-high-concurrency/363267 "2024-08-13T08:31:13Z")

</div>

We now have a large number of NetFlow records that need to be queried, with a data volume of 200,000 records/s. The query logic is to go to es to associate users based on time, aIp, start and end ports, and bIp. The spe…

---

## [O365 connectors within Teams will be deprecated and notifications from this service will stop](https://discuss.elastic.co/t/o365-connectors-within-teams-will-be-deprecated-and-notifications-from-this-service-will-stop/363240)

<div class="topic-metadata">

**Author:** [@Patr123](https://discuss.elastic.co/u/Patr123)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 8:43am UTC](https://discuss.elastic.co/t/o365-connectors-within-teams-will-be-deprecated-and-notifications-from-this-service-will-stop/363240 "2024-08-13T08:43:32Z")

</div>

Action Required: O365 connectors within Teams will be deprecated and notifications from this service will stop. Learn more about the timing and how the Workflows app provides a more flexible and secure experience. If you…

---

## [Spikes in Indexing Speed in Elasticsearch](https://discuss.elastic.co/t/spikes-in-indexing-speed-in-elasticsearch/364204)

<div class="topic-metadata">

**Author:** [@Priyansh\_Maheshwari](https://discuss.elastic.co/u/Priyansh_Maheshwari)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 8:18am UTC](https://discuss.elastic.co/t/spikes-in-indexing-speed-in-elasticsearch/364204 "2024-08-13T08:18:37Z")

</div>

Hi, for our application we are currently using a single node ES instance (planning to migrate to cluster in future). The average duration of pushing data from my Java based interface to ES server is around 10ms. However,…

---

## [Watcher execute OpenAPI definition](https://discuss.elastic.co/t/watcher-execute-openapi-definition/364228)

<div class="topic-metadata">

**Author:** [@Apolexian](https://discuss.elastic.co/u/Apolexian)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 8:13am UTC](https://discuss.elastic.co/t/watcher-execute-openapi-definition/364228 "2024-08-13T08:13:46Z")

</div>

Hi, I was wondering if there is an OpenAPI definition for the watcher execute (Execute watch API | Elasticsearch Guide \[8.14\] | Elastic) API? The only spec I have found is the following: Which does not have the watch…

---

## [Unable to use automatic slicing in reindex API](https://discuss.elastic.co/t/unable-to-use-automatic-slicing-in-reindex-api/364378)

<div class="topic-metadata">

**Author:** [@abhadauria](https://discuss.elastic.co/u/abhadauria)\
**Replies:** 2\
**Last updated:** [August 13, 2024, 8:12am UTC](https://discuss.elastic.co/t/unable-to-use-automatic-slicing-in-reindex-api/364378 "2024-08-13T08:12:00Z")

</div>

We are re-indexing data in ES cluster using \_reindex API ES version 7.17. We want to leverage automated slicing to finish the process sooner as we have really large index with doc count ~150 million. We were following …

---

## [How to enforce datatypes in an Index](https://discuss.elastic.co/t/how-to-enforce-datatypes-in-an-index/364579)

<div class="topic-metadata">

**Author:** [@werto165](https://discuss.elastic.co/u/werto165)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 8:09am UTC](https://discuss.elastic.co/t/how-to-enforce-datatypes-in-an-index/364579 "2024-08-13T08:09:09Z")

</div>

I have types that define my mappings, I am using the old client to create my mapping for the index. With this mapping I have set dynamic to "strict" which has allowed me to enforce that when passing an update for example…

---

## [Logstash Unable to Output Data to Elasticsearch](https://discuss.elastic.co/t/logstash-unable-to-output-data-to-elasticsearch/364758)

<div class="topic-metadata">

**Author:** [@tom\_ding](https://discuss.elastic.co/u/tom_ding)\
**Replies:** 2\
**Last updated:** [August 13, 2024, 8:04am UTC](https://discuss.elastic.co/t/logstash-unable-to-output-data-to-elasticsearch/364758 "2024-08-13T08:04:20Z")

</div>

I am using Elasticsearch 8.13.4, Logstash 8.13.4, and Filebeat 8.13.4. I followed the steps in the documentation here to get familiar with Logstash, but I am unable to sync data to Elasticsearch. I am encountering the fo…

---

## [Elasticsearch-7.4.2 getting stuck at having thousands of close\_wait connections with logstash-7.4.3](https://discuss.elastic.co/t/elasticsearch-7-4-2-getting-stuck-at-having-thousands-of-close-wait-connections-with-logstash-7-4-3/364766)

<div class="topic-metadata">

**Author:** [@anshulvika360](https://discuss.elastic.co/u/anshulvika360)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 7:36am UTC](https://discuss.elastic.co/t/elasticsearch-7-4-2-getting-stuck-at-having-thousands-of-close-wait-connections-with-logstash-7-4-3/364766 "2024-08-13T07:36:37Z")

</div>

We are running elasticsearch cluster with two nodes and sending logs from 7 different machines using logstash. Elasticsearch keeps working fine for one or two days until we start seeing close\_wait connections on master n…

---

## [Need help in integrating filebeat with Kibana](https://discuss.elastic.co/t/need-help-in-integrating-filebeat-with-kibana/364817)

<div class="topic-metadata">

**Author:** [@keerthi12](https://discuss.elastic.co/u/keerthi12)\
**Replies:** 0\
**Last updated:** [August 13, 2024, 7:18am UTC](https://discuss.elastic.co/t/need-help-in-integrating-filebeat-with-kibana/364817 "2024-08-13T07:18:25Z")

</div>

Hi Team, We had installed filebeat agent in our vm. Able to get the vm logs .Also did Elasticsearch configuration in filebeat yaml file but unable to view in Kibana dashboard. Kindly help. Thanks Keerthi

---

## [Filebeat: support for multiple identical fields in IPFIX/Netflow](https://discuss.elastic.co/t/filebeat-support-for-multiple-identical-fields-in-ipfix-netflow/364816)

<div class="topic-metadata">

**Author:** [@shanavas](https://discuss.elastic.co/u/shanavas)\
**Replies:** 0\
**Last updated:** [August 13, 2024, 6:55am UTC](https://discuss.elastic.co/t/filebeat-support-for-multiple-identical-fields-in-ipfix-netflow/364816 "2024-08-13T06:55:38Z")

</div>

Hello, I am using filebeat to collect Netflow/IPFIX stream. When IPFIX template specifies the same information element (IE) multiple times, filebeat yields only the last value. I am wondering if filebeat can handle it. …

---

## [Displays specifically which lines have been changed in the file](https://discuss.elastic.co/t/displays-specifically-which-lines-have-been-changed-in-the-file/364808)

<div class="topic-metadata">

**Author:** [@Erik\_Dito\_Tampubolon](https://discuss.elastic.co/u/Erik_Dito_Tampubolon)\
**Replies:** 6\
**Last updated:** [August 13, 2024, 3:26am UTC](https://discuss.elastic.co/t/displays-specifically-which-lines-have-been-changed-in-the-file/364808 "2024-08-13T03:26:07Z")

</div>

Does auditbeat (file integrity module) make it possible to display modified lines in a file? For example, when I change the content of a file, auditbeat can display at what line the content of the file has been changed. …

---

## [Memcached filter can't find host when using tls](https://discuss.elastic.co/t/memcached-filter-cant-find-host-when-using-tls/364803)

<div class="topic-metadata">

**Author:** [@JayAskrenPureStorage](https://discuss.elastic.co/u/JayAskrenPureStorage)\
**Replies:** 1\
**Last updated:** [August 13, 2024, 1:10am UTC](https://discuss.elastic.co/t/memcached-filter-cant-find-host-when-using-tls/364803 "2024-08-13T01:10:38Z")

</div>

How do we connect the memecached filter for logstash to AWS Elasticache with tls? We are using the memcached filter for logstash to augment our logs using AWS Elasticache and the filter looks something like this: m…

---

## [Duplicate data with filebeat and write it into two indices](https://discuss.elastic.co/t/duplicate-data-with-filebeat-and-write-it-into-two-indices/363692)

<div class="topic-metadata">

**Author:** [@Black-Shadow](https://discuss.elastic.co/u/Black-Shadow)\
**Replies:** 3\
**Last updated:** [August 12, 2024, 8:55pm UTC](https://discuss.elastic.co/t/duplicate-data-with-filebeat-and-write-it-into-two-indices/363692 "2024-08-12T20:55:52Z")

</div>

Hi, I'm new to the forum so please excuse me if this post is in the wrong section. I need some general help with Filebeat (beats in general). The main goal is to send data from Filebeat duplicated to Elasticsearch. W…

---

## [Filebeat resends all logs in log file after host reboot - registry not maintaining last file position](https://discuss.elastic.co/t/filebeat-resends-all-logs-in-log-file-after-host-reboot-registry-not-maintaining-last-file-position/364543)

<div class="topic-metadata">

**Author:** [@marmai16](https://discuss.elastic.co/u/marmai16)\
**Replies:** 2\
**Last updated:** [August 12, 2024, 8:34pm UTC](https://discuss.elastic.co/t/filebeat-resends-all-logs-in-log-file-after-host-reboot-registry-not-maintaining-last-file-position/364543 "2024-08-12T20:34:57Z")

</div>

Hello everyone, i've encountered a strange issue regarding the elastic-agent, filebeat respectively. I'am using a "Custom Logs" integration in Kibana, which is supposed to ship logs from a file on the host. This itsel…

---

## [Sending multiple logs to same ingestion VM with (elastic agent installed in it) and send them to elasticsearch cluster?](https://discuss.elastic.co/t/sending-multiple-logs-to-same-ingestion-vm-with-elastic-agent-installed-in-it-and-send-them-to-elasticsearch-cluster/364751)

<div class="topic-metadata">

**Author:** [@Abdarrahmane](https://discuss.elastic.co/u/Abdarrahmane)\
**Replies:** 2\
**Last updated:** [August 12, 2024, 7:19pm UTC](https://discuss.elastic.co/t/sending-multiple-logs-to-same-ingestion-vm-with-elastic-agent-installed-in-it-and-send-them-to-elasticsearch-cluster/364751 "2024-08-12T19:19:15Z")

</div>

hello everyone ! i need guidance please i want to use an ingestion vm 192.168.1.124 (ubuntu server with elastic agent installed in it and enrolled in fleet) to receive logs from a lot of servers and components in my i…

---

## [Support for Azure Managed Identity](https://discuss.elastic.co/t/support-for-azure-managed-identity/364787)

<div class="topic-metadata">

**Author:** [@piyushkp](https://discuss.elastic.co/u/piyushkp)\
**Replies:** 3\
**Last updated:** [August 12, 2024, 6:47pm UTC](https://discuss.elastic.co/t/support-for-azure-managed-identity/364787 "2024-08-12T18:47:37Z")

</div>

based on this PR, the support for Azure managed identity is added to the main branch and about to be release in 8.16.0. What is the release date for the 8.16.0 ? also can, you provide the clear instructions or the sampl…

---

## [Fields are not shown in KIbana](https://discuss.elastic.co/t/fields-are-not-shown-in-kibana/364634)

<div class="topic-metadata">

**Author:** [@peter170805](https://discuss.elastic.co/u/peter170805)\
**Replies:** 9\
**Last updated:** [August 12, 2024, 4:11pm UTC](https://discuss.elastic.co/t/fields-are-not-shown-in-kibana/364634 "2024-08-12T16:11:57Z")

</div>

Hello dear friends of the community. I wanted to know if you could give me some clues as to why I can't view the data loaded in Kibana in an index that I created. I created an index with the mapping to load all the data …

---

## [Fleet Server Private Certificates Error](https://discuss.elastic.co/t/fleet-server-private-certificates-error/363586)

<div class="topic-metadata">

**Author:** [@Nick5](https://discuss.elastic.co/u/Nick5)\
**Replies:** 7\
**Last updated:** [August 12, 2024, 2:45pm UTC](https://discuss.elastic.co/t/fleet-server-private-certificates-error/363586 "2024-08-12T14:45:03Z")

</div>

I have a 3 node Elasticsearch cluster with certificates configured like this: xpack.security.http.ssl: enabled: true key: certs/es1fqdn.key certificate: certs/es1fqdn.cer verification\_mode: certificate certifi…

---

## [How to change permissions for fleet-managed Elastic Agents? \[security\_exception\]](https://discuss.elastic.co/t/how-to-change-permissions-for-fleet-managed-elastic-agents-security-exception/363780)

<div class="topic-metadata">

**Author:** [@B\_Grimm](https://discuss.elastic.co/u/B_Grimm)\
**Replies:** 6\
**Last updated:** [August 12, 2024, 1:45pm UTC](https://discuss.elastic.co/t/how-to-change-permissions-for-fleet-managed-elastic-agents-security-exception/363780 "2024-08-12T13:45:51Z")

</div>

Hello, I am reaching out to you with an issue that has been concerning me for quite some time now. Overview I have enrolled a fleet-managed Elastic Agent on a machine and created an ingest pipeline in the Elastic Clu…

---

## [How to generate a sum of averages graph](https://discuss.elastic.co/t/how-to-generate-a-sum-of-averages-graph/364675)

<div class="topic-metadata">

**Author:** [@francieliton\_araujo](https://discuss.elastic.co/u/francieliton_araujo)\
**Replies:** 1\
**Last updated:** [August 12, 2024, 1:45pm UTC](https://discuss.elastic.co/t/how-to-generate-a-sum-of-averages-graph/364675 "2024-08-12T13:45:27Z")

</div>

Could someone help me? I don't even know where to start. I have the following data: location | quantity | A | 20 | B | 35 | C | 32 | B |…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=186)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=188)
