# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=154

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 155

---

## [Integrations doesn't get populated for agent policy under fleet server](https://discuss.elastic.co/t/integrations-doesnt-get-populated-for-agent-policy-under-fleet-server/365788)

<div class="topic-metadata">

**Author:** [@AnyThink\_A](https://discuss.elastic.co/u/AnyThink_A)\
**Replies:** 1\
**Last updated:** [October 14, 2024, 7:46am UTC](https://discuss.elastic.co/t/integrations-doesnt-get-populated-for-agent-policy-under-fleet-server/365788 "2024-10-14T07:46:38Z")

</div>

Hello All, I am trying create a fleet policy with integration, however, when click on integration it keeps loading and throws an error at the end. I check kibana logs and it shows below error {"service":{"node":{"role…

---

## [Logstash pipeline creation is behaving differently for different outputs](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351)

<div class="topic-metadata">

**Author:** [@sasikiranvaddi](https://discuss.elastic.co/u/sasikiranvaddi)\
**Replies:** 3\
**Last updated:** [October 14, 2024, 7:19am UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351 "2024-10-14T07:19:46Z")

</div>

We have two deployments where lumberjack is configured as output for one of the deployment and syslog is configured as output for another deployment. In both the deployments the outputs are down when Logstash is initiat…

---

## [Using Elastic Search With ElasticsearchClient](https://discuss.elastic.co/t/using-elastic-search-with-elasticsearchclient/368710)

<div class="topic-metadata">

**Author:** [@GANESHAN\_RAMAN](https://discuss.elastic.co/u/GANESHAN_RAMAN)\
**Replies:** 4\
**Last updated:** [October 14, 2024, 6:35am UTC](https://discuss.elastic.co/t/using-elastic-search-with-elasticsearchclient/368710 "2024-10-14T06:35:16Z")

</div>

Hi, Iam migrating from RestHighLevelClient to ElasticsearchClient and as part of this change i need to replace NativeSearchQuery and NativeSearchQueryBuilder with NativeQuery and NativeQueryBuilder But iam not able to p…

---

## [Increase document limit/sample size in Discover?](https://discuss.elastic.co/t/increase-document-limit-sample-size-in-discover/367268)

<div class="topic-metadata">

**Author:** [@juarrow](https://discuss.elastic.co/u/juarrow)\
**Replies:** 3\
**Last updated:** [October 14, 2024, 5:52am UTC](https://discuss.elastic.co/t/increase-document-limit-sample-size-in-discover/367268 "2024-10-14T05:52:32Z")

</div>

How do I overcome the "Document count is based on smaller..."-limitation in Kibana's Discover (without Dashboard)? It seems to have a hard limit on 5000 documents taken into account. (My date range is set to max; there…

---

## [Getting issue while starting kibana](https://discuss.elastic.co/t/getting-issue-while-starting-kibana/368693)

<div class="topic-metadata">

**Author:** [@pranchalm](https://discuss.elastic.co/u/pranchalm)\
**Replies:** 9\
**Last updated:** [October 14, 2024, 12:15am UTC](https://discuss.elastic.co/t/getting-issue-while-starting-kibana/368693 "2024-10-14T00:15:40Z")

</div>

Elasticsearch version-:8.15 Kibana version-:8.15 security is enabled(basic auth), without ssl Running Elasticsearch and kibana in local with single cluster -windows machine As we can see in the screenshot kibana i…

---

## [Receiving below error after updating ES indices deletion script to python 3.11](https://discuss.elastic.co/t/receiving-below-error-after-updating-es-indices-deletion-script-to-python-3-11/368742)

<div class="topic-metadata">

**Author:** [@Randika\_Munasinghe](https://discuss.elastic.co/u/Randika_Munasinghe)\
**Replies:** 0\
**Last updated:** [October 13, 2024, 10:59pm UTC](https://discuss.elastic.co/t/receiving-below-error-after-updating-es-indices-deletion-script-to-python-3-11/368742 "2024-10-13T22:59:47Z")

</div>

\[ERROR\] 2024-10-13T00:00:15.135Z 60708a75-e354-4207-96e0-24481a4a6c05 Missing 'index\_retention' in the event payload. Code is as below # Fetch all indexes all\_indexes = es.indices.get\_alias("\*") # Loop through all ind…

---

## [Search bar persistent? (or to pin search phrase as a filter to persist?)](https://discuss.elastic.co/t/search-bar-persistent-or-to-pin-search-phrase-as-a-filter-to-persist/368738)

<div class="topic-metadata">

**Author:** [@bob454522](https://discuss.elastic.co/u/bob454522)\
**Replies:** 0\
**Last updated:** [October 13, 2024, 6:46pm UTC](https://discuss.elastic.co/t/search-bar-persistent-or-to-pin-search-phrase-as-a-filter-to-persist/368738 "2024-10-13T18:46:10Z")

</div>

on Kibana (v8.15.2, but prior i was on 8.8.2) - how do you get a search phrase (ie typed into the search bar) to persist across pages? (ie either across different dashboards, or even across different pages of the same d…

---

## [Polygon rejected as self-intersecting, but it does not self-intersect](https://discuss.elastic.co/t/polygon-rejected-as-self-intersecting-but-it-does-not-self-intersect/368714)

<div class="topic-metadata">

**Author:** [@jamesdiacono](https://discuss.elastic.co/u/jamesdiacono)\
**Replies:** 2\
**Last updated:** [October 13, 2024, 8:54am UTC](https://discuss.elastic.co/t/polygon-rejected-as-self-intersecting-but-it-does-not-self-intersect/368714 "2024-10-13T08:54:32Z")

</div>

Elasticsearch 8.15.2 is refusing to index a polygon which, as far as I can tell, is perfectly valid. Here is an image of the polygon on a map. Notice that it is just a trapezoid with nothing funny going on, and it does n…

---

## [Index sorting on query performance when unable to perform early termination](https://discuss.elastic.co/t/index-sorting-on-query-performance-when-unable-to-perform-early-termination/368717)

<div class="topic-metadata">

**Author:** [@samde](https://discuss.elastic.co/u/samde)\
**Replies:** 0\
**Last updated:** [October 13, 2024, 5:03am UTC](https://discuss.elastic.co/t/index-sorting-on-query-performance-when-unable-to-perform-early-termination/368717 "2024-10-13T05:03:31Z")

</div>

Trying to understand the query performance implications of index sorting when track\_total\_hits is true, along with the following query parameters listed below. As afaik when track\_total\_hits is enabled, Elasticsearch wi…

---

## [What is the best practice that can be carried out?](https://discuss.elastic.co/t/what-is-the-best-practice-that-can-be-carried-out/368702)

<div class="topic-metadata">

**Author:** [@dsagent](https://discuss.elastic.co/u/dsagent)\
**Replies:** 7\
**Last updated:** [October 12, 2024, 5:28am UTC](https://discuss.elastic.co/t/what-is-the-best-practice-that-can-be-carried-out/368702 "2024-10-12T05:28:55Z")

</div>

hi I have a server with great specifications and I want to use elasticsearch to store data from 3100 devices What is the best practice? 1 Do I install the Linux system on the server and install one elasticsearch node, …

---

## [Data attributes for inclusion and exclusion are not working](https://discuss.elastic.co/t/data-attributes-for-inclusion-and-exclusion-are-not-working/359656)

<div class="topic-metadata">

**Author:** [@Dongmyoung\_Kim](https://discuss.elastic.co/u/Dongmyoung_Kim)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 7:49pm UTC](https://discuss.elastic.co/t/data-attributes-for-inclusion-and-exclusion-are-not-working/359656 "2024-10-11T19:49:11Z")

</div>

I've implemented the "data-elastic-exclude" attribute in the body tag and "data-elastic-include" in specific content sections to ensure that only those parts are indexed by Elasticsearch web crawler. However, it appears …

---

## [Filebeat DaemonSet on Kubernetes not shipping logs](https://discuss.elastic.co/t/filebeat-daemonset-on-kubernetes-not-shipping-logs/368703)

<div class="topic-metadata">

**Author:** [@paolovalladolid](https://discuss.elastic.co/u/paolovalladolid)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 9:17pm UTC](https://discuss.elastic.co/t/filebeat-daemonset-on-kubernetes-not-shipping-logs/368703 "2024-10-11T21:17:33Z")

</div>

I downloaded the latest manifest file curl -L -O https://raw.githubusercontent.com/elastic/beats/8.15/deploy/kubernetes/filebeat-kubernetes.yaml I then copied it, renamed the copy, and edited the file with the idea of …

---

## [8.15.0 Migration and RangeQuery builder](https://discuss.elastic.co/t/8-15-0-migration-and-rangequery-builder/366627)

<div class="topic-metadata">

**Author:** [@Gerald\_PONT](https://discuss.elastic.co/u/Gerald_PONT)\
**Replies:** 7\
**Last updated:** [October 11, 2024, 8:14pm UTC](https://discuss.elastic.co/t/8-15-0-migration-and-rangequery-builder/366627 "2024-10-11T20:14:34Z")

</div>

Hi all, We are using Elasticsearch in our software. We are migrating from version 8.10.1 to 8.15.1. We had this code in our software : rangeQueryBuilder = new RangeQuery.Builder() .field(fieldName) .gte(JsonData.of(…

---

## [Closing file after its contents have been read](https://discuss.elastic.co/t/closing-file-after-its-contents-have-been-read/368696)

<div class="topic-metadata">

**Author:** [@ncluff](https://discuss.elastic.co/u/ncluff)\
**Replies:** 4\
**Last updated:** [October 11, 2024, 7:21pm UTC](https://discuss.elastic.co/t/closing-file-after-its-contents-have-been-read/368696 "2024-10-11T19:21:28Z")

</div>

I'm using Filebeat 8.14.3 to collect lots of different files and the close.reader.on\_eof doesn't seem to be working. The file only needs to be read once and then closed. If you need more of the filebeat.yml, please let m…

---

## [Unable to Start Checkpoint Module Over TCP](https://discuss.elastic.co/t/unable-to-start-checkpoint-module-over-tcp/368519)

<div class="topic-metadata">

**Author:** [@mohsen.ghaffari](https://discuss.elastic.co/u/mohsen.ghaffari)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 6:57pm UTC](https://discuss.elastic.co/t/unable-to-start-checkpoint-module-over-tcp/368519 "2024-10-11T18:57:49Z")

</div>

Hi all, I'm facing an issue where I cannot start the Checkpoint firewall module over TCP. I’ve verified that the necessary ports are open and checked firewall settings, but still no success. Has anyone encountered a s…

---

## [Is it not possible to use / in the client\_id for the Kafka output plugin in Filebeat?](https://discuss.elastic.co/t/is-it-not-possible-to-use-in-the-client-id-for-the-kafka-output-plugin-in-filebeat/368587)

<div class="topic-metadata">

**Author:** [@henry.ahn](https://discuss.elastic.co/u/henry.ahn)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 6:13pm UTC](https://discuss.elastic.co/t/is-it-not-possible-to-use-in-the-client-id-for-the-kafka-output-plugin-in-filebeat/368587 "2024-10-11T18:13:00Z")

</div>

Hi, All! I configured the client.id in Filebeat for Kafka with a / character. However, I encountered the following error: ERROR \[kafka\] kafka/config.go:287 Invalid kafka configuration: kafka: invalid configuration (Cli…

---

## [Two cluster member failing to start](https://discuss.elastic.co/t/two-cluster-member-failing-to-start/368485)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 4\
**Last updated:** [October 11, 2024, 5:37pm UTC](https://discuss.elastic.co/t/two-cluster-member-failing-to-start/368485 "2024-10-11T17:37:51Z")

</div>

Version 1.17.12 two members of the my cluster are failing to start with the following error \[2024-10-09T15:17:43,176\]\[ERROR\]\[o.e.b.Bootstrap \] \[secesprd07\] node validation exception \[1\] bootstrap checks failed…

---

## [Error Setting ignore\_dynamic\_beyond\_limit to false](https://discuss.elastic.co/t/error-setting-ignore-dynamic-beyond-limit-to-false/368637)

<div class="topic-metadata">

**Author:** [@palkema](https://discuss.elastic.co/u/palkema)\
**Replies:** 2\
**Last updated:** [October 11, 2024, 3:41pm UTC](https://discuss.elastic.co/t/error-setting-ignore-dynamic-beyond-limit-to-false/368637 "2024-10-11T15:41:21Z")

</div>

Hi, I am trying to set the setting, index.mapping.total\_fields.ignore\_dynamic\_beyond\_limit to equal false. This is mentioned in the documentation here. When I run the request below, I am getting an error PUT /test-in…

---

## [Add several integrations to one Elastic Agent](https://discuss.elastic.co/t/add-several-integrations-to-one-elastic-agent/368509)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 3:23pm UTC](https://discuss.elastic.co/t/add-several-integrations-to-one-elastic-agent/368509 "2024-10-11T15:23:19Z")

</div>

Hello I have a Elastic Agent collecting Windows logs. I want to add that it collects Citrix ADC logs. How do I do this? I tried combining the elastic-agent.yml contents but...it does not work. Can I make several .ym…

---

## [Displaying a dashboard via iframe without anonymous user access enabled](https://discuss.elastic.co/t/displaying-a-dashboard-via-iframe-without-anonymous-user-access-enabled/368644)

<div class="topic-metadata">

**Author:** [@trudesea](https://discuss.elastic.co/u/trudesea)\
**Replies:** 4\
**Last updated:** [October 11, 2024, 3:14pm UTC](https://discuss.elastic.co/t/displaying-a-dashboard-via-iframe-without-anonymous-user-access-enabled/368644 "2024-10-11T15:14:21Z")

</div>

Hi, I'm trying to display a dashboard in an iframe. My Kibana instance is required to use basic auth. I've setup a user specifically for this purpose. I've tried setting up anonymous access but I don't want just anyo…

---

## [Where to apply integration policy](https://discuss.elastic.co/t/where-to-apply-integration-policy/368692)

<div class="topic-metadata">

**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\
**Replies:** 0\
**Last updated:** [October 11, 2024, 2:55pm UTC](https://discuss.elastic.co/t/where-to-apply-integration-policy/368692 "2024-10-11T14:55:59Z")

</div>

Hello My question is about this integration Where am I supposed to apply the policy? to the policy of my windows machines? or to the policy of the windows machines? or to the fleet server? or to the server where I h…

---

## [Kibana BUG](https://discuss.elastic.co/t/kibana-bug/368627)

<div class="topic-metadata">

**Author:** [@miiroslavkardos](https://discuss.elastic.co/u/miiroslavkardos)\
**Replies:** 5\
**Last updated:** [October 11, 2024, 2:42pm UTC](https://discuss.elastic.co/t/kibana-bug/368627 "2024-10-11T14:42:59Z")

</div>

Hello, When i select space and want to go to discover i got this error. Can somebody point me what is this? i cannot find anything...

---

## [Alerts not Triggering Email Notifications Despite Anomalies Detected in ML Jobs](https://discuss.elastic.co/t/alerts-not-triggering-email-notifications-despite-anomalies-detected-in-ml-jobs/368635)

<div class="topic-metadata">

**Author:** [@catarina](https://discuss.elastic.co/u/catarina)\
**Replies:** 1\
**Last updated:** [October 11, 2024, 2:33pm UTC](https://discuss.elastic.co/t/alerts-not-triggering-email-notifications-despite-anomalies-detected-in-ml-jobs/368635 "2024-10-11T14:33:13Z")

</div>

Hi Elasticsearch Community, I’ve created several Single Metric Machine Learning (ML) jobs, each configured to monitor sum of bytes for specific IP addresses. Due to the large volume of data, I’ve fine-tuned each job, an…

---

## [Keep getting \_jsonparsefailures](https://discuss.elastic.co/t/keep-getting-jsonparsefailures/367005)

<div class="topic-metadata">

**Author:** [@Mike\_Reprogle](https://discuss.elastic.co/u/Mike_Reprogle)\
**Replies:** 3\
**Last updated:** [October 11, 2024, 2:28pm UTC](https://discuss.elastic.co/t/keep-getting-jsonparsefailures/367005 "2024-10-11T14:28:49Z")

</div>

I am still relatively new to logstash, so I have been trying to run through a bit of a crash course in using it and getting logs to filter correctly. I finally have logs hitting like they should, but I cannot for the lif…

---

## [KNN search fails on empty index](https://discuss.elastic.co/t/knn-search-fails-on-empty-index/368670)

<div class="topic-metadata">

**Author:** [@JornWildt](https://discuss.elastic.co/u/JornWildt)\
**Replies:** 8\
**Last updated:** [October 11, 2024, 1:07pm UTC](https://discuss.elastic.co/t/knn-search-fails-on-empty-index/368670 "2024-10-11T13:07:08Z")

</div>

Doing a KNN search on an empty index fails with "All shards failed". A normal search with a GET like this succeeds with zero its: https://host/my-index/\_search But if I do a POST like this, ES fails with status code 4…

---

## [Beats not parsing \`message\` correctly with filebeat protocol](https://discuss.elastic.co/t/beats-not-parsing-message-correctly-with-filebeat-protocol/368517)

<div class="topic-metadata">

**Author:** [@Adam\_Kral](https://discuss.elastic.co/u/Adam_Kral)\
**Replies:** 7\
**Last updated:** [October 11, 2024, 11:54am UTC](https://discuss.elastic.co/t/beats-not-parsing-message-correctly-with-filebeat-protocol/368517 "2024-10-11T11:54:01Z")

</div>

Hi, I've ran into an issue with filebeat parsing a json message field when using the output.logstash. filebeat version: 8.15.2 logstash version: 8.13.0 The thing is, when I use: processors: - decode\_json\_fields: …

---

## [Restoring 7.x snapshot to fresh 8.14.3 ECK: System data streams missing after migration](https://discuss.elastic.co/t/restoring-7-x-snapshot-to-fresh-8-14-3-eck-system-data-streams-missing-after-migration/368674)

<div class="topic-metadata">

**Author:** [@Hadj\_Hassine\_Younes](https://discuss.elastic.co/u/Hadj_Hassine_Younes)\
**Replies:** 0\
**Last updated:** [October 11, 2024, 9:00am UTC](https://discuss.elastic.co/t/restoring-7-x-snapshot-to-fresh-8-14-3-eck-system-data-streams-missing-after-migration/368674 "2024-10-11T09:00:13Z")

</div>

I created the snapshot of my old version 7.x elk stack , and I now I am trying to restore the old snapshot on the new eck-elasticsearch version 8.14.3. Context: Upgraded from Elasticsearch v7.17.22 to v8.14.3 using ECK…

---

## [Winlogbeat process drop event doesn't work](https://discuss.elastic.co/t/winlogbeat-process-drop-event-doesnt-work/368675)

<div class="topic-metadata">

**Author:** [@kingofsa06](https://discuss.elastic.co/u/kingofsa06)\
**Replies:** 0\
**Last updated:** [October 11, 2024, 9:02am UTC](https://discuss.elastic.co/t/winlogbeat-process-drop-event-doesnt-work/368675 "2024-10-11T09:02:53Z")

</div>

Hi all, I have a confuse question. I need to transfer IIS logs from Exchange Server. But the data is too huge for server. So I want to have only wan IP log in Exchange Server to transport to graylog And used the win…

---

## [Elastic Search Configuration Problem with Kibana.yml](https://discuss.elastic.co/t/elastic-search-configuration-problem-with-kibana-yml/368665)

<div class="topic-metadata">

**Author:** [@schwarz\_ravenn](https://discuss.elastic.co/u/schwarz_ravenn)\
**Replies:** 2\
**Last updated:** [October 11, 2024, 8:15am UTC](https://discuss.elastic.co/t/elastic-search-configuration-problem-with-kibana-yml/368665 "2024-10-11T08:15:09Z")

</div>

So, I'm a newbie in Elasticsearch and Kibana. I've a problem with configuration and connection of Kibana to ES, sadly I couldn't find a solution that would work out for me, so I hope someone could help me out. Steps I'v…

---

## [BulkRequest failed when handle JSON data](https://discuss.elastic.co/t/bulkrequest-failed-when-handle-json-data/368611)

<div class="topic-metadata">

**Author:** [@ChatLee](https://discuss.elastic.co/u/ChatLee)\
**Replies:** 4\
**Last updated:** [October 11, 2024, 2:44am UTC](https://discuss.elastic.co/t/bulkrequest-failed-when-handle-json-data/368611 "2024-10-11T02:44:44Z")

</div>

Hi all, We want to index data into the ES with bulk api in the java client, the dependency is: elasticsearch-java: 8.13.2 the source data is a JSON string like this: t String createDoc1 = "{" + " …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=153)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=155)
