# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=140

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 141

---

## [Ignore term frequency but maintain relevancy](https://discuss.elastic.co/t/ignore-term-frequency-but-maintain-relevancy/370230)

<div class="topic-metadata">

**Author:** [@ryans](https://discuss.elastic.co/u/ryans)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 2:53pm UTC](https://discuss.elastic.co/t/ignore-term-frequency-but-maintain-relevancy/370230 "2024-11-08T14:53:45Z")

</div>

Here is my problem. If someone searches for "power rangers" (without quotes) on my site, ES is scoring documents with 100 instances of "power rangers" much higher than documents that only contain 1 instance of "power ra…

---

## [How to work around ES|QL lack of support for unique results](https://discuss.elastic.co/t/how-to-work-around-es-ql-lack-of-support-for-unique-results/370172)

<div class="topic-metadata">

**Author:** [@pjmlp](https://discuss.elastic.co/u/pjmlp)\
**Replies:** 4\
**Last updated:** [November 8, 2024, 2:14pm UTC](https://discuss.elastic.co/t/how-to-work-around-es-ql-lack-of-support-for-unique-results/370172 "2024-11-08T14:14:29Z")

</div>

Hi everyone, I am doing my first steps with analysing reports on Kibana, and after several hours I keep failing to find a way to produce unique results with ES|QL, or KQL as alternative. It seems to me that it is rathe…

---

## [Create Shareable Links to Query via API](https://discuss.elastic.co/t/create-shareable-links-to-query-via-api/370026)

<div class="topic-metadata">

**Author:** [@seboz123](https://discuss.elastic.co/u/seboz123)\
**Replies:** 2\
**Last updated:** [November 8, 2024, 12:55pm UTC](https://discuss.elastic.co/t/create-shareable-links-to-query-via-api/370026 "2024-11-08T12:55:12Z")

</div>

Hi, I would like to generate a shareable link to a Query under Discover in Kibana via an API. Like filters/index/timeframe should be set via an automation. Is there any way to do that? In the documentation I can only fi…

---

## [How to configure a Bar graph visualization to only display unique values of a field?](https://discuss.elastic.co/t/how-to-configure-a-bar-graph-visualization-to-only-display-unique-values-of-a-field/370081)

<div class="topic-metadata">

**Author:** [@vmassol](https://discuss.elastic.co/u/vmassol)\
**Replies:** 8\
**Last updated:** [November 8, 2024, 12:46pm UTC](https://discuss.elastic.co/t/how-to-configure-a-bar-graph-visualization-to-only-display-unique-values-of-a-field/370081 "2024-11-08T12:46:45Z")

</div>

Hello there, I know how to use an aggregation to query ES to display only unique values for a field, but I can't find how to do this in a Kibana "Bar Vertical" visualization: I have found how to do it for a "Pie" vi…

---

## [Using part of parsed date as selected output index](https://discuss.elastic.co/t/using-part-of-parsed-date-as-selected-output-index/370170)

<div class="topic-metadata">

**Author:** [@nilsen](https://discuss.elastic.co/u/nilsen)\
**Replies:** 5\
**Last updated:** [November 8, 2024, 12:41pm UTC](https://discuss.elastic.co/t/using-part-of-parsed-date-as-selected-output-index/370170 "2024-11-08T12:41:15Z")

</div>

I need to select output index based on the parsed date instead of using current date %{+YYYY.MM.dd}, because the log file does not roll at midnight. I have tried to research, but only solution I find is using ruby code: …

---

## [Elasticsearch-py cluster info fetch](https://discuss.elastic.co/t/elasticsearch-py-cluster-info-fetch/370220)

<div class="topic-metadata">

**Author:** [@Narzhan1](https://discuss.elastic.co/u/Narzhan1)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 12:37pm UTC](https://discuss.elastic.co/t/elasticsearch-py-cluster-info-fetch/370220 "2024-11-08T12:37:14Z")

</div>

After the Elasticsearch client is initialized in elasticsearch-py==7.17.0 like so: import elasticsearch host = elasticsearch.Elasticsearch(get\_elastic\_url()) the client sends a get request to the root of the Elasticsea…

---

## [Is it possible to change Index-level data tier allocation after creation?](https://discuss.elastic.co/t/is-it-possible-to-change-index-level-data-tier-allocation-after-creation/370186)

<div class="topic-metadata">

**Author:** [@catmanjan](https://discuss.elastic.co/u/catmanjan)\
**Replies:** 4\
**Last updated:** [November 8, 2024, 12:29pm UTC](https://discuss.elastic.co/t/is-it-possible-to-change-index-level-data-tier-allocation-after-creation/370186 "2024-11-08T12:29:22Z")

</div>

Hello, the documentation isn't clear on this - is it possible to set the data tier allocation AFTER an index has been created? e.g. index.routing.allocation.include.\_tier\_preference We are in a situation where a piece o…

---

## [How to handle fields with mixed field types in logstash?](https://discuss.elastic.co/t/how-to-handle-fields-with-mixed-field-types-in-logstash/370199)

<div class="topic-metadata">

**Author:** [@vwu\_su](https://discuss.elastic.co/u/vwu_su)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 11:51am UTC](https://discuss.elastic.co/t/how-to-handle-fields-with-mixed-field-types-in-logstash/370199 "2024-11-08T11:51:20Z")

</div>

Hello, I am using filebeat to collect Diagnostic Logs for Entra ID on Azure. I found that the properties.location field has different types in different logs. In some logs it should be configured as object type, in othe…

---

## [Using global method and headers for http\_poller multiple urls](https://discuss.elastic.co/t/using-global-method-and-headers-for-http-poller-multiple-urls/370210)

<div class="topic-metadata">

**Author:** [@dogee](https://discuss.elastic.co/u/dogee)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 11:40am UTC](https://discuss.elastic.co/t/using-global-method-and-headers-for-http-poller-multiple-urls/370210 "2024-11-08T11:40:05Z")

</div>

Hello, Having trouble to use global method GET and headers for multiple urls call. Copilot told me that it is possible, but it doesn't work in my case. This is my configuration : input { http\_poller { urls =\> { …

---

## [Multiple actions on alias api 8.15](https://discuss.elastic.co/t/multiple-actions-on-alias-api-8-15/370213)

<div class="topic-metadata">

**Author:** [@HSN\_AD](https://discuss.elastic.co/u/HSN_AD)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 11:01am UTC](https://discuss.elastic.co/t/multiple-actions-on-alias-api-8-15/370213 "2024-11-08T11:01:47Z")

</div>

Hi, I’ve found that multiple actions on the Alias API do not work properly. While it works fine in Kibana, it doesn't work in the .NET Elastic Client v8.15. Here’s my code:" await \_elasticClient.Indices.UpdateAliasesAs…

---

## [Issues with Forecast Start Times in Anomaly Detection Job](https://discuss.elastic.co/t/issues-with-forecast-start-times-in-anomaly-detection-job/370212)

<div class="topic-metadata">

**Author:** [@Thomas\_Muller](https://discuss.elastic.co/u/Thomas_Muller)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 10:53am UTC](https://discuss.elastic.co/t/issues-with-forecast-start-times-in-anomaly-detection-job/370212 "2024-11-08T10:53:30Z")

</div>

Hello everyone, I started an anomaly detection job with the following detector: mean("datapoint.value") partition\_field\_name="datapoint.external\_id" The bucket\_span is 15m and new documents are index every 5 minutes. …

---

## [Data loss in docker based elasticsearch at random index](https://discuss.elastic.co/t/data-loss-in-docker-based-elasticsearch-at-random-index/369288)

<div class="topic-metadata">

**Author:** [@Shivji\_Bhagat](https://discuss.elastic.co/u/Shivji_Bhagat)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 10:11am UTC](https://discuss.elastic.co/t/data-loss-in-docker-based-elasticsearch-at-random-index/369288 "2024-11-08T10:11:51Z")

</div>

I am using elasticsearch v8.13.2 with docker and single node. I have been facing loss of docs at random indices. this used to get resolved automatically earlier on increasing the ram size, but at current stage that is al…

---

## [Filebeat data sending problem with kerberos](https://discuss.elastic.co/t/filebeat-data-sending-problem-with-kerberos/368840)

<div class="topic-metadata">

**Author:** [@kocyigit](https://discuss.elastic.co/u/kocyigit)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 9:37am UTC](https://discuss.elastic.co/t/filebeat-data-sending-problem-with-kerberos/368840 "2024-11-08T09:37:30Z")

</div>

Hello everyone, I have a problem that is about filebeat yml configuration but it can also be about something else. I was use filebeat to send my logs from client computers to Kafka. There was not a problem while sending…

---

## [Elasticsearch build failure](https://discuss.elastic.co/t/elasticsearch-build-failure/369889)

<div class="topic-metadata">

**Author:** [@HAT](https://discuss.elastic.co/u/HAT)\
**Replies:** 7\
**Last updated:** [November 8, 2024, 9:30am UTC](https://discuss.elastic.co/t/elasticsearch-build-failure/369889 "2024-11-08T09:30:50Z")

</div>

I am trying to build Elasticsearch from source and getting the below error when I run "./gradlew assemble" \> Task :distribution:docker:buildWolfiDockerImage FAILED FAILURE: Build failed with an exception. \* What went …

---

## [Benefits of Metricbeat direct to ES vs Metricbeat Logstash?](https://discuss.elastic.co/t/benefits-of-metricbeat-direct-to-es-vs-metricbeat-logstash/366514)

<div class="topic-metadata">

**Author:** [@randomnamegenerator](https://discuss.elastic.co/u/randomnamegenerator)\
**Replies:** 2\
**Last updated:** [November 8, 2024, 9:26am UTC](https://discuss.elastic.co/t/benefits-of-metricbeat-direct-to-es-vs-metricbeat-logstash/366514 "2024-11-08T09:26:15Z")

</div>

Hello We are looking into installing Metricbeat on 8 customer application servers to get a better overview of what is happening regarding cpu,memory etc usage. At this stage we would only be using system and windows mod…

---

## [Filebeat in elastic agent is consuming more RAM in windows](https://discuss.elastic.co/t/filebeat-in-elastic-agent-is-consuming-more-ram-in-windows/370057)

<div class="topic-metadata">

**Author:** [@suhasbhatt101](https://discuss.elastic.co/u/suhasbhatt101)\
**Replies:** 2\
**Last updated:** [November 8, 2024, 9:10am UTC](https://discuss.elastic.co/t/filebeat-in-elastic-agent-is-consuming-more-ram-in-windows/370057 "2024-11-08T09:10:22Z")

</div>

I am using elastic agent to collect custom logs from my windows server. Filebeat stream is consuming more than 1GB of RAM, some time it is consuming 3 to 4 GB RAM. When i remove the filebeat configurations from the elas…

---

## [Logstash DLQ: sincedb never gets created](https://discuss.elastic.co/t/logstash-dlq-sincedb-never-gets-created/370205)

<div class="topic-metadata">

**Author:** [@hilsonp](https://discuss.elastic.co/u/hilsonp)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 8:13am UTC](https://discuss.elastic.co/t/logstash-dlq-sincedb-never-gets-created/370205 "2024-11-08T08:13:15Z")

</div>

Hello, I'm trying to configure dead letter queue on a setup which was installed by another team a few years ago. Documents refused by elastic are well going to the dlq. The dlq pipeline ingests them and send them corr…

---

## [{{context.link}} generated is too long to be resolved](https://discuss.elastic.co/t/context-link-generated-is-too-long-to-be-resolved/370157)

<div class="topic-metadata">

**Author:** [@blindahl](https://discuss.elastic.co/u/blindahl)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 7:46am UTC](https://discuss.elastic.co/t/context-link-generated-is-too-long-to-be-resolved/370157 "2024-11-08T07:46:12Z")

</div>

When including {{context.link}} in an email to inform about errors in our application logs we get an issue with the value of context.link seem to get too long when adding some filters to filter out specific log posts. Th…

---

## [Docker Failed Install Puglin Kuromoji In 7.17.25](https://discuss.elastic.co/t/docker-failed-install-puglin-kuromoji-in-7-17-25/370195)

<div class="topic-metadata">

**Author:** [@KuroDecimal](https://discuss.elastic.co/u/KuroDecimal)\
**Replies:** 0\
**Last updated:** [November 8, 2024, 4:25am UTC](https://discuss.elastic.co/t/docker-failed-install-puglin-kuromoji-in-7-17-25/370195 "2024-11-08T04:25:43Z")

</div>

Hello, friends. I was editing official Dockerfile 7.17.25 distributed on Github for develop a custom elasticsearch image. (Office Dockerfile URL : dockerfiles/elasticsearch/Dockerfile at 9a2cb64607abe3574f8f1d0fa8b9680…

---

## [Caching of runtime mappings](https://discuss.elastic.co/t/caching-of-runtime-mappings/370185)

<div class="topic-metadata">

**Author:** [@nicole.oresme](https://discuss.elastic.co/u/nicole.oresme)\
**Replies:** 0\
**Last updated:** [November 7, 2024, 9:34pm UTC](https://discuss.elastic.co/t/caching-of-runtime-mappings/370185 "2024-11-07T21:34:02Z")

</div>

Does anyone know when the results of runtime mappings are cached? I've seen instances where my first run takes 10s of seconds, but my second is near instant - so they are clearly being cached sometimes. But then I do w…

---

## [Increased CPU usage on data nodes after Elasticsearch upgrade from 8.8.2 to 8.15.3](https://discuss.elastic.co/t/increased-cpu-usage-on-data-nodes-after-elasticsearch-upgrade-from-8-8-2-to-8-15-3/370184)

<div class="topic-metadata">

**Author:** [@lifer](https://discuss.elastic.co/u/lifer)\
**Replies:** 0\
**Last updated:** [November 7, 2024, 8:50pm UTC](https://discuss.elastic.co/t/increased-cpu-usage-on-data-nodes-after-elasticsearch-upgrade-from-8-8-2-to-8-15-3/370184 "2024-11-07T20:50:53Z")

</div>

Hi! We are observing 1.5-2x increase in CPU usage after upgrade of our ES cluster from version 8.8.2 to 8.15.3. Our cluster is hosted on AWS EC2 instances, it consists of 6 nodes: 3 master nodes (c6i.large) and 3 data …

---

## [Error parsing json and truncated error in JSON logs](https://discuss.elastic.co/t/error-parsing-json-and-truncated-error-in-json-logs/370079)

<div class="topic-metadata">

**Author:** [@Seemant\_Bind](https://discuss.elastic.co/u/Seemant_Bind)\
**Replies:** 4\
**Last updated:** [November 7, 2024, 7:49pm UTC](https://discuss.elastic.co/t/error-parsing-json-and-truncated-error-in-json-logs/370079 "2024-11-07T19:49:48Z")

</div>

Hi, I am pushing logs through Filebeat and using logstash into Elastic. I have JSON logs and for some of the logs I am getting the error Error parsing json , \[truncated 4301 bytes\]; line: 1, column: 16\] but some of …

---

## [Filtering request urls wildcard](https://discuss.elastic.co/t/filtering-request-urls-wildcard/370166)

<div class="topic-metadata">

**Author:** [@Myles\_Kingsnorth1](https://discuss.elastic.co/u/Myles_Kingsnorth1)\
**Replies:** 1\
**Last updated:** [November 7, 2024, 7:24pm UTC](https://discuss.elastic.co/t/filtering-request-urls-wildcard/370166 "2024-11-07T19:24:49Z")

</div>

I'm using Kibana edit query DSL feature to try and filter for a URL structure. I have 2 types of urls: /products/example/example2 /products/example I'm trying to produce a query that will match /products/example NOT b…

---

## [Elastic agent reports "no CA certificate matching the fingerprint"](https://discuss.elastic.co/t/elastic-agent-reports-no-ca-certificate-matching-the-fingerprint/370182)

<div class="topic-metadata">

**Author:** [@mscheepers](https://discuss.elastic.co/u/mscheepers)\
**Replies:** 0\
**Last updated:** [November 7, 2024, 7:08pm UTC](https://discuss.elastic.co/t/elastic-agent-reports-no-ca-certificate-matching-the-fingerprint/370182 "2024-11-07T19:08:37Z")

</div>

Hi All, i have a internal CA what has signed the certificates and the CA certificate is known by the clients. All information is also been received by the Elasticsearch and showed in Kibana. So everything is looking goo…

---

## [Running integration tests for a specific integration](https://discuss.elastic.co/t/running-integration-tests-for-a-specific-integration/370140)

<div class="topic-metadata">

**Author:** [@jason26](https://discuss.elastic.co/u/jason26)\
**Replies:** 3\
**Last updated:** [November 7, 2024, 6:08pm UTC](https://discuss.elastic.co/t/running-integration-tests-for-a-specific-integration/370140 "2024-11-07T18:08:32Z")

</div>

Hi All, I'm trying to update some mappings for an Elastic Agent integration, specifically Suricata. I see some test input files and expected output files, but I haven't found a test that actually uses them. I've tried…

---

## [Help with pipeline and reindex and search using E5 embedding model](https://discuss.elastic.co/t/help-with-pipeline-and-reindex-and-search-using-e5-embedding-model/369359)

<div class="topic-metadata">

**Author:** [@Sergio\_Fernandez\_Col](https://discuss.elastic.co/u/Sergio_Fernandez_Col)\
**Replies:** 1\
**Last updated:** [November 7, 2024, 5:42pm UTC](https://discuss.elastic.co/t/help-with-pipeline-and-reindex-and-search-using-e5-embedding-model/369359 "2024-11-07T17:42:43Z")

</div>

Hi all, I have uploaded a tsv file with chunked information, this information is divided in this columns: "document\_name", "page\_number" and "text". I did this many times but using elser\_v2, now I have to use the built…

---

## [Beats Kafka Output: support for SASL OAUTH and MSK IAM Authentication](https://discuss.elastic.co/t/beats-kafka-output-support-for-sasl-oauth-and-msk-iam-authentication/368599)

<div class="topic-metadata">

**Author:** [@Jose\_Ledesma](https://discuss.elastic.co/u/Jose_Ledesma)\
**Replies:** 1\
**Last updated:** [November 7, 2024, 4:33pm UTC](https://discuss.elastic.co/t/beats-kafka-output-support-for-sasl-oauth-and-msk-iam-authentication/368599 "2024-11-07T16:33:24Z")

</div>

Hi, We are interested in sending logs with Filebeat to an MSK cluster using IAM authentication. Currently, the Kafka Output does not support SASL OAUTH, which is the underlying mechanism for IAM Authentication (see a Go…

---

## [Logstash plugins](https://discuss.elastic.co/t/logstash-plugins/370175)

<div class="topic-metadata">

**Author:** [@DOkuwa](https://discuss.elastic.co/u/DOkuwa)\
**Replies:** 1\
**Last updated:** [November 7, 2024, 4:29pm UTC](https://discuss.elastic.co/t/logstash-plugins/370175 "2024-11-07T16:29:45Z")

</div>

Hello, I am writing a new plugin using grpc from a cisco router to logstash here I have checked the website for this info as i am bit lost and not a ruby expert The information from the cisco router is just like this …

---

## [Trying to run the query in Kibana but getting '\[bool\] malformed query, expected \[END\_OBJECT\] but found \[FIELD\_NAME\]'](https://discuss.elastic.co/t/trying-to-run-the-query-in-kibana-but-getting-bool-malformed-query-expected-end-object-but-found-field-name/370056)

<div class="topic-metadata">

**Author:** [@Navaneeth\_K](https://discuss.elastic.co/u/Navaneeth_K)\
**Replies:** 1\
**Last updated:** [November 7, 2024, 3:32pm UTC](https://discuss.elastic.co/t/trying-to-run-the-query-in-kibana-but-getting-bool-malformed-query-expected-end-object-but-found-field-name/370056 "2024-11-07T15:32:43Z")

</div>

Query used: { "size": 0, "query": { "bool": { "must": \[ { "match": { "message": "\<API\_CALL\_NAME\>" } }, { "range": { "@timestamp": { "gte": "now-1h", "lte": "now" } } } \] } }, { "aggs": { "api\_call…

---

## [Elastic search to Postgres migration and building Cache for trillions records](https://discuss.elastic.co/t/elastic-search-to-postgres-migration-and-building-cache-for-trillions-records/370105)

<div class="topic-metadata">

**Author:** [@S8ukumar](https://discuss.elastic.co/u/S8ukumar)\
**Replies:** 6\
**Last updated:** [November 7, 2024, 10:53am UTC](https://discuss.elastic.co/t/elastic-search-to-postgres-migration-and-building-cache-for-trillions-records/370105 "2024-11-07T10:53:46Z")

</div>

I am working on a product design where we provide source data as input which is having details of files and folders. This data is huge and in trillions. This goes for metadata scan and keep the metadata scan details of i…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=139)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=141)
