# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=199

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 200

---

## [Documents will not be found with querry, even if querry and mapping is correctand documents contain the fields](https://discuss.elastic.co/t/documents-will-not-be-found-with-querry-even-if-querry-and-mapping-is-correctand-documents-contain-the-fields/363528)

<div class="topic-metadata">

**Author:** [@felix.maier](https://discuss.elastic.co/u/felix.maier)\
**Replies:** 0\
**Last updated:** [July 22, 2024, 7:59am UTC](https://discuss.elastic.co/t/documents-will-not-be-found-with-querry-even-if-querry-and-mapping-is-correctand-documents-contain-the-fields/363528 "2024-07-22T07:59:26Z")

</div>

Hello, I have a Problem to find Documents in a Data Stream. Every Document has the fileds "received\_from" With an Update from the Filebeats, the filed "host.hostname" was added. Bothe of the filds hold the same string, a…

---

## [Facing an issue while creating a dashboard where I want to plot a graph for successful items & failed. But what I need is that the successful items count should go to zero if there is a failed item](https://discuss.elastic.co/t/facing-an-issue-while-creating-a-dashboard-where-i-want-to-plot-a-graph-for-successful-items-failed-but-what-i-need-is-that-the-successful-items-count-should-go-to-zero-if-there-is-a-failed-item/363630)

<div class="topic-metadata">

**Author:** [@gaurow.deshmukh](https://discuss.elastic.co/u/gaurow.deshmukh)\
**Replies:** 0\
**Last updated:** [July 23, 2024, 11:49am UTC](https://discuss.elastic.co/t/facing-an-issue-while-creating-a-dashboard-where-i-want-to-plot-a-graph-for-successful-items-failed-but-what-i-need-is-that-the-successful-items-count-should-go-to-zero-if-there-is-a-failed-item/363630 "2024-07-23T11:49:37Z")

</div>

Need to investigate the possibility where: for example if from 8 to 10am we have successful items graph shows exponential growth . If there there is a failed item , successful item will restart the count from zero. Che…

---

## [Filebeat http request with access token](https://discuss.elastic.co/t/filebeat-http-request-with-access-token/363628)

<div class="topic-metadata">

**Author:** [@anis1](https://discuss.elastic.co/u/anis1)\
**Replies:** 0\
**Last updated:** [July 23, 2024, 11:30am UTC](https://discuss.elastic.co/t/filebeat-http-request-with-access-token/363628 "2024-07-23T11:30:05Z")

</div>

Hello I want to read messages from an HTTP API which requires an access token for authentication. In documentation, I found two ways to handle authentication: basic auth with username and password: this can't be used…

---

## [Aggregation fails silently, returns the default response of 10 docs and hits instead of error](https://discuss.elastic.co/t/aggregation-fails-silently-returns-the-default-response-of-10-docs-and-hits-instead-of-error/362872)

<div class="topic-metadata">

**Author:** [@Laurent\_Martelli](https://discuss.elastic.co/u/Laurent_Martelli)\
**Replies:** 2\
**Last updated:** [July 23, 2024, 10:23am UTC](https://discuss.elastic.co/t/aggregation-fails-silently-returns-the-default-response-of-10-docs-and-hits-instead-of-error/362872 "2024-07-23T10:23:44Z")

</div>

ES / Kibana v 8.14.1 Same as Aggregation fails silently when ran on huge data, instead of error returns the default response of 10 docs and hits I send an aggregation query with "size": 0 example query POST /logstash…

---

## [Nest v7 Support End date?](https://discuss.elastic.co/t/nest-v7-support-end-date/363353)

<div class="topic-metadata">

**Author:** [@bsehra](https://discuss.elastic.co/u/bsehra)\
**Replies:** 2\
**Last updated:** [July 23, 2024, 9:31am UTC](https://discuss.elastic.co/t/nest-v7-support-end-date/363353 "2024-07-23T09:31:23Z")

</div>

Hi All, We are planning to migrate from NEST v7 to .NET Client v8. Since it's going to take some time to completely migrate the whole project. I can see here at this link that "v7 NEST client continues to be supported"…

---

## [Logstash (TypeError) no implicit conversion of Hash into String](https://discuss.elastic.co/t/logstash-typeerror-no-implicit-conversion-of-hash-into-string/363616)

<div class="topic-metadata">

**Author:** [@Gimi\_Sedi](https://discuss.elastic.co/u/Gimi_Sedi)\
**Replies:** 0\
**Last updated:** [July 23, 2024, 8:58am UTC](https://discuss.elastic.co/t/logstash-typeerror-no-implicit-conversion-of-hash-into-string/363616 "2024-07-23T08:58:47Z")

</div>

For a couple of days, logstash stops ingesting logs (while the service is up and running). The error thrown on the logs is shown below: 2024-07-22 12:10:36,103 pool-84-thread-1 ERROR An exception occurred processing App…

---

## [How to set up third party https requests to Elasticsearch](https://discuss.elastic.co/t/how-to-set-up-third-party-https-requests-to-elasticsearch/363560)

<div class="topic-metadata">

**Author:** [@Knut\_Knackwurst](https://discuss.elastic.co/u/Knut_Knackwurst)\
**Replies:** 2\
**Last updated:** [July 23, 2024, 8:40am UTC](https://discuss.elastic.co/t/how-to-set-up-third-party-https-requests-to-elasticsearch/363560 "2024-07-23T08:40:14Z")

</div>

Hi, I followed both of these tutorials: Set up basic security for the Elastic Stack and Set up basic security for the Elastic Stack plus secured HTTPS traffic. Now i want to set up the ability for a third party app (I …

---

## [How to detect the absence of a file using filebeat](https://discuss.elastic.co/t/how-to-detect-the-absence-of-a-file-using-filebeat/363578)

<div class="topic-metadata">

**Author:** [@Puneet\_Singh](https://discuss.elastic.co/u/Puneet_Singh)\
**Replies:** 1\
**Last updated:** [July 23, 2024, 7:51am UTC](https://discuss.elastic.co/t/how-to-detect-the-absence-of-a-file-using-filebeat/363578 "2024-07-23T07:51:28Z")

</div>

Hi All, We have a monitoring pipeline available in out infrastructure for monitoring /var/log/messages logs. filebeat -\> kafka -\> logstash -\> elasticsearch -\> elastalert. We are using filebeat 8.0.1 to export system l…

---

## [\[6.7.1\]how to set ccs with kerberos](https://discuss.elastic.co/t/6-7-1-how-to-set-ccs-with-kerberos/363546)

<div class="topic-metadata">

**Author:** [@lammm4](https://discuss.elastic.co/u/lammm4)\
**Replies:** 9\
**Last updated:** [July 23, 2024, 3:25am UTC](https://discuss.elastic.co/t/6-7-1-how-to-set-ccs-with-kerberos/363546 "2024-07-23T03:25:17Z")

</div>

we use es 6.7.1 with kerberos, but after set remote cluster, the state connect is always false, and the seeds is empty. does it support ccs with using kerberos?

---

## [I am getting Malformed Escape Escape at Index error in logstash logs for http url. How to resolve it?](https://discuss.elastic.co/t/i-am-getting-malformed-escape-escape-at-index-error-in-logstash-logs-for-http-url-how-to-resolve-it/363440)

<div class="topic-metadata">

**Author:** [@Shalu\_Bisht](https://discuss.elastic.co/u/Shalu_Bisht)\
**Replies:** 4\
**Last updated:** [July 23, 2024, 2:44am UTC](https://discuss.elastic.co/t/i-am-getting-malformed-escape-escape-at-index-error-in-logstash-logs-for-http-url-how-to-resolve-it/363440 "2024-07-23T02:44:53Z")

</div>

I am getting Malformed Escape Escape at Index error in logstash logs for http url. How to resolve it ?

---

## [File based authentication for Kibana](https://discuss.elastic.co/t/file-based-authentication-for-kibana/363594)

<div class="topic-metadata">

**Author:** [@elastic\_noob1](https://discuss.elastic.co/u/elastic_noob1)\
**Replies:** 1\
**Last updated:** [July 22, 2024, 10:56pm UTC](https://discuss.elastic.co/t/file-based-authentication-for-kibana/363594 "2024-07-22T22:56:18Z")

</div>

I am trying to configure file based authentication for Kibana users but is it supported? The documentation suggests managing the users through API but is file realm supported? Based on my testing, it is not working but w…

---

## [Docker Swarm + Traefik - master not discovered when open ports 9200 and 9300](https://discuss.elastic.co/t/docker-swarm-traefik-master-not-discovered-when-open-ports-9200-and-9300/363574)

<div class="topic-metadata">

**Author:** [@ciocan](https://discuss.elastic.co/u/ciocan)\
**Replies:** 2\
**Last updated:** [July 22, 2024, 9:56pm UTC](https://discuss.elastic.co/t/docker-swarm-traefik-master-not-discovered-when-open-ports-9200-and-9300/363574 "2024-07-22T21:56:25Z")

</div>

Once I open ports on es03 the elasticsearch node can't communicate with others. Here is the compose file: version: '3.9' services: setup: image: ${ELASTIC\_IMAGE}:${STACK\_VERSION} networks: - esnet …

---

## [Nested query](https://discuss.elastic.co/t/nested-query/363549)

<div class="topic-metadata">

**Author:** [@shrm](https://discuss.elastic.co/u/shrm)\
**Replies:** 4\
**Last updated:** [July 22, 2024, 9:12pm UTC](https://discuss.elastic.co/t/nested-query/363549 "2024-07-22T21:12:23Z")

</div>

I have an index for a country list as: { "countries": { "mappings": { "properties": { "cities": { "type": "nested", "properties": { "id": { "type": "inte…

---

## [Logstash + TG](https://discuss.elastic.co/t/logstash-tg/362776)

<div class="topic-metadata">

**Author:** [@TatianaKlimova91](https://discuss.elastic.co/u/TatianaKlimova91)\
**Replies:** 8\
**Last updated:** [July 22, 2024, 8:11pm UTC](https://discuss.elastic.co/t/logstash-tg/362776 "2024-07-22T20:11:27Z")

</div>

Hi there! I try to set logstash.config to send alerts to telegram bot. I added in output section http part and recreated logstash container, but still can’t get alerts. Locally from api alerts are working. Logstash pl…

---

## [Best practice for managing many log formats with data streams](https://discuss.elastic.co/t/best-practice-for-managing-many-log-formats-with-data-streams/363376)

<div class="topic-metadata">

**Author:** [@DCraddockPOR](https://discuss.elastic.co/u/DCraddockPOR)\
**Replies:** 5\
**Last updated:** [July 22, 2024, 7:00pm UTC](https://discuss.elastic.co/t/best-practice-for-managing-many-log-formats-with-data-streams/363376 "2024-07-22T19:00:08Z")

</div>

Apologies if this is a redundant topic of conversation; I feel I've searched far and wide and can't find a clear answer. And, if it isn't obvious, I'm new to the Elastic ecosystem. I have many different log formats that…

---

## [Update entire documents](https://discuss.elastic.co/t/update-entire-documents/363585)

<div class="topic-metadata">

**Author:** [@jane\_manuel](https://discuss.elastic.co/u/jane_manuel)\
**Replies:** 0\
**Last updated:** [July 22, 2024, 5:43pm UTC](https://discuss.elastic.co/t/update-entire-documents/363585 "2024-07-22T17:43:17Z")

</div>

hello, i have an elastic instance with more than 100 million document, i have a date field with different format on each document, so i want to update all the documents to have a unified date format i am using somethin…

---

## [Latency in seeing a document](https://discuss.elastic.co/t/latency-in-seeing-a-document/363071)

<div class="topic-metadata">

**Author:** [@siakc](https://discuss.elastic.co/u/siakc)\
**Replies:** 42\
**Last updated:** [July 22, 2024, 3:59pm UTC](https://discuss.elastic.co/t/latency-in-seeing-a-document/363071 "2024-07-22T15:59:16Z")

</div>

It seems to be a delay between the time a doc is put and the time it is searchable in the Kibana. I wanted to find the reason. "indexing": { "index\_total": 3568228, "index\_time\_in\_millis": 1947151,…

---

## [Nested Field exists check not working as expected](https://discuss.elastic.co/t/nested-field-exists-check-not-working-as-expected/356859)

<div class="topic-metadata">

**Author:** [@Sankar\_S](https://discuss.elastic.co/u/Sankar_S)\
**Replies:** 8\
**Last updated:** [July 22, 2024, 3:28pm UTC](https://discuss.elastic.co/t/nested-field-exists-check-not-working-as-expected/356859 "2024-07-22T15:28:37Z")

</div>

GET index1/\_search { "query": { "bool": { "must\_not": \[ { "nested": { "path": "publish\_details", "query": { "bool": { "must\_not": \[ …

---

## [ILM delete policy and kibana scripted fields](https://discuss.elastic.co/t/ilm-delete-policy-and-kibana-scripted-fields/363567)

<div class="topic-metadata">

**Author:** [@mostafaelsayed](https://discuss.elastic.co/u/mostafaelsayed)\
**Replies:** 0\
**Last updated:** [July 22, 2024, 2:38pm UTC](https://discuss.elastic.co/t/ilm-delete-policy-and-kibana-scripted-fields/363567 "2024-07-22T14:38:35Z")

</div>

Hello team, The documentation on ILM rollover policy is saying that, for indices that have document updates, whenever a rollover triggered, a new write index is created, and the updates are happening in that new index M…

---

## [Kibana - Filtering by buckets](https://discuss.elastic.co/t/kibana-filtering-by-buckets/361745)

<div class="topic-metadata">

**Author:** [@Knut\_Knackwurst](https://discuss.elastic.co/u/Knut_Knackwurst)\
**Replies:** 3\
**Last updated:** [July 22, 2024, 2:28pm UTC](https://discuss.elastic.co/t/kibana-filtering-by-buckets/361745 "2024-07-22T14:28:38Z")

</div>

Hello! First of all, let me describe my data source: I have business items that run through multiple processes. I've got a historic SQL table, in which all actions (item status changed, item processed, item viewed,...…

---

## [Logshash filter plugin ruby code to remove duplicates from a json array of json address objects](https://discuss.elastic.co/t/logshash-filter-plugin-ruby-code-to-remove-duplicates-from-a-json-array-of-json-address-objects/363501)

<div class="topic-metadata">

**Author:** [@vvavad](https://discuss.elastic.co/u/vvavad)\
**Replies:** 2\
**Last updated:** [July 22, 2024, 12:19pm UTC](https://discuss.elastic.co/t/logshash-filter-plugin-ruby-code-to-remove-duplicates-from-a-json-array-of-json-address-objects/363501 "2024-07-22T12:19:33Z")

</div>

I am writing a logstash job/pipeline which takes input from Elasticsearch index(index 1), in filter plugin reads another elasticSearch index(index2). Both of these idices have json data with array of address objects. I w…

---

## [2 way search by query and incoming docs](https://discuss.elastic.co/t/2-way-search-by-query-and-incoming-docs/363170)

<div class="topic-metadata">

**Author:** [@elsaticnoob](https://discuss.elastic.co/u/elsaticnoob)\
**Replies:** 15\
**Last updated:** [July 22, 2024, 12:17pm UTC](https://discuss.elastic.co/t/2-way-search-by-query-and-incoming-docs/363170 "2024-07-22T12:17:36Z")

</div>

I am working on an app where the goal is to find likeminded people in your area, nothing revolutionary. Given a user's age, minAge,maxAge fields, we want to query for other docs that meet the criteria. However, the sear…

---

## [Getting Error while using TABS option for increasing processing time of Kibana](https://discuss.elastic.co/t/getting-error-while-using-tabs-option-for-increasing-processing-time-of-kibana/362702)

<div class="topic-metadata">

**Author:** [@Arshukla](https://discuss.elastic.co/u/Arshukla)\
**Replies:** 3\
**Last updated:** [July 22, 2024, 12:12pm UTC](https://discuss.elastic.co/t/getting-error-while-using-tabs-option-for-increasing-processing-time-of-kibana/362702 "2024-07-22T12:12:44Z")

</div>

Hello Team, I have enabled the advanced setting related to kibana TABS, and when i am moving to my dashboard getting below error. Please suggest way forward. Screenshot given for reference

---

## [Is it possible to remove the timerange from Canvas when preparing graphs in LENS](https://discuss.elastic.co/t/is-it-possible-to-remove-the-timerange-from-canvas-when-preparing-graphs-in-lens/362697)

<div class="topic-metadata">

**Author:** [@Arshukla](https://discuss.elastic.co/u/Arshukla)\
**Replies:** 1\
**Last updated:** [July 22, 2024, 12:12pm UTC](https://discuss.elastic.co/t/is-it-possible-to-remove-the-timerange-from-canvas-when-preparing-graphs-in-lens/362697 "2024-07-22T12:12:08Z")

</div>

Hello Team, Can we remove this timerange (Last 1 hour) given in LENS when using for Canvas. Refer below screenshot

---

## [Cannot read existing Message Signing Key pair](https://discuss.elastic.co/t/cannot-read-existing-message-signing-key-pair/363554)

<div class="topic-metadata">

**Author:** [@Mahmoud0x](https://discuss.elastic.co/u/Mahmoud0x)\
**Replies:** 0\
**Last updated:** [July 22, 2024, 12:02pm UTC](https://discuss.elastic.co/t/cannot-read-existing-message-signing-key-pair/363554 "2024-07-22T12:02:09Z")

</div>

Add integration or create new policy , i found message Cannot read existing Message Signing Key pair

---

## [Fleet managed elastic agent: Kubernetes Prometheus Metrics Autodiscover](https://discuss.elastic.co/t/fleet-managed-elastic-agent-kubernetes-prometheus-metrics-autodiscover/362808)

<div class="topic-metadata">

**Author:** [@Alphayeeeet](https://discuss.elastic.co/u/Alphayeeeet)\
**Replies:** 7\
**Last updated:** [July 22, 2024, 11:54am UTC](https://discuss.elastic.co/t/fleet-managed-elastic-agent-kubernetes-prometheus-metrics-autodiscover/362808 "2024-07-22T11:54:11Z")

</div>

Moved the discussion from github to here: Prometheus Input - auto discovery and leader election in fleet · Issue #4126 · elastic/elastic-agent · GitHub

---

## [elasticsearch updateByQuery is not working for large data](https://discuss.elastic.co/t/elasticsearch-updatebyquery-is-not-working-for-large-data/363485)

<div class="topic-metadata">

**Author:** [@Karan\_Rawat](https://discuss.elastic.co/u/Karan_Rawat)\
**Replies:** 3\
**Last updated:** [July 22, 2024, 11:21am UTC](https://discuss.elastic.co/t/elasticsearch-updatebyquery-is-not-working-for-large-data/363485 "2024-07-22T11:21:52Z")

</div>

i have written a script that will create a key "source" on 4 indices of elasticsearch based on some condition . All of my 4 indices contain at least 2~3 million data . when i ran the script it added the key for only 3 en…

---

## [Adding description to url field](https://discuss.elastic.co/t/adding-description-to-url-field/363497)

<div class="topic-metadata">

**Author:** [@eran2](https://discuss.elastic.co/u/eran2)\
**Replies:** 4\
**Last updated:** [July 22, 2024, 10:43am UTC](https://discuss.elastic.co/t/adding-description-to-url-field/363497 "2024-07-22T10:43:11Z")

</div>

Hey, I would like to add a description to url field to show it tooltip, for example: Google: www.google.com I Have a WebsiteDescription field (Google) and Website field (which is URL in dataview) appreciate for help

---

## [I install elasticsearch 8 in vps serverusing rpm in almalinux but elasticsearch8 not working it showing error](https://discuss.elastic.co/t/i-install-elasticsearch-8-in-vps-serverusing-rpm-in-almalinux-but-elasticsearch8-not-working-it-showing-error/363543)

<div class="topic-metadata">

**Author:** [@Rahul\_Sharma3](https://discuss.elastic.co/u/Rahul_Sharma3)\
**Replies:** 0\
**Last updated:** [July 22, 2024, 10:09am UTC](https://discuss.elastic.co/t/i-install-elasticsearch-8-in-vps-serverusing-rpm-in-almalinux-but-elasticsearch8-not-working-it-showing-error/363543 "2024-07-22T10:09:15Z")

</div>

I install elasticsearch 8 in vps server using rpm in almalinux but elasticsearch8 not working it showing no issue when using this command : curl -XGET "localhost:9200" but in after that when i execute : curl -XGET 'loca…

---

## [Getting Error on creating embedding via code](https://discuss.elastic.co/t/getting-error-on-creating-embedding-via-code/363530)

<div class="topic-metadata">

**Author:** [@Shubham\_Pandey1](https://discuss.elastic.co/u/Shubham_Pandey1)\
**Replies:** 1\
**Last updated:** [July 22, 2024, 9:19am UTC](https://discuss.elastic.co/t/getting-error-on-creating-embedding-via-code/363530 "2024-07-22T09:19:04Z")

</div>

function to create vector embeddings : - async getVectorEmbedding(text) { try { const response = await this.client.ingest.simulate({ body: { pipeline: { id: process.env.INGEST\_PIP…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=198)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=200)
