# Latest

**URL:** https://discuss.elastic.co/latest.md?page=561

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 562

---

## [Huge disk read count when MapperParsingException](https://discuss.elastic.co/t/huge-disk-read-count-when-mapperparsingexception/341673)

<div class="topic-metadata">

**Author:** [@ShanYang](https://discuss.elastic.co/u/ShanYang)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 9:41am UTC](https://discuss.elastic.co/t/huge-disk-read-count-when-mapperparsingexception/341673 "2023-08-25T09:41:52Z")

</div>

I found that the indexing efficiency of the entire cluster gradually decreased with each passing day. After checking the size of all the indices, I didn't find any abnormalities. However, at the same time, I noticed an…

---

## [Importing ndjson file of kibana dashboards from DEV kibana to Prod Kibana using jenkins](https://discuss.elastic.co/t/importing-ndjson-file-of-kibana-dashboards-from-dev-kibana-to-prod-kibana-using-jenkins/341653)

<div class="topic-metadata">

**Author:** [@Mangesh\_Mathe](https://discuss.elastic.co/u/Mangesh_Mathe)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 9:22am UTC](https://discuss.elastic.co/t/importing-ndjson-file-of-kibana-dashboards-from-dev-kibana-to-prod-kibana-using-jenkins/341653 "2023-08-25T09:22:29Z")

</div>

Hello Elastic Team, Elastic and Kibana version : v 8.4.2 configured on: Azure elastic cloud How can we import ndjson file of kibana dashboards from DEV kibana to Prod Kibana using jenkins? Our requirement is to integ…

---

## [Adding Custom headers to Kibana Dashboard Pdf Report](https://discuss.elastic.co/t/adding-custom-headers-to-kibana-dashboard-pdf-report/341464)

<div class="topic-metadata">

**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 9:18am UTC](https://discuss.elastic.co/t/adding-custom-headers-to-kibana-dashboard-pdf-report/341464 "2023-08-25T09:18:49Z")

</div>

Hi , I'm using Kibana 7.10 version in one of my old servers. I'm downloading a pdf report of the dashboard under "Reporting" Section. But I need to customize the Dashboard pdf header. Currently it shows blank. Is …

---

## [Rally op\_metrics throughput is null](https://discuss.elastic.co/t/rally-op-metrics-throughput-is-null/341667)

<div class="topic-metadata">

**Author:** [@hyt](https://discuss.elastic.co/u/hyt)\
**Replies:** 0\
**Last updated:** [August 25, 2023, 8:48am UTC](https://discuss.elastic.co/t/rally-op-metrics-throughput-is-null/341667 "2023-08-25T08:48:44Z")

</div>

es: 7.17.9 rally: 2.6.0 and 2.8.0 python: 3.8 cmd: esrally race --track=http\_logs --target-hosts=172.20.236.173:9200 --pipeline=benchmark-only --kill-running-processes --track-params=rally\_params.json --offline trac…

---

## [Old application server with elastic apm java agent](https://discuss.elastic.co/t/old-application-server-with-elastic-apm-java-agent/341598)

<div class="topic-metadata">

**Author:** [@miguel.longo](https://discuss.elastic.co/u/miguel.longo)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 8:16am UTC](https://discuss.elastic.co/t/old-application-server-with-elastic-apm-java-agent/341598 "2023-08-25T08:16:08Z")

</div>

Kibana version: 8.6.2 Elasticsearch version: 8.6.2 APM Server version: 8.6.2 APM Agent language and version: Java 1.42.0 Hi folks! Unfortunately, I need to monitoring an old legacy application. This application run…

---

## [Elasticsearch being open source](https://discuss.elastic.co/t/elasticsearch-being-open-source/341632)

<div class="topic-metadata">

**Author:** [@JasonGoldman](https://discuss.elastic.co/u/JasonGoldman)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 7:56am UTC](https://discuss.elastic.co/t/elasticsearch-being-open-source/341632 "2023-08-25T07:56:31Z")

</div>

The GitHub repository of Elasticsearch and Elastic's website should not be afraid to call Elasticsearch "open source". The upcoming release of the Open Source Definition (v1.11) will acknowledge that Server Side Public L…

---

## [Comparing disk usage on ES with different configurations](https://discuss.elastic.co/t/comparing-disk-usage-on-es-with-different-configurations/341655)

<div class="topic-metadata">

**Author:** [@hjazz6](https://discuss.elastic.co/u/hjazz6)\
**Replies:** 0\
**Last updated:** [August 25, 2023, 7:15am UTC](https://discuss.elastic.co/t/comparing-disk-usage-on-es-with-different-configurations/341655 "2023-08-25T07:15:30Z")

</div>

Hi, I'm trying to optimize the disk usage on my Elasticsearch (version 8.8), and I want to see how much disk space was used (saved) after configuring different things, e.g. dynamic vs static mapping, default compression…

---

## [How to integrate Elasticsearch (8.x) with Nest.js](https://discuss.elastic.co/t/how-to-integrate-elasticsearch-8-x-with-nest-js/341166)

<div class="topic-metadata">

**Author:** [@inkweon7269](https://discuss.elastic.co/u/inkweon7269)\
**Replies:** 3\
**Last updated:** [August 25, 2023, 6:09am UTC](https://discuss.elastic.co/t/how-to-integrate-elasticsearch-8-x-with-nest-js/341166 "2023-08-25T06:09:16Z")

</div>

I have a question about connecting Elasticsearch with Nest.js. When I make an API call to Elasticsearch, it works fine. In Nest.js, I've written the code as follows. search.module.ts import { Module } from '@nestj…

---

## [Login to kibana and access it from my website](https://discuss.elastic.co/t/login-to-kibana-and-access-it-from-my-website/341639)

<div class="topic-metadata">

**Author:** [@Neelam\_Zanvar](https://discuss.elastic.co/u/Neelam_Zanvar)\
**Replies:** 0\
**Last updated:** [August 25, 2023, 5:58am UTC](https://discuss.elastic.co/t/login-to-kibana-and-access-it-from-my-website/341639 "2023-08-25T05:58:30Z")

</div>

Hi i am trying to embed the kibana url in zabbix dashboard url widget. when i put in the kibana url, instead of giving login page it gives a blank page. Is there a way to do this?

---

## [Logstash 8.6 add a field "log.file.path"](https://discuss.elastic.co/t/logstash-8-6-add-a-field-log-file-path/341597)

<div class="topic-metadata">

**Author:** [@RobertC1](https://discuss.elastic.co/u/RobertC1)\
**Replies:** 3\
**Last updated:** [August 25, 2023, 3:33am UTC](https://discuss.elastic.co/t/logstash-8-6-add-a-field-log-file-path/341597 "2023-08-25T03:33:38Z")

</div>

Hi there I use .conf file to ingest data in my index. With the version 8.6 is added the field "log.file.path." I tried with mutate { remove\_field =\> \[ "message", "@version","host","log.file.path" \] } without suceed. …

---

## [Accurate decryption logstash data in Javascript](https://discuss.elastic.co/t/accurate-decryption-logstash-data-in-javascript/341538)

<div class="topic-metadata">

**Author:** [@Nik\_Ameer](https://discuss.elastic.co/u/Nik_Ameer)\
**Replies:** 2\
**Last updated:** [August 25, 2023, 3:26am UTC](https://discuss.elastic.co/t/accurate-decryption-logstash-data-in-javascript/341538 "2023-08-25T03:26:16Z")

</div>

I used logstash to encrypt my data using the cipher filter. My logstash.conf file are like so cipher { algorithm =\> "aes-256-cbc" cipher\_padding =\> 1 mode =\> "encrypt" so…

---

## [Does pre-filtered approximate kNN still need entire data in memory?](https://discuss.elastic.co/t/does-pre-filtered-approximate-knn-still-need-entire-data-in-memory/341636)

<div class="topic-metadata">

**Author:** [@veesahni](https://discuss.elastic.co/u/veesahni)\
**Replies:** 0\
**Last updated:** [August 25, 2023, 2:35am UTC](https://discuss.elastic.co/t/does-pre-filtered-approximate-knn-still-need-entire-data-in-memory/341636 "2023-08-25T02:35:04Z")

</div>

This article on tuning approximate kNN states "You should ensure that data nodes have at least enough RAM to hold the vector data and index structures". Does this still apply when doing filtered kNN search? To be clear…

---

## [Kibana stumbling over a colon in APM Service Names](https://discuss.elastic.co/t/kibana-stumbling-over-a-colon-in-apm-service-names/341618)

<div class="topic-metadata">

**Author:** [@johngregg](https://discuss.elastic.co/u/johngregg)\
**Replies:** 1\
**Last updated:** [August 25, 2023, 12:20am UTC](https://discuss.elastic.co/t/kibana-stumbling-over-a-colon-in-apm-service-names/341618 "2023-08-25T00:20:29Z")

</div>

We thought it would be a good idea to have a colon in our service node names, like abc:def. However Kibana doubly escapes the colon. The page listing our services has the correct link. The colon is escaped as %3A. Na…

---

## [Filebeat system module does not send process name](https://discuss.elastic.co/t/filebeat-system-module-does-not-send-process-name/341423)

<div class="topic-metadata">

**Author:** [@Cruz](https://discuss.elastic.co/u/Cruz)\
**Replies:** 4\
**Last updated:** [August 24, 2023, 10:25pm UTC](https://discuss.elastic.co/t/filebeat-system-module-does-not-send-process-name/341423 "2023-08-24T22:25:00Z")

</div>

Does anyone encounter this? There is no data in field: process name

---

## [Implement Multi-tenancy using an Index per tenant or 10 index per tenant which is better approach](https://discuss.elastic.co/t/implement-multi-tenancy-using-an-index-per-tenant-or-10-index-per-tenant-which-is-better-approach/341610)

<div class="topic-metadata">

**Author:** [@HARSHAL\_CHAUDHARI](https://discuss.elastic.co/u/HARSHAL_CHAUDHARI)\
**Replies:** 1\
**Last updated:** [August 24, 2023, 9:11pm UTC](https://discuss.elastic.co/t/implement-multi-tenancy-using-an-index-per-tenant-or-10-index-per-tenant-which-is-better-approach/341610 "2023-08-24T21:11:22Z")

</div>

Implement Multi-tenancy using an Index per tenant or 10 indexes per tenant which is a better approach, by considering Security, Scalability, Cost-effectiveness, and Complexity.

---

## [Using ELSER for multiple fields](https://discuss.elastic.co/t/using-elser-for-multiple-fields/341347)

<div class="topic-metadata">

**Author:** [@Rottonscope](https://discuss.elastic.co/u/Rottonscope)\
**Replies:** 1\
**Last updated:** [August 24, 2023, 7:44pm UTC](https://discuss.elastic.co/t/using-elser-for-multiple-fields/341347 "2023-08-24T19:44:16Z")

</div>

Hello! I've just begun exploring ELSER and I'm interesting in knowing if there is any guidance out there for scenarios whereby I want to run inference on multiple fields, e.g. Title and also Description. The documentati…

---

## [Create an elasticsearch based engine via API](https://discuss.elastic.co/t/create-an-elasticsearch-based-engine-via-api/341519)

<div class="topic-metadata">

**Author:** [@franmako](https://discuss.elastic.co/u/franmako)\
**Replies:** 1\
**Last updated:** [August 24, 2023, 7:43pm UTC](https://discuss.elastic.co/t/create-an-elasticsearch-based-engine-via-api/341519 "2023-08-24T19:43:43Z")

</div>

Hello, I am trying to create an Elasticsearch based app search engine via the API, but I keep getting the following error: "Type is not included in the list; valid options are meta and default". Here's my current reque…

---

## [Multi-Tenant - Shard and Index strategy / Optimizing Elasticsearch configuration?](https://discuss.elastic.co/t/multi-tenant-shard-and-index-strategy-optimizing-elasticsearch-configuration/341605)

<div class="topic-metadata">

**Author:** [@HARSHAL\_CHAUDHARI](https://discuss.elastic.co/u/HARSHAL_CHAUDHARI)\
**Replies:** 3\
**Last updated:** [August 24, 2023, 7:40pm UTC](https://discuss.elastic.co/t/multi-tenant-shard-and-index-strategy-optimizing-elasticsearch-configuration/341605 "2023-08-24T19:40:30Z")

</div>

Hi Team, Could you please suggest the Elasticsearch configuration? (for scale and performance) My use case is below I have 1000 - 2000 thousands of customers - each customer has a 100-200 index, How data nodes can b…

---

## [.NET: Using NEST 7.x high-level client against Elasticsearch 6.x:](https://discuss.elastic.co/t/net-using-nest-7-x-high-level-client-against-elasticsearch-6-x/340768)

<div class="topic-metadata">

**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\
**Replies:** 6\
**Last updated:** [August 24, 2023, 7:12pm UTC](https://discuss.elastic.co/t/net-using-nest-7-x-high-level-client-against-elasticsearch-6-x/340768 "2023-08-24T19:12:08Z")

</div>

Continuing the discussion from .NET: Using newer NEST high-level client against previous version of Elasticsearch: @stephenb we've gotten to point of trying this out now. We've seen that using NEST 7.x against an ES 6.…

---

## [Availavility reports](https://discuss.elastic.co/t/availavility-reports/340659)

<div class="topic-metadata">

**Author:** [@zenkovac](https://discuss.elastic.co/u/zenkovac)\
**Replies:** 4\
**Last updated:** [August 24, 2023, 7:03pm UTC](https://discuss.elastic.co/t/availavility-reports/340659 "2023-08-24T19:03:30Z")

</div>

hi, im looking for a way to have an availability report with maintenance windows exluded from the calculation. I have an index with availavility events that have basic status of 0 or 1, i can easily calculate the percen…

---

## [Pre-filter KNN vector search](https://discuss.elastic.co/t/pre-filter-knn-vector-search/341585)

<div class="topic-metadata">

**Author:** [@veesahni](https://discuss.elastic.co/u/veesahni)\
**Replies:** 1\
**Last updated:** [August 24, 2023, 7:01pm UTC](https://discuss.elastic.co/t/pre-filter-knn-vector-search/341585 "2023-08-24T19:01:59Z")

</div>

I'm trying to understand how to best implement a pre-filtered KNN vector search. To be clear: I'd like to pre-filter the total number of docs down to a smaller set, and then run a vector search that leverages a vector in…

---

## [How do drop logs from being forwarded? My drop rule doesn't seem to be working](https://discuss.elastic.co/t/how-do-drop-logs-from-being-forwarded-my-drop-rule-doesnt-seem-to-be-working/341520)

<div class="topic-metadata">

**Author:** [@feo13](https://discuss.elastic.co/u/feo13)\
**Replies:** 4\
**Last updated:** [August 24, 2023, 6:48pm UTC](https://discuss.elastic.co/t/how-do-drop-logs-from-being-forwarded-my-drop-rule-doesnt-seem-to-be-working/341520 "2023-08-24T18:48:44Z")

</div>

I'm ingesting AWS WAF logs and would like to drop the 'ALLOW' logs. I have the following filter in place but it doesn't seem to be working: filter { if "\\"action\\":\\"ALLOW\\"" in \[message\] { drop {} } if \[ty…

---

## [Help with file name to date logstash grok](https://discuss.elastic.co/t/help-with-file-name-to-date-logstash-grok/341592)

<div class="topic-metadata">

**Author:** [@ethranes](https://discuss.elastic.co/u/ethranes)\
**Replies:** 2\
**Last updated:** [August 24, 2023, 5:07pm UTC](https://discuss.elastic.co/t/help-with-file-name-to-date-logstash-grok/341592 "2023-08-24T17:07:15Z")

</div>

Hi, the date isn't included in my log files. But the filename itself has the date. So I'm trying to extract the year month and day from the filename and then put that into a field. But logstash can't parse my filename, I…

---

## [What is the impact of aggregated queries on performance](https://discuss.elastic.co/t/what-is-the-impact-of-aggregated-queries-on-performance/341525)

<div class="topic-metadata">

**Author:** [@fangyan](https://discuss.elastic.co/u/fangyan)\
**Replies:** 3\
**Last updated:** [August 24, 2023, 4:59pm UTC](https://discuss.elastic.co/t/what-is-the-impact-of-aggregated-queries-on-performance/341525 "2023-08-24T16:59:46Z")

</div>

What is the impact of aggregated queries on performance, with a data volume of 300000, requiring 2-3 layers of aggregation :grinning:

---

## [\[WATCHER\] Is it possible put in the payload the ack state?](https://discuss.elastic.co/t/watcher-is-it-possible-put-in-the-payload-the-ack-state/341594)

<div class="topic-metadata">

**Author:** [@Rossana](https://discuss.elastic.co/u/Rossana)\
**Replies:** 0\
**Last updated:** [August 24, 2023, 4:58pm UTC](https://discuss.elastic.co/t/watcher-is-it-possible-put-in-the-payload-the-ack-state/341594 "2023-08-24T16:58:30Z")

</div>

Hi, I want to know if it's possible take the acknowledge state of a watcher for an action. This is my scenario: I have a watcher and the actions of it are index and webhook. But I want to include the ack state in the …

---

## [Compare 2 indices and find missing documents](https://discuss.elastic.co/t/compare-2-indices-and-find-missing-documents/341434)

<div class="topic-metadata">

**Author:** [@arks1](https://discuss.elastic.co/u/arks1)\
**Replies:** 3\
**Last updated:** [August 24, 2023, 4:57pm UTC](https://discuss.elastic.co/t/compare-2-indices-and-find-missing-documents/341434 "2023-08-24T16:57:29Z")

</div>

I have 2 indices, index\_a and index\_b. The 2 indices have documents with the almost the exact same template. index\_b has some extra fields which was introduced as part of a new feature, but it also has all the fields al…

---

## [Retry on conflict](https://discuss.elastic.co/t/retry-on-conflict/341591)

<div class="topic-metadata">

**Author:** [@Vamsi\_krishna\_Ramaya](https://discuss.elastic.co/u/Vamsi_krishna_Ramaya)\
**Replies:** 0\
**Last updated:** [August 24, 2023, 4:02pm UTC](https://discuss.elastic.co/t/retry-on-conflict/341591 "2023-08-24T16:02:20Z")

</div>

Hi I am working on a node ja project with elasticsearch so i am trying to create index with out replica even though i added that number\_of\_replicas 0 replica is generating and that gives me problem that document is geti…

---

## [Two nested Grok patterns not working](https://discuss.elastic.co/t/two-nested-grok-patterns-not-working/341533)

<div class="topic-metadata">

**Author:** [@Priyaansh\_Dwivedi](https://discuss.elastic.co/u/Priyaansh_Dwivedi)\
**Replies:** 3\
**Last updated:** [August 24, 2023, 3:54pm UTC](https://discuss.elastic.co/t/two-nested-grok-patterns-not-working/341533 "2023-08-24T15:54:46Z")

</div>

Hey everyone, I'm new to using Logstash and Elasticsearch. I've been working on collecting logs through Filebeat and then using Logstash for parsing and data cleaning. I have two Grok patterns in place. The first one ex…

---

## [Structured Data set in Elastic](https://discuss.elastic.co/t/structured-data-set-in-elastic/341379)

<div class="topic-metadata">

**Author:** [@ishani.sengupta](https://discuss.elastic.co/u/ishani.sengupta)\
**Replies:** 2\
**Last updated:** [August 24, 2023, 3:44pm UTC](https://discuss.elastic.co/t/structured-data-set-in-elastic/341379 "2023-08-24T15:44:26Z")

</div>

Working on Analytics using ELK stack, the data being used is a structure data where we are facing issue with migration and correlation. Can elastic stack handle structure data within an index or any other ways to handle…

---

## [What is the proper way on migrating you elastic-stack environment?](https://discuss.elastic.co/t/what-is-the-proper-way-on-migrating-you-elastic-stack-environment/341517)

<div class="topic-metadata">

**Author:** [@jreyes25](https://discuss.elastic.co/u/jreyes25)\
**Replies:** 1\
**Last updated:** [August 24, 2023, 3:40pm UTC](https://discuss.elastic.co/t/what-is-the-proper-way-on-migrating-you-elastic-stack-environment/341517 "2023-08-24T15:40:43Z")

</div>

Hello, So I have the Elasticsearch, Kibana, Logstash, Fleet-server, and the Package-registry all running on docker containers. I'm still testing things out, but I wanted to know what the proper way to migrate my docker …

[Previous page](https://discuss.elastic.co/latest.md?page=560)

[Next page](https://discuss.elastic.co/latest.md?page=562)
