# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=181

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 182

---

## [How to increase the thread pool size](https://discuss.elastic.co/t/how-to-increase-the-thread-pool-size/365433)

<div class="topic-metadata">

**Author:** [@Rakhshunda\_Noorein\_J](https://discuss.elastic.co/u/Rakhshunda_Noorein_J)\
**Replies:** 7\
**Last updated:** [August 23, 2024, 10:37am UTC](https://discuss.elastic.co/t/how-to-increase-the-thread-pool-size/365433 "2024-08-23T10:37:46Z")

</div>

Hey, My elasticsearch cluster has 1 node with 3 processors, 32gb ram memory, 24 index with 1 shard each. Thread pool queue size = 1000 how many concurrent search requests my cluster can handle? How can I increase the…

---

## [Renaming of auto-generated field names (created by Postgres connector)](https://discuss.elastic.co/t/renaming-of-auto-generated-field-names-created-by-postgres-connector/364612)

<div class="topic-metadata">

**Author:** [@andrej.peplinski](https://discuss.elastic.co/u/andrej.peplinski)\
**Replies:** 3\
**Last updated:** [August 23, 2024, 9:54am UTC](https://discuss.elastic.co/t/renaming-of-auto-generated-field-names-created-by-postgres-connector/364612 "2024-08-23T09:54:28Z")

</div>

Dear Elastic team, I am currently using an Elasticsearch docker cluster with a Postgres connector and Kibana using a basic license. I am able to synchronize my data but find the default field names that are being genera…

---

## [Question about Kibana vulnerability (CVE-2024-37287)](https://discuss.elastic.co/t/question-about-kibana-vulnerability-cve-2024-37287/365448)

<div class="topic-metadata">

**Author:** [@YUUTA.INOUE-JPN](https://discuss.elastic.co/u/YUUTA.INOUE-JPN)\
**Replies:** 0\
**Last updated:** [August 23, 2024, 9:38am UTC](https://discuss.elastic.co/t/question-about-kibana-vulnerability-cve-2024-37287/365448 "2024-08-23T09:38:44Z")

</div>

Hello from Japan I'm concerned about Elastic's security announcement. Specifically, it's about the Kibana vulnerability (CVE-2024-37287). I created an elasticsearch.serviceAccountToken for Kibana using the command bel…

---

## [Overwrite index when the new input file is discovered](https://discuss.elastic.co/t/overwrite-index-when-the-new-input-file-is-discovered/365438)

<div class="topic-metadata">

**Author:** [@chun](https://discuss.elastic.co/u/chun)\
**Replies:** 1\
**Last updated:** [August 23, 2024, 8:29am UTC](https://discuss.elastic.co/t/overwrite-index-when-the-new-input-file-is-discovered/365438 "2024-08-23T08:29:41Z")

</div>

I have a logstash configuration below reading a large jason file dumped by seperate python code. The ask is to refresh the index with the new data on daily basis. How to clear the old data from index before reading the n…

---

## [Shard balance is by default is confusing, can someone pls explain?](https://discuss.elastic.co/t/shard-balance-is-by-default-is-confusing-can-someone-pls-explain/364048)

<div class="topic-metadata">

**Author:** [@mannoj87](https://discuss.elastic.co/u/mannoj87)\
**Replies:** 8\
**Last updated:** [August 23, 2024, 6:54am UTC](https://discuss.elastic.co/t/shard-balance-is-by-default-is-confusing-can-someone-pls-explain/364048 "2024-08-23T06:54:01Z")

</div>

Below is the default values for balance. ES 8.9. "disk\_usage": "2.0E-11", "index": "0.55", "threshold": "1.0", "shard": "0.45", "write\_load": "10.0" Fyi : In above default values…

---

## [Authentication Failure 400 Logstash - Salesforce input plugin](https://discuss.elastic.co/t/authentication-failure-400-logstash-salesforce-input-plugin/365426)

<div class="topic-metadata">

**Author:** [@mosaadshaikh1998](https://discuss.elastic.co/u/mosaadshaikh1998)\
**Replies:** 0\
**Last updated:** [August 23, 2024, 6:34am UTC](https://discuss.elastic.co/t/authentication-failure-400-logstash-salesforce-input-plugin/365426 "2024-08-23T06:34:20Z")

</div>

Hi @Samuele\_Lolli, @Badger, @leandrojmp, @carly.richmond I am trying to use the salesforce input plugin in one of the pipeline on my logstash server. However I am getting an error saying 'Authentication Failure 400'. L…

---

## [Keycloak OIDC authentication with basic license](https://discuss.elastic.co/t/keycloak-oidc-authentication-with-basic-license/362055)

<div class="topic-metadata">

**Author:** [@trwillis](https://discuss.elastic.co/u/trwillis)\
**Replies:** 8\
**Last updated:** [August 23, 2024, 6:24am UTC](https://discuss.elastic.co/t/keycloak-oidc-authentication-with-basic-license/362055 "2024-08-23T06:24:34Z")

</div>

Can I implement OIDC integration via Keycloak with the Elasticsearch basic license or do I need enterprise?

---

## [Metricbeat monitoring not showing up for elasticsearch, kibana, and logstash nodes](https://discuss.elastic.co/t/metricbeat-monitoring-not-showing-up-for-elasticsearch-kibana-and-logstash-nodes/365393)

<div class="topic-metadata">

**Author:** [@kus10522](https://discuss.elastic.co/u/kus10522)\
**Replies:** 1\
**Last updated:** [August 23, 2024, 5:05am UTC](https://discuss.elastic.co/t/metricbeat-monitoring-not-showing-up-for-elasticsearch-kibana-and-logstash-nodes/365393 "2024-08-23T05:05:22Z")

</div>

Hello, I am trying to connect three elasticsearch node, a kibana node, and a logstash node to monitor with metricbeat. I have installed metricbeat in all nodes, but the monitoring will still not show up in kibana. The s…

---

## [Issue with updation of record in latest Transform](https://discuss.elastic.co/t/issue-with-updation-of-record-in-latest-transform/365340)

<div class="topic-metadata">

**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\
**Replies:** 2\
**Last updated:** [August 23, 2024, 3:46am UTC](https://discuss.elastic.co/t/issue-with-updation-of-record-in-latest-transform/365340 "2024-08-23T03:46:51Z")

</div>

We are using Elasticsearch latest transforms to fetch latest records in our index based on sync time as ingest.time and sort as extractDatetime. The transformation involves fields like extractDatetime and ingest.time, w…

---

## [When creating indices and aliases in ES, user re\_test encounters errors, even though the user's index permissions are already set to all. How should this issue be handled? Thanks！](https://discuss.elastic.co/t/when-creating-indices-and-aliases-in-es-user-re-test-encounters-errors-even-though-the-users-index-permissions-are-already-set-to-all-how-should-this-issue-be-handled-thanks/365005)

<div class="topic-metadata">

**Author:** [@TYQ33](https://discuss.elastic.co/u/TYQ33)\
**Replies:** 2\
**Last updated:** [August 23, 2024, 2:35am UTC](https://discuss.elastic.co/t/when-creating-indices-and-aliases-in-es-user-re-test-encounters-errors-even-though-the-users-index-permissions-are-already-set-to-all-how-should-this-issue-be-handled-thanks/365005 "2024-08-23T02:35:44Z")

</div>

Failed to connect to backoff(elasticsearch(ES with IP:端口)): Connection marked as failed because the onConnect callback failed: failed to create alias: {"error":{"root\_cause":\[{"type":"security\_exception","reason":"action…

---

## [Filebeat how to not generate dashboards automatically](https://discuss.elastic.co/t/filebeat-how-to-not-generate-dashboards-automatically/365098)

<div class="topic-metadata">

**Author:** [@Tom\_N](https://discuss.elastic.co/u/Tom_N)\
**Replies:** 7\
**Last updated:** [August 23, 2024, 1:57am UTC](https://discuss.elastic.co/t/filebeat-how-to-not-generate-dashboards-automatically/365098 "2024-08-23T01:57:25Z")

</div>

I wanted to ask is there a configuration where I can disable Filebeat from automatically generating dashboards in Kibana? Most of the dashboards Filebeat generates are useless to me and it is a hassle to remove. In t…

---

## [Logstash has problem charset encoding non utf-8](https://discuss.elastic.co/t/logstash-has-problem-charset-encoding-non-utf-8/365418)

<div class="topic-metadata">

**Author:** [@sangwan1219](https://discuss.elastic.co/u/sangwan1219)\
**Replies:** 0\
**Last updated:** [August 22, 2024, 11:56pm UTC](https://discuss.elastic.co/t/logstash-has-problem-charset-encoding-non-utf-8/365418 "2024-08-22T23:56:59Z")

</div>

I use kafka - ELK stack for gathering logs. all the servers in our company use EUC-KR encoding. when the logstash input sets euc-kr and output stdout plain charset =\> "EUC-KR" (the logstash provides euc-kr in plain pl…

---

## [PutPipelineAsync conversion from vb.net to c#](https://discuss.elastic.co/t/putpipelineasync-conversion-from-vb-net-to-c/365411)

<div class="topic-metadata">

**Author:** [@kvickery](https://discuss.elastic.co/u/kvickery)\
**Replies:** 0\
**Last updated:** [August 22, 2024, 9:22pm UTC](https://discuss.elastic.co/t/putpipelineasync-conversion-from-vb-net-to-c/365411 "2024-08-22T21:22:05Z")

</div>

I am trying to convert some vb.net code for some old Elasticsearch over to C# with Elasticsearch 8. Simply converting to C# gives me the code below, but I am getting "cannot convert lambda expression to type field (or fi…

---

## [Need help with webhook alerts](https://discuss.elastic.co/t/need-help-with-webhook-alerts/365410)

<div class="topic-metadata">

**Author:** [@poqdavid](https://discuss.elastic.co/u/poqdavid)\
**Replies:** 0\
**Last updated:** [August 22, 2024, 9:03pm UTC](https://discuss.elastic.co/t/need-help-with-webhook-alerts/365410 "2024-08-22T21:03:45Z")

</div>

Hi, I have a small problem. When the alert status changes to “flapping,” it doesn’t send an update to the webhook, only indicating that it is flapping. I was wondering if it’s possible to enable an alert for the flappin…

---

## [Multi nodes cluster only finds one node](https://discuss.elastic.co/t/multi-nodes-cluster-only-finds-one-node/365403)

<div class="topic-metadata">

**Author:** [@rachelyang](https://discuss.elastic.co/u/rachelyang)\
**Replies:** 4\
**Last updated:** [August 22, 2024, 8:56pm UTC](https://discuss.elastic.co/t/multi-nodes-cluster-only-finds-one-node/365403 "2024-08-22T20:56:11Z")

</div>

I installed Elasticsearch version 8.15. I set up a cluster with two nodes. I have configured in elasticsearch.yml like this: discovery.seed\_hosts: \["cvnode1","cvnode2"\] But, when I checked cluster health, I got one nod…

---

## [Reference Different Log Than Alerting On](https://discuss.elastic.co/t/reference-different-log-than-alerting-on/364419)

<div class="topic-metadata">

**Author:** [@sfageol](https://discuss.elastic.co/u/sfageol)\
**Replies:** 2\
**Last updated:** [August 22, 2024, 8:52pm UTC](https://discuss.elastic.co/t/reference-different-log-than-alerting-on/364419 "2024-08-22T20:52:39Z")

</div>

I am setting up a "Rule". I send a request and that request might have 500 log lines. I have a "final failure" log line that I need to alert off of, but the failure reason is in a separate log line. Is it possible to dis…

---

## [Metricbeat nginx bug for non-https](https://discuss.elastic.co/t/metricbeat-nginx-bug-for-non-https/365408)

<div class="topic-metadata">

**Author:** [@tdanno](https://discuss.elastic.co/u/tdanno)\
**Replies:** 0\
**Last updated:** [August 22, 2024, 8:28pm UTC](https://discuss.elastic.co/t/metricbeat-nginx-bug-for-non-https/365408 "2024-08-22T20:28:08Z")

</div>

The elastic fleet integration for nginx has a metrics configuration that queries the stub status page, and requires the url. When you supply an http url, it will try to use it as an https url and error out. It ap…

---

## [Not a valid Logstash keystore java exception problem](https://discuss.elastic.co/t/not-a-valid-logstash-keystore-java-exception-problem/365362)

<div class="topic-metadata">

**Author:** [@Abdarrahmane](https://discuss.elastic.co/u/Abdarrahmane)\
**Replies:** 3\
**Last updated:** [August 22, 2024, 4:34pm UTC](https://discuss.elastic.co/t/not-a-valid-logstash-keystore-java-exception-problem/365362 "2024-08-22T16:34:53Z")

</div>

hello i encrypted the username and password of my elasticsearch and call them as variables in the pipeline.conf but I wasn't able to get it to work properly here is the guide I followed: Secrets keystore for secure s…

---

## [Logstash security best practices: keystore, monitoring, ssl\_verification\_mode](https://discuss.elastic.co/t/logstash-security-best-practices-keystore-monitoring-ssl-verification-mode/365166)

<div class="topic-metadata">

**Author:** [@Abdarrahmane](https://discuss.elastic.co/u/Abdarrahmane)\
**Replies:** 2\
**Last updated:** [August 22, 2024, 3:58pm UTC](https://discuss.elastic.co/t/logstash-security-best-practices-keystore-monitoring-ssl-verification-mode/365166 "2024-08-22T15:58:30Z")

</div>

hello ! can you guys please guide me to the best security practices to secure the communication between Logstash and elasticsearch (logstash configuration (logstash.yml) and its pipelines in the conf.d) here is my curr…

---

## [Logstash input plugin with domain-joined service account](https://discuss.elastic.co/t/logstash-input-plugin-with-domain-joined-service-account/365338)

<div class="topic-metadata">

**Author:** [@Rakesh\_Mukherjee](https://discuss.elastic.co/u/Rakesh_Mukherjee)\
**Replies:** 2\
**Last updated:** [August 22, 2024, 3:44pm UTC](https://discuss.elastic.co/t/logstash-input-plugin-with-domain-joined-service-account/365338 "2024-08-22T15:44:07Z")

</div>

I'm using Logstash to pull logs from MySQL Database server. In the Logstash configuration file, I'm using a domain-joined service account for the DB server, but I'm encountering an authentication error in the log message…

---

## [Create a piechart based on values](https://discuss.elastic.co/t/create-a-piechart-based-on-values/365368)

<div class="topic-metadata">

**Author:** [@javidr](https://discuss.elastic.co/u/javidr)\
**Replies:** 2\
**Last updated:** [August 22, 2024, 3:33pm UTC](https://discuss.elastic.co/t/create-a-piechart-based-on-values/365368 "2024-08-22T15:33:03Z")

</div>

Hi I have a document with the number of items in stock used and unused {total: 50, used: 38, unused: 12} How can i create a pie chart to display as the total, 50, and split it in used and unused? I have been able to …

---

## [ILM and determining the destination index without a lookup](https://discuss.elastic.co/t/ilm-and-determining-the-destination-index-without-a-lookup/365386)

<div class="topic-metadata">

**Author:** [@diegomansua](https://discuss.elastic.co/u/diegomansua)\
**Replies:** 2\
**Last updated:** [August 22, 2024, 1:55pm UTC](https://discuss.elastic.co/t/ilm-and-determining-the-destination-index-without-a-lookup/365386 "2024-08-22T13:55:53Z")

</div>

Hello, I'm using ILM to automatically rollover indices monthly. I have to bulk insert (or rather, upsert) a bunch of documents with pre-assigned ids, and I want to ensure that there won't be duplicates in different ind…

---

## [Remove escape characters from Drive](https://discuss.elastic.co/t/remove-escape-characters-from-drive/365378)

<div class="topic-metadata">

**Author:** [@A\_Mightiev](https://discuss.elastic.co/u/A_Mightiev)\
**Replies:** 1\
**Last updated:** [August 22, 2024, 12:55pm UTC](https://discuss.elastic.co/t/remove-escape-characters-from-drive/365378 "2024-08-22T12:55:52Z")

</div>

Hi, I'm monitoring some windows machines with metricbeat, the drives always have escape characters \\ that handling in logstash, and in kibana rules is a nightmare, is there a good way to remove them? preferably directly …

---

## [Having issues with brower navigation back to search page in NextJS](https://discuss.elastic.co/t/having-issues-with-brower-navigation-back-to-search-page-in-nextjs/365383)

<div class="topic-metadata">

**Author:** [@Justin\_Schoen](https://discuss.elastic.co/u/Justin_Schoen)\
**Replies:** 0\
**Last updated:** [August 22, 2024, 12:52pm UTC](https://discuss.elastic.co/t/having-issues-with-brower-navigation-back-to-search-page-in-nextjs/365383 "2024-08-22T12:52:23Z")

</div>

Background: We are using Elasticsearch We are using the search-ui package for react We are using Nextjs What's happening? We have a search page that's using the SearchProvider component to wrap all the filters, results…

---

## [Filebeat reads old lines as new every time Dnf writes to its log files](https://discuss.elastic.co/t/filebeat-reads-old-lines-as-new-every-time-dnf-writes-to-its-log-files/361406)

<div class="topic-metadata">

**Author:** [@Openstackuser2013](https://discuss.elastic.co/u/Openstackuser2013)\
**Replies:** 3\
**Last updated:** [August 22, 2024, 12:11pm UTC](https://discuss.elastic.co/t/filebeat-reads-old-lines-as-new-every-time-dnf-writes-to-its-log-files/361406 "2024-08-22T12:11:29Z")

</div>

I have Filebeat monitoring log files on several Linux servers. Recently I noticed that on all my Rocky Linux servers Filebeat reads all lines in files /var/log/dnf.\* as new every time the file is changed by Dnf. If I man…

---

## [Drilldown in Dashboard](https://discuss.elastic.co/t/drilldown-in-dashboard/365374)

<div class="topic-metadata">

**Author:** [@sintim](https://discuss.elastic.co/u/sintim)\
**Replies:** 3\
**Last updated:** [August 22, 2024, 11:41am UTC](https://discuss.elastic.co/t/drilldown-in-dashboard/365374 "2024-08-22T11:41:22Z")

</div>

Is there a way to add a drilldown to visualization on a dashboard to open another dashbaord. If yes, can i get a step by step approach to how that can be achieved.

---

## [Duplicate documents](https://discuss.elastic.co/t/duplicate-documents/365354)

<div class="topic-metadata">

**Author:** [@Anjali\_Singh](https://discuss.elastic.co/u/Anjali_Singh)\
**Replies:** 3\
**Last updated:** [August 22, 2024, 11:02am UTC](https://discuss.elastic.co/t/duplicate-documents/365354 "2024-08-22T11:02:00Z")

</div>

Hi, May i know how can we avoid duplication of documents in kibana

---

## [Cat API Info required](https://discuss.elastic.co/t/cat-api-info-required/365334)

<div class="topic-metadata">

**Author:** [@gchakkalakkal](https://discuss.elastic.co/u/gchakkalakkal)\
**Replies:** 4\
**Last updated:** [August 22, 2024, 10:44am UTC](https://discuss.elastic.co/t/cat-api-info-required/365334 "2024-08-22T10:44:22Z")

</div>

Hi Team, We wanted to know if all \_cat API are always served from master node? Even if it is fired from data node will it hit master node for getting response. e.g \_cat/indices?v

---

## [Upgrading elastic search & kibana from 6.6.1 to 7.x or 8.x](https://discuss.elastic.co/t/upgrading-elastic-search-kibana-from-6-6-1-to-7-x-or-8-x/365100)

<div class="topic-metadata">

**Author:** [@Mariajosephina](https://discuss.elastic.co/u/Mariajosephina)\
**Replies:** 10\
**Last updated:** [August 22, 2024, 10:37am UTC](https://discuss.elastic.co/t/upgrading-elastic-search-kibana-from-6-6-1-to-7-x-or-8-x/365100 "2024-08-22T10:37:16Z")

</div>

Hi @all This is regarding a query on upgrading Elasticsearch & kibana. The current version of Elastic search & Kibana in our organization is 6.6.1 used to storing RPA logs. I am planning to upgrade to 7.x or 8.x Cou…

---

## [Suddenly Filebeat agent is not sending the logs to Elastic](https://discuss.elastic.co/t/suddenly-filebeat-agent-is-not-sending-the-logs-to-elastic/364381)

<div class="topic-metadata">

**Author:** [@madhavsankarg](https://discuss.elastic.co/u/madhavsankarg)\
**Replies:** 6\
**Last updated:** [August 22, 2024, 10:19am UTC](https://discuss.elastic.co/t/suddenly-filebeat-agent-is-not-sending-the-logs-to-elastic/364381 "2024-08-22T10:19:08Z")

</div>

After a Vulnerability remediation update to a DockerHost server, the filebeat agent stopped pushing the logs. Other beats are pushing the logs and is received by the elastic. Error: ERROR \[registrar\] registrar/re…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=180)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=182)
