# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=223

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 224

---

## [Delay assigning new replica shards](https://discuss.elastic.co/t/delay-assigning-new-replica-shards/361199)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 0\
**Last updated:** [June 10, 2024, 8:59pm UTC](https://discuss.elastic.co/t/delay-assigning-new-replica-shards/361199 "2024-06-10T20:59:52Z")

</div>

Whenever I tweak the following settings. PUT \_cluster/settings { "persistent": { "cluster.routing.allocation.balance.threshold": null, "cluster.routing.allocation.cluster\_concurrent\_rebalance": null, "clus…

---

## [Filebeat processors](https://discuss.elastic.co/t/filebeat-processors/361198)

<div class="topic-metadata">

**Author:** [@Ajay\_Bhatnagar](https://discuss.elastic.co/u/Ajay_Bhatnagar)\
**Replies:** 0\
**Last updated:** [June 10, 2024, 8:59pm UTC](https://discuss.elastic.co/t/filebeat-processors/361198 "2024-06-10T20:59:23Z")

</div>

I am using S3 SQS notifications to fetch logs from S3 bucket to ingest pipeline with filebeat 8.13.4. Logs are being fetched and index created on cluster. Pipeline is cloned using filebeat s3 access ingest pipeline and n…

---

## [Logstash Error - Oracle"" was unexpected at this time](https://discuss.elastic.co/t/logstash-error-oracle-was-unexpected-at-this-time/361185)

<div class="topic-metadata">

**Author:** [@asandhu](https://discuss.elastic.co/u/asandhu)\
**Replies:** 3\
**Last updated:** [June 10, 2024, 7:36pm UTC](https://discuss.elastic.co/t/logstash-error-oracle-was-unexpected-at-this-time/361185 "2024-06-10T19:36:51Z")

</div>

Hello All I am trying to set up Logstash on my Local to connect to a hosted Elastic instance. Having followed the steps to set up Logstash - I get the following error when trying to run it. I thought I had multiple v…

---

## [Why match\_bool\_prefix with a query with trailing space will generate different results](https://discuss.elastic.co/t/why-match-bool-prefix-with-a-query-with-trailing-space-will-generate-different-results/360673)

<div class="topic-metadata">

**Author:** [@bigpotato](https://discuss.elastic.co/u/bigpotato)\
**Replies:** 1\
**Last updated:** [June 10, 2024, 5:59pm UTC](https://discuss.elastic.co/t/why-match-bool-prefix-with-a-query-with-trailing-space-will-generate-different-results/360673 "2024-06-10T17:59:57Z")

</div>

The index mapping: "orgName": { "type": "text", "fields": { "keyword": { "type": "keyword", "ignore…

---

## [Other Alerting Methods?](https://discuss.elastic.co/t/other-alerting-methods/361063)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 4\
**Last updated:** [June 10, 2024, 5:41pm UTC](https://discuss.elastic.co/t/other-alerting-methods/361063 "2024-06-10T17:41:27Z")

</div>

Hello, do others use other alerting methods for Elastic? I realized that the alerting system in Elastic isn't meant to pass raw data. I want to alert to notify but provide additional context/data not provided in the de…

---

## [Get synthetic monitor data: how?](https://discuss.elastic.co/t/get-synthetic-monitor-data-how/361082)

<div class="topic-metadata">

**Author:** [@NominaSumpta](https://discuss.elastic.co/u/NominaSumpta)\
**Replies:** 6\
**Last updated:** [June 10, 2024, 5:03pm UTC](https://discuss.elastic.co/t/get-synthetic-monitor-data-how/361082 "2024-06-10T17:03:17Z")

</div>

Hi, How do I get synthetic monitor data shown in Kibana from an API? Kibana provides cool monitor visualisations and data, such as 'Last 10 Test Runs' (table), 'Duration trends' (graphs), etc. There doesn't seem to…

---

## [Bulk index documents only if they don't already exist without using an id](https://discuss.elastic.co/t/bulk-index-documents-only-if-they-dont-already-exist-without-using-an-id/361166)

<div class="topic-metadata">

**Author:** [@catalin8](https://discuss.elastic.co/u/catalin8)\
**Replies:** 2\
**Last updated:** [June 10, 2024, 3:14pm UTC](https://discuss.elastic.co/t/bulk-index-documents-only-if-they-dont-already-exist-without-using-an-id/361166 "2024-06-10T15:14:38Z")

</div>

I'm looking to index a list of documents using the bulk API. I want to add only the ones that are not already indexed, and I don't use IDs. Is this possible?

---

## [Logstash java codec running error](https://discuss.elastic.co/t/logstash-java-codec-running-error/361160)

<div class="topic-metadata">

**Author:** [@xudl](https://discuss.elastic.co/u/xudl)\
**Replies:** 0\
**Last updated:** [June 10, 2024, 2:22pm UTC](https://discuss.elastic.co/t/logstash-java-codec-running-error/361160 "2024-06-10T14:22:55Z")

</div>

hi：i run logstash-codec-java\_codec\_example , have some error: Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :exception=\>"Java::JavaLang::IllegalStateException", :message=\>"Unable…

---

## [Improve Search Performance](https://discuss.elastic.co/t/improve-search-performance/359306)

<div class="topic-metadata">

**Author:** [@sravan\_kaheti](https://discuss.elastic.co/u/sravan_kaheti)\
**Replies:** 19\
**Last updated:** [June 10, 2024, 2:17pm UTC](https://discuss.elastic.co/t/improve-search-performance/359306 "2024-06-10T14:17:26Z")

</div>

Hi Team , I ingested huge amount of data (3-4 B records)with bellow index configuration Index - Data Stream Primaries - 5 replicas - 0 Master and Master eligible node - 3 Voting only node - 1 coordinator node - 1 …

---

## [Error parsing json in Logstash](https://discuss.elastic.co/t/error-parsing-json-in-logstash/361134)

<div class="topic-metadata">

**Author:** [@optimuspur3](https://discuss.elastic.co/u/optimuspur3)\
**Replies:** 2\
**Last updated:** [June 10, 2024, 2:06pm UTC](https://discuss.elastic.co/t/error-parsing-json-in-logstash/361134 "2024-06-10T14:06:44Z")

</div>

So I have been trying to setup cowrie to link it with my ELK but apparently I have been getting the error parsing json in my configuration files. The setup for my ELK is from this link. Error when it shows on my logst…

---

## [Elasticsearch Search Query Load Testing using Jmeter](https://discuss.elastic.co/t/elasticsearch-search-query-load-testing-using-jmeter/361156)

<div class="topic-metadata">

**Author:** [@kishorkumar](https://discuss.elastic.co/u/kishorkumar)\
**Replies:** 0\
**Last updated:** [June 10, 2024, 2:05pm UTC](https://discuss.elastic.co/t/elasticsearch-search-query-load-testing-using-jmeter/361156 "2024-06-10T14:05:11Z")

</div>

Hello i have been trying to test the load of my clustor of 1 node using JMeter. i have data of millions records, i have created csv which contians the 6000 ids. i have following configs: Thread Group: Thread Group …

---

## [Heartbeat Deployment For Uptime](https://discuss.elastic.co/t/heartbeat-deployment-for-uptime/361149)

<div class="topic-metadata">

**Author:** [@Yogesh\_AS](https://discuss.elastic.co/u/Yogesh_AS)\
**Replies:** 0\
**Last updated:** [June 10, 2024, 1:06pm UTC](https://discuss.elastic.co/t/heartbeat-deployment-for-uptime/361149 "2024-06-10T13:06:04Z")

</div>

Hi, we've installed the Elastic Agent in our work environment. We're looking to perform port checks and monitor port uptime. Can I configure this functionality with the existing Elastic Agent that we have already deploye…

---

## [How to boost source engine insid ethe meta engine](https://discuss.elastic.co/t/how-to-boost-source-engine-insid-ethe-meta-engine/360921)

<div class="topic-metadata">

**Author:** [@Ashok\_Vadya](https://discuss.elastic.co/u/Ashok_Vadya)\
**Replies:** 3\
**Last updated:** [June 10, 2024, 11:06am UTC](https://discuss.elastic.co/t/how-to-boost-source-engine-insid-ethe-meta-engine/360921 "2024-06-10T11:06:56Z")

</div>

Conside a meta engine having m and having two source engine a and engine b. and order of these engines are based on created date. when search for a document always document from engine a get highest score and always co…

---

## [Kibana container is not ready yet](https://discuss.elastic.co/t/kibana-container-is-not-ready-yet/360860)

<div class="topic-metadata">

**Author:** [@Hugo\_Perez\_Fernandez](https://discuss.elastic.co/u/Hugo_Perez_Fernandez)\
**Replies:** 5\
**Last updated:** [June 10, 2024, 10:47am UTC](https://discuss.elastic.co/t/kibana-container-is-not-ready-yet/360860 "2024-06-10T10:47:10Z")

</div>

Hi all, After configuring a cluster using docker compose, on multiple hosts, and that it worked correctly, allowing us to create indexes correctly, we have stopped the containers and restarted them to check that everyth…

---

## [NEST to ElasticSearch.net migration issue with DeleteMany](https://discuss.elastic.co/t/nest-to-elasticsearch-net-migration-issue-with-deletemany/361096)

<div class="topic-metadata">

**Author:** [@AMElastic](https://discuss.elastic.co/u/AMElastic)\
**Replies:** 0\
**Last updated:** [June 9, 2024, 10:18am UTC](https://discuss.elastic.co/t/nest-to-elasticsearch-net-migration-issue-with-deletemany/361096 "2024-06-09T10:18:56Z")

</div>

I have an issue while migrating the code from NEST to ES client 8.14. I have a list of ids, that I would want to delete. I tried the following, but it doesn't work as it doesn't accept ids as a parameter for the Delete…

---

## [Use result of an aggregation query to enrich doc](https://discuss.elastic.co/t/use-result-of-an-aggregation-query-to-enrich-doc/361130)

<div class="topic-metadata">

**Author:** [@StefanC](https://discuss.elastic.co/u/StefanC)\
**Replies:** 1\
**Last updated:** [June 10, 2024, 9:26am UTC](https://discuss.elastic.co/t/use-result-of-an-aggregation-query-to-enrich-doc/361130 "2024-06-10T09:26:11Z")

</div>

Is its possible to execute an aggregation query on an index and use the results in one action to enrich the same index/documents with it. Assume i have serveral document with field region, sensor type sensor. I want to…

---

## [Drill downs still do not work 3 years later](https://discuss.elastic.co/t/drill-downs-still-do-not-work-3-years-later/361038)

<div class="topic-metadata">

**Author:** [@hughes](https://discuss.elastic.co/u/hughes)\
**Replies:** 1\
**Last updated:** [June 10, 2024, 8:55am UTC](https://discuss.elastic.co/t/drill-downs-still-do-not-work-3-years-later/361038 "2024-06-10T08:55:06Z")

</div>

Continuing the discussion from Dashboard Drilldowns do not work in Data Table (7.13.1): Hello, I wanted to point out that three years later drill downs still do not work on Data Tables. I've tried clicking the plus but…

---

## [Adding multiple ingest pipelines to an index](https://discuss.elastic.co/t/adding-multiple-ingest-pipelines-to-an-index/361015)

<div class="topic-metadata">

**Author:** [@RajuParipelly](https://discuss.elastic.co/u/RajuParipelly)\
**Replies:** 3\
**Last updated:** [June 10, 2024, 4:42am UTC](https://discuss.elastic.co/t/adding-multiple-ingest-pipelines-to-an-index/361015 "2024-06-10T04:42:41Z")

</div>

Hi, How can we add multiple ingest pipelines to an index ? I have 30 ingest pipelines need to be added to an index pattern? is there any way to do this? Thanks in advance

---

## [I'm trying to parse an aplication log which is a Symfony application but its not working fine](https://discuss.elastic.co/t/im-trying-to-parse-an-aplication-log-which-is-a-symfony-application-but-its-not-working-fine/360563)

<div class="topic-metadata">

**Author:** [@evangelin](https://discuss.elastic.co/u/evangelin)\
**Replies:** 5\
**Last updated:** [June 10, 2024, 4:03am UTC](https://discuss.elastic.co/t/im-trying-to-parse-an-aplication-log-which-is-a-symfony-application-but-its-not-working-fine/360563 "2024-06-10T04:03:41Z")

</div>

hello, please help me to solve the below issues i have taken a sample log entries from sympony application and stored in elk server itself /crm.log for testing, if it would have done parsing the logs i will would have s…

---

## [Error Benchmarking AWS Managed Elasticsearch Cluster (version 7.10) using esrally](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031)

<div class="topic-metadata">

**Author:** [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\
**Replies:** 11\
**Last updated:** [June 9, 2024, 6:13pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031 "2024-06-09T18:13:17Z")

</div>

I'm attempting to benchmark an AWS Managed Elasticsearch Cluster (version: 7.10) using esrally, but I'm encountering the following error: \_\_\_\_ \_\_\_\_ / \_\_ \\\_\_\_\_ \_/ / /\_ \_\_ / /\_/ / \_\_ \`/ / / / / / / \_, \_/…

---

## [Logstash JDBC Input Issue - Single Quotes](https://discuss.elastic.co/t/logstash-jdbc-input-issue-single-quotes/360882)

<div class="topic-metadata">

**Author:** [@OscarFilho](https://discuss.elastic.co/u/OscarFilho)\
**Replies:** 2\
**Last updated:** [June 9, 2024, 6:09pm UTC](https://discuss.elastic.co/t/logstash-jdbc-input-issue-single-quotes/360882 "2024-06-09T18:09:43Z")

</div>

I'm using a JDBC input plugin (for sql server connection) in my logstash and having a issue on statement. The error displayed is: Java::ComMicrosoftSqlserverJdbc::SQLServerException: Incorrect syntax near 'ATUALIZADO\\'…

---

## [Logstash Configuration for Multi-Database Input Monitoring and Notification](https://discuss.elastic.co/t/logstash-configuration-for-multi-database-input-monitoring-and-notification/361115)

<div class="topic-metadata">

**Author:** [@SalehEska](https://discuss.elastic.co/u/SalehEska)\
**Replies:** 0\
**Last updated:** [June 9, 2024, 6:05pm UTC](https://discuss.elastic.co/t/logstash-configuration-for-multi-database-input-monitoring-and-notification/361115 "2024-06-09T18:05:05Z")

</div>

In Logstash, I have multiple inputs, such as Oracle and MySQL databases. Each input contains a query to retrieve data. I need to check if the process reaches each database input and executes the query, If the result of t…

---

## [Build plugin failing at last stage with ERROR Error: Premature close](https://discuss.elastic.co/t/build-plugin-failing-at-last-stage-with-error-error-premature-close/360110)

<div class="topic-metadata">

**Author:** [@Sunil\_Jagtap](https://discuss.elastic.co/u/Sunil_Jagtap)\
**Replies:** 2\
**Last updated:** [June 9, 2024, 12:50am UTC](https://discuss.elastic.co/t/build-plugin-failing-at-last-stage-with-error-error-premature-close/360110 "2024-06-09T00:50:11Z")

</div>

Hi Everyone, As per the documentation : Plugin tooling | Kibana Guide \[8.5\] | Elastic Topic : Build plugin distributable To build your plugin run within your plugin folder: yarn build It will output azip archive in …

---

## [Elasticsearch Change Logging Level](https://discuss.elastic.co/t/elasticsearch-change-logging-level/361102)

<div class="topic-metadata">

**Author:** [@Ahmed\_Essam](https://discuss.elastic.co/u/Ahmed_Essam)\
**Replies:** 1\
**Last updated:** [June 9, 2024, 4:01pm UTC](https://discuss.elastic.co/t/elasticsearch-change-logging-level/361102 "2024-06-09T16:01:50Z")

</div>

I want to be able to change various logs level for different elasticsearch module such as the following PUT /\_cluster/settings { "persistent": { "logger.org.elasticsearch.discovery": "OFF" } } But I cannot find…

---

## [The num\_candidates parameter leads to some confusing query results](https://discuss.elastic.co/t/the-num-candidates-parameter-leads-to-some-confusing-query-results/359355)

<div class="topic-metadata">

**Author:** [@EricTowns](https://discuss.elastic.co/u/EricTowns)\
**Replies:** 7\
**Last updated:** [June 9, 2024, 12:17pm UTC](https://discuss.elastic.co/t/the-num-candidates-parameter-leads-to-some-confusing-query-results/359355 "2024-06-09T12:17:04Z")

</div>

Hi team! I have an index, only 1 primary shard, I insert documents and then knn searching. When I do a knn query with k=10 and num\_candidates=20, I get a batch of results. When k=10 and num\_candidates=25, I got some doc…

---

## [Elastic-agent does not send metrics to Logstash](https://discuss.elastic.co/t/elastic-agent-does-not-send-metrics-to-logstash/360824)

<div class="topic-metadata">

**Author:** [@Viktor\_Movita](https://discuss.elastic.co/u/Viktor_Movita)\
**Replies:** 3\
**Last updated:** [June 9, 2024, 8:12am UTC](https://discuss.elastic.co/t/elastic-agent-does-not-send-metrics-to-logstash/360824 "2024-06-09T08:12:33Z")

</div>

I recently installed a stand-alone Elastic Agent version 8.11.3. I configured the agent to send metrics to the Logstash server and to collect metrics from the server on which it is installed. However, I do not see any d…

---

## [Spring data Elasticsearch](https://discuss.elastic.co/t/spring-data-elasticsearch/361089)

<div class="topic-metadata">

**Author:** [@mmahmood](https://discuss.elastic.co/u/mmahmood)\
**Replies:** 1\
**Last updated:** [June 9, 2024, 5:35am UTC](https://discuss.elastic.co/t/spring-data-elasticsearch/361089 "2024-06-09T05:35:00Z")

</div>

Hi all I have added aggregation to elasticsearch query by using QueryBuilder class provided in spring boot elasticsearch library but it is not working as expected. I may be missing something. following is code snippet …

---

## [SocketTimeout Exception issue reported for Elasticsearch Node with moderate resource usage](https://discuss.elastic.co/t/sockettimeout-exception-issue-reported-for-elasticsearch-node-with-moderate-resource-usage/360984)

<div class="topic-metadata">

**Author:** [@lzz118](https://discuss.elastic.co/u/lzz118)\
**Replies:** 9\
**Last updated:** [June 9, 2024, 5:32am UTC](https://discuss.elastic.co/t/sockettimeout-exception-issue-reported-for-elasticsearch-node-with-moderate-resource-usage/360984 "2024-06-09T05:32:24Z")

</div>

The Elasticsearch Cluster with the reported issue includes 86 data nodes and 3 dedicated master nodes, each with 32 GB heap 64 to 128GB OS memory, and between 16 ~ 32 CPU cores per node. We have two ES clusters with sim…

---

## [Elastic Agent - Parsing JSON file to fields](https://discuss.elastic.co/t/elastic-agent-parsing-json-file-to-fields/360319)

<div class="topic-metadata">

**Author:** [@idan\_amar](https://discuss.elastic.co/u/idan_amar)\
**Replies:** 1\
**Last updated:** [June 8, 2024, 2:20pm UTC](https://discuss.elastic.co/t/elastic-agent-parsing-json-file-to-fields/360319 "2024-06-08T14:20:13Z")

</div>

hello i use the custom logs for input mtr.json file { "report": { "mtr": { "src": "something.com", "dst": "something.else", "tos": 0, "tests": 10, …

---

## [Shard Allocation Awareness and .security-7 index](https://discuss.elastic.co/t/shard-allocation-awareness-and-security-7-index/361072)

<div class="topic-metadata">

**Author:** [@Sajad\_Soltanian](https://discuss.elastic.co/u/Sajad_Soltanian)\
**Replies:** 0\
**Last updated:** [June 8, 2024, 11:57am UTC](https://discuss.elastic.co/t/shard-allocation-awareness-and-security-7-index/361072 "2024-06-08T11:57:52Z")

</div>

We have recently added node attributes and update the cluster setting to allocate the shards based on this attribute. below is my cluster settings. "cluster" : { "routing" : { "allocation" : { …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=222)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=224)
