# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=170

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 171

---

## [Failed Snapshot using S3 Repository](https://discuss.elastic.co/t/failed-snapshot-using-s3-repository/348682)

<div class="topic-metadata">

**Author:** [@iTiago](https://discuss.elastic.co/u/iTiago)\
**Replies:** 1\
**Last updated:** [December 6, 2023, 3:13pm UTC](https://discuss.elastic.co/t/failed-snapshot-using-s3-repository/348682 "2023-12-06T15:13:32Z")

</div>

Guys, I am trying to take a snapshot of all my indexes in an S3 repository, I already checked the credentials and so on at the time of creating it and there was no problem, the problem occurs at the time of taking the sn…

---

## [JVM very greedy with memory. How do I get it to shrink when possible?](https://discuss.elastic.co/t/jvm-very-greedy-with-memory-how-do-i-get-it-to-shrink-when-possible/348657)

<div class="topic-metadata">

**Author:** [@Vulume](https://discuss.elastic.co/u/Vulume)\
**Replies:** 2\
**Last updated:** [December 6, 2023, 1:57pm UTC](https://discuss.elastic.co/t/jvm-very-greedy-with-memory-how-do-i-get-it-to-shrink-when-possible/348657 "2023-12-06T13:57:37Z")

</div>

I want my JVM to give back memory to the OS if it's not using it. I don't care about performance. When I set -Xms128m -Xmx4g, I see the JVM's memory usage grow while indexing and searching, but it never shrinks again af…

---

## [How to know if the result was due to a fuzzysearch?](https://discuss.elastic.co/t/how-to-know-if-the-result-was-due-to-a-fuzzysearch/348726)

<div class="topic-metadata">

**Author:** [@vidhaat](https://discuss.elastic.co/u/vidhaat)\
**Replies:** 0\
**Last updated:** [December 6, 2023, 1:50pm UTC](https://discuss.elastic.co/t/how-to-know-if-the-result-was-due-to-a-fuzzysearch/348726 "2023-12-06T13:50:34Z")

</div>

I have a query where I get results which may or may not have fuzzy search results. I want to get analytics on what results are the result of fuzzy search. How can this be achieved ? { "query": { "bool": { "f…

---

## [Custom analyzer for search and indexing](https://discuss.elastic.co/t/custom-analyzer-for-search-and-indexing/348661)

<div class="topic-metadata">

**Author:** [@ssanja](https://discuss.elastic.co/u/ssanja)\
**Replies:** 1\
**Last updated:** [December 6, 2023, 6:33am UTC](https://discuss.elastic.co/t/custom-analyzer-for-search-and-indexing/348661 "2023-12-06T06:33:34Z")

</div>

Hello, when creating an index I specifically created a custom analyzer which should be used for indexing and searching (see the example code below) "settings": { "analysis": { "analyzer": { "custom\_…

---

## [Azure AD SSO setting behind a proxy not working](https://discuss.elastic.co/t/azure-ad-sso-setting-behind-a-proxy-not-working/346654)

<div class="topic-metadata">

**Author:** [@Ilter\_Sag](https://discuss.elastic.co/u/Ilter_Sag)\
**Replies:** 5\
**Last updated:** [December 6, 2023, 5:28am UTC](https://discuss.elastic.co/t/azure-ad-sso-setting-behind-a-proxy-not-working/346654 "2023-12-06T05:28:36Z")

</div>

Hello, I am trying to integrate Azure AD to Elasticsearch cluster behind a proxy. I tried the proxy parameter settings below but could not succeeded. You can find the log behind that post. It say it cannot access to mic…

---

## [Using Debug.explain kills data nodes. (8.11.1)](https://discuss.elastic.co/t/using-debug-explain-kills-data-nodes-8-11-1/348690)

<div class="topic-metadata">

**Author:** [@ong-ar](https://discuss.elastic.co/u/ong-ar)\
**Replies:** 1\
**Last updated:** [December 6, 2023, 3:35am UTC](https://discuss.elastic.co/t/using-debug-explain-kills-data-nodes-8-11-1/348690 "2023-12-06T03:35:44Z")

</div>

Elasticsearch Version Version: 8.11.1, Build: rpm/6f9ff581fbcde658e6f69d6ce03050f060d1fd0c/2023-11-11T10:05:59.421038163Z, JVM: 21.0.1 Installed Plugins Java Version openjdk version "21.0.1" OS Version 6.1.61-85.141.…

---

## [How to Implement a Flexible Search Method in Java with Low Level Client to Filter, Sort, and Limit Fields?](https://discuss.elastic.co/t/how-to-implement-a-flexible-search-method-in-java-with-low-level-client-to-filter-sort-and-limit-fields/346253)

<div class="topic-metadata">

**Author:** [@Roman\_Kagan](https://discuss.elastic.co/u/Roman_Kagan)\
**Replies:** 4\
**Last updated:** [December 6, 2023, 2:29am UTC](https://discuss.elastic.co/t/how-to-implement-a-flexible-search-method-in-java-with-low-level-client-to-filter-sort-and-limit-fields/346253 "2023-12-06T02:29:18Z")

</div>

Hello, I'm working on implementing a search method in Java that needs to support several variations of search criteria. Specifically, I need the method to be able to: Search by a term within certain fields, conditiona…

---

## [Accuracy of date histogram sub-aggregation doc count under terms aggregation](https://discuss.elastic.co/t/accuracy-of-date-histogram-sub-aggregation-doc-count-under-terms-aggregation/348685)

<div class="topic-metadata">

**Author:** [@myronmarston](https://discuss.elastic.co/u/myronmarston)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 10:26pm UTC](https://discuss.elastic.co/t/accuracy-of-date-histogram-sub-aggregation-doc-count-under-terms-aggregation/348685 "2023-12-05T22:26:57Z")

</div>

Hello, I am working on query that combines a terms aggregation with a date histogram sub-aggregation. I would like to get the doc count of each sub-aggregation bucket, determine if it is accurate, and, if it is not acc…

---

## [Kibana Password User Interface](https://discuss.elastic.co/t/kibana-password-user-interface/348669)

<div class="topic-metadata">

**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\
**Replies:** 1\
**Last updated:** [December 5, 2023, 10:15pm UTC](https://discuss.elastic.co/t/kibana-password-user-interface/348669 "2023-12-05T22:15:49Z")

</div>

Hello, Again I ejjeje, I can't get past this point, what should I do? And if I don't want to be prompted for a password, what can I do?

---

## [Default ingest pipeline overwritten](https://discuss.elastic.co/t/default-ingest-pipeline-overwritten/348640)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 5\
**Last updated:** [December 5, 2023, 6:05pm UTC](https://discuss.elastic.co/t/default-ingest-pipeline-overwritten/348640 "2023-12-05T18:05:17Z")

</div>

Hi, I created an index template \`logs-{dataset\_name}-default' as well as setting up a data stream. I also setup a default ingest pipeline for this index. However after a number of days (and maybe coincidentally an Elas…

---

## [CreateIndexRequest with date math](https://discuss.elastic.co/t/createindexrequest-with-date-math/348496)

<div class="topic-metadata">

**Author:** [@avnere](https://discuss.elastic.co/u/avnere)\
**Replies:** 1\
**Last updated:** [December 5, 2023, 1:52pm UTC](https://discuss.elastic.co/t/createindexrequest-with-date-math/348496 "2023-12-05T13:52:55Z")

</div>

Hi I am using RestHighLevelClient 7.13. I am trying to create an index with date math: CreateIndexRequest cir = new CreateIndexRequest("\<books-{now/d}-0001\>"); It create an index with the name books, without the date…

---

## [The client is unable to verify that the server is Elasticsearch due to an unsuccessful product check call](https://discuss.elastic.co/t/the-client-is-unable-to-verify-that-the-server-is-elasticsearch-due-to-an-unsuccessful-product-check-call/348635)

<div class="topic-metadata">

**Author:** [@GRK](https://discuss.elastic.co/u/GRK)\
**Replies:** 7\
**Last updated:** [December 5, 2023, 12:29pm UTC](https://discuss.elastic.co/t/the-client-is-unable-to-verify-that-the-server-is-elasticsearch-due-to-an-unsuccessful-product-check-call/348635 "2023-12-05T12:29:19Z")

</div>

Invalid NEST response built from a unsuccessful () low level call on HEAD: /indexname Audit trail of this API call: \[1\] ProductCheckOnStartup: Took: \[2\] ProductCheckFailure: Node: OriginalException: Elasticsearch.Net…

---

## [Master node is not able to collect garbage memory](https://discuss.elastic.co/t/master-node-is-not-able-to-collect-garbage-memory/348625)

<div class="topic-metadata">

**Author:** [@equisde](https://discuss.elastic.co/u/equisde)\
**Replies:** 2\
**Last updated:** [December 5, 2023, 10:46am UTC](https://discuss.elastic.co/t/master-node-is-not-able-to-collect-garbage-memory/348625 "2023-12-05T10:46:06Z")

</div>

The active master node in my Elasticsearch cluster is not able to collect garbage memory. All other standby master nodes are fine. Symptoms: Heap gets increasing forever ES Version: 7.16.3 Nodes: 3 master nodes,…

---

## [Index stat analyse to increase performance](https://discuss.elastic.co/t/index-stat-analyse-to-increase-performance/348624)

<div class="topic-metadata">

**Author:** [@INS](https://discuss.elastic.co/u/INS)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 9:39am UTC](https://discuss.elastic.co/t/index-stat-analyse-to-increase-performance/348624 "2023-12-05T09:39:54Z")

</div>

Hi Can You look at the statistic from one of index. From our observations, it seems that the longer this index is updated, the worse the performanc i.e. response time results come out. What to pay attention to? Is there…

---

## [ILM not working node does not match index setting \[index.routing.allocation.require\] filters \[data:\\"warm\\"\]](https://discuss.elastic.co/t/ilm-not-working-node-does-not-match-index-setting-index-routing-allocation-require-filters-data-warm/348617)

<div class="topic-metadata">

**Author:** [@esseti](https://discuss.elastic.co/u/esseti)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 8:42am UTC](https://discuss.elastic.co/t/ilm-not-working-node-does-not-match-index-setting-index-routing-allocation-require-filters-data-warm/348617 "2023-12-05T08:42:41Z")

</div>

Hello i've setup an ILM but i noticed that indeces never leave the warm state, by checking \_cluster/allocation/ i get this message node does not match index setting \[index.routing.allocation.require\] filters \[data:\\"…

---

## [NEST and new elastic .net client](https://discuss.elastic.co/t/nest-and-new-elastic-net-client/348485)

<div class="topic-metadata">

**Author:** [@agonzalez](https://discuss.elastic.co/u/agonzalez)\
**Replies:** 1\
**Last updated:** [December 5, 2023, 8:04am UTC](https://discuss.elastic.co/t/nest-and-new-elastic-net-client/348485 "2023-12-05T08:04:06Z")

</div>

New elastic net client is not compatible with old NEST, we have complex application build on old NEST and is very difficult to migrate and test to new client. Is NEST going to be supported in future elastic version in c…

---

## [Is it possible to get an alert when an index of certain pattern is rolled over](https://discuss.elastic.co/t/is-it-possible-to-get-an-alert-when-an-index-of-certain-pattern-is-rolled-over/348611)

<div class="topic-metadata">

**Author:** [@Krishna\_Teja](https://discuss.elastic.co/u/Krishna_Teja)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 5:16am UTC](https://discuss.elastic.co/t/is-it-possible-to-get-an-alert-when-an-index-of-certain-pattern-is-rolled-over/348611 "2023-12-05T05:16:21Z")

</div>

I have an ILM policy setup to roll over a datastream when it reaches certain threshold values. Once a new index is created, I want to get notified so I can run a script to update some parameters in my backend. Is there a…

---

## [How to retrieve elastic data to import it in another instance with different version?](https://discuss.elastic.co/t/how-to-retrieve-elastic-data-to-import-it-in-another-instance-with-different-version/348608)

<div class="topic-metadata">

**Author:** [@Kliwon\_Zervaloski](https://discuss.elastic.co/u/Kliwon_Zervaloski)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 3:56am UTC](https://discuss.elastic.co/t/how-to-retrieve-elastic-data-to-import-it-in-another-instance-with-different-version/348608 "2023-12-05T03:56:06Z")

</div>

Hi Everyone, I want to migrate all the data from my old elastic instance which i installed on my local VM(the version is 7.16.3) and i want to send the data do my new instance on cloud vm with the latest version, is ther…

---

## [Clone api Bad Gateway error](https://discuss.elastic.co/t/clone-api-bad-gateway-error/348604)

<div class="topic-metadata">

**Author:** [@Krishna94](https://discuss.elastic.co/u/Krishna94)\
**Replies:** 0\
**Last updated:** [December 5, 2023, 2:27am UTC](https://discuss.elastic.co/t/clone-api-bad-gateway-error/348604 "2023-12-05T02:27:54Z")

</div>

Hi team, I tried to do a reindexing of my data but its taking more than 10 days so I tried to clone my index which is of 816GB and when I run clone api I am getting the following error, {"statusCode":502,"error":"Bad G…

---

## [Elastic Snapshot Restore from S3 Strangeness](https://discuss.elastic.co/t/elastic-snapshot-restore-from-s3-strangeness/348583)

<div class="topic-metadata">

**Author:** [@datencio](https://discuss.elastic.co/u/datencio)\
**Replies:** 1\
**Last updated:** [December 4, 2023, 6:11pm UTC](https://discuss.elastic.co/t/elastic-snapshot-restore-from-s3-strangeness/348583 "2023-12-04T18:11:04Z")

</div>

I am testing out the Elasticsearch Snapshot & Restore feature in my Lab environment. I ran into a strange situation where on a particular cluster the restore seems to complete but seeing strange behavior. For instance, a…

---

## [Anomaly Job - implications of low cardinality in population analysis](https://discuss.elastic.co/t/anomaly-job-implications-of-low-cardinality-in-population-analysis/348584)

<div class="topic-metadata">

**Author:** [@marmai16](https://discuss.elastic.co/u/marmai16)\
**Replies:** 0\
**Last updated:** [December 4, 2023, 4:41pm UTC](https://discuss.elastic.co/t/anomaly-job-implications-of-low-cardinality-in-population-analysis/348584 "2023-12-04T16:41:06Z")

</div>

Hello everybody, i'am testing an anomaly job. At creation, it warned me that the cardinality is below 10 and it might not be suitable for population analysis. I was asking myself, under which circumstances it might be …

---

## [The highlight is not returned when using prefixing query](https://discuss.elastic.co/t/the-highlight-is-not-returned-when-using-prefixing-query/348581)

<div class="topic-metadata">

**Author:** [@eric\_liu2007](https://discuss.elastic.co/u/eric_liu2007)\
**Replies:** 0\
**Last updated:** [December 4, 2023, 4:05pm UTC](https://discuss.elastic.co/t/the-highlight-is-not-returned-when-using-prefixing-query/348581 "2023-12-04T16:05:01Z")

</div>

hi all i am searching by using prefix query, the highlight was return on old version (tested 7.6.2, 7.10.3), but not in latest versions (tested 7.11.0, 7.17.5, 8.10.2, 8.10.4, 8.11.1). if ""index\_prefixes" sub-field …

---

## [Rally eventdata track combined-indexing-and-querying challenge - results](https://discuss.elastic.co/t/rally-eventdata-track-combined-indexing-and-querying-challenge-results/348579)

<div class="topic-metadata">

**Author:** [@jelliott1](https://discuss.elastic.co/u/jelliott1)\
**Replies:** 0\
**Last updated:** [December 4, 2023, 3:59pm UTC](https://discuss.elastic.co/t/rally-eventdata-track-combined-indexing-and-querying-challenge-results/348579 "2023-12-04T15:59:07Z")

</div>

Hello, I ran some tests on my Elasticsearch cluster with rally, using the eventdata track and the combined-indexing-and-querying challenge, and am hoping to get some help interpreting the results. I'm interested in the…

---

## [Selinux Restrictions](https://discuss.elastic.co/t/selinux-restrictions/348566)

<div class="topic-metadata">

**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\
**Replies:** 6\
**Last updated:** [December 4, 2023, 3:24pm UTC](https://discuss.elastic.co/t/selinux-restrictions/348566 "2023-12-04T15:24:14Z")

</div>

I am installing ELK 8.7.1 on an Oracle Linux version. I was able to install ELK without any problems and the services are in active state without any errors. When I try to access Kibana through port 5601 from the brows…

---

## [Deleting and index data with two params is not allowing - 8.11.0](https://discuss.elastic.co/t/deleting-and-index-data-with-two-params-is-not-allowing-8-11-0/348571)

<div class="topic-metadata">

**Author:** [@Rubsy](https://discuss.elastic.co/u/Rubsy)\
**Replies:** 1\
**Last updated:** [December 4, 2023, 3:23pm UTC](https://discuss.elastic.co/t/deleting-and-index-data-with-two-params-is-not-allowing-8-11-0/348571 "2023-12-04T15:23:37Z")

</div>

Here is my data PUT dynamicasset/\_doc/E3EBDC84-9281-46D3-9DA1-31672642C7D3 { "CustomerId":"E3EBDC84-9281-46D3-9DA1-31672642C7D3", "InvoiceNumber": "301", "InvoiceAmount": 450, "Description": "Test Sample for deleting ba…

---

## [Sorting script with tiebreaker](https://discuss.elastic.co/t/sorting-script-with-tiebreaker/348528)

<div class="topic-metadata">

**Author:** [@\_baba](https://discuss.elastic.co/u/_baba)\
**Replies:** 1\
**Last updated:** [December 4, 2023, 3:08pm UTC](https://discuss.elastic.co/t/sorting-script-with-tiebreaker/348528 "2023-12-04T15:08:25Z")

</div>

Hi, We have multiple documents in an index with duplicate field value (product\_id). I want to sort based on product\_id with a condition that for 2 records having same product\_id, sort based on product\_cost. Recreation …

---

## [Elasticsearch Connection Error](https://discuss.elastic.co/t/elasticsearch-connection-error/348536)

<div class="topic-metadata">

**Author:** [@Burak\_Karatay](https://discuss.elastic.co/u/Burak_Karatay)\
**Replies:** 1\
**Last updated:** [December 4, 2023, 3:08pm UTC](https://discuss.elastic.co/t/elasticsearch-connection-error/348536 "2023-12-04T15:08:08Z")

</div>

I have physical server with elasticsearch installed and from another computer I try to connect the elasticsearch with this code: const esClient = new Client({node: 'https://my-ip-address:5621', auth: {username: 'elastic…

---

## [Similarity field in KNN](https://discuss.elastic.co/t/similarity-field-in-knn/348552)

<div class="topic-metadata">

**Author:** [@Sai\_Krishna\_D](https://discuss.elastic.co/u/Sai_Krishna_D)\
**Replies:** 4\
**Last updated:** [December 4, 2023, 2:30pm UTC](https://discuss.elastic.co/t/similarity-field-in-knn/348552 "2023-12-04T14:30:06Z")

</div>

When using the Similarity field in KNN Query, The response is not expected, The similarity value I gave was 0.6 and the boost as 1. Even though there are more than 30 documents which have score greater than 0.7 only one …

---

## [Null pointer exception for explain with boost mode replace](https://discuss.elastic.co/t/null-pointer-exception-for-explain-with-boost-mode-replace/348545)

<div class="topic-metadata">

**Author:** [@elvanja](https://discuss.elastic.co/u/elvanja)\
**Replies:** 2\
**Last updated:** [December 4, 2023, 2:06pm UTC](https://discuss.elastic.co/t/null-pointer-exception-for-explain-with-boost-mode-replace/348545 "2023-12-04T14:06:46Z")

</div>

We seem to have odd situation for requesting explanation when boost mode is set to replace, the stack returns null pointer exception. Running on Version: 8.7.1, Build: docker/f229ed3f893a515d590d0f39b05f68913e2d9b53/2023…

---

## [Anomaly Job scroll\_size parameter behaviour](https://discuss.elastic.co/t/anomaly-job-scroll-size-parameter-behaviour/348533)

<div class="topic-metadata">

**Author:** [@marmai16](https://discuss.elastic.co/u/marmai16)\
**Replies:** 1\
**Last updated:** [December 4, 2023, 2:07pm UTC](https://discuss.elastic.co/t/anomaly-job-scroll-size-parameter-behaviour/348533 "2023-12-04T14:07:04Z")

</div>

Hello everyone, a quick question regarding the scroll\_size parameter of a datafeed in an anomaly job. Is the scroll\_size just limiting the number of results per query returned, but every document is processed (thus a r…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=169)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=171)
