# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=139

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 140

---

## [Version 8.10 still has recovery/rebalance issue?](https://discuss.elastic.co/t/version-8-10-still-has-recovery-rebalance-issue/354490)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 4\
**Last updated:** [March 4, 2024, 10:12pm UTC](https://discuss.elastic.co/t/version-8-10-still-has-recovery-rebalance-issue/354490 "2024-03-04T22:12:06Z")

</div>

We often add many data nodes at once (say 10). If I don't tweak the default setting, there are only 2 recovery tasks at any given moment and it'll take forever to rebalance. If I tweak "cluster.routing.allocation.clust…

---

## [What's the recommended method for checking if a string is part of a field?](https://discuss.elastic.co/t/whats-the-recommended-method-for-checking-if-a-string-is-part-of-a-field/354266)

<div class="topic-metadata">

**Author:** [@favoca](https://discuss.elastic.co/u/favoca)\
**Replies:** 1\
**Last updated:** [March 4, 2024, 10:01pm UTC](https://discuss.elastic.co/t/whats-the-recommended-method-for-checking-if-a-string-is-part-of-a-field/354266 "2024-03-04T22:01:44Z")

</div>

My research mainly pointed me towards two or three solutions. Firstly, using wildcards: { "query": { "wildcard": { "name": "\*searchTerm\*" } } } However, the drawback is that wildcards can be slow. S…

---

## [Running es rally](https://discuss.elastic.co/t/running-es-rally/354663)

<div class="topic-metadata">

**Author:** [@searchwithme](https://discuss.elastic.co/u/searchwithme)\
**Replies:** 0\
**Last updated:** [March 4, 2024, 3:37pm UTC](https://discuss.elastic.co/t/running-es-rally/354663 "2024-03-04T15:37:35Z")

</div>

Hi Team! I need to test the performance of an elasticsearch cluster and check: how much compute and RAM needed to run 20K requests for a minute my current cluster is set up on elastic cloud Is this something es rally…

---

## [Esrally installation](https://discuss.elastic.co/t/esrally-installation/354662)

<div class="topic-metadata">

**Author:** [@searchwithme](https://discuss.elastic.co/u/searchwithme)\
**Replies:** 2\
**Last updated:** [March 4, 2024, 3:30pm UTC](https://discuss.elastic.co/t/esrally-installation/354662 "2024-03-04T15:30:16Z")

</div>

I am trying to install esrally on my EC2 instance and I am getting this error: running build\_ext building 'psutil.\_psutil\_linux' extension creating build/temp.linux-x86\_64-cpython-37 creating build/temp.linux-x86\_64…

---

## [ELasticSearch for high frequency update scenario](https://discuss.elastic.co/t/elasticsearch-for-high-frequency-update-scenario/354619)

<div class="topic-metadata">

**Author:** [@manikandanid](https://discuss.elastic.co/u/manikandanid)\
**Replies:** 10\
**Last updated:** [March 4, 2024, 12:44pm UTC](https://discuss.elastic.co/t/elasticsearch-for-high-frequency-update-scenario/354619 "2024-03-04T12:44:25Z")

</div>

We have a scenario where in our domain entity undergoes very high frequency updates. Say a max of 100 updates for a domain entity in a minute. Currently we plan to index a summary of the domain information (few attribut…

---

## [Intermittent error while ingesting files in pipeline](https://discuss.elastic.co/t/intermittent-error-while-ingesting-files-in-pipeline/354638)

<div class="topic-metadata">

**Author:** [@ChristopheL77](https://discuss.elastic.co/u/ChristopheL77)\
**Replies:** 0\
**Last updated:** [March 4, 2024, 12:41pm UTC](https://discuss.elastic.co/t/intermittent-error-while-ingesting-files-in-pipeline/354638 "2024-03-04T12:41:53Z")

</div>

Hi, When indexing files with BulkOperation with NEST (7.17.5) client and Elastic Search 8.8.0 or 8.12.2, after a few successful operations we have an error message. If we retry, the error will happen on different file. …

---

## [Elasticsearch Java API Client BulkRequest](https://discuss.elastic.co/t/elasticsearch-java-api-client-bulkrequest/354625)

<div class="topic-metadata">

**Author:** [@Ansh\_Kumar](https://discuss.elastic.co/u/Ansh_Kumar)\
**Replies:** 3\
**Last updated:** [March 4, 2024, 12:28pm UTC](https://discuss.elastic.co/t/elasticsearch-java-api-client-bulkrequest/354625 "2024-03-04T12:28:52Z")

</div>

Hello , I am using new JAVA API Client version 8.7 in my Java multiThreaded Application I am doing two task 1)task1) Reading , first different threads reading data from elasticsearch indexes 2)task2)After reading dat…

---

## [Show Critical(Red background), Heathy(Green backround) using Top hit](https://discuss.elastic.co/t/show-critical-red-background-heathy-green-backround-using-top-hit/354416)

<div class="topic-metadata">

**Author:** [@PRASHANT\_MEHTA](https://discuss.elastic.co/u/PRASHANT_MEHTA)\
**Replies:** 1\
**Last updated:** [March 4, 2024, 11:31am UTC](https://discuss.elastic.co/t/show-critical-red-background-heathy-green-backround-using-top-hit/354416 "2024-03-04T11:31:30Z")

</div>

Hello All, I've a simple requirement and now it seems complex to achieve this in kibana and not sure how data can be handled here to show desired result. There are multiple tomcat servers sending there status in tomcat…

---

## [Need guidance on upgrading production elastic stack](https://discuss.elastic.co/t/need-guidance-on-upgrading-production-elastic-stack/354620)

<div class="topic-metadata">

**Author:** [@Souvik\_Das](https://discuss.elastic.co/u/Souvik_Das)\
**Replies:** 2\
**Last updated:** [March 4, 2024, 10:22am UTC](https://discuss.elastic.co/t/need-guidance-on-upgrading-production-elastic-stack/354620 "2024-03-04T10:22:22Z")

</div>

Hi All, I want to upgrade my ELK version in production. Below are the details - Current Version: 7.11.1 Elasticsearch Node - 3 Dedicated VMs for Kibana and Logstash OS - Ubuntu Please guide me to upgrade the stack.…

---

## [Filebeat - CryptoJS is not defined](https://discuss.elastic.co/t/filebeat-cryptojs-is-not-defined/354441)

<div class="topic-metadata">

**Author:** [@siva0030](https://discuss.elastic.co/u/siva0030)\
**Replies:** 8\
**Last updated:** [March 4, 2024, 9:36am UTC](https://discuss.elastic.co/t/filebeat-cryptojs-is-not-defined/354441 "2024-03-04T09:36:06Z")

</div>

Hello Team, I was trying to implement the hashing using Filebeat script processor. But Filebeat doesnt have Crypto module by default and staring below error. Is there any option to achieve this functionality? Geting …

---

## [Elasticsearch Cluster in Red State: Shard Allocation and Pending Tasks Issues](https://discuss.elastic.co/t/elasticsearch-cluster-in-red-state-shard-allocation-and-pending-tasks-issues/354587)

<div class="topic-metadata">

**Author:** [@Sanjeet\_Kumar](https://discuss.elastic.co/u/Sanjeet_Kumar)\
**Replies:** 5\
**Last updated:** [March 4, 2024, 7:43am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-in-red-state-shard-allocation-and-pending-tasks-issues/354587 "2024-03-04T07:43:44Z")

</div>

I have installed Elasticsearch on Linux Ubuntu at 3 VMs, 1 VM is a dedicated master node, and rest 2 VMs have 5 data nodes(there are 2 data nodes on each). I have installed these 5 nodes with rpm. The elasticsearch conf…

---

## [How to configure wso2 with elastic apm?](https://discuss.elastic.co/t/how-to-configure-wso2-with-elastic-apm/354611)

<div class="topic-metadata">

**Author:** [@vanhaiit90](https://discuss.elastic.co/u/vanhaiit90)\
**Replies:** 0\
**Last updated:** [March 4, 2024, 3:06am UTC](https://discuss.elastic.co/t/how-to-configure-wso2-with-elastic-apm/354611 "2024-03-04T03:06:44Z")

</div>

I have text code elastic APM I added the Elastic APM Java Agent to the integrator.sh and configured as follows. -javaagent:/tmp/elastic-apm-agent.jar \\ -Delastic.apm.service\_name=service-name \\ -Delastic.apm.applicat…

---

## [Logstash not responding at my container bering logstash and kibana image](https://discuss.elastic.co/t/logstash-not-responding-at-my-container-bering-logstash-and-kibana-image/354598)

<div class="topic-metadata">

**Author:** [@aditya\_rewari](https://discuss.elastic.co/u/aditya_rewari)\
**Replies:** 1\
**Last updated:** [March 3, 2024, 7:03pm UTC](https://discuss.elastic.co/t/logstash-not-responding-at-my-container-bering-logstash-and-kibana-image/354598 "2024-03-03T19:03:56Z")

</div>

I am doing a POC at elasticsearch Kibana where I am trying to register my GCS(Google Cloud Storage) for log archiving For same I am attempting to have a container at Docker Desktop of Elasticsearch and Kibana For this …

---

## [Dealing with concatenated words in elasticsearch](https://discuss.elastic.co/t/dealing-with-concatenated-words-in-elasticsearch/354602)

<div class="topic-metadata">

**Author:** [@Refi\_Peretz](https://discuss.elastic.co/u/Refi_Peretz)\
**Replies:** 0\
**Last updated:** [March 3, 2024, 6:03pm UTC](https://discuss.elastic.co/t/dealing-with-concatenated-words-in-elasticsearch/354602 "2024-03-03T18:03:26Z")

</div>

I feel this suppose to be a very straightforward problem but for some reason I can put my head around it. I want to build a product search engine using Elasticsearch. I have a problem when it comes to concatenated words…

---

## [Whether rrf can be applied to nested knn search using inner hits](https://discuss.elastic.co/t/whether-rrf-can-be-applied-to-nested-knn-search-using-inner-hits/352737)

<div class="topic-metadata">

**Author:** [@shwanlee](https://discuss.elastic.co/u/shwanlee)\
**Replies:** 1\
**Last updated:** [March 3, 2024, 3:07pm UTC](https://discuss.elastic.co/t/whether-rrf-can-be-applied-to-nested-knn-search-using-inner-hits/352737 "2024-03-03T15:07:35Z")

</div>

Does rrf apply to queries that combine keyword search, sparse vector search, and knn vector search using inner hits?

---

## [Eland import has IndexError](https://discuss.elastic.co/t/eland-import-has-indexerror/353143)

<div class="topic-metadata">

**Author:** [@Andrew\_Winter](https://discuss.elastic.co/u/Andrew_Winter)\
**Replies:** 1\
**Last updated:** [March 2, 2024, 4:22pm UTC](https://discuss.elastic.co/t/eland-import-has-indexerror/353143 "2024-03-02T16:22:43Z")

</div>

Hi, I am trying to load an NLP model into Elastic 8.8.2 using the guide here Running the following commend gives the error stack below eland\_import\_hub\_model --url http://localhost:9200 --hub-model-id FacebookAI/xlm-r…

---

## [Performing semantic searches - ELSER](https://discuss.elastic.co/t/performing-semantic-searches-elser/354568)

<div class="topic-metadata">

**Author:** [@sinhapunit](https://discuss.elastic.co/u/sinhapunit)\
**Replies:** 2\
**Last updated:** [March 2, 2024, 4:12pm UTC](https://discuss.elastic.co/t/performing-semantic-searches-elser/354568 "2024-03-02T16:12:50Z")

</div>

I am new to Elastic and I am sure my issue is very basic, if someone could give me high level pointers (or detailed instructions if they wish) it would be very helpful. I have about 120,000 documents and each document h…

---

## [How to truncate dense\_vector fields with a script](https://discuss.elastic.co/t/how-to-truncate-dense-vector-fields-with-a-script/354569)

<div class="topic-metadata">

**Author:** [@Valentin\_Pletzer](https://discuss.elastic.co/u/Valentin_Pletzer)\
**Replies:** 0\
**Last updated:** [March 2, 2024, 2:22pm UTC](https://discuss.elastic.co/t/how-to-truncate-dense-vector-fields-with-a-script/354569 "2024-03-02T14:22:50Z")

</div>

I want to make use of the Matryoshka feature of openAIs new text-embeddings. For that I want only to compare the first 256 fields of the dense\_vector field. Is that possible and if so how? This script doesn't seem to wor…

---

## [Track\_scores not working with suggestors and sort in v7.17.18](https://discuss.elastic.co/t/track-scores-not-working-with-suggestors-and-sort-in-v7-17-18/354563)

<div class="topic-metadata">

**Author:** [@Nikhil\_Bansal1](https://discuss.elastic.co/u/Nikhil_Bansal1)\
**Replies:** 5\
**Last updated:** [March 2, 2024, 1:25pm UTC](https://discuss.elastic.co/t/track-scores-not-working-with-suggestors-and-sort-in-v7-17-18/354563 "2024-03-02T13:25:35Z")

</div>

I am upgrading Elasticsearch from v6 to v7. There is one query which is not working for me with track\_scores. Same query giving result in v6 but in v7 getting this error "Can't compute score on document as it doesn't mat…

---

## [Elasticsearch failed to start with fatal exception while booting Elasticsearch", "ecs.version": "1.2.0","service.name":"ES\_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.bootstrap.Elasticsearch","e](https://discuss.elastic.co/t/elasticsearch-failed-to-start-with-fatal-exception-while-booting-elasticsearch-ecs-version-1-2-0-service-name-es-ecs-event-dataset-elasticsearch-server-process-thread-name-main-log-logger-org-elasticsearch-bootstrap-elasticsearch-e/354488)

<div class="topic-metadata">

**Author:** [@Vatsal\_Sharma](https://discuss.elastic.co/u/Vatsal_Sharma)\
**Replies:** 1\
**Last updated:** [March 2, 2024, 6:24am UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-start-with-fatal-exception-while-booting-elasticsearch-ecs-version-1-2-0-service-name-es-ecs-event-dataset-elasticsearch-server-process-thread-name-main-log-logger-org-elasticsearch-bootstrap-elasticsearch-e/354488 "2024-03-02T06:24:46Z")

</div>

I have deployed a elasticsearch cluster using eck-operator on my eks cluster. I am trying to restore a snapshot stored in my s3 by trying to connect to it. here is the manifest I used -\> --- # Default values for eck-ela…

---

## [Sort Alphanumeric Strings in Ascending or Descending Order](https://discuss.elastic.co/t/sort-alphanumeric-strings-in-ascending-or-descending-order/354523)

<div class="topic-metadata">

**Author:** [@c.tummalapalli](https://discuss.elastic.co/u/c.tummalapalli)\
**Replies:** 1\
**Last updated:** [March 2, 2024, 4:44am UTC](https://discuss.elastic.co/t/sort-alphanumeric-strings-in-ascending-or-descending-order/354523 "2024-03-02T04:44:29Z")

</div>

Hi Team, I have an index name object which has field Name whose mapping is defined as below "name": { "type": "keyword", "fields": { "keyword": { "type": "keyword", "normalizer": "case\_insensitive\_normalizer" } …

---

## [Create alias index that assigns alias names to fields in original index?](https://discuss.elastic.co/t/create-alias-index-that-assigns-alias-names-to-fields-in-original-index/354556)

<div class="topic-metadata">

**Author:** [@permaweb](https://discuss.elastic.co/u/permaweb)\
**Replies:** 2\
**Last updated:** [March 2, 2024, 4:36am UTC](https://discuss.elastic.co/t/create-alias-index-that-assigns-alias-names-to-fields-in-original-index/354556 "2024-03-02T04:36:47Z")

</div>

Hello, I have a large index with very specific field mapping that would not be easy to change. We have an application the requires specific field names for the data it uses. For example our main index has a field "fea…

---

## [Is it possible to do highlighting with knn and/or hybrid search?](https://discuss.elastic.co/t/is-it-possible-to-do-highlighting-with-knn-and-or-hybrid-search/354511)

<div class="topic-metadata">

**Author:** [@hadjebi](https://discuss.elastic.co/u/hadjebi)\
**Replies:** 12\
**Last updated:** [March 1, 2024, 9:26pm UTC](https://discuss.elastic.co/t/is-it-possible-to-do-highlighting-with-knn-and-or-hybrid-search/354511 "2024-03-01T21:26:28Z")

</div>

Is it possible to do highlighting with knn and/or hybrid search?

---

## [Custom \_id modification in elastic search](https://discuss.elastic.co/t/custom-id-modification-in-elastic-search/354514)

<div class="topic-metadata">

**Author:** [@sweta04](https://discuss.elastic.co/u/sweta04)\
**Replies:** 4\
**Last updated:** [March 1, 2024, 6:20pm UTC](https://discuss.elastic.co/t/custom-id-modification-in-elastic-search/354514 "2024-03-01T18:20:51Z")

</div>

I want to set “\_id” value in Elasticsearch document as my custom document id, using this from kibana? POST example/\_doc { "\_id":123, "firstName":"Sera", "lastName":"Zuck" } for this what i need to do ? should i h…

---

## [Unable to restore index from elasticsearch version 7.16.2 to 8.10.2](https://discuss.elastic.co/t/unable-to-restore-index-from-elasticsearch-version-7-16-2-to-8-10-2/354494)

<div class="topic-metadata">

**Author:** [@satyanvesh](https://discuss.elastic.co/u/satyanvesh)\
**Replies:** 5\
**Last updated:** [March 1, 2024, 12:10pm UTC](https://discuss.elastic.co/t/unable-to-restore-index-from-elasticsearch-version-7-16-2-to-8-10-2/354494 "2024-03-01T12:10:05Z")

</div>

I have elasticsearch with version 7.16.2 and index version is 7.6.2. Here GCS plugin is installed, GCS repo is configured and SLM is configured. I have setup new cluster with with 8.10.2 version. Configured GCS repo. Wh…

---

## [Elasticsearch timeouts and stop responding randomly](https://discuss.elastic.co/t/elasticsearch-timeouts-and-stop-responding-randomly/354386)

<div class="topic-metadata">

**Author:** [@agonzalez](https://discuss.elastic.co/u/agonzalez)\
**Replies:** 1\
**Last updated:** [March 1, 2024, 12:06pm UTC](https://discuss.elastic.co/t/elasticsearch-timeouts-and-stop-responding-randomly/354386 "2024-03-01T12:06:49Z")

</div>

I have 4 .net services that use elasticsearch for indexing and querying documents. From time to time .net services report timeout errors connecting to elasticsearch and during that time kibana also cant connect to elast…

---

## [Optimizing Performance and Managing Daily Data Updates in Elasticsearch with Multiple Indices](https://discuss.elastic.co/t/optimizing-performance-and-managing-daily-data-updates-in-elasticsearch-with-multiple-indices/354517)

<div class="topic-metadata">

**Author:** [@ejkim](https://discuss.elastic.co/u/ejkim)\
**Replies:** 2\
**Last updated:** [March 1, 2024, 9:32am UTC](https://discuss.elastic.co/t/optimizing-performance-and-managing-daily-data-updates-in-elasticsearch-with-multiple-indices/354517 "2024-03-01T09:32:09Z")

</div>

We are currently encountering challenges with our Elasticsearch setup, where we utilize a single alias across multiple indices (365 daily indices). Two key issues have come to our attention: Aggregation Performance: Ag…

---

## [Esrally connection aborted](https://discuss.elastic.co/t/esrally-connection-aborted/354440)

<div class="topic-metadata">

**Author:** [@uttamkrpanda](https://discuss.elastic.co/u/uttamkrpanda)\
**Replies:** 6\
**Last updated:** [March 1, 2024, 8:09am UTC](https://discuss.elastic.co/t/esrally-connection-aborted/354440 "2024-03-01T08:09:59Z")

</div>

I am trying to run the esrally in local , however it's getting connection aborted . The curl to the elasticsearch host is working fine but not via esrally . Any help here please ? esrally race --track=pmc --target-hos…

---

## [Calling union on two dataframes from spark and elastic search stuck](https://discuss.elastic.co/t/calling-union-on-two-dataframes-from-spark-and-elastic-search-stuck/353599)

<div class="topic-metadata">

**Author:** [@xsa\_xsa](https://discuss.elastic.co/u/xsa_xsa)\
**Replies:** 7\
**Last updated:** [March 1, 2024, 6:50am UTC](https://discuss.elastic.co/t/calling-union-on-two-dataframes-from-spark-and-elastic-search-stuck/353599 "2024-03-01T06:50:39Z")

</div>

i am using pyspark to query elstic search i have the folowing code d1 = data\_frame1.collect() # return 1 row d2 = data\_frame2.collect() # return no rows but when i call d3 data\_frame1.union(data\_frame2).collect() t…

---

## [Mapping shows exception for leap year date](https://discuss.elastic.co/t/mapping-shows-exception-for-leap-year-date/354439)

<div class="topic-metadata">

**Author:** [@Siva\_Karan](https://discuss.elastic.co/u/Siva_Karan)\
**Replies:** 6\
**Last updated:** [February 29, 2024, 10:32pm UTC](https://discuss.elastic.co/t/mapping-shows-exception-for-leap-year-date/354439 "2024-02-29T22:32:49Z")

</div>

Hi Team, Mapping "MM-dd" is throwing exception in leap year (feb 29,2024) We have the below "MM-dd" format mapping and the system is checking of the year (1970) YYYY which is not a leap year and throwing the below exce…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=138)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=140)
