# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=233

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 234

---

## [ILM not deleting index](https://discuss.elastic.co/t/ilm-not-deleting-index/337241)

<div class="topic-metadata">

**Author:** [@raymondmintz11](https://discuss.elastic.co/u/raymondmintz11)\
**Replies:** 22\
**Last updated:** [July 5, 2023, 10:12pm UTC](https://discuss.elastic.co/t/ilm-not-deleting-index/337241 "2023-07-05T22:12:11Z")

</div>

I am running a simple setup with ILM and small index. ILM should delete the index but instead its stuck at "step": "check-rollover-ready", here is my script to recreate the index #!/bin/bash echo -e "\\n update s…

---

## [Vector search for large amount of data with limited RAM resources](https://discuss.elastic.co/t/vector-search-for-large-amount-of-data-with-limited-ram-resources/337681)

<div class="topic-metadata">

**Author:** [@louis\_sg](https://discuss.elastic.co/u/louis_sg)\
**Replies:** 3\
**Last updated:** [July 5, 2023, 4:03pm UTC](https://discuss.elastic.co/t/vector-search-for-large-amount-of-data-with-limited-ram-resources/337681 "2023-07-05T16:03:15Z")

</div>

Hi there, I am new here trying to use Elasticsearch for vector similarity search. My dataset is as large as 100M records, each containing a 384 dimensions vector and a string payload. I am building the HNSW index type…

---

## [Max retries exceeded with url: /pmc/documents.json.bz2 SSLCertVerificationError \[SSL: CERTIFICATE\_VERIFY\_FAILED\]](https://discuss.elastic.co/t/max-retries-exceeded-with-url-pmc-documents-json-bz2-sslcertverificationerror-ssl-certificate-verify-failed/335708)

<div class="topic-metadata">

**Author:** [@Swathi\_Kakumanu](https://discuss.elastic.co/u/Swathi_Kakumanu)\
**Replies:** 7\
**Last updated:** [July 5, 2023, 3:51pm UTC](https://discuss.elastic.co/t/max-retries-exceeded-with-url-pmc-documents-json-bz2-sslcertverificationerror-ssl-certificate-verify-failed/335708 "2023-07-05T15:51:39Z")

</div>

Hi, I am facing an issue with SSL Verification of esrally for rally-tracks.elastic.co', port=443 , however curl request and openssl works fine. FYI, internet works on the rally VM. Command used to run: esrally race -…

---

## [Text embedding different in elastic search and python library](https://discuss.elastic.co/t/text-embedding-different-in-elastic-search-and-python-library/329164)

<div class="topic-metadata">

**Author:** [@Roshan\_Kumar1](https://discuss.elastic.co/u/Roshan_Kumar1)\
**Replies:** 5\
**Last updated:** [July 5, 2023, 3:07pm UTC](https://discuss.elastic.co/t/text-embedding-different-in-elastic-search-and-python-library/329164 "2023-07-05T15:07:51Z")

</div>

Deploying sentence transformer model as provided in this blog, using eland on Elasticsearch returns only the embedding corresponding to the first token. However, while using the python implementation to encode the text r…

---

## [Api Search in Python - how to get bad return code](https://discuss.elastic.co/t/api-search-in-python-how-to-get-bad-return-code/337686)

<div class="topic-metadata">

**Author:** [@RickT](https://discuss.elastic.co/u/RickT)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 2:43pm UTC](https://discuss.elastic.co/t/api-search-in-python-how-to-get-bad-return-code/337686 "2023-07-05T14:43:47Z")

</div>

Hi, I'm using the search API running from Python to collect some documents. The request goes well as long as the connection is OK. However, when the connection is timeout, the Python script crashes and i can't used any…

---

## [SAML without Elasticsearch SSL (using Traefik as a reverse proxy)](https://discuss.elastic.co/t/saml-without-elasticsearch-ssl-using-traefik-as-a-reverse-proxy/336396)

<div class="topic-metadata">

**Author:** [@rushil791](https://discuss.elastic.co/u/rushil791)\
**Replies:** 4\
**Last updated:** [July 5, 2023, 12:50pm UTC](https://discuss.elastic.co/t/saml-without-elasticsearch-ssl-using-traefik-as-a-reverse-proxy/336396 "2023-07-05T12:50:00Z")

</div>

Hi there, I want to be able to use SAML with my Elasticsearch-Kibana setup in Docker, but I need to be able to use my organisation's CA cert. I do not have access to the CA's private key, so I can't use the certutil to …

---

## [Login Elasticsearch and Kibana](https://discuss.elastic.co/t/login-elasticsearch-and-kibana/337661)

<div class="topic-metadata">

**Author:** [@stephane\_chan](https://discuss.elastic.co/u/stephane_chan)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 11:14am UTC](https://discuss.elastic.co/t/login-elasticsearch-and-kibana/337661 "2023-07-05T11:14:09Z")

</div>

Hi, Is it possible to generate a token on the elasticsearch API? A sort of login (username/password) and the same on kibana? Currently, there's no such thing on my elasticsearch and kibana instance, and anyone can make…

---

## [Is it possible to restore a specific index from a datastream to a datastream from snapshot](https://discuss.elastic.co/t/is-it-possible-to-restore-a-specific-index-from-a-datastream-to-a-datastream-from-snapshot/334710)

<div class="topic-metadata">

**Author:** [@Kay\_Khan](https://discuss.elastic.co/u/Kay_Khan)\
**Replies:** 3\
**Last updated:** [July 5, 2023, 10:50am UTC](https://discuss.elastic.co/t/is-it-possible-to-restore-a-specific-index-from-a-datastream-to-a-datastream-from-snapshot/334710 "2023-07-05T10:50:47Z")

</div>

Recently we migrated our elasticsearch cluster and used snapshot/restore to do this. Unfortunately we forgot about a change we made to the lifecycle policy of a the apm traces datastream. Which meant data older than 90 …

---

## [Elasticsearch 8.5.2 -- Restoring datastreams isn’t working as planned](https://discuss.elastic.co/t/elasticsearch-8-5-2-restoring-datastreams-isn-t-working-as-planned/337645)

<div class="topic-metadata">

**Author:** [@Gautier\_Franchini](https://discuss.elastic.co/u/Gautier_Franchini)\
**Replies:** 1\
**Last updated:** [July 5, 2023, 10:48am UTC](https://discuss.elastic.co/t/elasticsearch-8-5-2-restoring-datastreams-isn-t-working-as-planned/337645 "2023-07-05T10:48:37Z")

</div>

Hello, I encountered an issue during a datastream restore this morning: What I want to achieve: restore the backuped indices from may 2023 in the same current working datastream ; I would like to avoid interruption of…

---

## [Cluster overshard issue](https://discuss.elastic.co/t/cluster-overshard-issue/337603)

<div class="topic-metadata">

**Author:** [@JasonREC](https://discuss.elastic.co/u/JasonREC)\
**Replies:** 1\
**Last updated:** [July 5, 2023, 10:22am UTC](https://discuss.elastic.co/t/cluster-overshard-issue/337603 "2023-07-05T10:22:20Z")

</div>

Hi, I have question about how to solve the cluster overshard issue sot that things can get back to normal/ Currently, I am renting 2 node in 2 different zone. And, I've encountered oversharding issue, show in the b…

---

## [Cannot connect to elasticsearch, via functionbeat(using AWS Lambda)](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-via-functionbeat-using-aws-lambda/337657)

<div class="topic-metadata">

**Author:** [@Kavan\_Dalwadi](https://discuss.elastic.co/u/Kavan_Dalwadi)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 10:42am UTC](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-via-functionbeat-using-aws-lambda/337657 "2023-07-05T10:42:39Z")

</div>

Currently I have deployed Elasticstack (ELK) on AWS EKS and Im using NodePort service for all the application My elasticsearch is running at- 54.2xx.xxx.xxx:30092/ (Which is the public IP address of EC2). I have lamb…

---

## [Error while performing snapshot and restore in 3 node elk cluster](https://discuss.elastic.co/t/error-while-performing-snapshot-and-restore-in-3-node-elk-cluster/337656)

<div class="topic-metadata">

**Author:** [@Raushan\_kumar](https://discuss.elastic.co/u/Raushan_kumar)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 10:40am UTC](https://discuss.elastic.co/t/error-while-performing-snapshot-and-restore-in-3-node-elk-cluster/337656 "2023-07-05T10:40:49Z")

</div>

so i am trying to perform snapshot and restore on 3 node cluster in elasticsearch 8.7 through nfs.but when i am putting the path.repo same path of shared directory so its giving me that this path.repo is not accessible.n…

---

## [When the master node publishes the cluster state, if a certain slave node fails to respond consistently and no timeout is set, does it mean that it will keep waiting and cannot complete?](https://discuss.elastic.co/t/when-the-master-node-publishes-the-cluster-state-if-a-certain-slave-node-fails-to-respond-consistently-and-no-timeout-is-set-does-it-mean-that-it-will-keep-waiting-and-cannot-complete/337595)

<div class="topic-metadata">

**Author:** [@cm\_z](https://discuss.elastic.co/u/cm_z)\
**Replies:** 2\
**Last updated:** [July 5, 2023, 9:47am UTC](https://discuss.elastic.co/t/when-the-master-node-publishes-the-cluster-state-if-a-certain-slave-node-fails-to-respond-consistently-and-no-timeout-is-set-does-it-mean-that-it-will-keep-waiting-and-cannot-complete/337595 "2023-07-05T09:47:35Z")

</div>

I found that when the master node publishes the cluster state, in the second phase, it will wait for all slave nodes to respond (successfully or unsuccessfully) before proceeding with the subsequent process. If a request…

---

## [Change path of data file](https://discuss.elastic.co/t/change-path-of-data-file/337633)

<div class="topic-metadata">

**Author:** [@Hi\_u\_Thu\_n](https://discuss.elastic.co/u/Hi_u_Thu_n)\
**Replies:** 4\
**Last updated:** [July 5, 2023, 9:39am UTC](https://discuss.elastic.co/t/change-path-of-data-file/337633 "2023-07-05T09:39:22Z")

</div>

I change path in file elasticsearch.yml but it not working! # ----------------------------------- Paths ------------------------------------ # # Path to directory where to store the data (separate multiple locations by …

---

## [Can not create update index pipeline without unique identifier in database](https://discuss.elastic.co/t/can-not-create-update-index-pipeline-without-unique-identifier-in-database/337494)

<div class="topic-metadata">

**Author:** [@PodarcisMuralis](https://discuss.elastic.co/u/PodarcisMuralis)\
**Replies:** 3\
**Last updated:** [July 5, 2023, 9:31am UTC](https://discuss.elastic.co/t/can-not-create-update-index-pipeline-without-unique-identifier-in-database/337494 "2023-07-05T09:31:05Z")

</div>

Hi all. I want to create an update index using jdbc input and elasticsearch output. I have a left joined table consists of 4 tables in database. But I do not have a unique identifier in db. Therefore I can not create …

---

## [No node formation by changing bootstrap.password on all node](https://discuss.elastic.co/t/no-node-formation-by-changing-bootstrap-password-on-all-node/337643)

<div class="topic-metadata">

**Author:** [@MALKARAJ\_K](https://discuss.elastic.co/u/MALKARAJ_K)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 9:06am UTC](https://discuss.elastic.co/t/no-node-formation-by-changing-bootstrap-password-on-all-node/337643 "2023-07-05T09:06:30Z")

</div>

Elasticsearch nodes couldn't form the cluster by changing bootstrap.password on each node

---

## [PutComposableIndexTemplateRequest in Custom Plugin](https://discuss.elastic.co/t/putcomposableindextemplaterequest-in-custom-plugin/337625)

<div class="topic-metadata">

**Author:** [@\_murat](https://discuss.elastic.co/u/_murat)\
**Replies:** 0\
**Last updated:** [July 5, 2023, 7:12am UTC](https://discuss.elastic.co/t/putcomposableindextemplaterequest-in-custom-plugin/337625 "2023-07-05T07:12:14Z")

</div>

Hello! I have been working on a custom Elasticsearch plugin that should create an index template and its components when an Elasticsearch instance loads this plugin. The only client that I can access is NodeClient and t…

---

## [Can I use "from/size", "timeout", "track\_total\_hits", "format", etc. for free?](https://discuss.elastic.co/t/can-i-use-from-size-timeout-track-total-hits-format-etc-for-free/337523)

<div class="topic-metadata">

**Author:** [@kimjinyoung](https://discuss.elastic.co/u/kimjinyoung)\
**Replies:** 2\
**Last updated:** [July 4, 2023, 11:46pm UTC](https://discuss.elastic.co/t/can-i-use-from-size-timeout-track-total-hits-format-etc-for-free/337523 "2023-07-04T23:46:30Z")

</div>

hi thank for watching Can I use "from/size", "timeout", "track\_total\_hits", "format", etc. for free? "When I looked it up on the following site, I found that "from/size", "timeout"," "track\_total\_hits" and "format" be…

---

## [Strategy for matching unstructured text to phrases in index](https://discuss.elastic.co/t/strategy-for-matching-unstructured-text-to-phrases-in-index/337583)

<div class="topic-metadata">

**Author:** [@rustunooldu](https://discuss.elastic.co/u/rustunooldu)\
**Replies:** 2\
**Last updated:** [July 4, 2023, 7:39pm UTC](https://discuss.elastic.co/t/strategy-for-matching-unstructured-text-to-phrases-in-index/337583 "2023-07-04T19:39:59Z")

</div>

I'm trying to extract data from product descriptions, and I have the catalog data indexed and categorized. For example, I have a color name index (that contains all possible colors for the product), and I want to be able…

---

## [Replicas shards of Default indexers are in UNASSIGNED State](https://discuss.elastic.co/t/replicas-shards-of-default-indexers-are-in-unassigned-state/336979)

<div class="topic-metadata">

**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\
**Replies:** 11\
**Last updated:** [July 4, 2023, 5:42pm UTC](https://discuss.elastic.co/t/replicas-shards-of-default-indexers-are-in-unassigned-state/336979 "2023-07-04T17:42:45Z")

</div>

Hi Team, Recently we are facing a issue with replicas shards and all default indexers replica shards are in UNASSIGNED State. due to this cluster is going to yellow and red state. index shard prirep state .ta…

---

## [How to check if a keyword exists in elastalert](https://discuss.elastic.co/t/how-to-check-if-a-keyword-exists-in-elastalert/337581)

<div class="topic-metadata">

**Author:** [@Chel\_Db](https://discuss.elastic.co/u/Chel_Db)\
**Replies:** 2\
**Last updated:** [July 4, 2023, 5:14pm UTC](https://discuss.elastic.co/t/how-to-check-if-a-keyword-exists-in-elastalert/337581 "2023-07-04T17:14:33Z")

</div>

I wanted to send out an alert to our slack channel if a there is an indexing error or the number of events \> 20 for last 10 minutes. Below is my elastalert yaml configuration. influx\_indexing\_error\_slack\_message\_rule: |…

---

## [ilm policy delete action is disable but index is still be deleted](https://discuss.elastic.co/t/ilm-policy-delete-action-is-disable-but-index-is-still-be-deleted/337515)

<div class="topic-metadata">

**Author:** [@frank\_spr](https://discuss.elastic.co/u/frank_spr)\
**Replies:** 2\
**Last updated:** [July 4, 2023, 4:37pm UTC](https://discuss.elastic.co/t/ilm-policy-delete-action-is-disable-but-index-is-still-be-deleted/337515 "2023-07-04T16:37:49Z")

</div>

My Elasticsearch index is managed by IML. Recently, I discovered that my index has been deleted for no reason, so I disabled the delete operation in the IML policy. However, I found that my index will still be deleted 1…

---

## [How to setup a cluster from scratch](https://discuss.elastic.co/t/how-to-setup-a-cluster-from-scratch/337564)

<div class="topic-metadata">

**Author:** [@Dheeraj\_Gupta](https://discuss.elastic.co/u/Dheeraj_Gupta)\
**Replies:** 4\
**Last updated:** [July 4, 2023, 2:31pm UTC](https://discuss.elastic.co/t/how-to-setup-a-cluster-from-scratch/337564 "2023-07-04T14:31:18Z")

</div>

Hi, I have been using elasticsearch for a long time. Our initial cluster was setup in 5.x days (installation procedures have been 'lost') and we have performed rolling upgrade ever since. Currently the cluster is 8.8 wi…

---

## [How to change the username by own instead of elastic?](https://discuss.elastic.co/t/how-to-change-the-username-by-own-instead-of-elastic/337552)

<div class="topic-metadata">

**Author:** [@merson](https://discuss.elastic.co/u/merson)\
**Replies:** 1\
**Last updated:** [July 4, 2023, 2:09pm UTC](https://discuss.elastic.co/t/how-to-change-the-username-by-own-instead-of-elastic/337552 "2023-07-04T14:09:37Z")

</div>

How to change the username by own instead of elastic in ELK?

---

## [Boost score if query contains all tokens in the field](https://discuss.elastic.co/t/boost-score-if-query-contains-all-tokens-in-the-field/337551)

<div class="topic-metadata">

**Author:** [@Siah\_Wei\_Chong](https://discuss.elastic.co/u/Siah_Wei_Chong)\
**Replies:** 0\
**Last updated:** [July 4, 2023, 10:31am UTC](https://discuss.elastic.co/t/boost-score-if-query-contains-all-tokens-in-the-field/337551 "2023-07-04T10:31:17Z")

</div>

I am new to Elasticsearch. I am working off Search for an address My query looks like this GET all\_address/\_search { "explain":true, "query":{ "multi\_match": { "query": "Flat 1, Floor 1, Raymond Court"…

---

## [Elastic Security Detection Rule Management - Update of Duplicates](https://discuss.elastic.co/t/elastic-security-detection-rule-management-update-of-duplicates/337550)

<div class="topic-metadata">

**Author:** [@hanna](https://discuss.elastic.co/u/hanna)\
**Replies:** 0\
**Last updated:** [July 4, 2023, 10:28am UTC](https://discuss.elastic.co/t/elastic-security-detection-rule-management-update-of-duplicates/337550 "2023-07-04T10:28:57Z")

</div>

Hi everyone, does anyone have experience with managing prebuilt detection rules with your own index-patterns and exceptions? Right now I load the prebuilt rules into kibana and then duplicate them in order to add my ow…

---

## [How to create request body for Rust Elasticsearch mSearch](https://discuss.elastic.co/t/how-to-create-request-body-for-rust-elasticsearch-msearch/337540)

<div class="topic-metadata">

**Author:** [@aniket\_mandhare](https://discuss.elastic.co/u/aniket_mandhare)\
**Replies:** 1\
**Last updated:** [July 4, 2023, 9:50am UTC](https://discuss.elastic.co/t/how-to-create-request-body-for-rust-elasticsearch-msearch/337540 "2023-07-04T09:50:50Z")

</div>

Please help me to implement multi search functionality or \_msearch api in in Rust programming language.

---

## [Balance Nodes by CPU Usage](https://discuss.elastic.co/t/balance-nodes-by-cpu-usage/336932)

<div class="topic-metadata">

**Author:** [@IsaacD](https://discuss.elastic.co/u/IsaacD)\
**Replies:** 10\
**Last updated:** [July 4, 2023, 8:06am UTC](https://discuss.elastic.co/t/balance-nodes-by-cpu-usage/336932 "2023-07-04T08:06:19Z")

</div>

Is there a way to balance the nodes by CPU instead of shard count? I'm constantly seeing 1-3 of our hot nodes sitting above 60% cpu usage where the other 6 hot nodes are around 10%. They all have the same amount of sha…

---

## [Java ElasticsearchClient: Conditionally mapping result hits to a certain object depending on a field or index](https://discuss.elastic.co/t/java-elasticsearchclient-conditionally-mapping-result-hits-to-a-certain-object-depending-on-a-field-or-index/337524)

<div class="topic-metadata">

**Author:** [@paulwellnerbou](https://discuss.elastic.co/u/paulwellnerbou)\
**Replies:** 0\
**Last updated:** [July 4, 2023, 7:33am UTC](https://discuss.elastic.co/t/java-elasticsearchclient-conditionally-mapping-result-hits-to-a-certain-object-depending-on-a-field-or-index/337524 "2023-07-04T07:33:09Z")

</div>

Using the Java ElasticsearchClient, is it possible to create a custom mapper, so that depending on a certain field (or index) of the result hit, a different object is mapped? I have several indices with different, but v…

---

## [External application to connect kafka in internal network](https://discuss.elastic.co/t/external-application-to-connect-kafka-in-internal-network/337481)

<div class="topic-metadata">

**Author:** [@Shalinicts](https://discuss.elastic.co/u/Shalinicts)\
**Replies:** 4\
**Last updated:** [July 4, 2023, 7:13am UTC](https://discuss.elastic.co/t/external-application-to-connect-kafka-in-internal-network/337481 "2023-07-04T07:13:05Z")

</div>

Hi Team, How can I expose Kafka to external network so that external source can connect or push data to my Kafka within internal network . Thanks

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=232)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=234)
