# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=53 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 54 --- ## [ILM with rollovers breaking data integrity](https://discuss.elastic.co/t/ilm-with-rollovers-breaking-data-integrity/369426)
**Author:** [@Kruttika](https://discuss.elastic.co/u/Kruttika)\ **Replies:** 16\ **Last updated:** [January 8, 2025, 8:28am UTC](https://discuss.elastic.co/t/ilm-with-rollovers-breaking-data-integrity/369426 "2025-01-08T08:28:35Z")
Hello, We have an index where we need to continuously write new docs, run full-text searches and update the matched docs with a flag. The data consists of social media posts and news articles with timestamps. We previo… --- ## [What does slash stand for in a index request?](https://discuss.elastic.co/t/what-does-slash-stand-for-in-a-index-request/372914)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 2\ **Last updated:** [January 8, 2025, 8:02am UTC](https://discuss.elastic.co/t/what-does-slash-stand-for-in-a-index-request/372914 "2025-01-08T08:02:21Z")
Maybe a stupid question, I ask because I feel like there could be some concept about ES index that I'm not aware of (and maybe many others don't know either.). So it's worth to ask this question because it can be helpful… --- ## [Is it possible to set task\_id?](https://discuss.elastic.co/t/is-it-possible-to-set-task-id/372919)
**Author:** [@asafalroy](https://discuss.elastic.co/u/asafalroy)\ **Replies:** 0\ **Last updated:** [January 8, 2025, 7:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-set-task-id/372919 "2025-01-08T07:06:20Z")
Hey! Our team heavily relies on traces and I wondered if there was a way to set the task\_id of the elastic query to be the traceId from the services that made the request for troubleshooting purposes (long running tasks… --- ## [ILM created incorrect index name](https://discuss.elastic.co/t/ilm-created-incorrect-index-name/372877)
**Author:** [@Naveen\_S1](https://discuss.elastic.co/u/Naveen_S1)\ **Replies:** 0\ **Last updated:** [January 7, 2025, 5:32am UTC](https://discuss.elastic.co/t/ilm-created-incorrect-index-name/372877 "2025-01-07T05:32:26Z")
I have an ILM policy that creates a new index once the index reaches 250GB. With the incoming data, the current trend is 1 index / 1 day. I have started indexing 2 months before. I have started the initial index with the… --- ## [The inference processor triggers interface rate limiting](https://discuss.elastic.co/t/the-inference-processor-triggers-interface-rate-limiting/369902)
**Author:** [@Huaixinww](https://discuss.elastic.co/u/Huaixinww)\ **Replies:** 4\ **Last updated:** [January 8, 2025, 2:38am UTC](https://discuss.elastic.co/t/the-inference-processor-triggers-interface-rate-limiting/369902 "2025-01-08T02:38:32Z")
When using Elasticsearch's Inference API and Inference Processor to vectorize and write text (using Alibaba's text embedding model, PR:(\[Inference API\] Add Alibaba Cloud AI Search Model support to Inference API #111181),… --- ## [Question: Shard allocation awareness and search routing](https://discuss.elastic.co/t/question-shard-allocation-awareness-and-search-routing/372913)
**Author:** [@Huaixinww](https://discuss.elastic.co/u/Huaixinww)\ **Replies:** 0\ **Last updated:** [January 8, 2025, 2:36am UTC](https://discuss.elastic.co/t/question-shard-allocation-awareness-and-search-routing/372913 "2025-01-08T02:36:06Z")
Elasticsearch Version: 7.10.0 question: We have three awareness zones, and we found that the query traffic of the business is unevenly distributed among these zones. I researched related issues：Shard allocation awarene… --- ## [The update history of cluster settings](https://discuss.elastic.co/t/the-update-history-of-cluster-settings/372872)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 3\ **Last updated:** [January 8, 2025, 1:53am UTC](https://discuss.elastic.co/t/the-update-history-of-cluster-settings/372872 "2025-01-08T01:53:44Z")
as per doc update cluster settings request the api request updates the cluster settings. My question is - Is there any logs for tracking each time this api is called? I ask because we're seeing a strange setting in the… --- ## [How to restart elasticsearch after a power outage?](https://discuss.elastic.co/t/how-to-restart-elasticsearch-after-a-power-outage/372763)
**Author:** [@learningelastic](https://discuss.elastic.co/u/learningelastic)\ **Replies:** 5\ **Last updated:** [January 8, 2025, 1:07am UTC](https://discuss.elastic.co/t/how-to-restart-elasticsearch-after-a-power-outage/372763 "2025-01-08T01:07:42Z")
I have been hosting elasticsearch locally on my computer for over 1 year. It has been operating perfectly. Earlier this morning, there was a power outage in my city which caused my computer to lose power and unexpecte… --- ## [Is it possible to determine if an index was created automatically?](https://discuss.elastic.co/t/is-it-possible-to-determine-if-an-index-was-created-automatically/372874)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 3\ **Last updated:** [January 8, 2025, 12:50am UTC](https://discuss.elastic.co/t/is-it-possible-to-determine-if-an-index-was-created-automatically/372874 "2025-01-08T00:50:12Z")
Hi everyone, there are thousands of indices in our ES cluaster. Some of them were created automatically and some were explicitly created with a PUT request. I need to get the list of indices that were auto created whic… --- ## [Is the guidance for cluster.routing.allocation.\* settings still accurate?](https://discuss.elastic.co/t/is-the-guidance-for-cluster-routing-allocation-settings-still-accurate/372909)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 0\ **Last updated:** [January 7, 2025, 9:22pm UTC](https://discuss.elastic.co/t/is-the-guidance-for-cluster-routing-allocation-settings-still-accurate/372909 "2025-01-07T21:22:42Z")
Hi All, I was curious if anyone knows if the guidance for the cluster.routing.allocation.\* settings (ex: cluster.routing.allocation.node\_concurrent\_recoveries & cluster.routing.allocation.node\_initial\_primaries\_recoveri… --- ## [How to get all the suggestions in completion query](https://discuss.elastic.co/t/how-to-get-all-the-suggestions-in-completion-query/372882)
**Author:** [@Capybara07](https://discuss.elastic.co/u/Capybara07)\ **Replies:** 1\ **Last updated:** [January 7, 2025, 12:16pm UTC](https://discuss.elastic.co/t/how-to-get-all-the-suggestions-in-completion-query/372882 "2025-01-07T12:16:08Z")
so here is my mapping "skills\_completion": { "type": "completion", "contexts": \[ { "name": "api\_key", "type": "category" } \] }, and below are my inserted data… --- ## [Way to align Text in Discovery View](https://discuss.elastic.co/t/way-to-align-text-in-discovery-view/372804)
**Author:** [@samer\_saleh](https://discuss.elastic.co/u/samer_saleh)\ **Replies:** 11\ **Last updated:** [January 7, 2025, 11:41am UTC](https://discuss.elastic.co/t/way-to-align-text-in-discovery-view/372804 "2025-01-07T11:41:06Z")
Hi, I have created a Discovery View that I would like to use in a dashboard , but I could not find a way to align text in certain columns. Is there a way to do it? I understand Discovery are just for looking up data wit… --- ## [Parameters to consider for sizing and setting up an elastic search cluster in on-premise environment?](https://discuss.elastic.co/t/parameters-to-consider-for-sizing-and-setting-up-an-elastic-search-cluster-in-on-premise-environment/372886)
**Author:** [@ganesh\_wf](https://discuss.elastic.co/u/ganesh_wf)\ **Replies:** 2\ **Last updated:** [January 7, 2025, 8:50am UTC](https://discuss.elastic.co/t/parameters-to-consider-for-sizing-and-setting-up-an-elastic-search-cluster-in-on-premise-environment/372886 "2025-01-07T08:50:45Z")
Documentation about deciding no. of cluster nodes, CPU, RAM, disks and high availability etc... is needed. --- ## [ElasticSearch for OpenMetadata for multiple enviroments](https://discuss.elastic.co/t/elasticsearch-for-openmetadata-for-multiple-enviroments/372647)
**Author:** [@Jake\_K](https://discuss.elastic.co/u/Jake_K)\ **Replies:** 2\ **Last updated:** [January 7, 2025, 4:06am UTC](https://discuss.elastic.co/t/elasticsearch-for-openmetadata-for-multiple-enviroments/372647 "2025-01-07T04:06:35Z")
I would like to explore setting up Elasticsearch in Azure (Managed Service) to work with OpenMetadata. We will have 3 environments for OpenMetadata - Dev, QA and Prod. Question I have is whether we can use just one Ela… --- ## [When installing ElasticFlow 7.5, get fatal exception while bootstraping Elasticsearch](https://discuss.elastic.co/t/when-installing-elasticflow-7-5-get-fatal-exception-while-bootstraping-elasticsearch/372869)
**Author:** [@tallguy86](https://discuss.elastic.co/u/tallguy86)\ **Replies:** 5\ **Last updated:** [January 7, 2025, 2:46am UTC](https://discuss.elastic.co/t/when-installing-elasticflow-7-5-get-fatal-exception-while-bootstraping-elasticsearch/372869 "2025-01-07T02:46:40Z")
When following the install guide for Elasticsearch for Red Hat, Install Elasticsearch, 7. Edit elasticsearch.yml: I am being told that the config is enough to get started for a single node so I deleted all lines and pas… --- ## [Kibana Shrink Index](https://discuss.elastic.co/t/kibana-shrink-index/372410)
**Author:** [@peter170805](https://discuss.elastic.co/u/peter170805)\ **Replies:** 7\ **Last updated:** [January 6, 2025, 7:46pm UTC](https://discuss.elastic.co/t/kibana-shrink-index/372410 "2025-01-06T19:46:24Z")
Good morning friends. I am a little new to the Elastic topic. The problem is that in the company we have a Kibana version 7.5.1, I know that the version is old, but for the moment it is impossible to change it. The index… --- ## [Do I have to update mappings in existing indices after adding new fields in the index template?](https://discuss.elastic.co/t/do-i-have-to-update-mappings-in-existing-indices-after-adding-new-fields-in-the-index-template/372811)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 2\ **Last updated:** [January 6, 2025, 3:02pm UTC](https://discuss.elastic.co/t/do-i-have-to-update-mappings-in-existing-indices-after-adding-new-fields-in-the-index-template/372811 "2025-01-06T15:02:03Z")
Hi everyone, I have an index template and have already a lot of indices created based on this template. Now I'm going to add new fields in the index template. Will these new fields be added to existing indices automat… --- ## [How to update only a single setting in cluster settings?](https://discuss.elastic.co/t/how-to-update-only-a-single-setting-in-cluster-settings/372810)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 2\ **Last updated:** [January 6, 2025, 2:59pm UTC](https://discuss.elastic.co/t/how-to-update-only-a-single-setting-in-cluster-settings/372810 "2025-01-06T14:59:58Z")
Hi everyone, this page says we can update cluster settings with a PUT request, like below PUT /\_cluster/settings { "persistent" : { "indices.recovery.max\_bytes\_per\_sec" : "50mb" } } link to the page Since it'… --- ## [ILM is failing to delete closed indices](https://discuss.elastic.co/t/ilm-is-failing-to-delete-closed-indices/372755)
**Author:** [@GustavoSantos](https://discuss.elastic.co/u/GustavoSantos)\ **Replies:** 8\ **Last updated:** [January 6, 2025, 2:44pm UTC](https://discuss.elastic.co/t/ilm-is-failing-to-delete-closed-indices/372755 "2025-01-06T14:44:46Z")
ILM is failing to delete a few closed indices. We are getting the following issue: policy \[\\] for index \[\\] on an error step due to a transient error, moving back to the failed step \[wait-for-shard-… --- ## [I am encountering an issue while attempting to verify a snapshot repository in Elasticsearch. The repository is named old-indices. Below is the relevant log entry from the Elasticsearch cluster:](https://discuss.elastic.co/t/i-am-encountering-an-issue-while-attempting-to-verify-a-snapshot-repository-in-elasticsearch-the-repository-is-named-old-indices-below-is-the-relevant-log-entry-from-the-elasticsearch-cluster/372658)
**Author:** [@abdelkriem](https://discuss.elastic.co/u/abdelkriem)\ **Replies:** 9\ **Last updated:** [January 6, 2025, 2:12pm UTC](https://discuss.elastic.co/t/i-am-encountering-an-issue-while-attempting-to-verify-a-snapshot-repository-in-elasticsearch-the-repository-is-named-old-indices-below-is-the-relevant-log-entry-from-the-elasticsearch-cluster/372658 "2025-01-06T14:12:07Z")
\[2024-12-31T17:06:04,282\] \[WARN \] \[r.suppressed \] \[Elastic-Master-1\] path: /\_snapshot/old-indices/\_verify, params: {repository=old-indices}, status: 500org.elasticsearch.repositories.RepositoryVerificationException: \[old… --- ## [Dont count sources bytes and destinations bytes in filebeat netflow](https://discuss.elastic.co/t/dont-count-sources-bytes-and-destinations-bytes-in-filebeat-netflow/372822)
**Author:** [@Komeyl\_Pouya](https://discuss.elastic.co/u/Komeyl_Pouya)\ **Replies:** 4\ **Last updated:** [January 6, 2025, 4:16am UTC](https://discuss.elastic.co/t/dont-count-sources-bytes-and-destinations-bytes-in-filebeat-netflow/372822 "2025-01-06T04:16:27Z")
hi everyone PLZ help me i have ELK 8.17 (elasticsearch-logstech-kibana-filebeat) and send netflow from router to filebeat and recive all of netflow in ELK but dont count sources bytes and destinations bytes!!! and ju… --- ## [Route Logstash ES output plugin bulk Indexing request to Co-ordinating only vs Data nodes](https://discuss.elastic.co/t/route-logstash-es-output-plugin-bulk-indexing-request-to-co-ordinating-only-vs-data-nodes/372820)
**Author:** [@MChat](https://discuss.elastic.co/u/MChat)\ **Replies:** 0\ **Last updated:** [January 6, 2025, 2:15am UTC](https://discuss.elastic.co/t/route-logstash-es-output-plugin-bulk-indexing-request-to-co-ordinating-only-vs-data-nodes/372820 "2025-01-06T02:15:52Z")
I have a ES cluster (Total 10 nodes) set up as below: 2 - Co-ordinating nodes 3 - Dedicated master only nodes 5 - Data only nodes we do have multiple logstash pipelines (running at a schedule of every 1 sec) which pe… --- ## [Migration from 5.x to 8.x](https://discuss.elastic.co/t/migration-from-5-x-to-8-x/372772)
**Author:** [@kri](https://discuss.elastic.co/u/kri)\ **Replies:** 2\ **Last updated:** [January 5, 2025, 3:27pm UTC](https://discuss.elastic.co/t/migration-from-5-x-to-8-x/372772 "2025-01-05T15:27:57Z")
I am new here, I am trying to migrate from elastic 5.x to 8.x. I have a couple indexes including parent child relation as well.can anyone provide guidance on where to start ? I have created separate indexes from exisitng… --- ## [Incremental snapshots are failing in "Trying to write new repository data over unfinished write"](https://discuss.elastic.co/t/incremental-snapshots-are-failing-in-trying-to-write-new-repository-data-over-unfinished-write/372408)
**Author:** [@Rajesh\_Kannan](https://discuss.elastic.co/u/Rajesh_Kannan)\ **Replies:** 7\ **Last updated:** [January 3, 2025, 12:11pm UTC](https://discuss.elastic.co/t/incremental-snapshots-are-failing-in-trying-to-write-new-repository-data-over-unfinished-write/372408 "2025-01-03T12:11:20Z")
The incremental snapshot is failing with the below error. There is only one successful backup created and the daily crons are failing with the below errors. {"type": "server", "timestamp": "2024-12-26T06:46:46,097Z", "l… --- ## [\_sql/translate api translate incorect case when field](https://discuss.elastic.co/t/sql-translate-api-translate-incorect-case-when-field/372741)
**Author:** [@tung238](https://discuss.elastic.co/u/tung238)\ **Replies:** 1\ **Last updated:** [January 3, 2025, 12:08pm UTC](https://discuss.elastic.co/t/sql-translate-api-translate-incorect-case-when-field/372741 "2025-01-03T12:08:16Z")
I have a query like this and although /\_sql endpoint return correct results. /\_sql/translate only return fields that use in query, without calculation POST /\_sql/translate { "query": "SELECT Broker,IssueCount,Splits,C… --- ## [How we can manage to large shards on index?](https://discuss.elastic.co/t/how-we-can-manage-to-large-shards-on-index/372652)
**Author:** [@calvin01](https://discuss.elastic.co/u/calvin01)\ **Replies:** 11\ **Last updated:** [January 2, 2025, 4:19pm UTC](https://discuss.elastic.co/t/how-we-can-manage-to-large-shards-on-index/372652 "2025-01-02T16:19:13Z")
Hello, community Issue Overview: We are encountering an issue with one of our indices, which has entered an alerting state. The shard size for this index is currently 129.27GB, and it continues to increase. The index i… --- ## [Documentation for upgrading elasticsearch from archived repository to eck-stack](https://discuss.elastic.co/t/documentation-for-upgrading-elasticsearch-from-archived-repository-to-eck-stack/366057)
**Author:** [@ashwani.agrawal](https://discuss.elastic.co/u/ashwani.agrawal)\ **Replies:** 5\ **Last updated:** [January 2, 2025, 3:34pm UTC](https://discuss.elastic.co/t/documentation-for-upgrading-elasticsearch-from-archived-repository-to-eck-stack/366057 "2025-01-02T15:34:08Z")
Hi Team, We are currently using elasticsearch on our kubernetes cluster installed using archived helm chart repository: helm-charts/elasticsearch at main · elastic/helm-charts · GitHub 8.1.3 version. Now we need to upd… --- ## [Elasticsearch Semantic\_text Search](https://discuss.elastic.co/t/elasticsearch-semantic-text-search/372361)
**Author:** [@samer\_saleh](https://discuss.elastic.co/u/samer_saleh)\ **Replies:** 1\ **Last updated:** [January 2, 2025, 3:31pm UTC](https://discuss.elastic.co/t/elasticsearch-semantic-text-search/372361 "2025-01-02T15:31:27Z")
Hi, Is there any plans to make the semantic\_text field nested on the future so that chunks can be searched , scored and returned as part of inner\_hits query? Right now it doesnt seem like there is a way to do that. yes… --- ## [Normalizing knn and multi\_match clauses](https://discuss.elastic.co/t/normalizing-knn-and-multi-match-clauses/372307)
**Author:** [@Itay\_Bittan](https://discuss.elastic.co/u/Itay_Bittan)\ **Replies:** 1\ **Last updated:** [January 2, 2025, 1:40pm UTC](https://discuss.elastic.co/t/normalizing-knn-and-multi-match-clauses/372307 "2025-01-02T13:40:37Z")
I have a product catalog as Elasticsearch (8.16.1) index. Each doc represent a product with different fields, such as name, color, etc. I've added a vector as additional field to each product / doc. My search is can b… --- ## [How to stop/start an elastic cluster in AKS](https://discuss.elastic.co/t/how-to-stop-start-an-elastic-cluster-in-aks/371871)
**Author:** [@Manuel\_Osorio](https://discuss.elastic.co/u/Manuel_Osorio)\ **Replies:** 1\ **Last updated:** [January 1, 2025, 7:30pm UTC](https://discuss.elastic.co/t/how-to-stop-start-an-elastic-cluster-in-aks/371871 "2025-01-01T19:30:32Z")
Hi everyone, I need to find a way to stop an elastic cluster for some cost savings, I am looking how to do it and start the cluster only when it's required. could you please share some guidance for this? Thanks a lot [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=52) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=54)