# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=55

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 56

---

## [Importing Hugging Face Model into my Desktop](https://discuss.elastic.co/t/importing-hugging-face-model-into-my-desktop/372173)

<div class="topic-metadata">

**Author:** [@samer\_saleh](https://discuss.elastic.co/u/samer_saleh)\
**Replies:** 1\
**Last updated:** [December 20, 2024, 5:55pm UTC](https://discuss.elastic.co/t/importing-hugging-face-model-into-my-desktop/372173 "2024-12-20T17:55:29Z")

</div>

Hi All, Im trying to follow the code for chunking and indexing large documents . My problem right now is that I dont know how to import the semantic\_search model as specified in the ingest pipeline processor : { …

---

## [Indexing is getting slower and slower as it progresses](https://discuss.elastic.co/t/indexing-is-getting-slower-and-slower-as-it-progresses/371802)

<div class="topic-metadata">

**Author:** [@Raja95](https://discuss.elastic.co/u/Raja95)\
**Replies:** 30\
**Last updated:** [December 20, 2024, 4:25pm UTC](https://discuss.elastic.co/t/indexing-is-getting-slower-and-slower-as-it-progresses/371802 "2024-12-20T16:25:33Z")

</div>

I am trying to index 114mil rows of data with 150mil attachments from a PeopleSoft application to ES 6.1 (due to compatibility with PeopleSoft, can't upgrade to higher versions). Elastic Configuration: A single node (C…

---

## [Enrich Processor Usability](https://discuss.elastic.co/t/enrich-processor-usability/372279)

<div class="topic-metadata">

**Author:** [@jmello31](https://discuss.elastic.co/u/jmello31)\
**Replies:** 0\
**Last updated:** [December 20, 2024, 3:49pm UTC](https://discuss.elastic.co/t/enrich-processor-usability/372279 "2024-12-20T15:49:27Z")

</div>

Hello! I am dealing with a large data set that is configured with multiple data-streams and 0 concrete indices that I use. I am trying to use an enrich processor to grab information residing in some of the logs in one da…

---

## [After upgrading Elasticsearch from 5.3 to 5.6, do I need to reindex for schema updates](https://discuss.elastic.co/t/after-upgrading-elasticsearch-from-5-3-to-5-6-do-i-need-to-reindex-for-schema-updates/372267)

<div class="topic-metadata">

**Author:** [@Maelito](https://discuss.elastic.co/u/Maelito)\
**Replies:** 3\
**Last updated:** [December 20, 2024, 3:36pm UTC](https://discuss.elastic.co/t/after-upgrading-elasticsearch-from-5-3-to-5-6-do-i-need-to-reindex-for-schema-updates/372267 "2024-12-20T15:36:15Z")

</div>

Hello, I recently upgraded my Elasticsearch cluster from version 5.3 to 5.6. I’m now updating my schema to address deprecations introduced in 5.6. Below is the diff of the schema updates I intend to make: { "properti…

---

## [Elasticsearch Audit Logs are Incomplete and lacks important information](https://discuss.elastic.co/t/elasticsearch-audit-logs-are-incomplete-and-lacks-important-information/372189)

<div class="topic-metadata">

**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Replies:** 1\
**Last updated:** [December 20, 2024, 4:21am UTC](https://discuss.elastic.co/t/elasticsearch-audit-logs-are-incomplete-and-lacks-important-information/372189 "2024-12-20T04:21:23Z")

</div>

Hello, We recently configured the Audit logs on our on-prem cluster and configured an Elastic Agent to collect it, the goal is to build some custom dashboards and maybe some security rules on this data. While doing som…

---

## [Rolling Restart and Tasks](https://discuss.elastic.co/t/rolling-restart-and-tasks/372242)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [December 19, 2024, 8:04pm UTC](https://discuss.elastic.co/t/rolling-restart-and-tasks/372242 "2024-12-19T20:04:24Z")

</div>

Hello, I was wondering, if a I have ongoing tasks and I decide to do a rolling restart on the nodes in our elastic cluster. Would those tasks be dropped or continue back up to where they last left off?

---

## [Migrating from .net Nest client to v8.\* Elastic.Clients.Elasticsearch .net client](https://discuss.elastic.co/t/migrating-from-net-nest-client-to-v8-elastic-clients-elasticsearch-net-client/371465)

<div class="topic-metadata">

**Author:** [@utkarsh-007](https://discuss.elastic.co/u/utkarsh-007)\
**Replies:** 0\
**Last updated:** [December 4, 2024, 12:59pm UTC](https://discuss.elastic.co/t/migrating-from-net-nest-client-to-v8-elastic-clients-elasticsearch-net-client/371465 "2024-12-04T12:59:38Z")

</div>

I’m migrating an API codebase from the .net v7.\* Nest client to the newer v8 .net client The API codebase using the Nest client makes frequent use of QueryDescriptors with logic operators that derive QueryContainer obje…

---

## [ERROR: Elasticsearch died while starting up, with exit code 78](https://discuss.elastic.co/t/error-elasticsearch-died-while-starting-up-with-exit-code-78/365295)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 2\
**Last updated:** [December 19, 2024, 3:33pm UTC](https://discuss.elastic.co/t/error-elasticsearch-died-while-starting-up-with-exit-code-78/365295 "2024-12-19T15:33:36Z")

</div>

hello world :wink: i'm trying to start the elasticsearch, yet running into the following error: elk1-es01-1 | {"@timestamp":"2024-08-21T15:06:11.078Z", "log.level": "INFO", "message":"Native controller process has sto…

---

## [API key definition](https://discuss.elastic.co/t/api-key-definition/372212)

<div class="topic-metadata">

**Author:** [@Joey\_Visbeen](https://discuss.elastic.co/u/Joey_Visbeen)\
**Replies:** 0\
**Last updated:** [December 19, 2024, 9:46am UTC](https://discuss.elastic.co/t/api-key-definition/372212 "2024-12-19T09:46:04Z")

</div>

I was hoping to start this discussion with somebody from Elastic. Currently, the team I work with have been actively using the REST API's from Kibana and Elasticsearch allot, but have come across the difficulty of settin…

---

## [Elastic 8.17 and \_source](https://discuss.elastic.co/t/elastic-8-17-and-source/372181)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 2\
**Last updated:** [December 19, 2024, 1:13pm UTC](https://discuss.elastic.co/t/elastic-8-17-and-source/372181 "2024-12-19T13:13:20Z")

</div>

I was reading through 8.17.0 release note. first thing it says \_source is no longer available without subscription. is this means if you create index it won't have \_source and this means not able to update, update\_by\_q…

---

## [Elasticsearch Configuration for 220 Million Records (400 GB Data)](https://discuss.elastic.co/t/elasticsearch-configuration-for-220-million-records-400-gb-data/372148)

<div class="topic-metadata">

**Author:** [@dhanunjayavarma](https://discuss.elastic.co/u/dhanunjayavarma)\
**Replies:** 3\
**Last updated:** [December 19, 2024, 12:18pm UTC](https://discuss.elastic.co/t/elasticsearch-configuration-for-220-million-records-400-gb-data/372148 "2024-12-19T12:18:07Z")

</div>

Hi, I am planning to develop a full-text search engine using Elasticsearch 8.x to handle approximately 220 million records, totaling around 400 GB of data. Each document consists of a mix of full-text fields and filter …

---

## [Migrating from Elastic NEST v7 to .NET Elastic Client v8: Bulk indexing issue](https://discuss.elastic.co/t/migrating-from-elastic-nest-v7-to-net-elastic-client-v8-bulk-indexing-issue/371929)

<div class="topic-metadata">

**Author:** [@trubs](https://discuss.elastic.co/u/trubs)\
**Replies:** 4\
**Last updated:** [December 19, 2024, 8:59am UTC](https://discuss.elastic.co/t/migrating-from-elastic-nest-v7-to-net-elastic-client-v8-bulk-indexing-issue/371929 "2024-12-19T08:59:21Z")

</div>

I'm new to web development and working with Elastic, and I'm currently migrating a project from Elastic NEST v7 to the .NET Elastic Client v8. I've encountered an issue with bulk indexing in one of the projects. What wo…

---

## [Reindex from remote. From v8.5.1 to v7.17.1 error](https://discuss.elastic.co/t/reindex-from-remote-from-v8-5-1-to-v7-17-1-error/372153)

<div class="topic-metadata">

**Author:** [@Khanh\_Tran13579](https://discuss.elastic.co/u/Khanh_Tran13579)\
**Replies:** 5\
**Last updated:** [December 19, 2024, 8:27am UTC](https://discuss.elastic.co/t/reindex-from-remote-from-v8-5-1-to-v7-17-1-error/372153 "2024-12-19T08:27:43Z")

</div>

I am trying to reindex from the remote server. The source version is 8.5.1 and the dest version is 7.17.1. I got the error below. Please help me explain this error and how to solve it. { "error": { "root\_cause": \[…

---

## [Snapshot restore data stream problems](https://discuss.elastic.co/t/snapshot-restore-data-stream-problems/372170)

<div class="topic-metadata">

**Author:** [@Dave\_Houser](https://discuss.elastic.co/u/Dave_Houser)\
**Replies:** 0\
**Last updated:** [December 18, 2024, 2:48pm UTC](https://discuss.elastic.co/t/snapshot-restore-data-stream-problems/372170 "2024-12-18T14:48:02Z")

</div>

Running 8.13 I am working on restoring a data stream from a snapshot. I am doing this in a surgical way as I need to be able to write to indexes in snapshots while the restore of all other indexes happens in the backgro…

---

## [Traditional Group By With Aggregations & Pagination](https://discuss.elastic.co/t/traditional-group-by-with-aggregations-pagination/372151)

<div class="topic-metadata">

**Author:** [@jespin](https://discuss.elastic.co/u/jespin)\
**Replies:** 2\
**Last updated:** [December 18, 2024, 11:59am UTC](https://discuss.elastic.co/t/traditional-group-by-with-aggregations-pagination/372151 "2024-12-18T11:59:28Z")

</div>

Hi all, We are looking to rewrite our current Elastic search implementation as it's not fit for purpose. We have a number of hotels which we index in as a single document with all of the packages available for that hot…

---

## [Semantic Search in Java](https://discuss.elastic.co/t/semantic-search-in-java/372141)

<div class="topic-metadata">

**Author:** [@erkosh](https://discuss.elastic.co/u/erkosh)\
**Replies:** 1\
**Last updated:** [December 18, 2024, 9:09am UTC](https://discuss.elastic.co/t/semantic-search-in-java/372141 "2024-12-18T09:09:15Z")

</div>

I want to add a semantic search feature to my project but cannot find a good method. I tried using ELSER, but the libraries are deprecated. Is there any way to add semantic search in Java Spring?

---

## [Delete .monitoring index as it's unassigned elk 8.7](https://discuss.elastic.co/t/delete-monitoring-index-as-its-unassigned-elk-8-7/372144)

<div class="topic-metadata">

**Author:** [@amoghbarve](https://discuss.elastic.co/u/amoghbarve)\
**Replies:** 0\
**Last updated:** [December 18, 2024, 8:12am UTC](https://discuss.elastic.co/t/delete-monitoring-index-as-its-unassigned-elk-8-7/372144 "2024-12-18T08:12:16Z")

</div>

Hi All... Need one guidance I am using Elasticsearch 8.7 and my cluster status is yellow Upon checking I find that the . monitoring index is in unassigned status . Can it be deleted or dropped ? Is there any impact ? …

---

## [Snapshot Repository is 8x larger than total clustered data!?!?!](https://discuss.elastic.co/t/snapshot-repository-is-8x-larger-than-total-clustered-data/371625)

<div class="topic-metadata">

**Author:** [@ivanlawrence](https://discuss.elastic.co/u/ivanlawrence)\
**Replies:** 1\
**Last updated:** [December 18, 2024, 8:08am UTC](https://discuss.elastic.co/t/snapshot-repository-is-8x-larger-than-total-clustered-data/371625 "2024-12-18T08:08:16Z")

</div>

My cluster has a total usage reported by kibana (kibana/app/monitoring#/overview) as 1TB (102 indices with one replica.) Snapshots go to backblaze (as the s3 default client) which is reporting 8TB stored. I was snappin…

---

## [How to modify the content of the field in source?](https://discuss.elastic.co/t/how-to-modify-the-content-of-the-field-in-source/372097)

<div class="topic-metadata">

**Author:** [@yoopaan](https://discuss.elastic.co/u/yoopaan)\
**Replies:** 1\
**Last updated:** [December 18, 2024, 3:18am UTC](https://discuss.elastic.co/t/how-to-modify-the-content-of-the-field-in-source/372097 "2024-12-18T03:18:04Z")

</div>

I want to process the query return value of the document in the source code and implement the following operations: index: { "id": 1001, "title":"abcd" } return: { "id": 1001, "title": "bcde" } That is, replace the…

---

## [Nested object behavior](https://discuss.elastic.co/t/nested-object-behavior/372087)

<div class="topic-metadata">

**Author:** [@Carlos\_Barros](https://discuss.elastic.co/u/Carlos_Barros)\
**Replies:** 2\
**Last updated:** [December 17, 2024, 7:52pm UTC](https://discuss.elastic.co/t/nested-object-behavior/372087 "2024-12-17T19:52:09Z")

</div>

Hi, I have the situation exemplified below. I wonder if any of you can tell why when I search in the fields of the nested object "partes" I can't find the document that contains "fulano" and "beltrano" in the nested obje…

---

## [DLQ Errors after upgrading ELK (Elasticsearch and Kibana) from 7.17 to 8.15.2](https://discuss.elastic.co/t/dlq-errors-after-upgrading-elk-elasticsearch-and-kibana-from-7-17-to-8-15-2/372083)

<div class="topic-metadata">

**Author:** [@ErGeek](https://discuss.elastic.co/u/ErGeek)\
**Replies:** 1\
**Last updated:** [December 17, 2024, 6:22pm UTC](https://discuss.elastic.co/t/dlq-errors-after-upgrading-elk-elasticsearch-and-kibana-from-7-17-to-8-15-2/372083 "2024-12-17T18:22:06Z")

</div>

Hi All, Our log management process starts from Beats -\> MSK (Kafka) -\> Logstash -\> Elasticsearch -\> Kibana. We recently upgraded our Elastic cluster (application-test-cluster) in October. However, since the upgrade, we …

---

## [Does a utility function exist for converting SearchRequest into a RequestItem for elasticsearch-java?](https://discuss.elastic.co/t/does-a-utility-function-exist-for-converting-searchrequest-into-a-requestitem-for-elasticsearch-java/372071)

<div class="topic-metadata">

**Author:** [@Hans\_Kruse](https://discuss.elastic.co/u/Hans_Kruse)\
**Replies:** 1\
**Last updated:** [December 17, 2024, 4:18pm UTC](https://discuss.elastic.co/t/does-a-utility-function-exist-for-converting-searchrequest-into-a-requestitem-for-elasticsearch-java/372071 "2024-12-17T16:18:25Z")

</div>

Does a utility function exist for converting a SearchRequest into a RequestItem for performing multi search requests with the elasticsearch-java. The Java highlevel client allowed to create a multisearch request usi…

---

## [Self managed cluster](https://discuss.elastic.co/t/self-managed-cluster/372052)

<div class="topic-metadata">

**Author:** [@searchwithme](https://discuss.elastic.co/u/searchwithme)\
**Replies:** 1\
**Last updated:** [December 17, 2024, 1:02pm UTC](https://discuss.elastic.co/t/self-managed-cluster/372052 "2024-12-17T13:02:49Z")

</div>

A few questions on setting up a self managed cluster: I will be ingesting 100 gb data per day, want to do queries for a month. How to set up hot, warm, cold, frozen tier with self managed cluster? If I have to set up j…

---

## [How to translate HighLevel client Bucket order to elasticsearch-java](https://discuss.elastic.co/t/how-to-translate-highlevel-client-bucket-order-to-elasticsearch-java/371840)

<div class="topic-metadata">

**Author:** [@Hans\_Kruse](https://discuss.elastic.co/u/Hans_Kruse)\
**Replies:** 3\
**Last updated:** [December 17, 2024, 10:36am UTC](https://discuss.elastic.co/t/how-to-translate-highlevel-client-bucket-order-to-elasticsearch-java/371840 "2024-12-17T10:36:20Z")

</div>

In our Elasticsearch highlevel client based code we have some code that uses the BucketOrder.key(...) and BucketOrder.count(...) factory methods. What are equivalent constructs for the the elasticsearch-java client SDK?…

---

## [Shard allocation fails when splitting index on multi-node cluster](https://discuss.elastic.co/t/shard-allocation-fails-when-splitting-index-on-multi-node-cluster/372029)

<div class="topic-metadata">

**Author:** [@techytushar](https://discuss.elastic.co/u/techytushar)\
**Replies:** 1\
**Last updated:** [December 16, 2024, 10:35pm UTC](https://discuss.elastic.co/t/shard-allocation-fails-when-splitting-index-on-multi-node-cluster/372029 "2024-12-16T22:35:05Z")

</div>

I have a 3 node Elasticsearch cluster and an index of size 40GB on it which only has a single shard. The single shard of the index reside on one of the nodes. I am trying to split that index into 6 shards. The problem i…

---

## [Restore Snapshot while writing to indexes/data streams?](https://discuss.elastic.co/t/restore-snapshot-while-writing-to-indexes-data-streams/371407)

<div class="topic-metadata">

**Author:** [@Dave\_Houser](https://discuss.elastic.co/u/Dave_Houser)\
**Replies:** 12\
**Last updated:** [December 16, 2024, 8:51pm UTC](https://discuss.elastic.co/t/restore-snapshot-while-writing-to-indexes-data-streams/371407 "2024-12-16T20:51:50Z")

</div>

I need to put together a DR plan for our elastic system. I have already tested the snapshot restore process, and it works. However, my process is the following: Adjust cluster settings to allow action.destructive\_requi…

---

## [Way to move many indexes to a data stream backing index?](https://discuss.elastic.co/t/way-to-move-many-indexes-to-a-data-stream-backing-index/372030)

<div class="topic-metadata">

**Author:** [@Dave\_Houser](https://discuss.elastic.co/u/Dave_Houser)\
**Replies:** 0\
**Last updated:** [December 16, 2024, 3:36pm UTC](https://discuss.elastic.co/t/way-to-move-many-indexes-to-a-data-stream-backing-index/372030 "2024-12-16T15:36:56Z")

</div>

Hello, I have been working on figuring out a process to restore some of a snapshot, start writing to it and allow our frontend to read from it. Then restore the rest of the snapshot. I think I have a good process. Howe…

---

## [How to find forgotten taskIDs?](https://discuss.elastic.co/t/how-to-find-forgotten-taskids/372024)

<div class="topic-metadata">

**Author:** [@Haoke98](https://discuss.elastic.co/u/Haoke98)\
**Replies:** 1\
**Last updated:** [December 16, 2024, 2:09pm UTC](https://discuss.elastic.co/t/how-to-find-forgotten-taskids/372024 "2024-12-16T14:09:14Z")

</div>

Previously, I started a task on Elasticsearch and after a long period of time, I wanted to check its status but forgot its task ID. What should I do? Especially for tasks that terminate abnormally, I want to see their er…

---

## [Is there any way to downgrade elasticsearch from 8.15 to 7.17?](https://discuss.elastic.co/t/is-there-any-way-to-downgrade-elasticsearch-from-8-15-to-7-17/371856)

<div class="topic-metadata">

**Author:** [@debayan1](https://discuss.elastic.co/u/debayan1)\
**Replies:** 8\
**Last updated:** [December 16, 2024, 12:15pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-downgrade-elasticsearch-from-8-15-to-7-17/371856 "2024-12-16T12:15:26Z")

</div>

Is there any way to downgrade elasticsearch from 8.15 to 7.17 ? We were using elasticsearch version 7.17. Now, we upgraded to elasticsearch version and using collectors in backward compatibility mode in order to commun…

---

## [Smart rate limiting in a cluster in 2 DC](https://discuss.elastic.co/t/smart-rate-limiting-in-a-cluster-in-2-dc/372017)

<div class="topic-metadata">

**Author:** [@Jose\_E](https://discuss.elastic.co/u/Jose_E)\
**Replies:** 6\
**Last updated:** [December 16, 2024, 10:47am UTC](https://discuss.elastic.co/t/smart-rate-limiting-in-a-cluster-in-2-dc/372017 "2024-12-16T10:47:37Z")

</div>

Hi all, A very tricky question here. Our current setup comprises 6 nodes, 3 in one DC and 3 in another DC, so they work in a kind of high availability scenario, where we always have the replica in the other DC. So far …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=54)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=56)
