# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=287

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 288

---

## [Elasticsearch Master CPU being used 100% at times](https://discuss.elastic.co/t/elasticsearch-master-cpu-being-used-100-at-times/327801)

<div class="topic-metadata">

**Author:** [@aayush\_kumar](https://discuss.elastic.co/u/aayush_kumar)\
**Replies:** 8\
**Last updated:** [March 16, 2023, 6:54am UTC](https://discuss.elastic.co/t/elasticsearch-master-cpu-being-used-100-at-times/327801 "2023-03-16T06:54:43Z")

</div>

My elasticsearch active master node CPU usage rises to 100% at times and remains the same for few minutes/hours and then comes downs to normal 4-5%. I ran the "hot\_threads" API against the node and found below threads t…

---

## [Script based Bulk Update is not parsing the entire document into \_source](https://discuss.elastic.co/t/script-based-bulk-update-is-not-parsing-the-entire-document-into-source/327800)

<div class="topic-metadata">

**Author:** [@AnushaTalluri](https://discuss.elastic.co/u/AnushaTalluri)\
**Replies:** 0\
**Last updated:** [March 16, 2023, 4:52am UTC](https://discuss.elastic.co/t/script-based-bulk-update-is-not-parsing-the-entire-document-into-source/327800 "2023-03-16T04:52:00Z")

</div>

We have an elasticsearch index created in 6.8.23 version, and we used to use script based updates for the documents, which used to be working fine as expected. After upgrading the Elasticsearch version to 7.17, the scrip…

---

## [Bertopic at Elastic?](https://discuss.elastic.co/t/bertopic-at-elastic/327793)

<div class="topic-metadata">

**Author:** [@Guilherme\_Martins](https://discuss.elastic.co/u/Guilherme_Martins)\
**Replies:** 0\
**Last updated:** [March 16, 2023, 12:37am UTC](https://discuss.elastic.co/t/bertopic-at-elastic/327793 "2023-03-16T00:37:21Z")

</div>

Hello all , last month @alvaro\_ing asked about bertopic at elastic. Any new thoughts about it? @alvaro\_ing Any progress, wanna talk about it?

---

## [How to change the data directory of a node in a cluster?](https://discuss.elastic.co/t/how-to-change-the-data-directory-of-a-node-in-a-cluster/327779)

<div class="topic-metadata">

**Author:** [@Wpq](https://discuss.elastic.co/u/Wpq)\
**Replies:** 2\
**Last updated:** [March 15, 2023, 10:27pm UTC](https://discuss.elastic.co/t/how-to-change-the-data-directory-of-a-node-in-a-cluster/327779 "2023-03-15T22:27:28Z")

</div>

I have a cluster of 8 nodes. This is an "under development but with real data" kind of project (the worst type of project) and I see that I will soon have problems with disk space of the default data store. path: data…

---

## [Elasticsearch 8 Client is giving error The following method did not exist: 'org.elasticsearch.client.RequestOptions$Builder org.elasticsearch.client.RequestOptions$Builder.removeHeader(java.lang.String)'](https://discuss.elastic.co/t/elasticsearch-8-client-is-giving-error-the-following-method-did-not-exist-org-elasticsearch-client-requestoptions-builder-org-elasticsearch-client-requestoptions-builder-removeheader-java-lang-string/327762)

<div class="topic-metadata">

**Author:** [@suresh\_chaudhari](https://discuss.elastic.co/u/suresh_chaudhari)\
**Replies:** 1\
**Last updated:** [March 15, 2023, 9:50pm UTC](https://discuss.elastic.co/t/elasticsearch-8-client-is-giving-error-the-following-method-did-not-exist-org-elasticsearch-client-requestoptions-builder-org-elasticsearch-client-requestoptions-builder-removeheader-java-lang-string/327762 "2023-03-15T21:50:31Z")

</div>

Elasticsearch 8 is expecting some class RequestOptions which is present in elasticsearch-rest-client-7.6.2.jar. How I can resolve this error done exactly in a way mentioned in elastic8 docs @Bean public ElasticsearchCl…

---

## [Default Sorting Criteria after custom criteria](https://discuss.elastic.co/t/default-sorting-criteria-after-custom-criteria/327207)

<div class="topic-metadata">

**Author:** [@MrIacono](https://discuss.elastic.co/u/MrIacono)\
**Replies:** 3\
**Last updated:** [March 15, 2023, 6:51pm UTC](https://discuss.elastic.co/t/default-sorting-criteria-after-custom-criteria/327207 "2023-03-15T18:51:09Z")

</div>

Hi, If I have these two sorting criteria: "\_score": "desc" "date": "desc" And the query result consists of two documents with same date and same score, What's the third defult criteria? Thank you, Manuel

---

## [Terraform, Traffic Filters and Kibana](https://discuss.elastic.co/t/terraform-traffic-filters-and-kibana/327767)

<div class="topic-metadata">

**Author:** [@tensor](https://discuss.elastic.co/u/tensor)\
**Replies:** 0\
**Last updated:** [March 15, 2023, 3:48pm UTC](https://discuss.elastic.co/t/terraform-traffic-filters-and-kibana/327767 "2023-03-15T15:48:58Z")

</div>

Hi! We have been successfully using Terraform to set up Elasticcloud instances, and using traffic filtering to allow only access via private link to our own Azure serup - almost too successful, as it turns out, as it me…

---

## [Insert in nodejs is slow](https://discuss.elastic.co/t/insert-in-nodejs-is-slow/327705)

<div class="topic-metadata">

**Author:** [@HF\_Mohammad](https://discuss.elastic.co/u/HF_Mohammad)\
**Replies:** 4\
**Last updated:** [March 15, 2023, 3:19pm UTC](https://discuss.elastic.co/t/insert-in-nodejs-is-slow/327705 "2023-03-15T15:19:45Z")

</div>

This is my code: for (let i = 0; i \< 500; i++) { await client.index({ index: 'user', body: { name: 'mohammad', type: 'mobile' } }) } This code take time about 3 second to fin…

---

## [Best Web crawler to index data to elasticsearch](https://discuss.elastic.co/t/best-web-crawler-to-index-data-to-elasticsearch/327759)

<div class="topic-metadata">

**Author:** [@Disha\_Bodade](https://discuss.elastic.co/u/Disha_Bodade)\
**Replies:** 0\
**Last updated:** [March 15, 2023, 1:55pm UTC](https://discuss.elastic.co/t/best-web-crawler-to-index-data-to-elasticsearch/327759 "2023-03-15T13:55:05Z")

</div>

Hi Team, As elastic appsearch supports to crawl websites which uses basic auth alone. Any suggestions which web crawler we can use with elasticsearch to crawl the SSO, SAML, NTLM protected websites? Thanks, Disha

---

## [Actual use of join type field](https://discuss.elastic.co/t/actual-use-of-join-type-field/327627)

<div class="topic-metadata">

**Author:** [@SheetalM](https://discuss.elastic.co/u/SheetalM)\
**Replies:** 5\
**Last updated:** [March 15, 2023, 12:39pm UTC](https://discuss.elastic.co/t/actual-use-of-join-type-field/327627 "2023-03-15T12:39:28Z")

</div>

Hello Experts, We have a use case with a one-to-many relation scenario where number of documents of a child type are huge for one parent type of document. Something similar to a log store where all the events/messages f…

---

## [What's the meaning of rally operations when starting a track](https://discuss.elastic.co/t/whats-the-meaning-of-rally-operations-when-starting-a-track/325852)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 6\
**Last updated:** [March 15, 2023, 11:39am UTC](https://discuss.elastic.co/t/whats-the-meaning-of-rally-operations-when-starting-a-track/325852 "2023-03-15T11:39:57Z")

</div>

Hello, It's been several times working with rally and every time I feel like it's hard to understand and use. I started an http\_logs track against a cluster, and can't find the meaning of the following operations that r…

---

## [Upgrade from 7.x to 8.x requires multi upgrades?](https://discuss.elastic.co/t/upgrade-from-7-x-to-8-x-requires-multi-upgrades/327408)

<div class="topic-metadata">

**Author:** [@atdc12](https://discuss.elastic.co/u/atdc12)\
**Replies:** 5\
**Last updated:** [March 15, 2023, 9:36am UTC](https://discuss.elastic.co/t/upgrade-from-7-x-to-8-x-requires-multi-upgrades/327408 "2023-03-15T09:36:38Z")

</div>

We have a few production sites running ES 7.16 and would like to upgrade to 8.6: upgrade will be done with full cluster restart all indices were created under ES 7.x we have checked Upgrade Assistant on ES 7.16 and con…

---

## [Elasticsearch continuously on yellow Status - Unassigned Shards](https://discuss.elastic.co/t/elasticsearch-continuously-on-yellow-status-unassigned-shards/327742)

<div class="topic-metadata">

**Author:** [@Apostolos\_Koutoulas](https://discuss.elastic.co/u/Apostolos_Koutoulas)\
**Replies:** 1\
**Last updated:** [March 15, 2023, 9:34am UTC](https://discuss.elastic.co/t/elasticsearch-continuously-on-yellow-status-unassigned-shards/327742 "2023-03-15T09:34:13Z")

</div>

Hello all! Hope you are doing well Cluster status in yellow with unassigned replica shards Elasticsearch version 6.8.23 Cluster status: \[root@d38-pan020 ~\]# es\_cluster.sh health { "cluster\_name" : "\_\_pan\_cluster\_\_…

---

## [How can I mark root object as null](https://discuss.elastic.co/t/how-can-i-mark-root-object-as-null/327719)

<div class="topic-metadata">

**Author:** [@Vivek\_Burman](https://discuss.elastic.co/u/Vivek_Burman)\
**Replies:** 11\
**Last updated:** [March 15, 2023, 9:02am UTC](https://discuss.elastic.co/t/how-can-i-mark-root-object-as-null/327719 "2023-03-15T09:02:34Z")

</div>

So my mapping looks like this. My query is I would like to mark the custom\_field property as null as a root \[NULL\_VALUES IN ELASTIC SEARCH\] (null\_value | Elasticsearch Guide \[8.6\] | Elastic) "custom\_field":{ …

---

## [Data not ingested into master node](https://discuss.elastic.co/t/data-not-ingested-into-master-node/327649)

<div class="topic-metadata">

**Author:** [@truekonrads](https://discuss.elastic.co/u/truekonrads)\
**Replies:** 6\
**Last updated:** [March 15, 2023, 7:57am UTC](https://discuss.elastic.co/t/data-not-ingested-into-master-node/327649 "2023-03-15T07:57:19Z")

</div>

Hello, I have a three node cluster set up with no explicitly defined roles for each nodes. I can see by disk usage and index document count that no data was ingested into master node - only non-master nodes have data on…

---

## [How to pass multiple indies to ElasticSearch UI ElasticsearchAPIConnector](https://discuss.elastic.co/t/how-to-pass-multiple-indies-to-elasticsearch-ui-elasticsearchapiconnector/327707)

<div class="topic-metadata">

**Author:** [@Sheng111](https://discuss.elastic.co/u/Sheng111)\
**Replies:** 0\
**Last updated:** [March 15, 2023, 12:08am UTC](https://discuss.elastic.co/t/how-to-pass-multiple-indies-to-elasticsearch-ui-elasticsearchapiconnector/327707 "2023-03-15T00:08:35Z")

</div>

Hi there, I am using Search UI with Elasticsearch, wondering how to pass multiple indies to config? I got requirement is build a global search box, so users can search multiple indies data based on different attribute …

---

## [How to integrate my logs to Elastic Observability](https://discuss.elastic.co/t/how-to-integrate-my-logs-to-elastic-observability/326233)

<div class="topic-metadata">

**Author:** [@schavaku](https://discuss.elastic.co/u/schavaku)\
**Replies:** 2\
**Last updated:** [March 14, 2023, 10:01pm UTC](https://discuss.elastic.co/t/how-to-integrate-my-logs-to-elastic-observability/326233 "2023-03-14T22:01:05Z")

</div>

How can I configure my logs from SQL Server on Elastic Search server( is already exists). How can I integrate the logs? Pleas let me know the steps.

---

## [Datastream snapshot strategy](https://discuss.elastic.co/t/datastream-snapshot-strategy/327672)

<div class="topic-metadata">

**Author:** [@YP30](https://discuss.elastic.co/u/YP30)\
**Replies:** 0\
**Last updated:** [March 14, 2023, 1:57pm UTC](https://discuss.elastic.co/t/datastream-snapshot-strategy/327672 "2023-03-14T13:57:04Z")

</div>

Hello! We're planning to set up a cluster and use a datastream to ingest our custom logs into elasticsearch. Current setup (spread out over 3 ftServers): 3x master nodes (4vCPU, 12GB RAM) 3x data nodes (4vCPU, 64GB R…

---

## [Building an index for faster search](https://discuss.elastic.co/t/building-an-index-for-faster-search/326301)

<div class="topic-metadata">

**Author:** [@orlenkoda5](https://discuss.elastic.co/u/orlenkoda5)\
**Replies:** 2\
**Last updated:** [March 14, 2023, 1:49pm UTC](https://discuss.elastic.co/t/building-an-index-for-faster-search/326301 "2023-03-14T13:49:35Z")

</div>

Hi everyone, I have one question. How should I build my index to reduce the time of searching? In my case, using aggregations for distinct search really increases the time of searching.

---

## [Indexing script with parameters into percolation field breaks in 8.5](https://discuss.elastic.co/t/indexing-script-with-parameters-into-percolation-field-breaks-in-8-5/327667)

<div class="topic-metadata">

**Author:** [@cehj](https://discuss.elastic.co/u/cehj)\
**Replies:** 0\
**Last updated:** [March 14, 2023, 1:07pm UTC](https://discuss.elastic.co/t/indexing-script-with-parameters-into-percolation-field-breaks-in-8-5/327667 "2023-03-14T13:07:26Z")

</div>

When indexing into a percolation field on a document, we submit something like: { "bool": { "filter": \[ { "script": { "script": { "sour…

---

## [First search Request on Elasticsearch is slow](https://discuss.elastic.co/t/first-search-request-on-elasticsearch-is-slow/327560)

<div class="topic-metadata">

**Author:** [@Rakhshunda\_Noorein\_J](https://discuss.elastic.co/u/Rakhshunda_Noorein_J)\
**Replies:** 3\
**Last updated:** [March 14, 2023, 11:41am UTC](https://discuss.elastic.co/t/first-search-request-on-elasticsearch-is-slow/327560 "2023-03-14T11:41:33Z")

</div>

Hello, Having an issue on elasticsearch, my first request to search in elastic is slow. Once any term gets searched then it becomes fast. I have researched about this and get to know the solution is to change the index …

---

## [Slower Perfomance with Elaticsearch cluster in kubernetes compared to Docker](https://discuss.elastic.co/t/slower-perfomance-with-elaticsearch-cluster-in-kubernetes-compared-to-docker/325759)

<div class="topic-metadata">

**Author:** [@samdevops](https://discuss.elastic.co/u/samdevops)\
**Replies:** 12\
**Last updated:** [March 14, 2023, 10:30am UTC](https://discuss.elastic.co/t/slower-perfomance-with-elaticsearch-cluster-in-kubernetes-compared-to-docker/325759 "2023-03-14T10:30:02Z")

</div>

We are facing issues with Elasticsearch deployment resulting in response time being slower in EKS to that in Docker. In both cases, we are using AWS to provision EC2 instances. Docker consists of a single EC2 instance w…

---

## [Upgrade to 7.x aggregation performance degradation](https://discuss.elastic.co/t/upgrade-to-7-x-aggregation-performance-degradation/327449)

<div class="topic-metadata">

**Author:** [@dbajra94](https://discuss.elastic.co/u/dbajra94)\
**Replies:** 1\
**Last updated:** [March 14, 2023, 8:51am UTC](https://discuss.elastic.co/t/upgrade-to-7-x-aggregation-performance-degradation/327449 "2023-03-14T08:51:39Z")

</div>

We are currently in process of migrating our Cloud tenants to 7.16.3 in preparation for an internal 8.6 Elasticsearch upgrade of our software. However, we have noticed that our aggregation queries have suffered a hard un…

---

## [Issue with datastream, each similar datastream have own hidden index](https://discuss.elastic.co/t/issue-with-datastream-each-similar-datastream-have-own-hidden-index/327201)

<div class="topic-metadata">

**Author:** [@danoque](https://discuss.elastic.co/u/danoque)\
**Replies:** 5\
**Last updated:** [March 14, 2023, 8:45am UTC](https://discuss.elastic.co/t/issue-with-datastream-each-similar-datastream-have-own-hidden-index/327201 "2023-03-14T08:45:11Z")

</div>

I have issue after i configured datastream without "Component Templates". I created datastream with , so like this: "my-index-pattern-" in field "Index patterns". And then, each day elastic creats new datastream with h…

---

## [How the 'Transform API' Works](https://discuss.elastic.co/t/how-the-transform-api-works/327516)

<div class="topic-metadata">

**Author:** [@SEUNGHYO](https://discuss.elastic.co/u/SEUNGHYO)\
**Replies:** 2\
**Last updated:** [March 14, 2023, 1:00am UTC](https://discuss.elastic.co/t/how-the-transform-api-works/327516 "2023-03-14T01:00:50Z")

</div>

Hello. I was check "search \> aggregation (size=0)" and "transform \> pivot \> aggregation (\_preview)" I checked that the transform side has much fewer tooks. (Same aggs, small size set for simple comparison -\> There wa…

---

## [Extract stored field in elasticsearch document using start and end offset](https://discuss.elastic.co/t/extract-stored-field-in-elasticsearch-document-using-start-and-end-offset/327598)

<div class="topic-metadata">

**Author:** [@Ancel](https://discuss.elastic.co/u/Ancel)\
**Replies:** 0\
**Last updated:** [March 13, 2023, 9:43pm UTC](https://discuss.elastic.co/t/extract-stored-field-in-elasticsearch-document-using-start-and-end-offset/327598 "2023-03-13T21:43:30Z")

</div>

Hi all, I am seeking some pointers. Given the start and end offsets of text within a document field (e.g. as provided by the termvectors API), I would like to extract the stored text between those offsets. This text was …

---

## [Cannot restore index \[.security-7\]](https://discuss.elastic.co/t/cannot-restore-index-security-7/327473)

<div class="topic-metadata">

**Author:** [@Verdugo\_Gonzalo](https://discuss.elastic.co/u/Verdugo_Gonzalo)\
**Replies:** 6\
**Last updated:** [March 13, 2023, 9:39pm UTC](https://discuss.elastic.co/t/cannot-restore-index-security-7/327473 "2023-03-13T21:39:19Z")

</div>

Hello everyone, I'm trying to migrate all my users from my old 7.9 cluster to a new 8.5 cluster. I was reviewing the documentation and proceeded to take a snapshot of the security indexes of my old cluster to be able t…

---

## [Upgrade 7 -\> 8. depreciation messages -- ruby api](https://discuss.elastic.co/t/upgrade-7-8-depreciation-messages-ruby-api/327590)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 1\
**Last updated:** [March 13, 2023, 9:04pm UTC](https://discuss.elastic.co/t/upgrade-7-8-depreciation-messages-ruby-api/327590 "2023-03-13T21:04:54Z")

</div>

I am about to attempt to upgrade my test system from 7.17 to the latest 8.x... I have custom written ingestion processes which uses the ruby elasticsearch gem. Migration assistant says all is good but when I look at th…

---

## [Piece\_id.keyword vs piece\_id](https://discuss.elastic.co/t/piece-id-keyword-vs-piece-id/327584)

<div class="topic-metadata">

**Author:** [@Rafa\_H](https://discuss.elastic.co/u/Rafa_H)\
**Replies:** 1\
**Last updated:** [March 13, 2023, 6:11pm UTC](https://discuss.elastic.co/t/piece-id-keyword-vs-piece-id/327584 "2023-03-13T18:11:28Z")

</div>

Hello everyone. I am new to the community. I have a question related to elasticsearch and would appreciate your support. In the platform we are developing, in the local env and staging env elasticsearch works only if k…

---

## [User only with access to content they have created](https://discuss.elastic.co/t/user-only-with-access-to-content-they-have-created/327574)

<div class="topic-metadata">

**Author:** [@abrooky](https://discuss.elastic.co/u/abrooky)\
**Replies:** 2\
**Last updated:** [March 13, 2023, 4:36pm UTC](https://discuss.elastic.co/t/user-only-with-access-to-content-they-have-created/327574 "2023-03-13T16:36:53Z")

</div>

Can someone point me the in the right direction. I've built a simple search as you type tool for a website catalogue which will be used by multiple websites. I need to make sure that each tenant have a unique user/pass …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=286)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=288)
