# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=216

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 217

---

## [Queries regarding reindexing](https://discuss.elastic.co/t/queries-regarding-reindexing/340517)

<div class="topic-metadata">

**Author:** [@ANUBHAV\_GUPTA](https://discuss.elastic.co/u/ANUBHAV_GUPTA)\
**Replies:** 3\
**Last updated:** [August 10, 2023, 10:17am UTC](https://discuss.elastic.co/t/queries-regarding-reindexing/340517 "2023-08-10T10:17:11Z")

</div>

Hi there, I want to get some clarity on the reindexing API and how does it work. After talking to an ES developer I understood few points on the high level. But still I am having a doubt with the below question:- If …

---

## [Discovery service as endpoint provider not recognised](https://discuss.elastic.co/t/discovery-service-as-endpoint-provider-not-recognised/340512)

<div class="topic-metadata">

**Author:** [@nealder](https://discuss.elastic.co/u/nealder)\
**Replies:** 3\
**Last updated:** [August 10, 2023, 10:14am UTC](https://discuss.elastic.co/t/discovery-service-as-endpoint-provider-not-recognised/340512 "2023-08-10T10:14:52Z")

</div>

Hi Everyone, I have submitted a bug ticket on github, but I got redirected here. Here is the ticket. In short I found that the 'discovery.zen.ping.unicast.host' could resolve IP addresses of nodes in my cluster via dis…

---

## [The commercial usage of ELK stack in Russia today](https://discuss.elastic.co/t/the-commercial-usage-of-elk-stack-in-russia-today/340545)

<div class="topic-metadata">

**Author:** [@Abbey\_Monk](https://discuss.elastic.co/u/Abbey_Monk)\
**Replies:** 0\
**Last updated:** [August 10, 2023, 10:12am UTC](https://discuss.elastic.co/t/the-commercial-usage-of-elk-stack-in-russia-today/340545 "2023-08-10T10:12:39Z")

</div>

Hi, guys! Could we use ELK for free in Russia for the commercial purposes today? Thank you for your assistance.

---

## [Elasticsearch Composite Aggregation Orderby in Java Client 8.8.2](https://discuss.elastic.co/t/elasticsearch-composite-aggregation-orderby-in-java-client-8-8-2/340514)

<div class="topic-metadata">

**Author:** [@tcpeiris](https://discuss.elastic.co/u/tcpeiris)\
**Replies:** 5\
**Last updated:** [August 10, 2023, 9:11am UTC](https://discuss.elastic.co/t/elasticsearch-composite-aggregation-orderby-in-java-client-8-8-2/340514 "2023-08-10T09:11:23Z")

</div>

I'm getting a parse exception when I add order to CompositeAggregationSource. Map\<String, CompositeAggregationSource\> cas = new HashMap\<\>(); List\<NamedValue\<SortOrder\>\> orderby = new ArrayList\<\>(); orderby.add(NamedVal…

---

## [Isolate a node](https://discuss.elastic.co/t/isolate-a-node/340528)

<div class="topic-metadata">

**Author:** [@Manal\_A](https://discuss.elastic.co/u/Manal_A)\
**Replies:** 1\
**Last updated:** [August 10, 2023, 9:01am UTC](https://discuss.elastic.co/t/isolate-a-node/340528 "2023-08-10T09:01:53Z")

</div>

How can we isolate a node that serves both as a master and data node from a cluster?

---

## [Chaining queries with rally](https://discuss.elastic.co/t/chaining-queries-with-rally/340525)

<div class="topic-metadata">

**Author:** [@Gustavo\_Llermaly](https://discuss.elastic.co/u/Gustavo_Llermaly)\
**Replies:** 0\
**Last updated:** [August 10, 2023, 8:22am UTC](https://discuss.elastic.co/t/chaining-queries-with-rally/340525 "2023-08-10T08:22:08Z")

</div>

Hi , What's the best practice to benchmark an application side joins scenario? Meaning running an initial query with "collapse" to group by some id, take all the ids from the response and run a second "terms" query? W…

---

## [Multiterms on multi index](https://discuss.elastic.co/t/multiterms-on-multi-index/340519)

<div class="topic-metadata">

**Author:** [@Suresh\_Ghatuwa](https://discuss.elastic.co/u/Suresh_Ghatuwa)\
**Replies:** 0\
**Last updated:** [August 10, 2023, 7:47am UTC](https://discuss.elastic.co/t/multiterms-on-multi-index/340519 "2023-08-10T07:47:46Z")

</div>

Currently I am testing on ES Multi Terms feature. Please find the sample data with indices. PUT multi\_terms\_test1 { "settings": { "number\_of\_shards": 1, "number\_of\_replicas": 0 } } PUT multi\_terms\_test1/\_ma…

---

## [Elasticsearch: 'x\_content\_parse\_exception' \[template\] unknown field \[lifecycle\]](https://discuss.elastic.co/t/elasticsearch-x-content-parse-exception-template-unknown-field-lifecycle/340009)

<div class="topic-metadata">

**Author:** [@anton3](https://discuss.elastic.co/u/anton3)\
**Replies:** 6\
**Last updated:** [August 10, 2023, 7:45am UTC](https://discuss.elastic.co/t/elasticsearch-x-content-parse-exception-template-unknown-field-lifecycle/340009 "2023-08-10T07:45:15Z")

</div>

I have elk stack deployed from deviantony/docker-elk version 8.9 . every component is 8.9 And i'm trying to create lifecycle with retention policy for my datastream as mentioned in official documentetion PUT \_index\_te…

---

## [Overriding timestamp in logstash](https://discuss.elastic.co/t/overriding-timestamp-in-logstash/340515)

<div class="topic-metadata">

**Author:** [@Indeed2000](https://discuss.elastic.co/u/Indeed2000)\
**Replies:** 0\
**Last updated:** [August 10, 2023, 7:26am UTC](https://discuss.elastic.co/t/overriding-timestamp-in-logstash/340515 "2023-08-10T07:26:03Z")

</div>

Hi on logstash need to override timestamp, here is the scenario input file, output as http. here is the string must be send via “http output”: mymeasure,tag=mytag field="myfield" 1689682934 FYI: this part "1689682934…

---

## [Elasticsearch not getting data from filter after index migration](https://discuss.elastic.co/t/elasticsearch-not-getting-data-from-filter-after-index-migration/340467)

<div class="topic-metadata">

**Author:** [@cosskay](https://discuss.elastic.co/u/cosskay)\
**Replies:** 2\
**Last updated:** [August 10, 2023, 6:17am UTC](https://discuss.elastic.co/t/elasticsearch-not-getting-data-from-filter-after-index-migration/340467 "2023-08-10T06:17:23Z")

</div>

after moving an index from one cluster to another, the index does not search for data by filter. The number of Lucene docs is the same in both indexes. All indices Health (green) . Index cloned from VM in openshift . Ela…

---

## [This node doesn't appear to be auto-configured for security. Expected configuration is missing from elasticsearch.yml](https://discuss.elastic.co/t/this-node-doesnt-appear-to-be-auto-configured-for-security-expected-configuration-is-missing-from-elasticsearch-yml/339649)

<div class="topic-metadata">

**Author:** [@KunwarAkanksha](https://discuss.elastic.co/u/KunwarAkanksha)\
**Replies:** 2\
**Last updated:** [August 10, 2023, 4:14am UTC](https://discuss.elastic.co/t/this-node-doesnt-appear-to-be-auto-configured-for-security-expected-configuration-is-missing-from-elasticsearch-yml/339649 "2023-08-10T04:14:28Z")

</div>

Kindly Help, While the Elasticsearch is with the default elasticsearch.yml it is giving such error /usr/share/elasticsearch/bin/elasticsearch-reconfigure-node --enrollment-token Generates all the necessary security c…

---

## [Elasticdump is getting failed for uploading the index into elastic](https://discuss.elastic.co/t/elasticdump-is-getting-failed-for-uploading-the-index-into-elastic/340501)

<div class="topic-metadata">

**Author:** [@shailendra1](https://discuss.elastic.co/u/shailendra1)\
**Replies:** 0\
**Last updated:** [August 10, 2023, 1:38am UTC](https://discuss.elastic.co/t/elasticdump-is-getting-failed-for-uploading-the-index-into-elastic/340501 "2023-08-10T01:38:09Z")

</div>

hello all, i am trying to upload the index dump which i have taken using the elasticdump while uploading i am facing issue, as below - Tue, 08 Aug 2023 10:21:37 GMT | sent 10000 objects to destination elasticsearch, wr…

---

## [Documentation - get index api- why there is no info about what api is returning](https://discuss.elastic.co/t/documentation-get-index-api-why-there-is-no-info-about-what-api-is-returning/340495)

<div class="topic-metadata">

**Author:** [@Krzysztof\_Lempicki](https://discuss.elastic.co/u/Krzysztof_Lempicki)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 9:16pm UTC](https://discuss.elastic.co/t/documentation-get-index-api-why-there-is-no-info-about-what-api-is-returning/340495 "2023-08-09T21:16:42Z")

</div>

In doc: Get index information | Elasticsearch API documentation there is no info about what is returned. Is this in purpose? If yes why? For example: From console I see that keys of returned map are index names. With…

---

## [Snapshot/restore repository-s3 --\> Using IAM roles for Kubernetes service accounts for authentication is not working](https://discuss.elastic.co/t/snapshot-restore-repository-s3-using-iam-roles-for-kubernetes-service-accounts-for-authentication-is-not-working/340125)

<div class="topic-metadata">

**Author:** [@Celal\_SAHIN](https://discuss.elastic.co/u/Celal_SAHIN)\
**Replies:** 1\
**Last updated:** [August 9, 2023, 7:15pm UTC](https://discuss.elastic.co/t/snapshot-restore-repository-s3-using-iam-roles-for-kubernetes-service-accounts-for-authentication-is-not-working/340125 "2023-08-09T19:15:43Z")

</div>

Hi, Currently we are following the guide here\[1\]. We can successfully assign proper service account(hence AWS iam role) to the es pods. If relevant here\[2\] you can see our redacted elasticsearch CRD file. This correctl…

---

## [Parse the values from aggregation results in watcher transform painless script](https://discuss.elastic.co/t/parse-the-values-from-aggregation-results-in-watcher-transform-painless-script/340485)

<div class="topic-metadata">

**Author:** [@Pavani\_Reddy](https://discuss.elastic.co/u/Pavani_Reddy)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 5:51pm UTC](https://discuss.elastic.co/t/parse-the-values-from-aggregation-results-in-watcher-transform-painless-script/340485 "2023-08-09T17:51:14Z")

</div>

Hello @Badger , @magnusbaeck Please help on painless script for parsing the timestamp and compare with now-1h. ''' "aggs": { "by\_index": { "terms": { "field": "\_index" }, "aggs": { "by\_timestamp": { "max": { "…

---

## [Separate result by category](https://discuss.elastic.co/t/separate-result-by-category/340479)

<div class="topic-metadata">

**Author:** [@Murilo\_Livorato](https://discuss.elastic.co/u/Murilo_Livorato)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 5:05pm UTC](https://discuss.elastic.co/t/separate-result-by-category/340479 "2023-08-09T17:05:07Z")

</div>

Hello , I have nested filed . And I want to bring the result separated by broker , something like this - \[ "broker\_one" =\> \[ result \], "broker\_two" =\> \[ result \] I know that I can aggregate the result , and co…

---

## [Elasticsearch node stats api showing high cpu when nodes are idle](https://discuss.elastic.co/t/elasticsearch-node-stats-api-showing-high-cpu-when-nodes-are-idle/340455)

<div class="topic-metadata">

**Author:** [@Pradeep\_B1](https://discuss.elastic.co/u/Pradeep_B1)\
**Replies:** 1\
**Last updated:** [August 9, 2023, 3:21pm UTC](https://discuss.elastic.co/t/elasticsearch-node-stats-api-showing-high-cpu-when-nodes-are-idle/340455 "2023-08-09T15:21:51Z")

</div>

We are observing high CPU usage in elastic cluster master node even when cluster is Idle. We are using elasticsearch version 7.12 We are using cluster with 3 master nodes and 5 data nodes . All data nodes are having 36…

---

## [Filter and search through python](https://discuss.elastic.co/t/filter-and-search-through-python/340386)

<div class="topic-metadata">

**Author:** [@IamExperimenting\_Now](https://discuss.elastic.co/u/IamExperimenting_Now)\
**Replies:** 3\
**Last updated:** [August 9, 2023, 2:51pm UTC](https://discuss.elastic.co/t/filter-and-search-through-python/340386 "2023-08-09T14:51:49Z")

</div>

Hi, I'm new to elasticsearch, I'm using elasticsearch for semantic search. I have pushed 5pdf files after converting into vector. when I do search i'm not getting right index value. so, I thought I would do the filter …

---

## [Elasticsearch failed Search rejected due to missing shards \[\[.kibana\_task\_manager\_7.17.7\_001\]\[0\]\]](https://discuss.elastic.co/t/elasticsearch-failed-search-rejected-due-to-missing-shards-kibana-task-manager-7-17-7-001-0/340192)

<div class="topic-metadata">

**Author:** [@johnashish](https://discuss.elastic.co/u/johnashish)\
**Replies:** 7\
**Last updated:** [August 9, 2023, 1:42pm UTC](https://discuss.elastic.co/t/elasticsearch-failed-search-rejected-due-to-missing-shards-kibana-task-manager-7-17-7-001-0/340192 "2023-08-09T13:42:03Z")

</div>

Hello, Current Conf - Version - Elasticsearch| Kibana - 7.17.3 2 Node Cluster Recently i am facing lot of trouble to keep the cluster in healthy state. The error which i am facing is - Caused by: org.elasticsearch…

---

## [Elasticsearch started by Windows Service needs keystore password](https://discuss.elastic.co/t/elasticsearch-started-by-windows-service-needs-keystore-password/340463)

<div class="topic-metadata">

**Author:** [@stephencoffman](https://discuss.elastic.co/u/stephencoffman)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 1:22pm UTC](https://discuss.elastic.co/t/elasticsearch-started-by-windows-service-needs-keystore-password/340463 "2023-08-09T13:22:15Z")

</div>

We are using VM’s in Azure to host Elasticsearch in a FedRAMP High (FIPS enabled) environment. The VM’s have their own disk space. We are currently using the “zip” distribution type for Windows. We install a Windows S…

---

## [EsHadoopRemoteException: illegal\_argument\_exception: only write ops with an op\_type of create are allowed in data streams?](https://discuss.elastic.co/t/eshadoopremoteexception-illegal-argument-exception-only-write-ops-with-an-op-type-of-create-are-allowed-in-data-streams/340267)

<div class="topic-metadata">

**Author:** [@Zephery\_Wen](https://discuss.elastic.co/u/Zephery_Wen)\
**Replies:** 4\
**Last updated:** [August 9, 2023, 1:07pm UTC](https://discuss.elastic.co/t/eshadoopremoteexception-illegal-argument-exception-only-write-ops-with-an-op-type-of-create-are-allowed-in-data-streams/340267 "2023-08-09T13:07:05Z")

</div>

I want to use Spark to save data to a data stream. JavaEsSparkSQL.saveToEs(result, dataStream, map); It seems like 'saveToEs' only allows index. EsHadoopRemoteException: illegal\_argument\_exception: only write ops with…

---

## [Populate a dense vector field for only a subset of the documents](https://discuss.elastic.co/t/populate-a-dense-vector-field-for-only-a-subset-of-the-documents/340326)

<div class="topic-metadata">

**Author:** [@sbruinsje](https://discuss.elastic.co/u/sbruinsje)\
**Replies:** 4\
**Last updated:** [August 9, 2023, 12:56pm UTC](https://discuss.elastic.co/t/populate-a-dense-vector-field-for-only-a-subset-of-the-documents/340326 "2023-08-09T12:56:58Z")

</div>

I have an index of over 10 million documents. On those documents, I want to store an openai (or similar) embedding vector using an indexed dense vector field. I will be using cosine similarity to search through those vec…

---

## [Elasticsearch v2.3 disk throughput Throttle](https://discuss.elastic.co/t/elasticsearch-v2-3-disk-throughput-throttle/340453)

<div class="topic-metadata">

**Author:** [@ram\_222](https://discuss.elastic.co/u/ram_222)\
**Replies:** 3\
**Last updated:** [August 9, 2023, 11:58am UTC](https://discuss.elastic.co/t/elasticsearch-v2-3-disk-throughput-throttle/340453 "2023-08-09T11:58:02Z")

</div>

we are currently using Elasticsearch v2.3 Cluster configuration Details: 3 master Nodes ( t2.medium.search ) and 9 Data Nodes ( r4.xlarge.search ) EBS changed from gp2 to Provision IOPS Storage is 250 Gib/Node CPU Ut…

---

## [How Elasticsearch works with OIDC realm](https://discuss.elastic.co/t/how-elasticsearch-works-with-oidc-realm/340442)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 9:10am UTC](https://discuss.elastic.co/t/how-elasticsearch-works-with-oidc-realm/340442 "2023-08-09T09:10:51Z")

</div>

Hi Team, Recently we have integrated Azure AD OIDC with Elasticsearch and kibana. The OP will provide the token to users of kibana User of kibana will present the token to elasticsearch for accessing the resources Ela…

---

## [Adding noeud for elasticsearch cluster](https://discuss.elastic.co/t/adding-noeud-for-elasticsearch-cluster/340441)

<div class="topic-metadata">

**Author:** [@Ali\_Trache](https://discuss.elastic.co/u/Ali_Trache)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 9:09am UTC](https://discuss.elastic.co/t/adding-noeud-for-elasticsearch-cluster/340441 "2023-08-09T09:09:56Z")

</div>

hello community , i need help please , i had installer ELK stack in my virtuelle machine with one noeud ( elasticsearch , kibana , logstash) now i wish add a second noeud for my cluster so i had installed a second V…

---

## [How to use predicate / expression with C# client](https://discuss.elastic.co/t/how-to-use-predicate-expression-with-c-client/340437)

<div class="topic-metadata">

**Author:** [@Daniel\_Dudek](https://discuss.elastic.co/u/Daniel_Dudek)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 8:29am UTC](https://discuss.elastic.co/t/how-to-use-predicate-expression-with-c-client/340437 "2023-08-09T08:29:15Z")

</div>

Hi, I was looking for a solution to use expression with Elasticsearch C# client. I'm using the Elastic.Clients.Elasticsearch in 8.9.1 version. In my repository I have a specification (based on the specification design …

---

## [Synchronize distributed term frequencies on READ ONLY shards?](https://discuss.elastic.co/t/synchronize-distributed-term-frequencies-on-read-only-shards/340420)

<div class="topic-metadata">

**Author:** [@Yukha\_Dharmeswara](https://discuss.elastic.co/u/Yukha_Dharmeswara)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 6:06am UTC](https://discuss.elastic.co/t/synchronize-distributed-term-frequencies-on-read-only-shards/340420 "2023-08-09T06:06:32Z")

</div>

Hello, I wonder if it is possible to synchronize shard's distributed term frequencies so we are able to reliably sort data by relevancenes when using search\_type=query\_then\_fetch? query\_then\_fetch vs dfs\_query\_then\_fet…

---

## [We are looking for having search solution for platform contain data from multiple application. Our use case is providing exact search and recommendation. We are exploring best to suit and ES/Vespa is what in discussion](https://discuss.elastic.co/t/we-are-looking-for-having-search-solution-for-platform-contain-data-from-multiple-application-our-use-case-is-providing-exact-search-and-recommendation-we-are-exploring-best-to-suit-and-es-vespa-is-what-in-discussion/339984)

<div class="topic-metadata">

**Author:** [@Nik\_Ag](https://discuss.elastic.co/u/Nik_Ag)\
**Replies:** 1\
**Last updated:** [August 9, 2023, 2:55am UTC](https://discuss.elastic.co/t/we-are-looking-for-having-search-solution-for-platform-contain-data-from-multiple-application-our-use-case-is-providing-exact-search-and-recommendation-we-are-exploring-best-to-suit-and-es-vespa-is-what-in-discussion/339984 "2023-08-09T02:55:39Z")

</div>

What difference between Vespa and ES? For longer term which would be better to choose? Elastic coming up with Elser model will it be available for GA if so, when?

---

## [Php client 7.17 for elastic 8.9 (client for php 7.2)](https://discuss.elastic.co/t/php-client-7-17-for-elastic-8-9-client-for-php-7-2/340406)

<div class="topic-metadata">

**Author:** [@vt\_g](https://discuss.elastic.co/u/vt_g)\
**Replies:** 0\
**Last updated:** [August 8, 2023, 9:08pm UTC](https://discuss.elastic.co/t/php-client-7-17-for-elastic-8-9-client-for-php-7-2/340406 "2023-08-08T21:08:09Z")

</div>

Hello! Who knows if php client 7.17 can work with elastic 8.9? The site works on PHP 7.2, it is not possible to upload more Thank you!

---

## [Why IDs query expands to terms query?](https://discuss.elastic.co/t/why-ids-query-expands-to-terms-query/340410)

<div class="topic-metadata">

**Author:** [@etki](https://discuss.elastic.co/u/etki)\
**Replies:** 0\
**Last updated:** [August 9, 2023, 12:53am UTC](https://discuss.elastic.co/t/why-ids-query-expands-to-terms-query/340410 "2023-08-09T00:53:25Z")

</div>

So i was poking around sources and looks like ids query doesn't do much by itself: protected Query doToQuery(SearchExecutionContext context) throws IOException { MappedFieldType idField = context.getFieldTyp…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=215)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=217)
