# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=636 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 637 --- ## [Performance issues when returning many ids](https://discuss.elastic.co/t/performance-issues-when-returning-many-ids/274618)
**Author:** [@Kristian\_Andersen](https://discuss.elastic.co/u/Kristian_Andersen)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 10:52am UTC](https://discuss.elastic.co/t/performance-issues-when-returning-many-ids/274618 "2021-06-01T10:52:46Z")
Hello, I have a search index with 200.000 documents, and experience bad performance when performing searches that returns multiple results. Each document consists of 1040 fields all mapped as keywords. See filemapping … --- ## [Remove drive letter from file path GROK pattern](https://discuss.elastic.co/t/remove-drive-letter-from-file-path-grok-pattern/274609)
**Author:** [@sam3546](https://discuss.elastic.co/u/sam3546)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 9:57am UTC](https://discuss.elastic.co/t/remove-drive-letter-from-file-path-grok-pattern/274609 "2021-06-01T09:57:00Z")
Im trying to remove the drive letter from file paths as they are ingested through the pipeline, my input is something like C:\\folder1\\folder2\\file.ext (This is just an example the file could be many more folders deep) … --- ## [Vega Visualization with nested Hashes](https://discuss.elastic.co/t/vega-visualization-with-nested-hashes/274604)
**Author:** [@etot94](https://discuss.elastic.co/u/etot94)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 9:28am UTC](https://discuss.elastic.co/t/vega-visualization-with-nested-hashes/274604 "2021-06-01T09:28:46Z")
Hello ES Team. :slight\_smile: I would like to visualize my data from ES with Vega-lite. My fields are: data\_field which is an array of nested hashes. data\_number which is just a number representing each of the data\_f… --- ## [Count query is returning inaccurate results](https://discuss.elastic.co/t/count-query-is-returning-inaccurate-results/274436)
**Author:** [@kapso](https://discuss.elastic.co/u/kapso)\ **Replies:** 13\ **Last updated:** [June 1, 2021, 9:12am UTC](https://discuss.elastic.co/t/count-query-is-returning-inaccurate-results/274436 "2021-06-01T09:12:47Z")
Count query (filter term) is returning inaccurate results - \*/\_count We have tried to get the count using a regular search query using this approach - "size":0,"track\_total\_hits":true and the count is still inaccurate. … --- ## [Index.sort on sequence numbers](https://discuss.elastic.co/t/index-sort-on-sequence-numbers/274485)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 7\ **Last updated:** [June 1, 2021, 8:42am UTC](https://discuss.elastic.co/t/index-sort-on-sequence-numbers/274485 "2021-06-01T08:42:21Z")
We have a use case that can greatly benefit from the ability to have an index.sort on \_seq\_no meta field of ES but that's not possible it seems As of now, that's not possible curl -XPUT -H "Content-Type:application/jso… --- ## [ILM action - lifecycle action \[migrate\] waiting for \[1\] shards to be moved to the \[data\_cold\] tier](https://discuss.elastic.co/t/ilm-action-lifecycle-action-migrate-waiting-for-1-shards-to-be-moved-to-the-data-cold-tier/274574)
**Author:** [@Kmalik19](https://discuss.elastic.co/u/Kmalik19)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 8:40am UTC](https://discuss.elastic.co/t/ilm-action-lifecycle-action-migrate-waiting-for-1-shards-to-be-moved-to-the-data-cold-tier/274574 "2021-06-01T08:40:44Z")
Hello Everyone, We have configured ILM policy but it's stucked in warm phase.Here is the details: ILM Policy definition { "km\_ilm" : { "version" : 3, "modified\_date" : "2021-05-31T14:28:26.359Z", "policy… --- ## [Multiple fast consecutive updates on the same document](https://discuss.elastic.co/t/multiple-fast-consecutive-updates-on-the-same-document/274595)
**Author:** [@Niels\_Theen](https://discuss.elastic.co/u/Niels_Theen)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 8:26am UTC](https://discuss.elastic.co/t/multiple-fast-consecutive-updates-on-the-same-document/274595 "2021-06-01T08:26:37Z")
Hi there, I hope someone can help me with a very specific problem I have. We integrated Elasticsearch in our multi-tenant-system. Based on our system we forced to use update\_by\_query instead of update. This system cr… --- ## [Es\_rejected\_execution\_exception](https://discuss.elastic.co/t/es-rejected-execution-exception/274594)
**Author:** [@Cesidio\_DiBenedetto](https://discuss.elastic.co/u/Cesidio_DiBenedetto)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 8:13am UTC](https://discuss.elastic.co/t/es-rejected-execution-exception/274594 "2021-06-01T08:13:47Z")
All of a sudden, our cluster has started to receive a huge of amount of "es\_rejected\_execution\_exception" errors when upserting. Nothing has really changed on our code side so we are at a complete loss. Our main API is n… --- ## [Dynamically append field from an index to same field in other indices](https://discuss.elastic.co/t/dynamically-append-field-from-an-index-to-same-field-in-other-indices/274579)
**Author:** [@CoolCommando\_Sniper](https://discuss.elastic.co/u/CoolCommando_Sniper)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 5:51am UTC](https://discuss.elastic.co/t/dynamically-append-field-from-an-index-to-same-field-in-other-indices/274579 "2021-06-01T05:51:10Z")
Hi, I would like to achieve the following: Lets say there are 3 indices A, B & C, each having a document with \_id '1'. I would like to append value of a field in A to the same field in indices B & C, where document \_i… --- ## [Sum aggregated values](https://discuss.elastic.co/t/sum-aggregated-values/274554)
**Author:** [@qvers](https://discuss.elastic.co/u/qvers)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 6:41am UTC](https://discuss.elastic.co/t/sum-aggregated-values/274554 "2021-06-01T06:41:44Z")
Hello. I'm trying to collect some statistics data from my docs, but I'm struggling a bit. My docs looks like this: { "productId": "156" "price": "101.23" "discount": "2.23" "marketplace": "some\_marketplace" "… --- ## [Is there any way to do batch inference(matrix compute) using cosineSimilarity?](https://discuss.elastic.co/t/is-there-any-way-to-do-batch-inference-matrix-compute-using-cosinesimilarity/274573)
**Author:** [@berry](https://discuss.elastic.co/u/berry)\ **Replies:** 0\ **Last updated:** [June 1, 2021, 5:17am UTC](https://discuss.elastic.co/t/is-there-any-way-to-do-batch-inference-matrix-compute-using-cosinesimilarity/274573 "2021-06-01T05:17:29Z")
In some scenarios, I want to calculate the cosine similarity between M dense\_vectors and all the stored dense\_vectors. This can be achieved by calling the cosineSimilarity function for M times like this: "script": { … --- ## [Elasticsearch 2021 License](https://discuss.elastic.co/t/elasticsearch-2021-license/274133)
**Author:** [@xodn0812](https://discuss.elastic.co/u/xodn0812)\ **Replies:** 6\ **Last updated:** [June 1, 2021, 5:13am UTC](https://discuss.elastic.co/t/elasticsearch-2021-license/274133 "2021-06-01T05:13:20Z")
Hi. I am asking a question because the elasticsearch license changed in 2021 is not well understood. I have the phrase below, People who take our products and sell them directly as services, like Amazon Elasticsearch … --- ## [Elasticsearch 7.x with Curator -- close replicas older than N days to reduce shard count](https://discuss.elastic.co/t/elasticsearch-7-x-with-curator-close-replicas-older-than-n-days-to-reduce-shard-count/274560)
**Author:** [@cknz](https://discuss.elastic.co/u/cknz)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 3:33am UTC](https://discuss.elastic.co/t/elasticsearch-7-x-with-curator-close-replicas-older-than-n-days-to-reduce-shard-count/274560 "2021-06-01T03:33:48Z")
I bumped against the cluster shard limit recently, and am trying to find useful ways to manage this. I'm dealling with logs as my primary use-case, and some of these logs are very high volume. By default, I've generally… --- ## [Showing newsfeed posts based on friends' list](https://discuss.elastic.co/t/showing-newsfeed-posts-based-on-friends-list/274557)
**Author:** [@m-asfour](https://discuss.elastic.co/u/m-asfour)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 2:01am UTC](https://discuss.elastic.co/t/showing-newsfeed-posts-based-on-friends-list/274557 "2021-06-01T02:01:47Z")
Hi, I'm trying to build a social network app similar to Facebook which shows each user their friends' posts on their feed. What is the best way to implement this using Elasticsearch? --- ## [Elasticsearch 2021 License](https://discuss.elastic.co/t/elasticsearch-2021-license/274559)
**Author:** [@xodn0812](https://discuss.elastic.co/u/xodn0812)\ **Replies:** 1\ **Last updated:** [June 1, 2021, 1:38am UTC](https://discuss.elastic.co/t/elasticsearch-2021-license/274559 "2021-06-01T01:38:21Z")
Hi. I am asking a question because the elasticsearch license changed in 2021 is not well understood. It cannot be provided as a managed-service to other users. Our company develops a system called “A” and sells “A” … --- ## [Elasticsearch Cluster Status is RED](https://discuss.elastic.co/t/elasticsearch-cluster-status-is-red/274129)
**Author:** [@lls](https://discuss.elastic.co/u/lls)\ **Replies:** 11\ **Last updated:** [June 1, 2021, 12:28am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-status-is-red/274129 "2021-06-01T00:28:34Z")
Hi guys: I need advise to fix the following error after issuing \_cluster/allocation/explain. I did try to fix it by running this \_cluster/reroute?retry\_failed=true but no luck. Appreciate your advise, thanks so much. {… --- ## [Best ELK Stack option for AWS centric Team](https://discuss.elastic.co/t/best-elk-stack-option-for-aws-centric-team/274481)
**Author:** [@saif3r](https://discuss.elastic.co/u/saif3r)\ **Replies:** 3\ **Last updated:** [May 31, 2021, 11:38pm UTC](https://discuss.elastic.co/t/best-elk-stack-option-for-aws-centric-team/274481 "2021-05-31T23:38:17Z")
Hello Everyone, I'm a part of team that focuses on creating AI products on AWS Cloud. We are currently looking into what would be the option for setting up Elastic as a part of our stack. Its main job would be to visual… --- ## [KQL : query\_string doesn't work](https://discuss.elastic.co/t/kql-query-string-doesnt-work/274451)
**Author:** [@lls](https://discuss.elastic.co/u/lls)\ **Replies:** 2\ **Last updated:** [May 31, 2021, 9:42pm UTC](https://discuss.elastic.co/t/kql-query-string-doesnt-work/274451 "2021-05-31T21:42:07Z")
Hi there: Interestingly, I'm not sure why the below "query\_string" doesn't returns any hits but it returns hits on 'Discovery UI's Filters section. Please advise, thanks "sql\_string" - This doesn't return any hits GET… --- ## [Role that would allow a user to create index in ES](https://discuss.elastic.co/t/role-that-would-allow-a-user-to-create-index-in-es/274534)
**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\ **Replies:** 4\ **Last updated:** [May 31, 2021, 9:05pm UTC](https://discuss.elastic.co/t/role-that-would-allow-a-user-to-create-index-in-es/274534 "2021-05-31T21:05:02Z")
Hi, I am looking for a role that would allow a user to create indices in ES. Basically I want to avoid assigning "superuser" role. Please guide on what role can I assign? My configuration for ELK7.6.2 stack looks li… --- ## [New Node in Docker Implementation](https://discuss.elastic.co/t/new-node-in-docker-implementation/274536)
**Author:** [@augandi](https://discuss.elastic.co/u/augandi)\ **Replies:** 0\ **Last updated:** [May 31, 2021, 4:24pm UTC](https://discuss.elastic.co/t/new-node-in-docker-implementation/274536 "2021-05-31T16:24:23Z")
Hi, I am new here and I hope you can help me with a frustrating issue :frowning: I have a Docker-based installation of the Elastic Stack. There were just two containers: es01 and kib01 Here the Docker-Compose yml File: … --- ## [Node sync fails and cluster goes to "red"](https://discuss.elastic.co/t/node-sync-fails-and-cluster-goes-to-red/274409)
**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\ **Replies:** 21\ **Last updated:** [May 31, 2021, 4:58pm UTC](https://discuss.elastic.co/t/node-sync-fails-and-cluster-goes-to-red/274409 "2021-05-31T16:58:37Z")
Hello, I hope you and your loved ones are safe and healthy. I have a 3 node cluster with 2 data nodes and 1 voting only node. I accidentally deleted the separate disk that holds data for one of the data node. I separa… --- ## [Updating an index setting](https://discuss.elastic.co/t/updating-an-index-setting/274126)
**Author:** [@Cesidio\_DiBenedetto](https://discuss.elastic.co/u/Cesidio_DiBenedetto)\ **Replies:** 6\ **Last updated:** [May 31, 2021, 12:50pm UTC](https://discuss.elastic.co/t/updating-an-index-setting/274126 "2021-05-31T12:50:04Z")
Currently I have the following on one of my indexes. ... "analysis": { "filter": { "custom\_edge\_ngram": { "type": "edge\_ngram", "min\_gram": "1", … --- ## [Enable "basic" ES features on local ES rpm installation](https://discuss.elastic.co/t/enable-basic-es-features-on-local-es-rpm-installation/274469)
**Author:** [@eliase](https://discuss.elastic.co/u/eliase)\ **Replies:** 2\ **Last updated:** [May 31, 2021, 12:38pm UTC](https://discuss.elastic.co/t/enable-basic-es-features-on-local-es-rpm-installation/274469 "2021-05-31T12:38:30Z")
Hi, I installed elasticsearch via the rpm repository. However, it is unclear to me what steps I need to take to switch from the OSS to the " Basic - free and open" version as advertised here. (I want to use the dense v… --- ## [Upgrade elasticsearch version from 7.10 to 7.13 error](https://discuss.elastic.co/t/upgrade-elasticsearch-version-from-7-10-to-7-13-error/274459)
**Author:** [@AlexM566](https://discuss.elastic.co/u/AlexM566)\ **Replies:** 6\ **Last updated:** [May 31, 2021, 11:22am UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-version-from-7-10-to-7-13-error/274459 "2021-05-31T11:22:05Z")
Hey guys, I am trying to update the version of elasticsearch to 7.13 from 7.10 and I am following the instructions from Rolling upgrades | Elasticsearch Guide \[7.13\] | Elastic but in the final when i procced with the i… --- ## [How Sliced Scan Works in the background?](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274486)
**Author:** [@arkash20](https://discuss.elastic.co/u/arkash20)\ **Replies:** 0\ **Last updated:** [May 31, 2021, 10:53am UTC](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274486 "2021-05-31T10:53:21Z")
Hi, I used scan method to retrieve data from a huge indice we have (200M records), using multiprocessing. For that I used sliced scan and set it to 6 slices, as the number of my shards. Now here comes the theory questi… --- ## [Search API error Elasticsearch](https://discuss.elastic.co/t/search-api-error-elasticsearch/274349)
**Author:** [@Jose\_Angel\_Morena\_Si](https://discuss.elastic.co/u/Jose_Angel_Morena_Si)\ **Replies:** 11\ **Last updated:** [May 31, 2021, 10:15am UTC](https://discuss.elastic.co/t/search-api-error-elasticsearch/274349 "2021-05-31T10:15:56Z")
Hello there, When I use python elasticsearch module to query for documents, there seems to be something strange going on: elasticsearch module: version 7.11.2 elasticsearch cluster: version 7.11.2 The following query: … --- ## [German compound words in an e-commerce search](https://discuss.elastic.co/t/german-compound-words-in-an-e-commerce-search/270280)
**Author:** [@thaarbach](https://discuss.elastic.co/u/thaarbach)\ **Replies:** 3\ **Last updated:** [May 31, 2021, 9:59am UTC](https://discuss.elastic.co/t/german-compound-words-in-an-e-commerce-search/270280 "2021-05-31T09:59:27Z")
Hi elastic! We are developing an e-commerce application and have been using elasticsearch 2.0 since 2014. We are prevented from upgrading by a problem that we simply cannot solve with the current ES version. The german… --- ## [Master node missing path.data](https://discuss.elastic.co/t/master-node-missing-path-data/274338)
**Author:** [@Juri\_P](https://discuss.elastic.co/u/Juri_P)\ **Replies:** 2\ **Last updated:** [May 31, 2021, 9:23am UTC](https://discuss.elastic.co/t/master-node-missing-path-data/274338 "2021-05-31T09:23:18Z")
I have an ELK cluster, with two elasticsearch nodes, one with roles master, data and ingest, and the other with only data and ingest. There's also a script making backups each night to a shared disk on another server. I … --- ## [Is there any way we can use list of vectors to store in ElasticSearch and what are the corresponding changes required in ES query for calculating cosine similarity](https://discuss.elastic.co/t/is-there-any-way-we-can-use-list-of-vectors-to-store-in-elasticsearch-and-what-are-the-corresponding-changes-required-in-es-query-for-calculating-cosine-similarity/273888)
**Author:** [@SagarPalyal](https://discuss.elastic.co/u/SagarPalyal)\ **Replies:** 1\ **Last updated:** [May 31, 2021, 9:00am UTC](https://discuss.elastic.co/t/is-there-any-way-we-can-use-list-of-vectors-to-store-in-elasticsearch-and-what-are-the-corresponding-changes-required-in-es-query-for-calculating-cosine-similarity/273888 "2021-05-31T09:00:28Z")
Provided I am able to create single dense vector field and calculate cosine similarity using the ElasticSearch query mentioned in official documentation. Still not getting how to create list of dense vectors and apply co… --- ## [Custom similarity is really slow, even when very simple (using doc.freq)](https://discuss.elastic.co/t/custom-similarity-is-really-slow-even-when-very-simple-using-doc-freq/273936)
**Author:** [@JF2018](https://discuss.elastic.co/u/JF2018)\ **Replies:** 1\ **Last updated:** [May 31, 2021, 8:48am UTC](https://discuss.elastic.co/t/custom-similarity-is-really-slow-even-when-very-simple-using-doc-freq/273936 "2021-05-31T08:48:54Z")
Hi I am trying to use custom similarities. I wish to have a very simple similarity, where the score is just doc.freq. As I understand this is stored in the statistics, so it should be very fast. When having ~30mill do… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=635) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=637)