# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=648 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 649 --- ## [ConnectionError while creating track in Rally with docker image](https://discuss.elastic.co/t/connectionerror-while-creating-track-in-rally-with-docker-image/272448)
**Author:** [@akm](https://discuss.elastic.co/u/akm)\ **Replies:** 2\ **Last updated:** [May 11, 2021, 1:49pm UTC](https://discuss.elastic.co/t/connectionerror-while-creating-track-in-rally-with-docker-image/272448 "2021-05-11T13:49:03Z")
Hi, I am trying to create a custom track from an existing Elasticsearch cluster using the instructions in the Rally documentation page. I am running Rally as a Docker Image. I am running elasticsearch:7.12.0 as well a… --- ## [ILM hot/warm policy is not moving shards](https://discuss.elastic.co/t/ilm-hot-warm-policy-is-not-moving-shards/272603)
**Author:** [@vkatsikaros](https://discuss.elastic.co/u/vkatsikaros)\ **Replies:** 3\ **Last updated:** [May 11, 2021, 10:25am UTC](https://discuss.elastic.co/t/ilm-hot-warm-policy-is-not-moving-shards/272603 "2021-05-11T10:25:20Z")
Hi I have created an ILM policy and template, and I create daily indices with Logstash on an ES cluster 7.10. I have some fast and expensive nodes as hot (and other types) and a few slow and inexpensive as warm only. I … --- ## [Elastic Search update api - updating complex data including array objects and parts of document](https://discuss.elastic.co/t/elastic-search-update-api-updating-complex-data-including-array-objects-and-parts-of-document/272644)
**Author:** [@ab.umarjikar](https://discuss.elastic.co/u/ab.umarjikar)\ **Replies:** 1\ **Last updated:** [May 11, 2021, 9:20am UTC](https://discuss.elastic.co/t/elastic-search-update-api-updating-complex-data-including-array-objects-and-parts-of-document/272644 "2021-05-11T09:20:40Z")
I have complex structure of data coming in as bellow: { ​​​​​ "id": 1, "other\_details": \[{ ​​​​​ "address\_details": { ​​​​​ "city": "pune", … --- ## [Please explain how rewrite top\_terms\_n works](https://discuss.elastic.co/t/please-explain-how-rewrite-top-terms-n-works/270128)
**Author:** [@carantunes](https://discuss.elastic.co/u/carantunes)\ **Replies:** 1\ **Last updated:** [May 11, 2021, 8:57am UTC](https://discuss.elastic.co/t/please-explain-how-rewrite-top-terms-n-works/270128 "2021-05-11T08:57:59Z")
Can someone expand a bit on how rewrite top\_terms\_n works? Related to https://discuss.elastic.co/t/missing-results-using-query-string-wildcard-query-with-rewrite-top-terms-n/269680 Thanks in advance! --- ## [Transforms - using painless for terms aggs on nested objects](https://discuss.elastic.co/t/transforms-using-painless-for-terms-aggs-on-nested-objects/272501)
**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\ **Replies:** 1\ **Last updated:** [May 11, 2021, 7:31am UTC](https://discuss.elastic.co/t/transforms-using-painless-for-terms-aggs-on-nested-objects/272501 "2021-05-11T07:31:42Z")
I understand that Transforms does not support nested aggregations, but what is the alternative ? here is the mappings: "properties" : { "clientId" : { "type" : "integer" }, "clientIdAsString" : { "type" : "keywor… --- ## [ElasaticSearch Killed](https://discuss.elastic.co/t/elasaticsearch-killed/272580)
**Author:** [@Sohaib\_Gondal](https://discuss.elastic.co/u/Sohaib_Gondal)\ **Replies:** 6\ **Last updated:** [May 11, 2021, 7:16am UTC](https://discuss.elastic.co/t/elasaticsearch-killed/272580 "2021-05-11T07:16:04Z")
When I try to run the Elasticsearch it says "Killed" and shows the following error. Error Log \[2021-05-10T11:56:50.233+0000\]\[15547\]\[gc\] Using Concurrent Mark Sweep \[2021-05-10T11:56:50.233+0000\]\[15547\]\[gc,heap,coops\] … --- ## [Prometheus Elasticsearch exporter for receiving CCR stats](https://discuss.elastic.co/t/prometheus-elasticsearch-exporter-for-receiving-ccr-stats/272487)
**Author:** [@Armen\_Petrosyan](https://discuss.elastic.co/u/Armen_Petrosyan)\ **Replies:** 3\ **Last updated:** [May 11, 2021, 7:14am UTC](https://discuss.elastic.co/t/prometheus-elasticsearch-exporter-for-receiving-ccr-stats/272487 "2021-05-11T07:14:39Z")
Is there any Prometheus Elasticsearch exporter for receiving CCR stats? I don't see such. Is this planned ? --- ## [Elasticsearch cluster have millions of pending tasks](https://discuss.elastic.co/t/elasticsearch-cluster-have-millions-of-pending-tasks/272349)
**Author:** [@fengxiaobai](https://discuss.elastic.co/u/fengxiaobai)\ **Replies:** 14\ **Last updated:** [May 11, 2021, 5:33am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-have-millions-of-pending-tasks/272349 "2021-05-11T05:33:57Z")
i have a es cluster , 7.4 version . There are a lot of pending tasks around 8 a.m. every day。 pending task list info： 639479 "source": "ilm-execute-cluster-state-steps", 82666 "source": "ilm-move-to-step"… --- ## [Data type long error](https://discuss.elastic.co/t/data-type-long-error/272631)
**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\ **Replies:** 2\ **Last updated:** [May 11, 2021, 4:22am UTC](https://discuss.elastic.co/t/data-type-long-error/272631 "2021-05-11T04:22:53Z")
Hi, ELK version: 7.10.0 I have a request, which is to import the ip2location csv data into elasticsearch and then use program (c# or python) to search the ip range and return the country info. The data were not able t… --- ## [Watcher: Password changes to ::es\_redacted::](https://discuss.elastic.co/t/watcher-password-changes-to/272628)
**Author:** [@Rohan-boogeyman](https://discuss.elastic.co/u/Rohan-boogeyman)\ **Replies:** 2\ **Last updated:** [May 11, 2021, 3:56am UTC](https://discuss.elastic.co/t/watcher-password-changes-to/272628 "2021-05-11T03:56:51Z")
Hello, Hope you all are doing great! Thought I'd bring this concern which I've been experiencing - When I add auth category in actions of watcher - after I hit save watch button password changes to "::es\_redacted::" W… --- ## [Wildcards+fuzzy in one query](https://discuss.elastic.co/t/wildcards-fuzzy-in-one-query/272620)
**Author:** [@abdess](https://discuss.elastic.co/u/abdess)\ **Replies:** 1\ **Last updated:** [May 11, 2021, 2:46am UTC](https://discuss.elastic.co/t/wildcards-fuzzy-in-one-query/272620 "2021-05-11T02:46:32Z")
I'm new to Elasticsearch and have 2 Questions: Q1) The following query return this result(pic): Query: { "query": { "query\_string": { "query": "china~" } } } Result: {… --- ## [How to start Elasticsearch database from exist volume on docker](https://discuss.elastic.co/t/how-to-start-elasticsearch-database-from-exist-volume-on-docker/272543)
**Author:** [@overbid](https://discuss.elastic.co/u/overbid)\ **Replies:** 1\ **Last updated:** [May 11, 2021, 1:51am UTC](https://discuss.elastic.co/t/how-to-start-elasticsearch-database-from-exist-volume-on-docker/272543 "2021-05-11T01:51:36Z")
I'm trying to install via docker compose in 3 machines on AWS EC2. My compose file is version: "3.8" services: es01: image: docker.elastic.co/elasticsearch/elasticsearch:7.12.1 container\_name: es01 environ… --- ## [Logstash created Index || index.lifecycle.rollover\_alias is empty or not defined](https://discuss.elastic.co/t/logstash-created-index-index-lifecycle-rollover-alias-is-empty-or-not-defined/272240)
**Author:** [@Boris\_Joseph](https://discuss.elastic.co/u/Boris_Joseph)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 11:31pm UTC](https://discuss.elastic.co/t/logstash-created-index-index-lifecycle-rollover-alias-is-empty-or-not-defined/272240 "2021-05-10T23:31:37Z")
Hi Elastic Team, I have Indices in my Elastic cluster created from logstash based on date regex. And these indices can be deleted after 3 days. but below error comes up for all indices. \*\*\*Index lifecycle error illega… --- ## [Index vs Update for partial updates](https://discuss.elastic.co/t/index-vs-update-for-partial-updates/272590)
**Author:** [@bogdanjsx](https://discuss.elastic.co/u/bogdanjsx)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 11:23pm UTC](https://discuss.elastic.co/t/index-vs-update-for-partial-updates/272590 "2021-05-10T23:23:28Z")
Hello! I'm having a hard time deciding on the Index vs Update APIs for a particular use case. Let's say I have an index with documents containing a name field, which nests a string translated in different languages/loc… --- ## [Multiple Date format in mapping fails](https://discuss.elastic.co/t/multiple-date-format-in-mapping-fails/272616)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 11:22pm UTC](https://discuss.elastic.co/t/multiple-date-format-in-mapping-fails/272616 "2021-05-10T23:22:08Z")
Hi all, There is provision for multiple date format in elasticsearch. But whenever I try my multiple date format in console, it fails to parse and no data is displayed. PUT brs\_total { "mappings": { "properties"… --- ## [Storage rate for a specefic machine](https://discuss.elastic.co/t/storage-rate-for-a-specefic-machine/272043)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 7\ **Last updated:** [May 10, 2021, 11:03pm UTC](https://discuss.elastic.co/t/storage-rate-for-a-specefic-machine/272043 "2021-05-10T23:03:11Z")
Hello everyobody, I have a production cluster where I have some windows machines connected to my ELK Cluster, and for some monitoring reasons, I would like to know how many data collected from each machine for eample fo… --- ## [Elasticsearch with NEST: How can I score matches of multiple keywords much higher than single matches?](https://discuss.elastic.co/t/elasticsearch-with-nest-how-can-i-score-matches-of-multiple-keywords-much-higher-than-single-matches/272226)
**Author:** [@WestCoastWondering](https://discuss.elastic.co/u/WestCoastWondering)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 11:01pm UTC](https://discuss.elastic.co/t/elasticsearch-with-nest-how-can-i-score-matches-of-multiple-keywords-much-higher-than-single-matches/272226 "2021-05-10T23:01:45Z")
Hi there, Our users often type in a list of keywords, hoping for a good match from within the "Title" field, the primary field in many of our indices. Using the multimatch query, we get decent results for single keywor… --- ## [When do you really need full text search capabilities? Need help understanding tradeoffs](https://discuss.elastic.co/t/when-do-you-really-need-full-text-search-capabilities-need-help-understanding-tradeoffs/272613)
**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\ **Replies:** 3\ **Last updated:** [May 10, 2021, 11:00pm UTC](https://discuss.elastic.co/t/when-do-you-really-need-full-text-search-capabilities-need-help-understanding-tradeoffs/272613 "2021-05-10T23:00:12Z")
Should we add Elastic for our very simple searches on metadata fields that have a few words (\<10) such as titles? Does this constitute requiring "Full Text Search"? We have a database w/ postgres to store all our metada… --- ## [Failed to create service Error response from daemon network cannot be used with services and invalidargument containerspec](https://discuss.elastic.co/t/failed-to-create-service-error-response-from-daemon-network-cannot-be-used-with-services-and-invalidargument-containerspec/272605)
**Author:** [@MdRashid](https://discuss.elastic.co/u/MdRashid)\ **Replies:** 0\ **Last updated:** [May 10, 2021, 6:13pm UTC](https://discuss.elastic.co/t/failed-to-create-service-error-response-from-daemon-network-cannot-be-used-with-services-and-invalidargument-containerspec/272605 "2021-05-10T18:13:32Z")
Hi All, Below are 2 errors im getting 1. Creating service monitoring\_kibana failed to create service monitoring\_kibana: Error response from daemon: rpc error: code = InvalidArgument desc = ContainerSpec: image referen… --- ## [Kibana can't cancel long-running queries — "action \[cluster:admin/tasks/cancel\[n\]\] is unauthorized for user \[\_async\_search\]"](https://discuss.elastic.co/t/kibana-cant-cancel-long-running-queries-action-cluster-admin-tasks-cancel-n-is-unauthorized-for-user-async-search/272225)
**Author:** [@smokris](https://discuss.elastic.co/u/smokris)\ **Replies:** 4\ **Last updated:** [May 10, 2021, 9:11pm UTC](https://discuss.elastic.co/t/kibana-cant-cancel-long-running-queries-action-cluster-admin-tasks-cancel-n-is-unauthorized-for-user-async-search/272225 "2021-05-10T21:11:53Z")
I'm seeing a lot of exceptions like this while making changes to Kibana Dashboards: ElasticsearchSecurityException\[action \[cluster:admin/tasks/cancel\[n\]\] is unauthorized for user \[\_async\_search\], this action is granted… --- ## [Unable to update index rollover](https://discuss.elastic.co/t/unable-to-update-index-rollover/272595)
**Author:** [@Jose\_Angel\_Morena\_Si](https://discuss.elastic.co/u/Jose_Angel_Morena_Si)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 5:04pm UTC](https://discuss.elastic.co/t/unable-to-update-index-rollover/272595 "2021-05-10T17:04:17Z")
Hello there, I am trying to modify the rollover conditions of a handful of indexes in my ES cluster. Elasticsearch version: 7.11.2 Winlogbeat version: 7.11.2 In order to do so I am using the following query: curl -u… --- ## [Why sometime 99.99th doesn't shown](https://discuss.elastic.co/t/why-sometime-99-99th-doesnt-shown/272467)
**Author:** [@GITnewfish](https://discuss.elastic.co/u/GITnewfish)\ **Replies:** 1\ **Last updated:** [May 10, 2021, 4:32pm UTC](https://discuss.elastic.co/t/why-sometime-99-99th-doesnt-shown/272467 "2021-05-10T16:32:05Z")
I do found sometime 99.99th doesn't shown in my summary, and sometime it shows ok. In the doc, it said "Rally will not show a 99.99th percentile if it could only capture five samples because that would be a vanity metri… --- ## [API key and document-level security: Query not limiting response](https://discuss.elastic.co/t/api-key-and-document-level-security-query-not-limiting-response/271786)
**Author:** [@sgasse](https://discuss.elastic.co/u/sgasse)\ **Replies:** 5\ **Last updated:** [May 10, 2021, 1:54pm UTC](https://discuss.elastic.co/t/api-key-and-document-level-security-query-not-limiting-response/271786 "2021-05-10T13:54:25Z")
Hi! I was reading up a bit on API keys and document level security. Here are the relevant guides that I read: Create an API key Document Level Secuity Now I created an API key like this: POST /\_security/api\_key { … --- ## [Index not rollover when the date changes](https://discuss.elastic.co/t/index-not-rollover-when-the-date-changes/272385)
**Author:** [@maadhav](https://discuss.elastic.co/u/maadhav)\ **Replies:** 4\ **Last updated:** [May 10, 2021, 1:37pm UTC](https://discuss.elastic.co/t/index-not-rollover-when-the-date-changes/272385 "2021-05-10T13:37:33Z")
Hi Team With ILM policy, we can do rollover using different parameters such as size/document\_count/age. This works fine and if we create first index with date-math, we are able to generate date-wise index. But the prob… --- ## [ILM phases rolling out index but keeping](https://discuss.elastic.co/t/ilm-phases-rolling-out-index-but-keeping/272291)
**Author:** [@narendraingale2](https://discuss.elastic.co/u/narendraingale2)\ **Replies:** 2\ **Last updated:** [May 10, 2021, 1:27pm UTC](https://discuss.elastic.co/t/ilm-phases-rolling-out-index-but-keeping/272291 "2021-05-10T13:27:21Z")
Hi All Below is my ILM policy { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "rollover": { "max\_size": "200gb", "max\_age": "7d" … --- ## [Elastic shards and replica](https://discuss.elastic.co/t/elastic-shards-and-replica/272552)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 5\ **Last updated:** [May 10, 2021, 1:21pm UTC](https://discuss.elastic.co/t/elastic-shards-and-replica/272552 "2021-05-10T13:21:43Z")
Hello everyone, I would like to understand something about shards and replica, I have a cluster of 3 DATA nodes (2 Hot and 1 Warm), I have configured ILM to have one shard and one replica in the HOT nodes, and then onc… --- ## [Self hosted in aws ec2](https://discuss.elastic.co/t/self-hosted-in-aws-ec2/272483)
**Author:** [@THOM-AwS](https://discuss.elastic.co/u/THOM-AwS)\ **Replies:** 5\ **Last updated:** [May 10, 2021, 1:13pm UTC](https://discuss.elastic.co/t/self-hosted-in-aws-ec2/272483 "2021-05-10T13:13:27Z")
Hey all, this is part question, and part tips for my elastic experience on ec2. for background I am running two servers, one with elasticsearch on an m6gd.large, and the other server runs kibana on an m6gd.medium. this i… --- ## [Find and replace word in all documents in any field](https://discuss.elastic.co/t/find-and-replace-word-in-all-documents-in-any-field/272393)
**Author:** [@simone.dicola](https://discuss.elastic.co/u/simone.dicola)\ **Replies:** 4\ **Last updated:** [May 10, 2021, 11:52am UTC](https://discuss.elastic.co/t/find-and-replace-word-in-all-documents-in-any-field/272393 "2021-05-10T11:52:12Z")
As per title, due to a bug in conversion library, we got more than 200k documents containing & instead of &. Is there a query I can run to do a find and replace in any field? Thanks --- ## [Reindex remote-Received Error "socket\_exception" & "Connection reset"](https://discuss.elastic.co/t/reindex-remote-received-error-socket-exception-connection-reset/272538)
**Author:** [@Ragul\_R](https://discuss.elastic.co/u/Ragul_R)\ **Replies:** 6\ **Last updated:** [May 10, 2021, 10:55am UTC](https://discuss.elastic.co/t/reindex-remote-received-error-socket-exception-connection-reset/272538 "2021-05-10T10:55:54Z")
I'm Copying index remotely cluster1 to Cluster2.\[Received Error "socket\_exception" & "Connection reset"\] i haved tried Type 1& 2 configuration, im facing same error elasticsearch.yml Type1: reindex.remote.whitelist:… --- ## [https://artifacts.elastic.co/packages/7.x/apt/dists/stable/InRelease intermittently fails](https://discuss.elastic.co/t/https-artifacts-elastic-co-packages-7-x-apt-dists-stable-inrelease-intermittently-fails/272317)
**Author:** [@baba.tunde](https://discuss.elastic.co/u/baba.tunde)\ **Replies:** 2\ **Last updated:** [May 10, 2021, 10:49am UTC](https://discuss.elastic.co/t/https-artifacts-elastic-co-packages-7-x-apt-dists-stable-inrelease-intermittently-fails/272317 "2021-05-10T10:49:05Z")
Hi folks, ############################################### wget https://artifacts.elastic.co/packages/7.x/apt/dists/stable/InRelease --2021-05-06 17:35:16-- https://artifacts.elastic.co/packages/7.x/apt/dists/stable/I… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=647) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=649)