# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=855 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 856 --- ## [Update by query performance question](https://discuss.elastic.co/t/update-by-query-performance-question/242042)
**Author:** [@ciocan](https://discuss.elastic.co/u/ciocan)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 2:18pm UTC](https://discuss.elastic.co/t/update-by-query-performance-question/242042 "2020-07-21T14:18:25Z")
Hi, I'm quite new to elastic search. My problem is the following: There are two indexes: index1 - around 18m docs (~40gb of data) index2 - around 22k docs (10mb of data) I need to update all documents from index1 wit… --- ## [Watcher Alert Condition](https://discuss.elastic.co/t/watcher-alert-condition/240972)
**Author:** [@velu](https://discuss.elastic.co/u/velu)\ **Replies:** 3\ **Last updated:** [July 21, 2020, 12:48pm UTC](https://discuss.elastic.co/t/watcher-alert-condition/240972 "2020-07-21T12:48:29Z")
Hi , Please help me on this how to set conditional alert in watcher ..the alert to be trigger once my threshold breaches more than 10 mins. Thanks, Velu G --- ## [ES 2 to 7.5 migration](https://discuss.elastic.co/t/es-2-to-7-5-migration/242022)
**Author:** [@lhmzhou](https://discuss.elastic.co/u/lhmzhou)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 12:46pm UTC](https://discuss.elastic.co/t/es-2-to-7-5-migration/242022 "2020-07-21T12:46:09Z")
Hi, I'm currently migrating from ES 2 to 7.5. Below query gives me results in the older version and no results/error in newer version when executed in Postman. {"query":{"constant\_score":{"filter":{"terms":{"templateI… --- ## [Records from all nodes are not searched by the custom plugin](https://discuss.elastic.co/t/records-from-all-nodes-are-not-searched-by-the-custom-plugin/242021)
**Author:** [@radhika](https://discuss.elastic.co/u/radhika)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 11:57am UTC](https://discuss.elastic.co/t/records-from-all-nodes-are-not-searched-by-the-custom-plugin/242021 "2020-07-21T11:57:45Z")
Hi, I have recently migrated a custom scoring plugin from ES 1.7.5 to version 7.5.2. The plugin works fine and gives expected results when running in a single node environment. The issue arrises when there are 2 or more… --- ## [Repository-gcs high amount of requests](https://discuss.elastic.co/t/repository-gcs-high-amount-of-requests/241902)
**Author:** [@chaekew2xie1ohh2aoYe](https://discuss.elastic.co/u/chaekew2xie1ohh2aoYe)\ **Replies:** 5\ **Last updated:** [July 21, 2020, 11:42am UTC](https://discuss.elastic.co/t/repository-gcs-high-amount-of-requests/241902 "2020-07-21T11:42:00Z")
I followed the repository-gcs guide to install a snapshot repository for gcs a month ago. https://www.elastic.co/guide/en/elasticsearch/plugins/7.5/repository-gcs.html POST http://elasticsearch-cluster:9200/\_snapshot/da… --- ## [Bug in standard analyzer?](https://discuss.elastic.co/t/bug-in-standard-analyzer/242010)
**Author:** [@corbosman](https://discuss.elastic.co/u/corbosman)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 10:51am UTC](https://discuss.elastic.co/t/bug-in-standard-analyzer/242010 "2020-07-21T10:51:27Z")
Hi all, we have a field that contains hostnames like "foo.bar.com". I noticed that when I searched for hostnames with only digits, I got too many results. Let's say I search for "1234.example.com", I would also get back… --- ## [Find offending index causing "unknown mapping" in v6.8.6](https://discuss.elastic.co/t/find-offending-index-causing-unknown-mapping-in-v6-8-6/242007)
**Author:** [@atmosx](https://discuss.elastic.co/u/atmosx)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 10:40am UTC](https://discuss.elastic.co/t/find-offending-index-causing-unknown-mapping-in-v6-8-6/242007 "2020-07-21T10:40:55Z")
Hello, We have several ES clusters receiving logs from kubernetes apps (fluentd) and non kubernetes apps (filebeat). All clusters have the same configuration. The "sandbox" cluster contains "unknown" type fields in some… --- ## [How to execute Must and Should query that matches an individual Nested field?](https://discuss.elastic.co/t/how-to-execute-must-and-should-query-that-matches-an-individual-nested-field/239648)
**Author:** [@rd8388](https://discuss.elastic.co/u/rd8388)\ **Replies:** 9\ **Last updated:** [July 21, 2020, 10:26am UTC](https://discuss.elastic.co/t/how-to-execute-must-and-should-query-that-matches-an-individual-nested-field/239648 "2020-07-21T10:26:52Z")
A record has two items/values indexed in a nested field type addresses.fulladdress. "11 High Street" and "88 West Avenue" If a user searched for "11 West" this record should not be matched. How should we structure the … --- ## [Aggregator \[load\_time\_outlier\] of type \[percentiles\] cannot accept sub-aggregations](https://discuss.elastic.co/t/aggregator-load-time-outlier-of-type-percentiles-cannot-accept-sub-aggregations/241981)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 10:15am UTC](https://discuss.elastic.co/t/aggregator-load-time-outlier-of-type-percentiles-cannot-accept-sub-aggregations/241981 "2020-07-21T10:15:48Z")
i use percentiles aggregation for the response times low25% mid50% top25% partitions and then want to get min/max values based on each aggregated partitions. i try to write query like GET myindex-2020.06/\_search { "si… --- ## [Elasticsearch 7.7.1 ServiceConfigurationError Cannot instantiate FastCompressingCodec](https://discuss.elastic.co/t/elasticsearch-7-7-1-serviceconfigurationerror-cannot-instantiate-fastcompressingcodec/241971)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 10:12am UTC](https://discuss.elastic.co/t/elasticsearch-7-7-1-serviceconfigurationerror-cannot-instantiate-fastcompressingcodec/241971 "2020-07-21T10:12:25Z")
I am trying to run a test by extending ESSingleNodeTestCase with elasticsearch 7.7.1. But I am getting the below error. I am not seeing any jar hell error and I have made the intellij settings as mentioned here java.uti… --- ## [Need suggestions on tutorials](https://discuss.elastic.co/t/need-suggestions-on-tutorials/241995)
**Author:** [@prajwalgmpp](https://discuss.elastic.co/u/prajwalgmpp)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 9:33am UTC](https://discuss.elastic.co/t/need-suggestions-on-tutorials/241995 "2020-07-21T09:33:40Z")
Is there a comprehensive tutorial that shows how to create AWS Instances as IAAS, push data through filebeat to logstash, index the data in ElasticSearch and visualize in Kibana? Please suggest. --- ## [ES 7.8.0: query\_string with fields: \["\*"\] vs default\_field: "\*" performance](https://discuss.elastic.co/t/es-7-8-0-query-string-with-fields-vs-default-field-performance/241990)
**Author:** [@jojo23](https://discuss.elastic.co/u/jojo23)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 9:01am UTC](https://discuss.elastic.co/t/es-7-8-0-query-string-with-fields-vs-default-field-performance/241990 "2020-07-21T09:01:04Z")
I'm getting very different performance searching a small (\< 200MB) index with a query\_string filter, depending on how I specify the fields to be searched: fields: \["\*"\] - 1600ms consistently default\_field: "\*" - \< 100m… --- ## [Should we continue or stop indexing during rolling upgrades of Elastic-Search?](https://discuss.elastic.co/t/should-we-continue-or-stop-indexing-during-rolling-upgrades-of-elastic-search/240779)
**Author:** [@het](https://discuss.elastic.co/u/het)\ **Replies:** 7\ **Last updated:** [July 21, 2020, 8:56am UTC](https://discuss.elastic.co/t/should-we-continue-or-stop-indexing-during-rolling-upgrades-of-elastic-search/240779 "2020-07-21T08:56:56Z")
Hi team, Should we continue or stop indexing during rolling upgrades of Elastic-Search? I read in the upgrade documentation that it is optional steps to stop indexing and do flush sync. My query is if we do not stop in… --- ## [Handle Nested data in elasticsearch](https://discuss.elastic.co/t/handle-nested-data-in-elasticsearch/241401)
**Author:** [@mathur7vidit](https://discuss.elastic.co/u/mathur7vidit)\ **Replies:** 2\ **Last updated:** [July 21, 2020, 7:04am UTC](https://discuss.elastic.co/t/handle-nested-data-in-elasticsearch/241401 "2020-07-21T07:04:08Z")
Hi All, I have a json Input file where I have a field namely error. this error is basically nested and has 3 sub-fields namely error.message, error.stacktrace and error.class. Currently i am able to use filters with the… --- ## [Help running esrally performace test on a storage SAN volume](https://discuss.elastic.co/t/help-running-esrally-performace-test-on-a-storage-san-volume/241242)
**Author:** [@dmaman](https://discuss.elastic.co/u/dmaman)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 6:41am UTC](https://discuss.elastic.co/t/help-running-esrally-performace-test-on-a-storage-san-volume/241242 "2020-07-21T06:41:59Z")
Hi, I would like to compare performance using esrally on a local SDD vs A NAS volume, how can I configure esrally to use the NAS volume? thanks, dve. --- ## [Number of shards](https://discuss.elastic.co/t/number-of-shards/241802)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 4\ **Last updated:** [July 20, 2020, 8:02am UTC](https://discuss.elastic.co/t/number-of-shards/241802 "2020-07-20T08:02:02Z")
hello I found this rule of thumb for 30-50gb per shared so, does it mean that if I have 100gb of data, I will need 2 primary shards, or 1 primary and 1 replica is good enough? thanks! --- ## [Elasticsearch cluster physical server](https://discuss.elastic.co/t/elasticsearch-cluster-physical-server/241970)
**Author:** [@jang](https://discuss.elastic.co/u/jang)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 6:23am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-physical-server/241970 "2020-07-21T06:23:52Z")
hi, i'm using ELK stack. I try to collect about 120 million data a day. I am considering the number of physical servers in Logstash server and Elastic Search server. I want 120 million data stored a day without error… --- ## [Slowly Indexing speed](https://discuss.elastic.co/t/slowly-indexing-speed/241733)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 25\ **Last updated:** [July 21, 2020, 5:17am UTC](https://discuss.elastic.co/t/slowly-indexing-speed/241733 "2020-07-21T05:17:38Z")
Hi, I insert bulk into elasticsearch with c++ client each bulk contains 30,000 documents each document has 40 numeric fields indexing duration is about 13 seconds the data in each bulk is targeted to one shard in on… --- ## [Using Nested Fields in Composite Aggregation](https://discuss.elastic.co/t/using-nested-fields-in-composite-aggregation/241921)
**Author:** [@lmariselvam](https://discuss.elastic.co/u/lmariselvam)\ **Replies:** 0\ **Last updated:** [July 20, 2020, 6:03pm UTC](https://discuss.elastic.co/t/using-nested-fields-in-composite-aggregation/241921 "2020-07-20T18:03:34Z")
Basically, I'm trying to find the duplicate contacts by first name, last name & email address. For that, I've tried to use composite aggregation with the fields firstName, lastName & emails.email, the response from the q… --- ## [How to shrink an index spread over multiple nodes](https://discuss.elastic.co/t/how-to-shrink-an-index-spread-over-multiple-nodes/241814)
**Author:** [@Prash7](https://discuss.elastic.co/u/Prash7)\ **Replies:** 7\ **Last updated:** [July 21, 2020, 5:09am UTC](https://discuss.elastic.co/t/how-to-shrink-an-index-spread-over-multiple-nodes/241814 "2020-07-21T05:09:40Z")
Hey Team, How do i go about shrinking an index, which has shards over multiple nodes ? I keep getting this error { "error": { "root\_cause": \[ { "type": "remote\_transport\_exception", "reason… --- ## [How to convert EST time into UTC and add it as a field](https://discuss.elastic.co/t/how-to-convert-est-time-into-utc-and-add-it-as-a-field/241878)
**Author:** [@prabhakar\_talari](https://discuss.elastic.co/u/prabhakar_talari)\ **Replies:** 3\ **Last updated:** [July 21, 2020, 5:08am UTC](https://discuss.elastic.co/t/how-to-convert-est-time-into-utc-and-add-it-as-a-field/241878 "2020-07-21T05:08:21Z")
All, I am getting field called date with EST time, but i need to convert this date time into UTC and add it as a @timestamp through ingest pipelines. Please help me what is the correct way to do it. Thanks --- ## [Scoring when using wildcard search in query\_string](https://discuss.elastic.co/t/scoring-when-using-wildcard-search-in-query-string/241964)
**Author:** [@vangap](https://discuss.elastic.co/u/vangap)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 4:29am UTC](https://discuss.elastic.co/t/scoring-when-using-wildcard-search-in-query-string/241964 "2020-07-21T04:29:30Z")
Hi, This may be partly a general FTS question If I have two tokens like "abc" and "abc123" And user searches for "abc", in general is "abc" considered more relevant or "abc123"? Is there any deterministic ranking by… --- ## [How to partition response time low25% mid50% top25%](https://discuss.elastic.co/t/how-to-partition-response-time-low25-mid50-top25/241959)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 2\ **Last updated:** [July 21, 2020, 3:06am UTC](https://discuss.elastic.co/t/how-to-partition-response-time-low25-mid50-top25/241959 "2020-07-21T03:06:25Z")
hi community there is one report based on response time (req~resp) like this response time Lowest 25% and it's min/max values response time Median 50% and it's min/max values response time Top 25% and it's min/max va… --- ## [Agent status as a time series data](https://discuss.elastic.co/t/agent-status-as-a-time-series-data/241936)
**Author:** [@madhan\_dc](https://discuss.elastic.co/u/madhan_dc)\ **Replies:** 7\ **Last updated:** [July 21, 2020, 2:23am UTC](https://discuss.elastic.co/t/agent-status-as-a-time-series-data/241936 "2020-07-21T02:23:45Z")
Newbie question. I am exploring elastic for our needs. We have a lot of filemonitor agents. these agents can go down sometimes and we want to monitor this via Kibana my understanding, i need to save the status of the ag… --- ## [How to extract ES related keys from pem certs](https://discuss.elastic.co/t/how-to-extract-es-related-keys-from-pem-certs/241950)
**Author:** [@sb116](https://discuss.elastic.co/u/sb116)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 12:42am UTC](https://discuss.elastic.co/t/how-to-extract-es-related-keys-from-pem-certs/241950 "2020-07-21T00:42:11Z")
I have a signed cert in PEM format; how do i extract necessary certs the is required by ES cluster. We use ELB to discover ES cluster. --- ## [Error response in search](https://discuss.elastic.co/t/error-response-in-search/241447)
**Author:** [@Sagar\_jain](https://discuss.elastic.co/u/Sagar_jain)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 12:17am UTC](https://discuss.elastic.co/t/error-response-in-search/241447 "2020-07-21T00:17:57Z")
I am not getting the below error. string(738) "{"error":{"root\_cause":,"type":"search\_phase\_execution\_exception","reason":"", "phase":"fetch","grouped":true,"failed\_shards":,"caused\_by":{"type":"es\_rejected\_execution\_e… --- ## [Helping with red shards](https://discuss.elastic.co/t/helping-with-red-shards/241748)
**Author:** [@AayushPatel](https://discuss.elastic.co/u/AayushPatel)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 12:09am UTC](https://discuss.elastic.co/t/helping-with-red-shards/241748 "2020-07-21T00:09:19Z")
Hi I have elastic on 1 node and tried to reindex but it maked my node health red and after i delete the destination index to free space all of my shards get red and do not get back to run elastic the data is important … --- ## [Elastic user password is not working for my docker image](https://discuss.elastic.co/t/elastic-user-password-is-not-working-for-my-docker-image/241864)
**Author:** [@Ashok\_Reddy](https://discuss.elastic.co/u/Ashok_Reddy)\ **Replies:** 0\ **Last updated:** [July 20, 2020, 9:15am UTC](https://discuss.elastic.co/t/elastic-user-password-is-not-working-for-my-docker-image/241864 "2020-07-20T09:15:09Z")
Hello There, When I am using the elasticsearch official docker image ELASTIC\_PASSWORD env variable is working good docker run -dti -e ELASTIC\_PASSWORD=my\_own\_password -e discovery.type=single-node elasticsearch:7.8.0 … --- ## [ElasticSearch upgrade 6.7 to 7.8](https://discuss.elastic.co/t/elasticsearch-upgrade-6-7-to-7-8/241863)
**Author:** [@starwin\_stephen](https://discuss.elastic.co/u/starwin_stephen)\ **Replies:** 1\ **Last updated:** [July 20, 2020, 11:48pm UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-6-7-to-7-8/241863 "2020-07-20T23:48:26Z")
Recently i have upgraded from 6.7 to 7.8 in a single node server.Now i am facing below error while trying to clear/reindex from the application server. \*\*\[error\]\*\* \*\*Message: {"error":{"root\_cause":\[{"type":"illegal\_a… --- ## [List indices in a snapshot](https://discuss.elastic.co/t/list-indices-in-a-snapshot/241908)
**Author:** [@Jonny\_McCullagh](https://discuss.elastic.co/u/Jonny_McCullagh)\ **Replies:** 1\ **Last updated:** [July 20, 2020, 11:42pm UTC](https://discuss.elastic.co/t/list-indices-in-a-snapshot/241908 "2020-07-20T23:42:17Z")
Hi, is it possible for curator to get a list of the indices that are contained within a snapshot? This is for the purposes of restoring snapshots based on date. I've tried playing with endpoints and options but can't s… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=854) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=856)