# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=767 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 768 --- ## [Queries without fully qualified field names failing in the latest versions of Elasticsearch](https://discuss.elastic.co/t/queries-without-fully-qualified-field-names-failing-in-the-latest-versions-of-elasticsearch/254958)
**Author:** [@Bhargav\_Balu](https://discuss.elastic.co/u/Bhargav_Balu)\ **Replies:** 4\ **Last updated:** [November 11, 2020, 6:55am UTC](https://discuss.elastic.co/t/queries-without-fully-qualified-field-names-failing-in-the-latest-versions-of-elasticsearch/254958 "2020-11-11T06:55:30Z")
Hi, We are currently running Elasticsearch 1.4 and are trying to upgrade to the newer versions 7.x. As part of that effort, we noticed our queries are failing on the latest versions i.e 7.x if the fileds used in queries… --- ## [What is the use of internal verison\_type now that one should use seq\_no and primary\_term for Optimistic Concurrency Control?](https://discuss.elastic.co/t/what-is-the-use-of-internal-verison-type-now-that-one-should-use-seq-no-and-primary-term-for-optimistic-concurrency-control/252061)
**Author:** [@Bhargav\_Balu](https://discuss.elastic.co/u/Bhargav_Balu)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 6:29am UTC](https://discuss.elastic.co/t/what-is-the-use-of-internal-verison-type-now-that-one-should-use-seq-no-and-primary-term-for-optimistic-concurrency-control/252061 "2020-11-11T06:29:23Z")
Hi, Why is internal version type still supported here The latest versions doesn't support this way of concurrency control anymore and one should use seq\_no and primary\_term right? --- ## [What should I do if the 'state' file is corrupted](https://discuss.elastic.co/t/what-should-i-do-if-the-state-file-is-corrupted/254999)
**Author:** [@cigarl](https://discuss.elastic.co/u/cigarl)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 6:09am UTC](https://discuss.elastic.co/t/what-should-i-do-if-the-state-file-is-corrupted/254999 "2020-11-11T06:09:31Z")
When shard-data is corrupt, I can use 'reroute' or 'elasticSearch-shard' to restore the cluster, even if some data of the shard could be lost. But when the 'state' file is corrupted, the cluster cannot even be started. … --- ## [Limit of total fields \[1000\] exceeded](https://discuss.elastic.co/t/limit-of-total-fields-1000-exceeded/254747)
**Author:** [@ahmedbrandver](https://discuss.elastic.co/u/ahmedbrandver)\ **Replies:** 17\ **Last updated:** [November 11, 2020, 4:26am UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-exceeded/254747 "2020-11-11T04:26:36Z")
I am getting Limit of total fields \[1000\] in index \[products\] has been exceeded. Although total number of properties that is added dynamically is 499. Every where I search is asking me to increase total\_fields length sin… --- ## [Regex question on dsl](https://discuss.elastic.co/t/regex-question-on-dsl/254998)
**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 3:23am UTC](https://discuss.elastic.co/t/regex-question-on-dsl/254998 "2020-11-11T03:23:45Z")
Hi all The regex on the search api have some limitation that i need to overcome somehow so please help me. i would like to search for something like this: test123.test\[.\]com something.test\[.\]com now the regex that i… --- ## [Save queries elsewhere besides inside Python app](https://discuss.elastic.co/t/save-queries-elsewhere-besides-inside-python-app/254965)
**Author:** [@ErikvdVen](https://discuss.elastic.co/u/ErikvdVen)\ **Replies:** 2\ **Last updated:** [November 10, 2020, 11:55pm UTC](https://discuss.elastic.co/t/save-queries-elsewhere-besides-inside-python-app/254965 "2020-11-10T23:55:13Z")
We use Elasticsearch queries inside our Python application, which are quite big. For now we saved them as JSON files, to keep the code a bit clean. But I was wondering if anyone knows a better solution? I guess it would… --- ## [How to re-index Elasticsearch without stale reads?](https://discuss.elastic.co/t/how-to-re-index-elasticsearch-without-stale-reads/254860)
**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\ **Replies:** 1\ **Last updated:** [November 10, 2020, 11:40pm UTC](https://discuss.elastic.co/t/how-to-re-index-elasticsearch-without-stale-reads/254860 "2020-11-10T23:40:22Z")
I have indices with heavy read/write operations. My indices have a read and a write alias. When I need to update the mapping in my indices I go about this process: create a new index with the new mapping, add write-ali… --- ## [Sending instance ID in watcher alert](https://discuss.elastic.co/t/sending-instance-id-in-watcher-alert/254903)
**Author:** [@Agneb](https://discuss.elastic.co/u/Agneb)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 12:20pm UTC](https://discuss.elastic.co/t/sending-instance-id-in-watcher-alert/254903 "2020-11-10T12:20:41Z")
Hi , i would like to create an alert using json , which sends the cloud.instance.id with the high CPU in the mail { "trigger": { "schedule": { "interval": "1m" } }, "input": { "search": { "request": { "body": { … --- ## [Use template for webhook action in Watcher](https://discuss.elastic.co/t/use-template-for-webhook-action-in-watcher/254966)
**Author:** [@Ofir\_Edi](https://discuss.elastic.co/u/Ofir_Edi)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 7:31pm UTC](https://discuss.elastic.co/t/use-template-for-webhook-action-in-watcher/254966 "2020-11-10T19:31:03Z")
Hi, we have multiple watchers (different inputs and conditions) that are doing the exactly same webhook action. Is there a way to create/store action (like the \_scripts or \_templates api) and refer to it in the watcher… --- ## [Load LimeSurvey results in ELK for analysis](https://discuss.elastic.co/t/load-limesurvey-results-in-elk-for-analysis/254971)
**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\ **Replies:** 1\ **Last updated:** [November 10, 2020, 11:32pm UTC](https://discuss.elastic.co/t/load-limesurvey-results-in-elk-for-analysis/254971 "2020-11-10T23:32:39Z")
Does anyone knows of a Beat product that would allow to load in realtime LimeSurvey results in ELK for analysis and Dashboard in Kibana? Or maybe there is something even more efficient? Thanks. --- ## [ELK stack 5.4 to 6.6 Upgrade](https://discuss.elastic.co/t/elk-stack-5-4-to-6-6-upgrade/254580)
**Author:** [@Bader](https://discuss.elastic.co/u/Bader)\ **Replies:** 6\ **Last updated:** [November 10, 2020, 11:29pm UTC](https://discuss.elastic.co/t/elk-stack-5-4-to-6-6-upgrade/254580 "2020-11-10T23:29:15Z")
Hello! I am looking to upgrade a single-node ELK stack cluster running version 5.4.0 to 6.6.0 on RHEL 7.6. I have read through the ELK documentation and have found that a "rolling upgrade" is the way to go. I do have a… --- ## [Few questions as I take over from an external Dev](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705)
**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Replies:** 5\ **Last updated:** [November 10, 2020, 10:49pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705 "2020-11-10T22:49:13Z")
Hey all, I'm starting to transition our ES from our external dev to myself. I'm no developer, but can generally learn most things. I have a few questions just to stat getting my head around things. Our current mappi… --- ## [Templates matching specific date patterns](https://discuss.elastic.co/t/templates-matching-specific-date-patterns/254972)
**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\ **Replies:** 1\ **Last updated:** [November 10, 2020, 10:48pm UTC](https://discuss.elastic.co/t/templates-matching-specific-date-patterns/254972 "2020-11-10T22:48:50Z")
I have day-wise indices that are named like prefix-yyyy-mm-dd e.g myindex-2020-10-01, myindex-2020-10-02 and so on. I want to re-index them into monthly indices named prefix-yyyy-mm e.g. myindex-2020-10, myindex-2020-09 … --- ## [Rollup job unable to start](https://discuss.elastic.co/t/rollup-job-unable-to-start/254266)
**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\ **Replies:** 9\ **Last updated:** [November 10, 2020, 10:46pm UTC](https://discuss.elastic.co/t/rollup-job-unable-to-start/254266 "2020-11-10T22:46:29Z")
I've created a new rollup job using the PUT \_rollup/job/\ api. I received an acknowledged response and the new rollup index is created. However, when I try to start the job using POST \_rollup/job/\/\_start, … --- ## [List of Elasticsearch error states when at a RED state](https://discuss.elastic.co/t/list-of-elasticsearch-error-states-when-at-a-red-state/254985)
**Author:** [@21908](https://discuss.elastic.co/u/21908)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 10:33pm UTC](https://discuss.elastic.co/t/list-of-elasticsearch-error-states-when-at-a-red-state/254985 "2020-11-10T22:33:06Z")
I’m interested in getting a list of states/reasons on why an Elasticsearch cluster would be in the RED state. Is there a full list somewhere within the Elasticsearch documentation? I would then like to take this a step… --- ## [How to delete bunch of documents by list of ids](https://discuss.elastic.co/t/how-to-delete-bunch-of-documents-by-list-of-ids/254511)
**Author:** [@Alex12](https://discuss.elastic.co/u/Alex12)\ **Replies:** 6\ **Last updated:** [November 6, 2020, 12:33pm UTC](https://discuss.elastic.co/t/how-to-delete-bunch-of-documents-by-list-of-ids/254511 "2020-11-06T12:33:33Z")
Is it possible to delete list of documents by list of documents id? i tryed like this but it does not work at all deleteAllByIdIn(List\ ids); from ElasticsearchRepository and it does not work at all please guid me… --- ## [Updating elasticsearch entities with bulk](https://discuss.elastic.co/t/updating-elasticsearch-entities-with-bulk/254936)
**Author:** [@Alex12](https://discuss.elastic.co/u/Alex12)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 3:30pm UTC](https://discuss.elastic.co/t/updating-elasticsearch-entities-with-bulk/254936 "2020-11-10T15:30:12Z")
I have this database data as below (ES 7.xx) version { "id":"1234", "expirationDate":"17343234234", "paths":"http:localhost:9090", "work":"software dev", "family":{ "baba":"jams", "mother"… --- ## [How to access nested docs in scripted\_metric after nested aggregation](https://discuss.elastic.co/t/how-to-access-nested-docs-in-scripted-metric-after-nested-aggregation/254947)
**Author:** [@drewblin](https://discuss.elastic.co/u/drewblin)\ **Replies:** 1\ **Last updated:** [November 10, 2020, 8:53pm UTC](https://discuss.elastic.co/t/how-to-access-nested-docs-in-scripted-metric-after-nested-aggregation/254947 "2020-11-10T20:53:55Z")
How can i access nested docs in scripted\_metric after nested aggregation? I make request { "query": { "match\_all": {} }, "aggs": { "q1": { "nested": { "path": "pp" }, "aggs": { "q2": { "scripted… --- ## [How to reindex after updating a field's ignore\_above attribute](https://discuss.elastic.co/t/how-to-reindex-after-updating-a-fields-ignore-above-attribute/254964)
**Author:** [@pheathers](https://discuss.elastic.co/u/pheathers)\ **Replies:** 2\ **Last updated:** [November 10, 2020, 8:47pm UTC](https://discuss.elastic.co/t/how-to-reindex-after-updating-a-fields-ignore-above-attribute/254964 "2020-11-10T20:47:21Z")
Hi. I have an index created using dynamic mapping with a field set to the default ignore\_above value of 256. I realized that the length is not nearly as high as I would need since the field can have stack traces. I u… --- ## [CentOS: Failed to start Elasticsearch 7.3.1](https://discuss.elastic.co/t/centos-failed-to-start-elasticsearch-7-3-1/254767)
**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\ **Replies:** 3\ **Last updated:** [November 10, 2020, 7:54pm UTC](https://discuss.elastic.co/t/centos-failed-to-start-elasticsearch-7-3-1/254767 "2020-11-10T19:54:34Z")
Hi there, Some time ago I installed ELKB-Stack on CentOS7. It was running great. Everything was working. Unfortunately it was broken about half a year ago, but I did not got time to look after it earlier. In meantime I… --- ## [Primary & replica shards with different size](https://discuss.elastic.co/t/primary-replica-shards-with-different-size/254849)
**Author:** [@smm](https://discuss.elastic.co/u/smm)\ **Replies:** 3\ **Last updated:** [November 10, 2020, 7:54pm UTC](https://discuss.elastic.co/t/primary-replica-shards-with-different-size/254849 "2020-11-10T19:54:05Z")
Hi there, yesterday I saw that a primary shard and its replica do have a different size. GET /\_cat/shards/dus-log-3v\_mcc\_pp\_dev-6.6.0-2020.42 dus-log-3v\_mcc\_pp\_dev-6.6.0-2020.42 0 p STARTED 29677 35.9mb X.X.X.X node1 … --- ## [Testing TLS/SSL secured elastic cluster](https://discuss.elastic.co/t/testing-tls-ssl-secured-elastic-cluster/250572)
**Author:** [@dzyubanv](https://discuss.elastic.co/u/dzyubanv)\ **Replies:** 31\ **Last updated:** [November 10, 2020, 5:36pm UTC](https://discuss.elastic.co/t/testing-tls-ssl-secured-elastic-cluster/250572 "2020-11-10T17:36:31Z")
I configured 2 node es cluster with the TLS security section in es yml file using certificates in PKCS#12 format, native realm by default, basic license, elasticsearch-7.8.0-linux-86\_64.tar.gz, RHEL 5.11. Used command w… --- ## [Documents found in scroll, can't be updated?](https://discuss.elastic.co/t/documents-found-in-scroll-cant-be-updated/254956)
**Author:** [@coogle](https://discuss.elastic.co/u/coogle)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 5:36pm UTC](https://discuss.elastic.co/t/documents-found-in-scroll-cant-be-updated/254956 "2020-11-10T17:36:08Z")
Hello, I am using the PHP bindings to do a simple update of an index of about 60k documents via scroll. Basically I am just splitting one field of comma-separated values into two separate lists. I am encountering somet… --- ## [Shard unassigned NODE\_LEFT](https://discuss.elastic.co/t/shard-unassigned-node-left/254955)
**Author:** [@kpiyush](https://discuss.elastic.co/u/kpiyush)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 5:34pm UTC](https://discuss.elastic.co/t/shard-unassigned-node-left/254955 "2020-11-10T17:34:30Z")
Hi, I have restarted the Elsaticsearch worker nodes. After restarting, one of the indexes is stuck on INITIALIZING mode and it is been quite a long time. I ran: curl -k -XGET 'https://eu1.elasticsearch.svc.cluster.loc… --- ## [Shards rebalance after node leaves cluster](https://discuss.elastic.co/t/shards-rebalance-after-node-leaves-cluster/254930)
**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\ **Replies:** 2\ **Last updated:** [November 10, 2020, 5:10pm UTC](https://discuss.elastic.co/t/shards-rebalance-after-node-leaves-cluster/254930 "2020-11-10T17:10:33Z")
Hello eveybody ! In a 6.8 cluster of 3 hot nodes and 2 cold nodes (with node attribute "Zone" and forced awareness option) : hot\_node1: Zone1 hot\_node2: Zone1 cold\_node\_4: Zone1 / hot\_node3: Zone2 hot\_node5: Zo… --- ## [How to deal with 10MB CSV download size limit?](https://discuss.elastic.co/t/how-to-deal-with-10mb-csv-download-size-limit/254832)
**Author:** [@lchen5](https://discuss.elastic.co/u/lchen5)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 12:55am UTC](https://discuss.elastic.co/t/how-to-deal-with-10mb-csv-download-size-limit/254832 "2020-11-10T00:55:43Z")
We are using elastic.co cloud service, and having issue with the 10MB size limitation for CSV download. Questions. Is there a way to increase the limit for the download operation ? If there is no way to increase the … --- ## [Call Elastic API to get an info on a parameter](https://discuss.elastic.co/t/call-elastic-api-to-get-an-info-on-a-parameter/254762)
**Author:** [@Baptiste\_Orsoni](https://discuss.elastic.co/u/Baptiste_Orsoni)\ **Replies:** 9\ **Last updated:** [November 10, 2020, 4:37pm UTC](https://discuss.elastic.co/t/call-elastic-api-to-get-an-info-on-a-parameter/254762 "2020-11-10T16:37:04Z")
Hello, I would like to use the Elastic Search API in order to get information on a parameter I have in one of my index. In concrete terms, I would like to know if there have been any hits for a particular client . ( pa… --- ## [Less number of active ML Node in anomaly detection jobs](https://discuss.elastic.co/t/less-number-of-active-ml-node-in-anomaly-detection-jobs/254827)
**Author:** [@heric](https://discuss.elastic.co/u/heric)\ **Replies:** 5\ **Last updated:** [November 10, 2020, 4:15pm UTC](https://discuss.elastic.co/t/less-number-of-active-ml-node-in-anomaly-detection-jobs/254827 "2020-11-10T16:15:31Z")
Hi, I have 5 nodes elasticsearch cluster and for all of them i activated ML roles. from GET \_nodes i can see ml role for each of the nodes, however in the anomaly detection jobs i saw only 4 active ML nodes "r… --- ## [Rescoring documents based on Author occurrence](https://discuss.elastic.co/t/rescoring-documents-based-on-author-occurrence/254942)
**Author:** [@Charles\_Lariviere](https://discuss.elastic.co/u/Charles_Lariviere)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 3:59pm UTC](https://discuss.elastic.co/t/rescoring-documents-based-on-author-occurrence/254942 "2020-11-10T15:59:59Z")
Hey! We have an index with documents that look like so: { "id": "1", "author\_id": "8", "popularity": 2.5, "tags": \["illustration", "book", "image"\] } We search this index for documents matching given t… --- ## [Find static list of phrases in 32M ES index](https://discuss.elastic.co/t/find-static-list-of-phrases-in-32m-es-index/254924)
**Author:** [@mexekanez](https://discuss.elastic.co/u/mexekanez)\ **Replies:** 0\ **Last updated:** [November 10, 2020, 3:04pm UTC](https://discuss.elastic.co/t/find-static-list-of-phrases-in-32m-es-index/254924 "2020-11-10T15:04:21Z")
SO I have a list of 140K records, how do perform a fast search in an index of 32M records? @elasticsearch Appreciate any suggest thanks [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=766) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=768)