# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1168

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1169

---

## [Effect of cores on searching/indexing](https://discuss.elastic.co/t/effect-of-cores-on-searching-indexing/198020)

<div class="topic-metadata">

**Author:** [@pokaleshrey](https://discuss.elastic.co/u/pokaleshrey)\
**Replies:** 5\
**Last updated:** [September 5, 2019, 12:35am UTC](https://discuss.elastic.co/t/effect-of-cores-on-searching-indexing/198020 "2019-09-05T00:35:40Z")

</div>

Need some inputs on searching and indexing on below concept w.r.t data nodes: Query: What is the difference between having 2 data nodes of 16cores each and 4 data nodes of 8cores each ? In both scenarios i have 32core…

---

## [Use variable in search query](https://discuss.elastic.co/t/use-variable-in-search-query/198129)

<div class="topic-metadata">

**Author:** [@JohnM](https://discuss.elastic.co/u/JohnM)\
**Replies:** 0\
**Last updated:** [September 5, 2019, 12:30am UTC](https://discuss.elastic.co/t/use-variable-in-search-query/198129 "2019-09-05T00:30:11Z")

</div>

I am using python elasticsearch client to query. https://elasticsearch-py.readthedocs.io/en/master/ Everything works fine except using queries string as variable. Sorry if this is more python question. This works well…

---

## [Trying to get sort to work on items containing an optional field](https://discuss.elastic.co/t/trying-to-get-sort-to-work-on-items-containing-an-optional-field/198115)

<div class="topic-metadata">

**Author:** [@lhartzman](https://discuss.elastic.co/u/lhartzman)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 10:41pm UTC](https://discuss.elastic.co/t/trying-to-get-sort-to-work-on-items-containing-an-optional-field/198115 "2019-09-04T22:41:42Z")

</div>

I have records with an element that is an array of data. If one of the array elements has the 'role' element attached to it, the sort should apply to the data labeled with 'FranchiseCode'. Below is the mapping, sample da…

---

## [Shards not being allocated according to "box\_type" setting in designated nodes of same type](https://discuss.elastic.co/t/shards-not-being-allocated-according-to-box-type-setting-in-designated-nodes-of-same-type/197723)

<div class="topic-metadata">

**Author:** [@viniciof](https://discuss.elastic.co/u/viniciof)\
**Replies:** 4\
**Last updated:** [September 2, 2019, 6:07pm UTC](https://discuss.elastic.co/t/shards-not-being-allocated-according-to-box-type-setting-in-designated-nodes-of-same-type/197723 "2019-09-02T18:07:19Z")

</div>

I have an index of around 4.1TB~ total size in a cluster of 12 nodes (9 DATA & INGEST, 3 DATA & MASTER) and all of them are set to "hot" category - we don't currently have any "warm" node in this cluster. The problem is…

---

## [Bootstrapping Elasticsearch 7.3 in AWS using Cloudformation](https://discuss.elastic.co/t/bootstrapping-elasticsearch-7-3-in-aws-using-cloudformation/198109)

<div class="topic-metadata">

**Author:** [@mlmurray](https://discuss.elastic.co/u/mlmurray)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 10:23pm UTC](https://discuss.elastic.co/t/bootstrapping-elasticsearch-7-3-in-aws-using-cloudformation/198109 "2019-09-04T22:23:55Z")

</div>

Hi all, I've seen a couple of people who have posted questions on how to bootstrap a cluster in 7.x.x using auto-scaling groups (and or auto-generated infrastructure using Cloudformation) but I haven't seen anyone actua…

---

## [Newbie questions on mapping](https://discuss.elastic.co/t/newbie-questions-on-mapping/197606)

<div class="topic-metadata">

**Author:** [@lhartzman](https://discuss.elastic.co/u/lhartzman)\
**Replies:** 3\
**Last updated:** [September 4, 2019, 9:57pm UTC](https://discuss.elastic.co/t/newbie-questions-on-mapping/197606 "2019-09-04T21:57:13Z")

</div>

I just started to investigate Elasticsearch since my company uses it. I took a section of a mapping and used it to create a new index on a new ES instance and don't understand what happened. The mapping has a dynamic te…

---

## [Lots of bulk requests being rejected by data node](https://discuss.elastic.co/t/lots-of-bulk-requests-being-rejected-by-data-node/198105)

<div class="topic-metadata">

**Author:** [@viniciof](https://discuss.elastic.co/u/viniciof)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 9:22pm UTC](https://discuss.elastic.co/t/lots-of-bulk-requests-being-rejected-by-data-node/198105 "2019-09-04T21:22:46Z")

</div>

Hi all, One of my data nodes is always running 4 "bulk" tasks, has a waiting queue of 500 (max queue limit in our settings) and millions of rejected requests. GET \_cat/thread\_pool?v If I check the tasks running th…

---

## [API call - how to set @timestamp (or equivalent)](https://discuss.elastic.co/t/api-call-how-to-set-timestamp-or-equivalent/197742)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 1\
**Last updated:** [September 4, 2019, 8:42pm UTC](https://discuss.elastic.co/t/api-call-how-to-set-timestamp-or-equivalent/197742 "2019-09-04T20:42:23Z")

</div>

Im posting some timeseries data from an app. As it stands presently I can't see it in Kibana though I can get it via curl request. The posted data lacks a timestamp so Im wondering what the appropriate syntax is. Presen…

---

## [Query\_string query with fuzzy matching enabled without explicit \`~\` operators](https://discuss.elastic.co/t/query-string-query-with-fuzzy-matching-enabled-without-explicit-operators/198101)

<div class="topic-metadata">

**Author:** [@rocketraman](https://discuss.elastic.co/u/rocketraman)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 7:44pm UTC](https://discuss.elastic.co/t/query-string-query-with-fuzzy-matching-enabled-without-explicit-operators/198101 "2019-09-04T19:44:33Z")

</div>

With query\_string for queries, a user can use operators like AND and OR. However, if they are searching for the term bill and type in bil as a search term, they don't find anything (the field uses a standard analyzer). …

---

## [Store indices in separate locations](https://discuss.elastic.co/t/store-indices-in-separate-locations/197925)

<div class="topic-metadata">

**Author:** [@vini](https://discuss.elastic.co/u/vini)\
**Replies:** 4\
**Last updated:** [September 4, 2019, 7:39pm UTC](https://discuss.elastic.co/t/store-indices-in-separate-locations/197925 "2019-09-04T19:39:50Z")

</div>

Hi all, I know this wasn’t possible with older version of elastic but in the recent version I haven’t been able to confirm yet. Can I define multiple locations to store indexes and define what index type is placed where…

---

## [Best practices to delete / mark for delete specific documents in an index?](https://discuss.elastic.co/t/best-practices-to-delete-mark-for-delete-specific-documents-in-an-index/194385)

<div class="topic-metadata">

**Author:** [@Ariel\_B](https://discuss.elastic.co/u/Ariel_B)\
**Replies:** 8\
**Last updated:** [August 8, 2019, 2:12pm UTC](https://discuss.elastic.co/t/best-practices-to-delete-mark-for-delete-specific-documents-in-an-index/194385 "2019-08-08T14:12:20Z")

</div>

Hello, In my use cases i use a monthly indexes, which store large amount of documents. When user adds some kind of configuration, some of those documents need to be deleted. I understand that it's not efficient to keep…

---

## [Using Custom Sort with Track Scores set to True is still showing score as null](https://discuss.elastic.co/t/using-custom-sort-with-track-scores-set-to-true-is-still-showing-score-as-null/196012)

<div class="topic-metadata">

**Author:** [@andres\_512](https://discuss.elastic.co/u/andres_512)\
**Replies:** 3\
**Last updated:** [August 22, 2019, 11:49am UTC](https://discuss.elastic.co/t/using-custom-sort-with-track-scores-set-to-true-is-still-showing-score-as-null/196012 "2019-08-22T11:49:52Z")

</div>

So I'm setting a default query in my React Native app. Essentially I'm trying to set a sortOrder based on the elementOrder values. My partner used this same piece of code in his web app and it works for him. It doesn't s…

---

## [Applying My First Index Template](https://discuss.elastic.co/t/applying-my-first-index-template/196967)

<div class="topic-metadata">

**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\
**Replies:** 4\
**Last updated:** [September 4, 2019, 5:49pm UTC](https://discuss.elastic.co/t/applying-my-first-index-template/196967 "2019-09-04T17:49:33Z")

</div>

Hi everyone, I’m trying to apply my first ElasticSearch Index Template, and am having some issues. I think I’m both a little confused about the process of wedding a Template to an Index, and about the exact syntax of t…

---

## [X-pack seems to be creating a logstash index template automatically](https://discuss.elastic.co/t/x-pack-seems-to-be-creating-a-logstash-index-template-automatically/197009)

<div class="topic-metadata">

**Author:** [@jwalls](https://discuss.elastic.co/u/jwalls)\
**Replies:** 6\
**Last updated:** [September 4, 2019, 5:11pm UTC](https://discuss.elastic.co/t/x-pack-seems-to-be-creating-a-logstash-index-template-automatically/197009 "2019-09-04T17:11:31Z")

</div>

I have an issue with conflicting logstash index templates, and when deleting the one I don't need, it gets immediately recreated. considering it's called logstash-index-template this follows the similar naming convention…

---

## [Sort does not work properly with from size parameter on elastic 7.2](https://discuss.elastic.co/t/sort-does-not-work-properly-with-from-size-parameter-on-elastic-7-2/198084)

<div class="topic-metadata">

**Author:** [@Enes\_Acikoglu](https://discuss.elastic.co/u/Enes_Acikoglu)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 4:56pm UTC](https://discuss.elastic.co/t/sort-does-not-work-properly-with-from-size-parameter-on-elastic-7-2/198084 "2019-09-04T16:56:31Z")

</div>

Hello All, We are using elastic 7.2 via rest high-level client on kotlin app. When we try to use below query sort return as false.It seems like sorting string instead of number like 1000-\>101-\>102 it looks third digit f…

---

## [Change \_id field generation strategy from UUID-strings to long (by means of ES)](https://discuss.elastic.co/t/change-id-field-generation-strategy-from-uuid-strings-to-long-by-means-of-es/198050)

<div class="topic-metadata">

**Author:** [@tworogue](https://discuss.elastic.co/u/tworogue)\
**Replies:** 1\
**Last updated:** [September 4, 2019, 4:31pm UTC](https://discuss.elastic.co/t/change-id-field-generation-strategy-from-uuid-strings-to-long-by-means-of-es/198050 "2019-09-04T16:31:54Z")

</div>

Hello! I'm wondering if I can change the default behavior for '\_id' field generation. I'd like ES to generate ids, but, instead of Flake-based string UUIDs I would like to get long (incremental, sequential) numbers (re…

---

## [Removing the ability do make any changes to advanced settings](https://discuss.elastic.co/t/removing-the-ability-do-make-any-changes-to-advanced-settings/198076)

<div class="topic-metadata">

**Author:** [@cowensel](https://discuss.elastic.co/u/cowensel)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 4:20pm UTC](https://discuss.elastic.co/t/removing-the-ability-do-make-any-changes-to-advanced-settings/198076 "2019-09-04T16:20:47Z")

</div>

Hi there, I think I am going slightly mad. I have created what I thought is a read only role but the user has the ability to create/delete spaces. The permissions set using the kibana UI are: Cluster privileges : None …

---

## [Calculate overall score of the query using score of each term](https://discuss.elastic.co/t/calculate-overall-score-of-the-query-using-score-of-each-term/198073)

<div class="topic-metadata">

**Author:** [@nehacv](https://discuss.elastic.co/u/nehacv)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 4:06pm UTC](https://discuss.elastic.co/t/calculate-overall-score-of-the-query-using-score-of-each-term/198073 "2019-09-04T16:06:15Z")

</div>

I have a query which has 4-5 filters with each having score of its own filter A has score a and filter B has score b: { "boost\_factor": "3", "filter": {...} }, { "filter": {â.}, "script": "\_score \* doc\['my\_numeric…

---

## [Delete Indices Action removes also Index patterns from Kibana](https://discuss.elastic.co/t/delete-indices-action-removes-also-index-patterns-from-kibana/197802)

<div class="topic-metadata">

**Author:** [@Ab\_Avramidis](https://discuss.elastic.co/u/Ab_Avramidis)\
**Replies:** 1\
**Last updated:** [September 4, 2019, 3:43pm UTC](https://discuss.elastic.co/t/delete-indices-action-removes-also-index-patterns-from-kibana/197802 "2019-09-04T15:43:42Z")

</div>

Hi, I was wondering If anyone can explain to me why and how I can avoid that issue, when I execute through curator an action to delete my old indices, it also delete(removes) automatically the Index patterns from my Kib…

---

## [Default search timeout not applying on search and msearch calls](https://discuss.elastic.co/t/default-search-timeout-not-applying-on-search-and-msearch-calls/198060)

<div class="topic-metadata">

**Author:** [@o1o1o11o1](https://discuss.elastic.co/u/o1o1o11o1)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 2:03pm UTC](https://discuss.elastic.co/t/default-search-timeout-not-applying-on-search-and-msearch-calls/198060 "2019-09-04T14:03:09Z")

</div>

I've configured ES 7.1 with a default\_search\_timeout of 120s, however when I list all search or msearch tasks (\*search) I can still see long running tasks of more than 20,000 seconds. I can cancel them just fine, but was…

---

## [Can not elect master when restarting cluster from 7.3 upgrade](https://discuss.elastic.co/t/can-not-elect-master-when-restarting-cluster-from-7-3-upgrade/197846)

<div class="topic-metadata">

**Author:** [@elastic\_paul](https://discuss.elastic.co/u/elastic_paul)\
**Replies:** 18\
**Last updated:** [September 4, 2019, 12:17pm UTC](https://discuss.elastic.co/t/can-not-elect-master-when-restarting-cluster-from-7-3-upgrade/197846 "2019-09-04T12:17:43Z")

</div>

Hi team, I have an 8 node ES cluster in dev. I shut it all down, upgraded to 7.3.1 Restarted, and no I can not get a master elected :frowning: Here is a sample of the log entry (similar appear on all nodes) \[2019-0…

---

## [SearchScript score for nested docs](https://discuss.elastic.co/t/searchscript-score-for-nested-docs/198039)

<div class="topic-metadata">

**Author:** [@poitevinpm](https://discuss.elastic.co/u/poitevinpm)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 11:58am UTC](https://discuss.elastic.co/t/searchscript-score-for-nested-docs/198039 "2019-09-04T11:58:31Z")

</div>

Hi! I am trying to implement a SearchScript to have a custom scoring algo. Some of the queries I use have filters on nested fields. So I have a few questions I didn't find answers on the documentation. Also I am using …

---

## [Error: failed to authenticate user](https://discuss.elastic.co/t/error-failed-to-authenticate-user/198038)

<div class="topic-metadata">

**Author:** [@rajatrj16](https://discuss.elastic.co/u/rajatrj16)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 11:38am UTC](https://discuss.elastic.co/t/error-failed-to-authenticate-user/198038 "2019-09-04T11:38:26Z")

</div>

when I am restarting elasticsearch ./bin/elasticsearch. It gives error: \[2019-09-04T16:53:35,773\]\[INFO \]\[o.e.x.s.a.AuthenticationService\] \[elk\] Authentication of \[elastic\] was terminated by realm \[reserved\] - failed to…

---

## [Data node constantly dropping out of the cluster](https://discuss.elastic.co/t/data-node-constantly-dropping-out-of-the-cluster/194216)

<div class="topic-metadata">

**Author:** [@Jorge\_Betancourt](https://discuss.elastic.co/u/Jorge_Betancourt)\
**Replies:** 18\
**Last updated:** [September 4, 2019, 11:36am UTC](https://discuss.elastic.co/t/data-node-constantly-dropping-out-of-the-cluster/194216 "2019-09-04T11:36:43Z")

</div>

We had a situation after migrating to Elasticsearch 7.3. We run 3 dedicated masters and 4 data nodes. Each data node has 24 vCPUs and 30GB of RAM, used primarily for ingesting logs. One of our data nodes was constantly b…

---

## [Accidentally deleted Index- Error: failed to find metadata for existing index](https://discuss.elastic.co/t/accidentally-deleted-index-error-failed-to-find-metadata-for-existing-index/197983)

<div class="topic-metadata">

**Author:** [@rajatrj16](https://discuss.elastic.co/u/rajatrj16)\
**Replies:** 9\
**Last updated:** [September 4, 2019, 11:33am UTC](https://discuss.elastic.co/t/accidentally-deleted-index-error-failed-to-find-metadata-for-existing-index/197983 "2019-09-04T11:33:07Z")

</div>

I have accidentally deleted 2-3 indexes form path: elasticsearch/data/nodes/0 And now I can't able to restart the elastic search. It gives me the error: Caused by: java.io.IOException: failed to find metadata for exis…

---

## [\_update\_by\_query doesn't return a list of affected IDs and Indices](https://discuss.elastic.co/t/update-by-query-doesnt-return-a-list-of-affected-ids-and-indices/197820)

<div class="topic-metadata">

**Author:** [@markb](https://discuss.elastic.co/u/markb)\
**Replies:** 4\
**Last updated:** [September 4, 2019, 11:07am UTC](https://discuss.elastic.co/t/update-by-query-doesnt-return-a-list-of-affected-ids-and-indices/197820 "2019-09-04T11:07:28Z")

</div>

I want to update records by running "\_update\_by\_query" and after that receive the list of affected ID's and indices like it happens when creating new record. It would be also nice to have returning the selected fields f…

---

## [Delete by query limitation](https://discuss.elastic.co/t/delete-by-query-limitation/198028)

<div class="topic-metadata">

**Author:** [@tom\_es](https://discuss.elastic.co/u/tom_es)\
**Replies:** 1\
**Last updated:** [September 4, 2019, 10:47am UTC](https://discuss.elastic.co/t/delete-by-query-limitation/198028 "2019-09-04T10:47:13Z")

</div>

Hi, we have an index with 50 Million docs, and from time to time we would like to purge some of it's data. in order to do that, we would like to use "delete by" query. I was trying to understand what are the limitatio…

---

## [Logstash - elastic Search connection refused](https://discuss.elastic.co/t/logstash-elastic-search-connection-refused/197975)

<div class="topic-metadata">

**Author:** [@katara](https://discuss.elastic.co/u/katara)\
**Replies:** 4\
**Last updated:** [September 4, 2019, 10:01am UTC](https://discuss.elastic.co/t/logstash-elastic-search-connection-refused/197975 "2019-09-04T10:01:09Z")

</div>

Hi, I have 2 servers from the same domain where I have installed Elasticsearch 7.1.0 in one and Logstash 7.1.0 in another. I am trying to fetch data from DB(same as Logstash server) and push the data to my ES server. …

---

## [Elastic Security Error 7.3.1](https://discuss.elastic.co/t/elastic-security-error-7-3-1/197849)

<div class="topic-metadata">

**Author:** [@eduardobarrete](https://discuss.elastic.co/u/eduardobarrete)\
**Replies:** 2\
**Last updated:** [September 4, 2019, 9:52am UTC](https://discuss.elastic.co/t/elastic-security-error-7-3-1/197849 "2019-09-04T09:52:39Z")

</div>

I'm trying to follow this blog https://www.elastic.co/blog/getting-started-with-elasticsearch-security using the version 7.3.1 but i stumble after running this command $ bin/elasticsearch Error..OpenJDK 64-Bit Server V…

---

## [Whole email notification system fails if even just one email is not whitelisted](https://discuss.elastic.co/t/whole-email-notification-system-fails-if-even-just-one-email-is-not-whitelisted/198021)

<div class="topic-metadata">

**Author:** [@Josip\_Cagalj](https://discuss.elastic.co/u/Josip_Cagalj)\
**Replies:** 0\
**Last updated:** [September 4, 2019, 9:38am UTC](https://discuss.elastic.co/t/whole-email-notification-system-fails-if-even-just-one-email-is-not-whitelisted/198021 "2019-09-04T09:38:33Z")

</div>

Hi, we are using elastic cloud service and it's excellent watcher functionalities. My question is why is that whole email notification part of a watcher fails if only one (or a few) from many others, email addresses are…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1167)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1169)
