# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=832

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 833

---

## [Basic License showing wrong expiration date](https://discuss.elastic.co/t/basic-license-showing-wrong-expiration-date/245237)

<div class="topic-metadata">

**Author:** [@baidwan007](https://discuss.elastic.co/u/baidwan007)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 7:54am UTC](https://discuss.elastic.co/t/basic-license-showing-wrong-expiration-date/245237 "2020-08-18T07:54:33Z")

</div>

I ran the update license command on ES cluster and kibana cluster today to switch to basic license. On kibana console it shows todays date itself as expiration date. I hope this is not the real case? Does this mean s…

---

## [Upgrading elk stack without stopping services using docker](https://discuss.elastic.co/t/upgrading-elk-stack-without-stopping-services-using-docker/245257)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 11\
**Last updated:** [August 18, 2020, 7:12am UTC](https://discuss.elastic.co/t/upgrading-elk-stack-without-stopping-services-using-docker/245257 "2020-08-18T07:12:21Z")

</div>

I have elk stack running on docker now the question is i want to upgrade to 7.8 version.Is there any way to upgrade the images of elk stack without stopping container ?

---

## [Aggregating the sum of sub-aggregation](https://discuss.elastic.co/t/aggregating-the-sum-of-sub-aggregation/245363)

<div class="topic-metadata">

**Author:** [@opentree](https://discuss.elastic.co/u/opentree)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 6:53am UTC](https://discuss.elastic.co/t/aggregating-the-sum-of-sub-aggregation/245363 "2020-08-18T06:53:05Z")

</div>

I've been trying to put together an aggregation on what I would call an "intermediate bucket" (aggregating the total of a bucket). The data is coming from packetbeat, where I'm trying to aggregate the total number bytes…

---

## [Max\_concurrent\_shard\_request per node](https://discuss.elastic.co/t/max-concurrent-shard-request-per-node/245359)

<div class="topic-metadata">

**Author:** [@hamid\_bayat](https://discuss.elastic.co/u/hamid_bayat)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 6:48am UTC](https://discuss.elastic.co/t/max-concurrent-shard-request-per-node/245359 "2020-08-18T06:48:08Z")

</div>

Hi I have read the elasticsearch document search API and understand Max\_concurrent\_shard\_request is used to control the maximum number of concurrent shard requests the search API will execute per node for the (per?) req…

---

## [Max\_concurrent\_shard\_requests over cross cluster search 7.5 to 6.5](https://discuss.elastic.co/t/max-concurrent-shard-requests-over-cross-cluster-search-7-5-to-6-5/245353)

<div class="topic-metadata">

**Author:** [@hamid\_bayat](https://discuss.elastic.co/u/hamid_bayat)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 6:34am UTC](https://discuss.elastic.co/t/max-concurrent-shard-requests-over-cross-cluster-search-7-5-to-6-5/245353 "2020-08-18T06:34:37Z")

</div>

Hi. As you know In elasticsearch 7.x the max\_concurrent\_shard\_requests concept change from over cluster (default 256) to per node (default 5). we want to use cross cluster search from 7.5 cluster to 6.5 cluster with max…

---

## [Nested query within single index](https://discuss.elastic.co/t/nested-query-within-single-index/244937)

<div class="topic-metadata">

**Author:** [@j3grewal](https://discuss.elastic.co/u/j3grewal)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 5:52am UTC](https://discuss.elastic.co/t/nested-query-within-single-index/244937 "2020-08-18T05:52:13Z")

</div>

Hi, Is there support for nested queries within a single index. I'll try to explain in SQL terms what I am trying to achieve in Elasticsearch: Say mytable has these columns: name, type, value fields in it. There can be…

---

## [Cannot allocate because a previous copy of the primary shard existed but can no longer be found on the nodes in the cluster](https://discuss.elastic.co/t/cannot-allocate-because-a-previous-copy-of-the-primary-shard-existed-but-can-no-longer-be-found-on-the-nodes-in-the-cluster/245335)

<div class="topic-metadata">

**Author:** [@daemon](https://discuss.elastic.co/u/daemon)\
**Replies:** 8\
**Last updated:** [August 18, 2020, 4:42am UTC](https://discuss.elastic.co/t/cannot-allocate-because-a-previous-copy-of-the-primary-shard-existed-but-can-no-longer-be-found-on-the-nodes-in-the-cluster/245335 "2020-08-18T04:42:18Z")

</div>

{ "index" : "edge-access", "shard" : 0, "primary" : true, "current\_state" : "unassigned", "unassigned\_info" : { "reason" : "INDEX\_REOPENED", "at" : "2020-08-18T03:02:26.620Z", "last\_allocation\_statu…

---

## [Elasticsearch Error "Event loop shutdown"](https://discuss.elastic.co/t/elasticsearch-error-event-loop-shutdown/245329)

<div class="topic-metadata">

**Author:** [@nguacon90](https://discuss.elastic.co/u/nguacon90)\
**Replies:** 4\
**Last updated:** [August 18, 2020, 3:20am UTC](https://discuss.elastic.co/t/elasticsearch-error-event-loop-shutdown/245329 "2020-08-18T03:20:07Z")

</div>

Hi All, I'm using elastic search with information as following: { "name": "3KOuo1W", "cluster\_name": "common-cluster", "cluster\_uuid": "H9IcVILhROqC76KMneIxlA", "version": { "number": "5.5.3", …

---

## [Can Elasticsearch cluster appoint the shards to a specific data node?](https://discuss.elastic.co/t/can-elasticsearch-cluster-appoint-the-shards-to-a-specific-data-node/245192)

<div class="topic-metadata">

**Author:** [@Fent](https://discuss.elastic.co/u/Fent)\
**Replies:** 4\
**Last updated:** [August 18, 2020, 12:51am UTC](https://discuss.elastic.co/t/can-elasticsearch-cluster-appoint-the-shards-to-a-specific-data-node/245192 "2020-08-18T00:51:41Z")

</div>

Hi ,i have two question 1 , If Elasticsearch cluster data node can located in different cities ? for expample ,some data node server in New York and others in Washington ? 2, IF elasticsearch cluster can appiont th…

---

## [Unable to start elasticsearch 7.8 container with a password](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-8-container-with-a-password/245307)

<div class="topic-metadata">

**Author:** [@vorpal\_sledge](https://discuss.elastic.co/u/vorpal_sledge)\
**Replies:** 2\
**Last updated:** [August 17, 2020, 11:32pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-8-container-with-a-password/245307 "2020-08-17T23:32:59Z")

</div>

Hello, I am attempting to setup an elastisearch cluster using a series of nodes which each will run a docker-compose. However, when starting up the first node I am unable to log in, and see the following error in docker…

---

## [Using High Level Rest Client in order to monitor all new records put in an index?](https://discuss.elastic.co/t/using-high-level-rest-client-in-order-to-monitor-all-new-records-put-in-an-index/245282)

<div class="topic-metadata">

**Author:** [@Rietty](https://discuss.elastic.co/u/Rietty)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 4:36pm UTC](https://discuss.elastic.co/t/using-high-level-rest-client-in-order-to-monitor-all-new-records-put-in-an-index/245282 "2020-08-17T16:36:58Z")

</div>

Hi, I'm currently working with the High Level Rest Client and I'd like to set it up so that given an index, it will automatically download/get a copy of all records (i.e. Anything that happened after it was turned on) so…

---

## [How to delete all data from an index without deleting the index?](https://discuss.elastic.co/t/how-to-delete-all-data-from-an-index-without-deleting-the-index/245276)

<div class="topic-metadata">

**Author:** [@kovacsbv](https://discuss.elastic.co/u/kovacsbv)\
**Replies:** 2\
**Last updated:** [August 17, 2020, 10:30pm UTC](https://discuss.elastic.co/t/how-to-delete-all-data-from-an-index-without-deleting-the-index/245276 "2020-08-17T22:30:44Z")

</div>

Hello, I am looking for a simple and efficient way to delete all data from an index without deleting the index. This is known as a truncate in SQL parlance. The rationale is that I want to clear the data while leaving…

---

## [Downgrading from Gold licence to basic license](https://discuss.elastic.co/t/downgrading-from-gold-licence-to-basic-license/245202)

<div class="topic-metadata">

**Author:** [@baidwan007](https://discuss.elastic.co/u/baidwan007)\
**Replies:** 3\
**Last updated:** [August 17, 2020, 9:58pm UTC](https://discuss.elastic.co/t/downgrading-from-gold-licence-to-basic-license/245202 "2020-08-17T21:58:39Z")

</div>

We have a cluster with ES 7.1 where we use gold licence. We have native authentication realm (order 0) and pki realm (order 1) as auth mechanisms. xpack.security.enabled: true in elasticsearch.yaml Now we have decided…

---

## [Continuous transform failure](https://discuss.elastic.co/t/continuous-transform-failure/245302)

<div class="topic-metadata">

**Author:** [@Vlad\_K](https://discuss.elastic.co/u/Vlad_K)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 6:14pm UTC](https://discuss.elastic.co/t/continuous-transform-failure/245302 "2020-08-17T18:14:05Z")

</div>

I have 4GB JVM heap and continuous transform with filtered search throws this errors in logs and stops with "failed" state after some period. Insufficient memory for search, reducing number of buckets per search from \[4…

---

## [Elasticsearch search query size limit](https://discuss.elastic.co/t/elasticsearch-search-query-size-limit/245278)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 4:25pm UTC](https://discuss.elastic.co/t/elasticsearch-search-query-size-limit/245278 "2020-08-17T16:25:02Z")

</div>

Hi all, I am using elasticsearch input in my logstash config file. logstash input part is as following: input { elasticsearch { hosts =\> \["http://10.0.0.1:9200/"\] index =\> "my-log\*" query =\> '{ "from" : 0, "size" : …

---

## [Best way to handle Customer Specific Visibility](https://discuss.elastic.co/t/best-way-to-handle-customer-specific-visibility/245271)

<div class="topic-metadata">

**Author:** [@mrkresc](https://discuss.elastic.co/u/mrkresc)\
**Replies:** 2\
**Last updated:** [August 17, 2020, 4:04pm UTC](https://discuss.elastic.co/t/best-way-to-handle-customer-specific-visibility/245271 "2020-08-17T16:04:53Z")

</div>

Hey guys, This question may have been asked before, but when searching, I was not able to find an answer. I am new to the forums and elasticsearch so please bear with me. I am currently working with the search applica…

---

## [Huge number of open files on data node with multiple paths](https://discuss.elastic.co/t/huge-number-of-open-files-on-data-node-with-multiple-paths/245272)

<div class="topic-metadata">

**Author:** [@luiz.ooliveira](https://discuss.elastic.co/u/luiz.ooliveira)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 3:57pm UTC](https://discuss.elastic.co/t/huge-number-of-open-files-on-data-node-with-multiple-paths/245272 "2020-08-17T15:57:41Z")

</div>

Hi, I added a new data node to my cluster with a different configuration from the others. I have 3 data nodes that use a single "path.data" and it is working fine. The new one was configured to use multiple data paths,…

---

## [Different behaviour from 7.6.2 and 7.8.1](https://discuss.elastic.co/t/different-behaviour-from-7-6-2-and-7-8-1/245245)

<div class="topic-metadata">

**Author:** [@DavidKHE](https://discuss.elastic.co/u/DavidKHE)\
**Replies:** 1\
**Last updated:** [August 17, 2020, 3:51pm UTC](https://discuss.elastic.co/t/different-behaviour-from-7-6-2-and-7-8-1/245245 "2020-08-17T15:51:05Z")

</div>

Hi, use case - merging two indexes into new output. the flow is to take 2 indexes, both having timestamp and pivot by time where aggregations are unique to each index. KPI1 - index1 and KPI2 - index2. when using ES 7.…

---

## [How to provide custom start\_date and time to rollup job’s indexer at rollup job’s creation time](https://discuss.elastic.co/t/how-to-provide-custom-start-date-and-time-to-rollup-job-s-indexer-at-rollup-job-s-creation-time/245262)

<div class="topic-metadata">

**Author:** [@darkwarrior](https://discuss.elastic.co/u/darkwarrior)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 3:20pm UTC](https://discuss.elastic.co/t/how-to-provide-custom-start-date-and-time-to-rollup-job-s-indexer-at-rollup-job-s-creation-time/245262 "2020-08-17T15:20:23Z")

</div>

Hey all, On our ES cluster we do create daily indices with index-pattern like this =\> "index-20200101" and now we want to rollup documents from those indices with 1-day interval. But we don't want to rollup data from a…

---

## [Create new field on object using painless](https://discuss.elastic.co/t/create-new-field-on-object-using-painless/245211)

<div class="topic-metadata">

**Author:** [@david.preston](https://discuss.elastic.co/u/david.preston)\
**Replies:** 11\
**Last updated:** [August 17, 2020, 2:50pm UTC](https://discuss.elastic.co/t/create-new-field-on-object-using-painless/245211 "2020-08-17T14:50:44Z")

</div>

Hi I'm trying to set an object field from another using an update query but am getting an error. Currently by doc has an event object in the root of the doc with a field: id i.e. { event { id: 1 } } all the docume…

---

## [Cluster.initial\_master\_nodes mandatory when upgrading?](https://discuss.elastic.co/t/cluster-initial-master-nodes-mandatory-when-upgrading/245035)

<div class="topic-metadata">

**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\
**Replies:** 3\
**Last updated:** [August 17, 2020, 2:45pm UTC](https://discuss.elastic.co/t/cluster-initial-master-nodes-mandatory-when-upgrading/245035 "2020-08-17T14:45:55Z")

</div>

Hello Elasticians ! I'm asking is cluster.initial\_master\_nodes is mandatory when we upgrade from a already running 6.8 cluster to 7.8 cluster I don't think so but if you could confirm.. Thanks :wink:

---

## [Sort fields on numeric part, and the alpha part](https://discuss.elastic.co/t/sort-fields-on-numeric-part-and-the-alpha-part/244163)

<div class="topic-metadata">

**Author:** [@JjOon](https://discuss.elastic.co/u/JjOon)\
**Replies:** 1\
**Last updated:** [August 17, 2020, 1:54pm UTC](https://discuss.elastic.co/t/sort-fields-on-numeric-part-and-the-alpha-part/244163 "2020-08-17T13:54:20Z")

</div>

Hi all, I am facing the following issue. I have some addresses, and when we sort them on the number, we have a alphanumeric sort. Like : 1 11 2 etc... My problem is : this number can contains letters or others char…

---

## [Problems with path.data change on local machine](https://discuss.elastic.co/t/problems-with-path-data-change-on-local-machine/245243)

<div class="topic-metadata">

**Author:** [@vbelobragin](https://discuss.elastic.co/u/vbelobragin)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 1:33pm UTC](https://discuss.elastic.co/t/problems-with-path-data-change-on-local-machine/245243 "2020-08-17T13:33:46Z")

</div>

Hello everyone. I can not change local ES location - can not modify path.data . That's probably some elementary mistake, but I am stuck and greatly appreciate any assistance. So: Fresh local installation of ES 7.8.1 …

---

## [ES Backup restore](https://discuss.elastic.co/t/es-backup-restore/245241)

<div class="topic-metadata">

**Author:** [@Sagar\_Gulia](https://discuss.elastic.co/u/Sagar_Gulia)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 1:24pm UTC](https://discuss.elastic.co/t/es-backup-restore/245241 "2020-08-17T13:24:10Z")

</div>

Can anyone tell me how can I pick latest snapshot while restoring my es backup in java. As I am keeping a snapshot every 30 min whole day and I want to shutdown es for night and in morning i want to restore the latest ba…

---

## [Can't find master nodes after node restart](https://discuss.elastic.co/t/cant-find-master-nodes-after-node-restart/245138)

<div class="topic-metadata">

**Author:** [@Barak](https://discuss.elastic.co/u/Barak)\
**Replies:** 13\
**Last updated:** [August 17, 2020, 1:29pm UTC](https://discuss.elastic.co/t/cant-find-master-nodes-after-node-restart/245138 "2020-08-17T13:29:36Z")

</div>

After upgrading to 7.7.1, the data nodes can't find the master nodes after a restart of the data node. I am using EC2 discovery plugin, and on the initial startup it joins the cluster as expected, but once restarted in …

---

## [Growing field mapping management](https://discuss.elastic.co/t/growing-field-mapping-management/245235)

<div class="topic-metadata">

**Author:** [@WDK](https://discuss.elastic.co/u/WDK)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 12:35pm UTC](https://discuss.elastic.co/t/growing-field-mapping-management/245235 "2020-08-17T12:35:15Z")

</div>

Hi all, I wonder how people here manage the growing amount of mappings you see in some indices. Especially kubernetes logs tend to have a wild variety of field. In my situation, all kubernetes logs end up in the same in…

---

## [Use custom field instead of doc\_count](https://discuss.elastic.co/t/use-custom-field-instead-of-doc-count/245234)

<div class="topic-metadata">

**Author:** [@sesha](https://discuss.elastic.co/u/sesha)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 12:34pm UTC](https://discuss.elastic.co/t/use-custom-field-instead-of-doc-count/245234 "2020-08-17T12:34:14Z")

</div>

Need to use custom field instead of doc\_count Is it possible to change the default configuration to change doc\_count to sum by custom field Query: GET test/\_search { "aggs": { "NAME": { "term…

---

## [How to use elastic search for storing & fetching document as json](https://discuss.elastic.co/t/how-to-use-elastic-search-for-storing-fetching-document-as-json/245232)

<div class="topic-metadata">

**Author:** [@mmuzammil45](https://discuss.elastic.co/u/mmuzammil45)\
**Replies:** 0\
**Last updated:** [August 17, 2020, 12:13pm UTC](https://discuss.elastic.co/t/how-to-use-elastic-search-for-storing-fetching-document-as-json/245232 "2020-08-17T12:13:12Z")

</div>

I am working on ElasticSearch for the purpose of storing & fetching data as json. The problem is ES treats json as text/string when I use search/highlight function and does not complete my requirement i.e. to get all the…

---

## [How to keep enrich index updated](https://discuss.elastic.co/t/how-to-keep-enrich-index-updated/245188)

<div class="topic-metadata">

**Author:** [@askids](https://discuss.elastic.co/u/askids)\
**Replies:** 2\
**Last updated:** [August 17, 2020, 12:07pm UTC](https://discuss.elastic.co/t/how-to-keep-enrich-index-updated/245188 "2020-08-17T12:07:44Z")

</div>

hi, When we create a enrich index to use in enrich policy, is there a way to keep the enrich index updated based on changes happening in source index from which enrich index was created? If I have to constantly update …

---

## [Different number of hits for the same time range](https://discuss.elastic.co/t/different-number-of-hits-for-the-same-time-range/244912)

<div class="topic-metadata">

**Author:** [@chapmantrain](https://discuss.elastic.co/u/chapmantrain)\
**Replies:** 2\
**Last updated:** [August 17, 2020, 11:59am UTC](https://discuss.elastic.co/t/different-number-of-hits-for-the-same-time-range/244912 "2020-08-17T11:59:58Z")

</div>

As I am using the same time range for the same query, it is returning different numbers of hits on re-query. { "size": "0", "query": { "bool": { "must": \[ { "range": { "timest…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=831)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=833)
