# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=824

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 825

---

## [Nodes Space balancing Issue](https://discuss.elastic.co/t/nodes-space-balancing-issue/246378)

<div class="topic-metadata">

**Author:** [@shubhamblackstratus](https://discuss.elastic.co/u/shubhamblackstratus)\
**Replies:** 7\
**Last updated:** [August 27, 2020, 4:13am UTC](https://discuss.elastic.co/t/nodes-space-balancing-issue/246378 "2020-08-27T04:13:46Z")

</div>

Hi Team, I am having cluster which has three data nodes, which are having a single master. We found that due to some hardware failure, one of the data noes got stuck and shut down. We restarted that nodes and it joined…

---

## [Getting the latest entry using Python's requests library](https://discuss.elastic.co/t/getting-the-latest-entry-using-pythons-requests-library/246538)

<div class="topic-metadata">

**Author:** [@Anowar](https://discuss.elastic.co/u/Anowar)\
**Replies:** 0\
**Last updated:** [August 27, 2020, 3:02am UTC](https://discuss.elastic.co/t/getting-the-latest-entry-using-pythons-requests-library/246538 "2020-08-27T03:02:23Z")

</div>

I tried making a query to get the latest entry of a field by curl: curl -X GET -H "Content-Type: application/json" -H "Accept: application/json" -d '{"query": {"match\_all": {}}, "\_source": "@timestamp", "size": 1, "sort…

---

## [Does random\_score seed value got cache?](https://discuss.elastic.co/t/does-random-score-seed-value-got-cache/246536)

<div class="topic-metadata">

**Author:** [@Altiano\_Gerung](https://discuss.elastic.co/u/Altiano_Gerung)\
**Replies:** 0\
**Last updated:** [August 27, 2020, 2:47am UTC](https://discuss.elastic.co/t/does-random-score-seed-value-got-cache/246536 "2020-08-27T02:47:50Z")

</div>

Want to know whether the seed value on function\_score.random\_score got cache? I'm implementing the so-called : consistently random scoring: https://www.elastic.co/guide/en/elasticsearch/guide/current/random-scoring.htm…

---

## [Scroll API with SearchTemplateRequest](https://discuss.elastic.co/t/scroll-api-with-searchtemplaterequest/246510)

<div class="topic-metadata">

**Author:** [@ljr9600](https://discuss.elastic.co/u/ljr9600)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 8:50pm UTC](https://discuss.elastic.co/t/scroll-api-with-searchtemplaterequest/246510 "2020-08-26T20:50:39Z")

</div>

There doesn't seem to be a way to use the scroll api with SearchTemplateRequest() from the Java high level client. Is this a feature request, or a bug/miss? I use moustache to expand complex json queries. So I could d…

---

## [Delete Index after x amount of days](https://discuss.elastic.co/t/delete-index-after-x-amount-of-days/246492)

<div class="topic-metadata">

**Author:** [@userR](https://discuss.elastic.co/u/userR)\
**Replies:** 10\
**Last updated:** [August 27, 2020, 1:49am UTC](https://discuss.elastic.co/t/delete-index-after-x-amount-of-days/246492 "2020-08-27T01:49:48Z")

</div>

Currently reading logs from Logstash to Elasticsearch and creating daily indexes. Is there a way to delete each of these indexes after an X amount of days? Also, is there an auto delete feature when my elasticsearch clu…

---

## [Boolean MUST Match in "Nested" type Not working for timestamp - precisely](https://discuss.elastic.co/t/boolean-must-match-in-nested-type-not-working-for-timestamp-precisely/246514)

<div class="topic-metadata">

**Author:** [@baig](https://discuss.elastic.co/u/baig)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 9:22pm UTC](https://discuss.elastic.co/t/boolean-must-match-in-nested-type-not-working-for-timestamp-precisely/246514 "2020-08-26T21:22:53Z")

</div>

Hi, couldn't find a matching topic to continue so opening a new issue. I am currently using ES version 7.6.2. I have a list of similar json objects where one of each objects also contains a field timestamp. When I do a…

---

## [How to search (query or filter) on an integer array field](https://discuss.elastic.co/t/how-to-search-query-or-filter-on-an-integer-array-field/246526)

<div class="topic-metadata">

**Author:** [@taichi](https://discuss.elastic.co/u/taichi)\
**Replies:** 0\
**Last updated:** [August 27, 2020, 12:27am UTC](https://discuss.elastic.co/t/how-to-search-query-or-filter-on-an-integer-array-field/246526 "2020-08-27T00:27:11Z")

</div>

I have a document mapping like this: { "id": 1, "some\_category\_ids": \[1, 2, 3\] } I would like to search documents which includes specified category\_ids. For example, when I specify in query "some\_category\_ids"…

---

## [Elastic with Traefik xpack security settings?](https://discuss.elastic.co/t/elastic-with-traefik-xpack-security-settings/246524)

<div class="topic-metadata">

**Author:** [@rainfarmer](https://discuss.elastic.co/u/rainfarmer)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 11:41pm UTC](https://discuss.elastic.co/t/elastic-with-traefik-xpack-security-settings/246524 "2020-08-26T23:41:21Z")

</div>

I've finally got Elastic cluster and Kibana working on Traefik + Let's Encrypt SSL. But now I need to setup passwords for Elastic and Kibana. Before I decided to use Traefik, I was able to successfully setup passwords …

---

## [ES 7.3 --- date\_time\_parse\_exception: Text '2020-08-25 11:50:00 AM'](https://discuss.elastic.co/t/es-7-3-date-time-parse-exception-text-2020-08-25-1100-am/246523)

<div class="topic-metadata">

**Author:** [@vishal22mehra](https://discuss.elastic.co/u/vishal22mehra)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 11:26pm UTC](https://discuss.elastic.co/t/es-7-3-date-time-parse-exception-text-2020-08-25-1100-am/246523 "2020-08-26T23:26:30Z")

</div>

Hi All, I am getting following error message "failed to parse date field \[2020-08-25 11:50:00 AM\] with format \[uuuu-MM-dd HH:mm:ss:SSS||uuuu-MM-dd HH:mm a||uuuu-MM-dd HH:mm:ss||uuuu-MM-dd HH:mm:ss a||uuuu-MM-dd||epoch\_…

---

## [Unable to migrate indices from old 6.1.2 elasticsearch node to 7.8 elasticsearch node](https://discuss.elastic.co/t/unable-to-migrate-indices-from-old-6-1-2-elasticsearch-node-to-7-8-elasticsearch-node/243939)

<div class="topic-metadata">

**Author:** [@cmiles](https://discuss.elastic.co/u/cmiles)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 11:13pm UTC](https://discuss.elastic.co/t/unable-to-migrate-indices-from-old-6-1-2-elasticsearch-node-to-7-8-elasticsearch-node/243939 "2020-08-26T23:13:40Z")

</div>

Hello, We have a relatively old ELK stack that we're attempting to migrate off. It's been neglected and left running to collect some logs from our F5 load balancers. I'm attempting to migrate the daily f5 indices to …

---

## [Securing ES cluster](https://discuss.elastic.co/t/securing-es-cluster/246446)

<div class="topic-metadata">

**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\
**Replies:** 1\
**Last updated:** [August 26, 2020, 10:01pm UTC](https://discuss.elastic.co/t/securing-es-cluster/246446 "2020-08-26T22:01:22Z")

</div>

Hi As part of ES clustering, I have mapped my ES ip to network.host. After that I see my elasticsearch is accessible for all machines/ip's. How to restrict elasticsearch to be accessible only within cluster nodes, not t…

---

## [Can not point Grafana datasource to Elastic search through server(default) mode-Error 503](https://discuss.elastic.co/t/can-not-point-grafana-datasource-to-elastic-search-through-server-default-mode-error-503/246483)

<div class="topic-metadata">

**Author:** [@Moksha20](https://discuss.elastic.co/u/Moksha20)\
**Replies:** 1\
**Last updated:** [August 26, 2020, 9:49pm UTC](https://discuss.elastic.co/t/can-not-point-grafana-datasource-to-elastic-search-through-server-default-mode-error-503/246483 "2020-08-26T21:49:48Z")

</div>

Hi, I can point my grafana datasource to elasticsearch through browser mode.But I am not able to do it through server mode as service is unavailable(error 503). Thanks in advance. Regards, Moksha

---

## [Elastic search nodes are going down across multiple instances](https://discuss.elastic.co/t/elastic-search-nodes-are-going-down-across-multiple-instances/246151)

<div class="topic-metadata">

**Author:** [@prasanthpola](https://discuss.elastic.co/u/prasanthpola)\
**Replies:** 6\
**Last updated:** [August 26, 2020, 9:39pm UTC](https://discuss.elastic.co/t/elastic-search-nodes-are-going-down-across-multiple-instances/246151 "2020-08-26T21:39:28Z")

</div>

Hi - We have a problem of Elastic nodes going down one by one around the same time frames which are hosted on different VPC's in aws. I could not figure out the pattern, i see these errors in the log files, Appreciate a…

---

## [Could i skip xpack.security.transport.ssl.enabled?](https://discuss.elastic.co/t/could-i-skip-xpack-security-transport-ssl-enabled/246511)

<div class="topic-metadata">

**Author:** [@zakabluk](https://discuss.elastic.co/u/zakabluk)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 9:31pm UTC](https://discuss.elastic.co/t/could-i-skip-xpack-security-transport-ssl-enabled/246511 "2020-08-26T21:31:01Z")

</div>

I launch elastic 7.9 by nomad. I have 3 master nodes, 3 data, 1 kibana, 1 ingest and 1 coordinator. I set ELASTIC\_PASSWORD for coordinator & added xpack.security.enabled: true to every config of nodes. I want only have…

---

## [Creating ILM](https://discuss.elastic.co/t/creating-ilm/246304)

<div class="topic-metadata">

**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\
**Replies:** 3\
**Last updated:** [August 26, 2020, 9:20pm UTC](https://discuss.elastic.co/t/creating-ilm/246304 "2020-08-26T21:20:59Z")

</div>

I want to create an ILM rule that would that would apply to all indices ( I only have auditbeat-\* and filebeat-\*). In ILM, it seems like there's no option to give it an indice, but rather it wants index template. How d…

---

## [Performance issue with CoveringQuery with percolate in ES 7.6](https://discuss.elastic.co/t/performance-issue-with-coveringquery-with-percolate-in-es-7-6/246495)

<div class="topic-metadata">

**Author:** [@sb116](https://discuss.elastic.co/u/sb116)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 5:37pm UTC](https://discuss.elastic.co/t/performance-issue-with-coveringquery-with-percolate-in-es-7-6/246495 "2020-08-26T17:37:41Z")

</div>

Based on query profiling, we noticed that CoveringQuery is taking most of the time and eventually failed (query.extraction\_result) at TermQuery Any tips on tuning CoveringQuery or disable it?

---

## [Elastic bootstrap password not picked up by second cluster member](https://discuss.elastic.co/t/elastic-bootstrap-password-not-picked-up-by-second-cluster-member/246508)

<div class="topic-metadata">

**Author:** [@cotjoey](https://discuss.elastic.co/u/cotjoey)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 8:17pm UTC](https://discuss.elastic.co/t/elastic-bootstrap-password-not-picked-up-by-second-cluster-member/246508 "2020-08-26T20:17:39Z")

</div>

I enabled security on my ELK stack. I tested the configuration locally several times before going on the dev environment. On the second master node of my cluster, I get the following error: \[2020-08-26T16:54:40,203\]\[INF…

---

## [Elastic Index data](https://discuss.elastic.co/t/elastic-index-data/246011)

<div class="topic-metadata">

**Author:** [@daviddavid](https://discuss.elastic.co/u/daviddavid)\
**Replies:** 10\
**Last updated:** [August 26, 2020, 6:48pm UTC](https://discuss.elastic.co/t/elastic-index-data/246011 "2020-08-26T18:48:01Z")

</div>

I am trying to save data in to table which has relational mapping to another table. Using a spring java jpa project. When the tables are updated with data it works fine but the elastic indexes are not updated with mappe…

---

## [Security index is unavailable. short circuiting retrieval of user with helm chart and letsencrypt](https://discuss.elastic.co/t/security-index-is-unavailable-short-circuiting-retrieval-of-user-with-helm-chart-and-letsencrypt/246497)

<div class="topic-metadata">

**Author:** [@dcanales](https://discuss.elastic.co/u/dcanales)\
**Replies:** 1\
**Last updated:** [August 26, 2020, 6:22pm UTC](https://discuss.elastic.co/t/security-index-is-unavailable-short-circuiting-retrieval-of-user-with-helm-chart-and-letsencrypt/246497 "2020-08-26T18:22:45Z")

</div>

Hi, i have a kubernetes cluster and im trying to configure elasticsearch with xpack.security.enabled through the helm template I have the same config from the documentation: https://github.com/elastic/helm-charts/blob/7…

---

## [Elasticsearch nested sorting is not working](https://discuss.elastic.co/t/elasticsearch-nested-sorting-is-not-working/246491)

<div class="topic-metadata">

**Author:** [@abhishek\_chaturvedi](https://discuss.elastic.co/u/abhishek_chaturvedi)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 5:08pm UTC](https://discuss.elastic.co/t/elasticsearch-nested-sorting-is-not-working/246491 "2020-08-26T17:08:16Z")

</div>

I want to sort below query based on responseDate: And every time I am returning some wrong BIG\_INTEGER in sort with each data. I think nested sort is not working properly. Kindly help: { "size": 1000, "query": { …

---

## [Issue on creating index mapping](https://discuss.elastic.co/t/issue-on-creating-index-mapping/246475)

<div class="topic-metadata">

**Author:** [@jakobdoering](https://discuss.elastic.co/u/jakobdoering)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 4:09pm UTC](https://discuss.elastic.co/t/issue-on-creating-index-mapping/246475 "2020-08-26T16:09:21Z")

</div>

Hi, i would like to create the following structure with my index template: egress.bytes egress.test egress.test.delta egress.test.performance egress.test.state egress.test.state.performance.low …

---

## [Elastic Memory:Storage Ratio / Hot-warm](https://discuss.elastic.co/t/elastic-memory-storage-ratio-hot-warm/246389)

<div class="topic-metadata">

**Author:** [@skysbsb](https://discuss.elastic.co/u/skysbsb)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 3:48pm UTC](https://discuss.elastic.co/t/elastic-memory-storage-ratio-hot-warm/246389 "2020-08-26T15:48:55Z")

</div>

I am setting up a cluster with the Elasticsearch BASIC version and one question I have is related to the memory: storage ratio. I saw in a webinar (https://www.elastic.co/pdf/elasticsearch-sizing-and-capacity-planning…

---

## [Elasticsearch with warm nodes setup, kibana not yet ready](https://discuss.elastic.co/t/elasticsearch-with-warm-nodes-setup-kibana-not-yet-ready/246324)

<div class="topic-metadata">

**Author:** [@souji](https://discuss.elastic.co/u/souji)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 3:37pm UTC](https://discuss.elastic.co/t/elasticsearch-with-warm-nodes-setup-kibana-not-yet-ready/246324 "2020-08-26T15:37:11Z")

</div>

Hi I setup the 7.8 version elastic search with 3 master, 3 client, 3 warm, 3 data nodes in amazon ec2 machines. warm nodes: bootstrap.memory\_lock: true node.name: ${HOSTNAME} action.destructive\_requires\_name: true ind…

---

## [\[Ingest management\] Use insecure elasticsearch output managed in fleet mode for elastic agent](https://discuss.elastic.co/t/ingest-management-use-insecure-elasticsearch-output-managed-in-fleet-mode-for-elastic-agent/246022)

<div class="topic-metadata">

**Author:** [@arnold79](https://discuss.elastic.co/u/arnold79)\
**Replies:** 14\
**Last updated:** [August 26, 2020, 1:21pm UTC](https://discuss.elastic.co/t/ingest-management-use-insecure-elasticsearch-output-managed-in-fleet-mode-for-elastic-agent/246022 "2020-08-26T13:21:14Z")

</div>

I'm playing around with the new Elastic agent (7.9) and using the Ingest Manager BETA. Created several agent configs with several integrations and can them easily re-assign to an agent. Standalone the configuration goe…

---

## [Deleting indices with Curator based upon age of document timestamps](https://discuss.elastic.co/t/deleting-indices-with-curator-based-upon-age-of-document-timestamps/246451)

<div class="topic-metadata">

**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 12:49pm UTC](https://discuss.elastic.co/t/deleting-indices-with-curator-based-upon-age-of-document-timestamps/246451 "2020-08-26T12:49:15Z")

</div>

All the indices I deal with contain logs from servers so I'd like to have Curator delete indices once the documents inside them refer to events that happened more than N days ago. Looking at the Curator documentation htt…

---

## [Does \_delete\_by\_query need a plugin or not? ES version 5.5](https://discuss.elastic.co/t/does-delete-by-query-need-a-plugin-or-not-es-version-5-5/246343)

<div class="topic-metadata">

**Author:** [@makons](https://discuss.elastic.co/u/makons)\
**Replies:** 2\
**Last updated:** [August 26, 2020, 12:22pm UTC](https://discuss.elastic.co/t/does-delete-by-query-need-a-plugin-or-not-es-version-5-5/246343 "2020-08-26T12:22:17Z")

</div>

So I've seen this post from way before in 2015 saying that delete by query is supported through a plugin delete-by-query. This was for the Elasticsearch version 2.0.0. However, there's a newer post which says that now th…

---

## [Logging of mapper\_parsing\_exception](https://discuss.elastic.co/t/logging-of-mapper-parsing-exception/246433)

<div class="topic-metadata">

**Author:** [@huberttrz](https://discuss.elastic.co/u/huberttrz)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 10:30am UTC](https://discuss.elastic.co/t/logging-of-mapper-parsing-exception/246433 "2020-08-26T10:30:53Z")

</div>

Hello, I've been googling for it with no luck to find out whether it is possible to have elasticsearch log any "mapper\_parsing\_exception" somewehre to a file / stdout wherever. I'm not using logstash, just elasticsearch…

---

## [How to remove a field from document?](https://discuss.elastic.co/t/how-to-remove-a-field-from-document/246420)

<div class="topic-metadata">

**Author:** [@jake\_hickory](https://discuss.elastic.co/u/jake_hickory)\
**Replies:** 5\
**Last updated:** [August 26, 2020, 9:57am UTC](https://discuss.elastic.co/t/how-to-remove-a-field-from-document/246420 "2020-08-26T09:57:26Z")

</div>

Hello, I am new to the forum so hi. I have the old \_type field from previous elasticsearch versions in all my documents and want it removed from my documents. How can I do this? Document: "\_index": "new-index", "\_type…

---

## [When searchable snapshot release?](https://discuss.elastic.co/t/when-searchable-snapshot-release/246209)

<div class="topic-metadata">

**Author:** [@ginger](https://discuss.elastic.co/u/ginger)\
**Replies:** 4\
**Last updated:** [August 26, 2020, 9:22am UTC](https://discuss.elastic.co/t/when-searchable-snapshot-release/246209 "2020-08-26T09:22:50Z")

</div>

We have seen search snapshot feature. We are looking forward to know when this feature release?

---

## [How can we aggregate SUM on column of type text in Elastic Search?](https://discuss.elastic.co/t/how-can-we-aggregate-sum-on-column-of-type-text-in-elastic-search/246422)

<div class="topic-metadata">

**Author:** [@anupambharti](https://discuss.elastic.co/u/anupambharti)\
**Replies:** 0\
**Last updated:** [August 26, 2020, 9:17am UTC](https://discuss.elastic.co/t/how-can-we-aggregate-sum-on-column-of-type-text-in-elastic-search/246422 "2020-08-26T09:17:55Z")

</div>

I have been trying to apply aggregate function for eg : sum on type of text my index mappings are below : \`\`\` { "my\_elastic\_search\_index" : { "mappings" : { "properties" : { "@timest…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=823)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=825)
