# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=640

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 641

---

## [Lowercase field value](https://discuss.elastic.co/t/lowercase-field-value/273869)

<div class="topic-metadata">

**Author:** [@prosens](https://discuss.elastic.co/u/prosens)\
**Replies:** 4\
**Last updated:** [May 25, 2021, 2:08pm UTC](https://discuss.elastic.co/t/lowercase-field-value/273869 "2021-05-25T14:08:44Z")

</div>

We are using 2.4.1. We have a string field that might contain both uppercase and lowercase values. Is there a way to return it as lowercase always without reindexing the data?

---

## [Dfs\_query\_then\_fetch returns the same scores as query\_then\_fetch](https://discuss.elastic.co/t/dfs-query-then-fetch-returns-the-same-scores-as-query-then-fetch/273024)

<div class="topic-metadata">

**Author:** [@Drept](https://discuss.elastic.co/u/Drept)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 2:02pm UTC](https://discuss.elastic.co/t/dfs-query-then-fetch-returns-the-same-scores-as-query-then-fetch/273024 "2021-05-25T14:02:58Z")

</div>

I have multiple indices in Elasticsearch (and the corresponding documents in Django created using django-elasticsearch-dsl). All of the indices have these settings: settings = {'number\_of\_shards': 1, …

---

## [Sort with aggregation with another aggregation in Java REST API](https://discuss.elastic.co/t/sort-with-aggregation-with-another-aggregation-in-java-rest-api/273520)

<div class="topic-metadata">

**Author:** [@Nick\_M](https://discuss.elastic.co/u/Nick_M)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 1:33pm UTC](https://discuss.elastic.co/t/sort-with-aggregation-with-another-aggregation-in-java-rest-api/273520 "2021-05-25T13:33:59Z")

</div>

I created the query below and I want to execute it with the Java Client provided but I can't really find a way. GET asset-records-latest/\_search { "size": 0, "aggs": { "agg1": { "terms": { "field":…

---

## [How to modify the generation rules of DataStream naming?](https://discuss.elastic.co/t/how-to-modify-the-generation-rules-of-datastream-naming/273933)

<div class="topic-metadata">

**Author:** [@asasas234](https://discuss.elastic.co/u/asasas234)\
**Replies:** 0\
**Last updated:** [May 25, 2021, 12:44pm UTC](https://discuss.elastic.co/t/how-to-modify-the-generation-rules-of-datastream-naming/273933 "2021-05-25T12:44:32Z")

</div>

I want to use DataStream to manage indexes instead of splicing dates after index names, but I found that the indexes generated by DataStream start with .ds-, which does not match our old index naming rules, which will ca…

---

## ['reindexed-v7-yellow' shards?](https://discuss.elastic.co/t/reindexed-v7-yellow-shards/273661)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 12:23pm UTC](https://discuss.elastic.co/t/reindexed-v7-yellow-shards/273661 "2021-05-25T12:23:49Z")

</div>

After some recent server updates these showed up as 'unassigned shards'. What are they and can I delete them? They're on every node in the cluster.

---

## [Extract routing value from document - bulk index](https://discuss.elastic.co/t/extract-routing-value-from-document-bulk-index/273404)

<div class="topic-metadata">

**Author:** [@brjisc](https://discuss.elastic.co/u/brjisc)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 12:05pm UTC](https://discuss.elastic.co/t/extract-routing-value-from-document-bulk-index/273404 "2021-05-25T12:05:15Z")

</div>

The documentation states " When setting up explicit mapping, you can also use the \_routing field to direct the index operation to extract the routing value from the document itself" How is the routing information repres…

---

## [Geo\_shape mapping for xyz format to xy format](https://discuss.elastic.co/t/geo-shape-mapping-for-xyz-format-to-xy-format/273579)

<div class="topic-metadata">

**Author:** [@cpavan811](https://discuss.elastic.co/u/cpavan811)\
**Replies:** 3\
**Last updated:** [May 25, 2021, 11:02am UTC](https://discuss.elastic.co/t/geo-shape-mapping-for-xyz-format-to-xy-format/273579 "2021-05-25T11:02:27Z")

</div>

We have field in one of our index with GeoJSON supported format of coordinates \[ x, y , z\] in number format. however when tried to created mapping with geo\_shape format with flag "ignore\_z\_value" to true it still fails t…

---

## [Unable to calculate average bucket over multi layer data](https://discuss.elastic.co/t/unable-to-calculate-average-bucket-over-multi-layer-data/273270)

<div class="topic-metadata">

**Author:** [@sumit.sontakke](https://discuss.elastic.co/u/sumit.sontakke)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 10:34am UTC](https://discuss.elastic.co/t/unable-to-calculate-average-bucket-over-multi-layer-data/273270 "2021-05-25T10:34:25Z")

</div>

Hi, I'm able to calculate average bucket score over one layer of data, but not on two lever hierarchy data. Example: A-parent-group m-group t-team 1 A-parent-group m-group t-team 4 A-parent-group n-group p-team 45 …

---

## [./gradlew clean check is giving error \> Task :licenseHeaders FAILED](https://discuss.elastic.co/t/gradlew-clean-check-is-giving-error-task-licenseheaders-failed/273745)

<div class="topic-metadata">

**Author:** [@Sreekumar\_Chathambil](https://discuss.elastic.co/u/Sreekumar_Chathambil)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 10:30am UTC](https://discuss.elastic.co/t/gradlew-clean-check-is-giving-error-task-licenseheaders-failed/273745 "2021-05-25T10:30:50Z")

</div>

Hi, I am new to plugin development. I have created ingest-plugin project using cookiecutter for the version 7.9.0 and tried checking with ./gradle clean check. i was getting an error Task :licenseHeaders FAILED Unapp…

---

## [Wildcard match on multiple fields](https://discuss.elastic.co/t/wildcard-match-on-multiple-fields/273852)

<div class="topic-metadata">

**Author:** [@Rammi22](https://discuss.elastic.co/u/Rammi22)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 7:11am UTC](https://discuss.elastic.co/t/wildcard-match-on-multiple-fields/273852 "2021-05-25T07:11:03Z")

</div>

Hi, im looking for the right query to find in multiple fields a wildcard query (phone number in phone number fields). i use ElasticsearchDSL ElasticsearchPHP I try the Multi-match query with a part of given value, t…

---

## [Setting Xms and Xmx](https://discuss.elastic.co/t/setting-xms-and-xmx/273875)

<div class="topic-metadata">

**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 8:52am UTC](https://discuss.elastic.co/t/setting-xms-and-xmx/273875 "2021-05-25T08:52:52Z")

</div>

I assume this is a long-debated topic but I was kind of puzzled by this recommendation: Modifying advanced settings is generally not recommended and could negatively impact performance and stability. Using the Elastics…

---

## [Elasticsearch simple query string and highlighter leads to timeout](https://discuss.elastic.co/t/elasticsearch-simple-query-string-and-highlighter-leads-to-timeout/273897)

<div class="topic-metadata">

**Author:** [@schubec](https://discuss.elastic.co/u/schubec)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 8:42am UTC](https://discuss.elastic.co/t/elasticsearch-simple-query-string-and-highlighter-leads-to-timeout/273897 "2021-05-25T08:42:11Z")

</div>

Hi! I am facing a strange problem with Elasticsearch: I have this query which results in a timeout because it takes more than 60 seconds: GET /website/\_search { "query": { "simple\_query\_string": { "query":…

---

## [Import es source code into idea,not recognize the src/java as java source fold in searchable-snapshot](https://discuss.elastic.co/t/import-es-source-code-into-idea-not-recognize-the-src-java-as-java-source-fold-in-searchable-snapshot/273905)

<div class="topic-metadata">

**Author:** [@J\_Jackie](https://discuss.elastic.co/u/J_Jackie)\
**Replies:** 0\
**Last updated:** [May 25, 2021, 8:16am UTC](https://discuss.elastic.co/t/import-es-source-code-into-idea-not-recognize-the-src-java-as-java-source-fold-in-searchable-snapshot/273905 "2021-05-25T08:16:17Z")

</div>

how can i make it same as others

---

## [Need to test a index with terabytes of data, how can I do](https://discuss.elastic.co/t/need-to-test-a-index-with-terabytes-of-data-how-can-i-do/272787)

<div class="topic-metadata">

**Author:** [@GITnewfish](https://discuss.elastic.co/u/GITnewfish)\
**Replies:** 7\
**Last updated:** [May 24, 2021, 8:30am UTC](https://discuss.elastic.co/t/need-to-test-a-index-with-terabytes-of-data-how-can-i-do/272787 "2021-05-24T08:30:53Z")

</div>

I need to test performance of appand to a index with terabytes of data, and the index mapping is customed. Is there a solution to this scenario? Refer to this topic: Increase data size in Rally existing tracks Whet…

---

## [Elastic CCR feature update/delete fails at follower index](https://discuss.elastic.co/t/elastic-ccr-feature-update-delete-fails-at-follower-index/273828)

<div class="topic-metadata">

**Author:** [@pavan\_koppolu](https://discuss.elastic.co/u/pavan_koppolu)\
**Replies:** 0\
**Last updated:** [May 24, 2021, 1:22pm UTC](https://discuss.elastic.co/t/elastic-ccr-feature-update-delete-fails-at-follower-index/273828 "2021-05-24T13:22:59Z")

</div>

Hi Team, I have a query like while working with CCR feature everything went well except one use case like Placed a document from one cluster, then replicated the same doc in other cluster Then the first cluster down, …

---

## [OutOfMemoryError of web browser happen by search specific word in Kibana](https://discuss.elastic.co/t/outofmemoryerror-of-web-browser-happen-by-search-specific-word-in-kibana/273884)

<div class="topic-metadata">

**Author:** [@BlackCat](https://discuss.elastic.co/u/BlackCat)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 5:32am UTC](https://discuss.elastic.co/t/outofmemoryerror-of-web-browser-happen-by-search-specific-word-in-kibana/273884 "2021-05-25T05:32:30Z")

</div>

■Elasticsearch server spec CPU:8 Memory:64GB Disk:1TB Total Java Heap Size:32GB in yml. es01 - "ES\_JAVA\_OPTS=-Xms12g -Xmx12g" es02 - "ES\_JAVA\_OPTS=-Xms10g -Xmx10g" es03 - "ES\_JAVA\_OPTS=-Xms10g -Xmx10g" number…

---

## [Maximum shards per node](https://discuss.elastic.co/t/maximum-shards-per-node/273830)

<div class="topic-metadata">

**Author:** [@Muna](https://discuss.elastic.co/u/Muna)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 2:17am UTC](https://discuss.elastic.co/t/maximum-shards-per-node/273830 "2021-05-25T02:17:54Z")

</div>

Is there any option to disable the max\_shard\_per\_node in cluster settings in Elastic 7.12 as in the older version 6.5 there is no such values. Elastic 7.12 "cluster" : { "max\_shards\_per\_node" : "1000" }

---

## [Words vs Guids, what is faster?](https://discuss.elastic.co/t/words-vs-guids-what-is-faster/273819)

<div class="topic-metadata">

**Author:** [@Baygon](https://discuss.elastic.co/u/Baygon)\
**Replies:** 2\
**Last updated:** [May 25, 2021, 1:53am UTC](https://discuss.elastic.co/t/words-vs-guids-what-is-faster/273819 "2021-05-25T01:53:48Z")

</div>

I'm in front of a design choice where I would need a bit of help to choose the most efficient way. I'm currently indexing data tagged with a string of comma separated Guids, for example: \\"e659959d-392f-44c5-83a5-fb959…

---

## [How to plan/define needed clusters](https://discuss.elastic.co/t/how-to-plan-define-needed-clusters/273514)

<div class="topic-metadata">

**Author:** [@agKaspar](https://discuss.elastic.co/u/agKaspar)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 12:25am UTC](https://discuss.elastic.co/t/how-to-plan-define-needed-clusters/273514 "2021-05-25T00:25:16Z")

</div>

Hello, I'm working on setting up an elastic search environment within a kubernetes cluster (on MS Azure AKS), and am reading through the Elastic Cloud on Kubernetes \[1.5\] | Elastic documentation. It explains how to setu…

---

## [Can I delete some indices manually from elasticsearch to free up some space?](https://discuss.elastic.co/t/can-i-delete-some-indices-manually-from-elasticsearch-to-free-up-some-space/273480)

<div class="topic-metadata">

**Author:** [@prat](https://discuss.elastic.co/u/prat)\
**Replies:** 9\
**Last updated:** [May 25, 2021, 12:19am UTC](https://discuss.elastic.co/t/can-i-delete-some-indices-manually-from-elasticsearch-to-free-up-some-space/273480 "2021-05-25T00:19:16Z")

</div>

Hi All, I have indices from 1st Feb in elasticsearch. Everyday there on average 4 indices. It has consumed 79 GB space out of 100GB. Can I delete few of them to release space without impacting to anything? Thanks,

---

## [How to send Elasticsearch 6.8 logs to syslog?](https://discuss.elastic.co/t/how-to-send-elasticsearch-6-8-logs-to-syslog/273621)

<div class="topic-metadata">

**Author:** [@sviscapi](https://discuss.elastic.co/u/sviscapi)\
**Replies:** 0\
**Last updated:** [May 21, 2021, 6:38am UTC](https://discuss.elastic.co/t/how-to-send-elasticsearch-6-8-logs-to-syslog/273621 "2021-05-21T06:38:58Z")

</div>

Dear all, First post on these boards :slight\_smile: I've been tasked to configure some Elasticsearch 6.8 server to send its logs to syslog. Based on the official documentation, I came up with the following in /etc/elas…

---

## [Reindexing of the same document](https://discuss.elastic.co/t/reindexing-of-the-same-document/273629)

<div class="topic-metadata">

**Author:** [@Renat\_Zamaletdinov](https://discuss.elastic.co/u/Renat_Zamaletdinov)\
**Replies:** 1\
**Last updated:** [May 25, 2021, 12:06am UTC](https://discuss.elastic.co/t/reindexing-of-the-same-document/273629 "2021-05-25T00:06:54Z")

</div>

What will happen if we upsert an existing document with the same content and the same id? Will it trigger reindexing? Or it will detect that nothing is changed and will do nothing?

---

## [Search all fields for a string](https://discuss.elastic.co/t/search-all-fields-for-a-string/273846)

<div class="topic-metadata">

**Author:** [@vinholla](https://discuss.elastic.co/u/vinholla)\
**Replies:** 1\
**Last updated:** [May 24, 2021, 11:57pm UTC](https://discuss.elastic.co/t/search-all-fields-for-a-string/273846 "2021-05-24T23:57:27Z")

</div>

I am unable to get any results GET /earnings\_transcripts/\_search { "query": { "bool": { "must": \[ { "match\_phrase": { "presentationContent.componentText": "inflation" } } \] } } } my index data looks "\_ind…

---

## [Best way to aggregate terms from a text field with type text](https://discuss.elastic.co/t/best-way-to-aggregate-terms-from-a-text-field-with-type-text/273864)

<div class="topic-metadata">

**Author:** [@thedraketaylor](https://discuss.elastic.co/u/thedraketaylor)\
**Replies:** 0\
**Last updated:** [May 24, 2021, 8:09pm UTC](https://discuss.elastic.co/t/best-way-to-aggregate-terms-from-a-text-field-with-type-text/273864 "2021-05-24T20:09:28Z")

</div>

I'm using Elasticsearch to hold descriptions of products I get from scraping sites. I have a description field in my index to hold the data and it's of type "text" because I want to search in those fields. Now, I find my…

---

## [How to remove \_id, \_index, \_type, num\_matches, num\_hits and @timestamp from elastialert rules](https://discuss.elastic.co/t/how-to-remove-id-index-type-num-matches-num-hits-and-timestamp-from-elastialert-rules/273822)

<div class="topic-metadata">

**Author:** [@MdRashid](https://discuss.elastic.co/u/MdRashid)\
**Replies:** 3\
**Last updated:** [May 24, 2021, 6:27pm UTC](https://discuss.elastic.co/t/how-to-remove-id-index-type-num-matches-num-hits-and-timestamp-from-elastialert-rules/273822 "2021-05-24T18:27:41Z")

</div>

Hi All, Below is the content which im getting in my gmail inbox. I want to remove \_id, \_index, \_type, num\_matches, num\_hits and @timestamp all this only i want message to be include in my email triggering everytime. …

---

## [Allocate index on the hot \_tier](https://discuss.elastic.co/t/allocate-index-on-the-hot-tier/273420)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 4\
**Last updated:** [May 24, 2021, 6:12pm UTC](https://discuss.elastic.co/t/allocate-index-on-the-hot-tier/273420 "2021-05-24T18:12:31Z")

</div>

hey there, I was trying to use ILM policies with a hot/warm/cold infrastructure. My indices are not data stream so I have to bootstrap the index with an alias. Is there a way to assign it at the \_hot tier nodes at the …

---

## [Better search result with relevant data with prioritization](https://discuss.elastic.co/t/better-search-result-with-relevant-data-with-prioritization/273849)

<div class="topic-metadata">

**Author:** [@Gopal\_Chauhan](https://discuss.elastic.co/u/Gopal_Chauhan)\
**Replies:** 1\
**Last updated:** [May 24, 2021, 4:32pm UTC](https://discuss.elastic.co/t/better-search-result-with-relevant-data-with-prioritization/273849 "2021-05-24T16:32:21Z")

</div>

Hi , I am trying to improve relevant search. I have list of fields (around 21) with priority order(total fields in document arnd 120). Those fields need to get more priority as compare to others during search. I am usi…

---

## [Compostable index templates](https://discuss.elastic.co/t/compostable-index-templates/273841)

<div class="topic-metadata">

**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Replies:** 0\
**Last updated:** [May 24, 2021, 3:05pm UTC](https://discuss.elastic.co/t/compostable-index-templates/273841 "2021-05-24T15:05:57Z")

</div>

Is there a 10,000 foot description of the new template changes somewhere?

---

## [Index Lifecycle Management (ILM) based on a document field](https://discuss.elastic.co/t/index-lifecycle-management-ilm-based-on-a-document-field/273701)

<div class="topic-metadata">

**Author:** [@fefontana](https://discuss.elastic.co/u/fefontana)\
**Replies:** 4\
**Last updated:** [May 24, 2021, 2:13pm UTC](https://discuss.elastic.co/t/index-lifecycle-management-ilm-based-on-a-document-field/273701 "2021-05-24T14:13:41Z")

</div>

Hello, I would like to know if there is any way to partition and index based on a field of documents within it. I don't want to use the index size (like "max\_size"), nor the index time (like "max\_age") and nor max numbe…

---

## [Shard size issue in elastic](https://discuss.elastic.co/t/shard-size-issue-in-elastic/273760)

<div class="topic-metadata">

**Author:** [@Muna](https://discuss.elastic.co/u/Muna)\
**Replies:** 3\
**Last updated:** [May 24, 2021, 1:51pm UTC](https://discuss.elastic.co/t/shard-size-issue-in-elastic/273760 "2021-05-24T13:51:11Z")

</div>

How to configure the optimal shard size in elastic search? I've gone through multiple posts in this forum and I'm not able to find an exact way to calculate the optimal value for cluster.max\_shards\_per\_node Increasing …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=639)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=641)
