# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=662

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 663

---

## [Relative index time metrics?](https://discuss.elastic.co/t/relative-index-time-metrics/270583)

<div class="topic-metadata">

**Author:** [@alsyia](https://discuss.elastic.co/u/alsyia)\
**Replies:** 2\
**Last updated:** [April 19, 2021, 1:55pm UTC](https://discuss.elastic.co/t/relative-index-time-metrics/270583 "2021-04-19T13:55:11Z")

</div>

Hello, I'm running ESRally against an existing (test/staging) cluster (whose traffic I can stop if needed for the benchmark duration) and I would like to compare the resulting benchmark against a new, empty cluster. I'm…

---

## [Error in Elasticsearch master pod that FileSystemException: /data/log: Input/output error](https://discuss.elastic.co/t/error-in-elasticsearch-master-pod-that-filesystemexception-data-log-input-output-error/270379)

<div class="topic-metadata">

**Author:** [@subha1](https://discuss.elastic.co/u/subha1)\
**Replies:** 2\
**Last updated:** [April 19, 2021, 11:15am UTC](https://discuss.elastic.co/t/error-in-elasticsearch-master-pod-that-filesystemexception-data-log-input-output-error/270379 "2021-04-19T11:15:59Z")

</div>

I found the below error logs in Elasticsearch master pod logs- Caused by: java.lang.IllegalStateException: Unable to access 'path.logs' (/data/log) at org.elasticsearch.bootstrap.FilePermissionUtils.addDirector…

---

## [How to delete a mapping field of an index?](https://discuss.elastic.co/t/how-to-delete-a-mapping-field-of-an-index/270371)

<div class="topic-metadata">

**Author:** [@KeithTt](https://discuss.elastic.co/u/KeithTt)\
**Replies:** 2\
**Last updated:** [April 19, 2021, 11:12am UTC](https://discuss.elastic.co/t/how-to-delete-a-mapping-field-of-an-index/270371 "2021-04-19T11:12:34Z")

</div>

I followed this page: Update mapping API | Elasticsearch Guide \[master\] | Elastic It seems ES does not support delete a mapping field directly?

---

## [How to reflect the DELETE operations in ES logs](https://discuss.elastic.co/t/how-to-reflect-the-delete-operations-in-es-logs/270564)

<div class="topic-metadata">

**Author:** [@yuriy.kasterin](https://discuss.elastic.co/u/yuriy.kasterin)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 10:35am UTC](https://discuss.elastic.co/t/how-to-reflect-the-delete-operations-in-es-logs/270564 "2021-04-19T10:35:03Z")

</div>

Hello. I have an issue on ES server that an old records are constantly disappear from the server after 15 days. I have checked all the relevant logs related to an application that indexes a new records into ES server a…

---

## [Elasticsearch deletes my index out of nowhere](https://discuss.elastic.co/t/elasticsearch-deletes-my-index-out-of-nowhere/270551)

<div class="topic-metadata">

**Author:** [@Nikolaj\_Karpov](https://discuss.elastic.co/u/Nikolaj_Karpov)\
**Replies:** 5\
**Last updated:** [April 19, 2021, 10:27am UTC](https://discuss.elastic.co/t/elasticsearch-deletes-my-index-out-of-nowhere/270551 "2021-04-19T10:27:18Z")

</div>

I have Elasticsearch server on AWS . And every now and then my Elasticsearch index is being somehow deleted without me doing anything. Below are the logs from my Elasticsearch server. \[2021-04-19T01:30:00,001\]\[INFO…

---

## [Find all documents containing array object field of size 0 or more](https://discuss.elastic.co/t/find-all-documents-containing-array-object-field-of-size-0-or-more/270562)

<div class="topic-metadata">

**Author:** [@dheeru4elastic](https://discuss.elastic.co/u/dheeru4elastic)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 9:53am UTC](https://discuss.elastic.co/t/find-all-documents-containing-array-object-field-of-size-0-or-more/270562 "2021-04-19T09:53:14Z")

</div>

Please find below the sample documents that I have in my elasticsearch 7.7.0. How can i build a optimize query to fetch all the documents that contains the array field problemInvestigations . As you can see some document…

---

## [Aws plugin installation problem](https://discuss.elastic.co/t/aws-plugin-installation-problem/270085)

<div class="topic-metadata">

**Author:** [@Weathmious](https://discuss.elastic.co/u/Weathmious)\
**Replies:** 20\
**Last updated:** [April 19, 2021, 9:23am UTC](https://discuss.elastic.co/t/aws-plugin-installation-problem/270085 "2021-04-19T09:23:06Z")

</div>

Hello, In order to send my elasticsearch indexes to aws S3, I find myself having to install the aws-cloud plugin on my server For that, I have to enter this order while being in the file /usr/share/elasticsearch: sudo…

---

## [Shrink action turns cluster to yellow state](https://discuss.elastic.co/t/shrink-action-turns-cluster-to-yellow-state/270553)

<div class="topic-metadata">

**Author:** [@d4nnyx](https://discuss.elastic.co/u/d4nnyx)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 8:51am UTC](https://discuss.elastic.co/t/shrink-action-turns-cluster-to-yellow-state/270553 "2021-04-19T08:51:08Z")

</div>

Hello, in our cluster we manage about 10K indices, all with ILM and every shrink action turns the cluster to yellow state, which is really annoying, because of our monitoring of cluster state. Is there any way to change…

---

## [Why elasticsearch mapping conflicts?](https://discuss.elastic.co/t/why-elasticsearch-mapping-conflicts/270544)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 7:49am UTC](https://discuss.elastic.co/t/why-elasticsearch-mapping-conflicts/270544 "2021-04-19T07:49:31Z")

</div>

I am facing some issues in elasticsearch mapping.Although i have check the forum the solution is reindexing but why? GET \_template/winlogbeat\_sysmon { "winlogbeat\_sysmon" : { "order" : 0, "index\_patterns" : \[ …

---

## [Could not index event to elasticsearch maximum shards open](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-maximum-shards-open/270524)

<div class="topic-metadata">

**Author:** [@TrAMT](https://discuss.elastic.co/u/TrAMT)\
**Replies:** 3\
**Last updated:** [April 19, 2021, 7:47am UTC](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-maximum-shards-open/270524 "2021-04-19T07:47:06Z")

</div>

Hi I have problem with Elasticsearch and Logstash. Here is the detail of log: Apr 16 13:01:24 elastic7-logstash logstash\[980\]: \[2021-04-16T13:01:24,828\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to E…

---

## [Template mapping not being applied](https://discuss.elastic.co/t/template-mapping-not-being-applied/269848)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 5\
**Last updated:** [April 19, 2021, 7:41am UTC](https://discuss.elastic.co/t/template-mapping-not-being-applied/269848 "2021-04-19T07:41:56Z")

</div>

Hello I am currently setting a mapping in my template but it seems to not be working. My work flow is basically Data -\> Logstash -\> Elasticsearch In Logstash, I do NOT set a template SO it gets the default, which is …

---

## [Exists query for field that has only 1 nested child not working](https://discuss.elastic.co/t/exists-query-for-field-that-has-only-1-nested-child-not-working/268897)

<div class="topic-metadata">

**Author:** [@MiDe](https://discuss.elastic.co/u/MiDe)\
**Replies:** 4\
**Last updated:** [April 19, 2021, 7:39am UTC](https://discuss.elastic.co/t/exists-query-for-field-that-has-only-1-nested-child-not-working/268897 "2021-04-19T07:39:20Z")

</div>

Trying to query entries based on a mapping like this: {"top": { "properties": { "doc": { "properties": { "A": { "properties": { "B": { "type…

---

## [Getting exception while storing the date field format as strict\_hour\_minute](https://discuss.elastic.co/t/getting-exception-while-storing-the-date-field-format-as-strict-hour-minute/270540)

<div class="topic-metadata">

**Author:** [@anjilinga](https://discuss.elastic.co/u/anjilinga)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 6:26am UTC](https://discuss.elastic.co/t/getting-exception-while-storing-the-date-field-format-as-strict-hour-minute/270540 "2021-04-19T06:26:29Z")

</div>

Hi, Created a field with mapping strict\_hour\_minute. running transform with group by field as below. "PeriodStartDateTime": { "date\_histogram": { "field": "StartDateTime", "fixed\_interval": "15m" } },after runnin…

---

## [Elasticsearch-plugin install repository-gcs is stuck](https://discuss.elastic.co/t/elasticsearch-plugin-install-repository-gcs-is-stuck/270537)

<div class="topic-metadata">

**Author:** [@rolandgroza](https://discuss.elastic.co/u/rolandgroza)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 5:35am UTC](https://discuss.elastic.co/t/elasticsearch-plugin-install-repository-gcs-is-stuck/270537 "2021-04-19T05:35:51Z")

</div>

I'm trying to install the repository-gcs plugin after upgrading elasticsearch from 7.0 -\> 7.12, but it looks like it gets stuck: time sudo /usr/share/elasticsearch/bin/elasticsearch-plugin install --batch repository-gcs…

---

## [Is index sorting beneficial in the following cases of (constantly updated) indexes?](https://discuss.elastic.co/t/is-index-sorting-beneficial-in-the-following-cases-of-constantly-updated-indexes/270501)

<div class="topic-metadata">

**Author:** [@Catalin](https://discuss.elastic.co/u/Catalin)\
**Replies:** 2\
**Last updated:** [April 19, 2021, 4:59am UTC](https://discuss.elastic.co/t/is-index-sorting-beneficial-in-the-following-cases-of-constantly-updated-indexes/270501 "2021-04-19T04:59:47Z")

</div>

I have a "products" index with ~750.000 documents. When displaying the products I allow the users to sort them by price ( asc, desc ) or 1-2 other metrics. The prices are constantly updated, as well as products constant…

---

## [How to exlude \`org.elasticsearch.test.framework\` dependency from Gradle \`esplugin\`?](https://discuss.elastic.co/t/how-to-exlude-org-elasticsearch-test-framework-dependency-from-gradle-esplugin/270526)

<div class="topic-metadata">

**Author:** [@BruceCL0407](https://discuss.elastic.co/u/BruceCL0407)\
**Replies:** 0\
**Last updated:** [April 19, 2021, 4:29am UTC](https://discuss.elastic.co/t/how-to-exlude-org-elasticsearch-test-framework-dependency-from-gradle-esplugin/270526 "2021-04-19T04:29:40Z")

</div>

Gradle esplugin introducing the dependency org.elasticsearch.test.framework requires RandomizedRunner to run tests(both Unit Tests and Integration Tests). In comparison, Maven doesn't introduce org.elasticsearch.test.fr…

---

## [Questions about ElasticSearch memory improvement](https://discuss.elastic.co/t/questions-about-elasticsearch-memory-improvement/270345)

<div class="topic-metadata">

**Author:** [@HalimKim](https://discuss.elastic.co/u/HalimKim)\
**Replies:** 3\
**Last updated:** [April 19, 2021, 4:29am UTC](https://discuss.elastic.co/t/questions-about-elasticsearch-memory-improvement/270345 "2021-04-19T04:29:21Z")

</div>

Hi, i've been researching ElasticSearch's improvement in terms of memory usage. Today, I've read this article(https://www.elastic.co/kr/blog/significantly-decrease-your-elasticsearch-heap-memory-usage). This article s…

---

## [How to set include\_type\_name to be true or false by Java rest High client APM](https://discuss.elastic.co/t/how-to-set-include-type-name-to-be-true-or-false-by-java-rest-high-client-apm/270365)

<div class="topic-metadata">

**Author:** [@SomberOfShadow](https://discuss.elastic.co/u/SomberOfShadow)\
**Replies:** 2\
**Last updated:** [April 19, 2021, 1:56am UTC](https://discuss.elastic.co/t/how-to-set-include-type-name-to-be-true-or-false-by-java-rest-high-client-apm/270365 "2021-04-19T01:56:59Z")

</div>

How to set include\_type\_name to be true or false by Java rest High client APM in order to solve follwing issue : Elasticsearch error: Types cannot be provided in get mapping requests, unless include\_type\_name is set…

---

## [Failed to validate incoming join request from node](https://discuss.elastic.co/t/failed-to-validate-incoming-join-request-from-node/270515)

<div class="topic-metadata">

**Author:** [@hussshe](https://discuss.elastic.co/u/hussshe)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 9:20pm UTC](https://discuss.elastic.co/t/failed-to-validate-incoming-join-request-from-node/270515 "2021-04-18T21:20:58Z")

</div>

Hello, With Elasticsearch 7.6.0, I'm trying to set up a simple master-1 node with data-1 and data-2 nodes but when I look at the log I get the below error. I'd really appreciate if you could help me understand why I ge…

---

## [7.12 No longer move warm indexes to the warm node](https://discuss.elastic.co/t/7-12-no-longer-move-warm-indexes-to-the-warm-node/270510)

<div class="topic-metadata">

**Author:** [@luigius](https://discuss.elastic.co/u/luigius)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 8:48pm UTC](https://discuss.elastic.co/t/7-12-no-longer-move-warm-indexes-to-the-warm-node/270510 "2021-04-18T20:48:41Z")

</div>

Hi, since upgrading to elastic 7.12 indices get marked warm but are not moved to the warm node. This of course uses all the space on the hot node. Any suggestion Luigi

---

## [Reindex thousands of indices into a shared stream](https://discuss.elastic.co/t/reindex-thousands-of-indices-into-a-shared-stream/270507)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 7:11pm UTC](https://discuss.elastic.co/t/reindex-thousands-of-indices-into-a-shared-stream/270507 "2021-04-18T19:11:57Z")

</div>

Hello I'm trying to achieve the following: reindex 3000 indices (between 100 mb to 5gb), which contains data for the years 2019-2021, into a shared stream. Ideally the target stream needs to be sorted by date, so the …

---

## [Mapper Parsing Exception](https://discuss.elastic.co/t/mapper-parsing-exception/270050)

<div class="topic-metadata">

**Author:** [@hussshe](https://discuss.elastic.co/u/hussshe)\
**Replies:** 2\
**Last updated:** [April 18, 2021, 6:35pm UTC](https://discuss.elastic.co/t/mapper-parsing-exception/270050 "2021-04-18T18:35:22Z")

</div>

Hello, I am trying to add mappings to the index named ecommerce. But this throws "mapper\_parsing\_exception" error. Any help on rectifying this error would be appreciated. Elastic Search version is 7.12.0 PUT /ecommerc…

---

## [Want. Best practices to solve the sort question with ES](https://discuss.elastic.co/t/want-best-practices-to-solve-the-sort-question-with-es/270502)

<div class="topic-metadata">

**Author:** [@yout0703](https://discuss.elastic.co/u/yout0703)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 4:35pm UTC](https://discuss.elastic.co/t/want-best-practices-to-solve-the-sort-question-with-es/270502 "2021-04-18T16:35:10Z")

</div>

I want to sort some entities(A)，each of them is related to another kind of entity(B). Different A has different relation score with B。I want to query A by B and sort them by relation scores。 some samples for A： { "n…

---

## ["No field found for \["..."\] in mapping" error with correct mapping](https://discuss.elastic.co/t/no-field-found-for-in-mapping-error-with-correct-mapping/270499)

<div class="topic-metadata">

**Author:** [@Marco\_R](https://discuss.elastic.co/u/Marco_R)\
**Replies:** 2\
**Last updated:** [April 18, 2021, 4:31pm UTC](https://discuss.elastic.co/t/no-field-found-for-in-mapping-error-with-correct-mapping/270499 "2021-04-18T16:31:49Z")

</div>

Hello, new to elastic here. I am trying to run this: GET /test/\_search { "query": { "match": { "doc\_type": "test" } }, "sort": { "\_script" : { "type" : "number", "script" : { …

---

## [Elastic basic version - visualize bulk data aggregations in Tableau](https://discuss.elastic.co/t/elastic-basic-version-visualize-bulk-data-aggregations-in-tableau/270484)

<div class="topic-metadata">

**Author:** [@Rasool\_Shaik](https://discuss.elastic.co/u/Rasool_Shaik)\
**Replies:** 2\
**Last updated:** [April 18, 2021, 4:14pm UTC](https://discuss.elastic.co/t/elastic-basic-version-visualize-bulk-data-aggregations-in-tableau/270484 "2021-04-18T16:14:51Z")

</div>

Hi All We plan to leverage Tableau for visualization of large data indexed in Elasticsearch basic version. Need help with options to aggregate huge data from elasticsearch & visualize within Tableau. Explored ODBC/JDB…

---

## [Unable to restore to an index in a newer Elastic Version](https://discuss.elastic.co/t/unable-to-restore-to-an-index-in-a-newer-elastic-version/270496)

<div class="topic-metadata">

**Author:** [@mastersmit](https://discuss.elastic.co/u/mastersmit)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 2:26pm UTC](https://discuss.elastic.co/t/unable-to-restore-to-an-index-in-a-newer-elastic-version/270496 "2021-04-18T14:26:29Z")

</div>

I have taken a snapshot in the version 7.8 and uploaded to AWS S3. After which, I have downloaded a newer version of elastic 7.12 and configured AWS S3. I am able to see the snapshots in kibana, and the restoring is als…

---

## [Post and Comments Mapping](https://discuss.elastic.co/t/post-and-comments-mapping/268007)

<div class="topic-metadata">

**Author:** [@Ignacio\_Fernandez](https://discuss.elastic.co/u/Ignacio_Fernandez)\
**Replies:** 2\
**Last updated:** [April 18, 2021, 12:04pm UTC](https://discuss.elastic.co/t/post-and-comments-mapping/268007 "2021-04-18T12:04:47Z")

</div>

Hello, I need to create a mapping for a forum website, where you have Post (with some properties) and each Post can have multiple comment (with more or less same properties). For this scenario is it better to have Ne…

---

## [Create a mapping that makes all fields type as keyword type](https://discuss.elastic.co/t/create-a-mapping-that-makes-all-fields-type-as-keyword-type/270481)

<div class="topic-metadata">

**Author:** [@wangqinghuan](https://discuss.elastic.co/u/wangqinghuan)\
**Replies:** 1\
**Last updated:** [April 18, 2021, 7:58am UTC](https://discuss.elastic.co/t/create-a-mapping-that-makes-all-fields-type-as-keyword-type/270481 "2021-04-18T07:58:21Z")

</div>

Hi Is there way to create an index that accept all dynamic fields as keyword type in case of type conflict ? For example: doc 1, { "id":1, "name":"Li" } doc 2, { "id":"uedjks", "name":"Wu…

---

## [Indices to JSON](https://discuss.elastic.co/t/indices-to-json/270459)

<div class="topic-metadata">

**Author:** [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\
**Replies:** 1\
**Last updated:** [April 18, 2021, 2:47am UTC](https://discuss.elastic.co/t/indices-to-json/270459 "2021-04-18T02:47:44Z")

</div>

Hi! I want to export a indices to a JSON file. I've verified this location /var/lib/elasticsearch/nodes/0/indices/RKq99IGSSF6aLa\_3J29XLg, but there is no JSON file and I don't know which one is the correct file. Thank …

---

## [How can I reflect the results of kuromoji in the search results?](https://discuss.elastic.co/t/how-can-i-reflect-the-results-of-kuromoji-in-the-search-results/270475)

<div class="topic-metadata">

**Author:** [@111464](https://discuss.elastic.co/u/111464)\
**Replies:** 0\
**Last updated:** [April 18, 2021, 12:19am UTC](https://discuss.elastic.co/t/how-can-i-reflect-the-results-of-kuromoji-in-the-search-results/270475 "2021-04-18T00:19:12Z")

</div>

I'm applying a standard analyzer and a kuromoji analyzer to one field. The version of Elasticsearch is 6.3.0. PUT /test { "mappings": { "docs": { "properties": { "body": { "type": "text", …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=661)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=663)
