# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=921

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 922

---

## [Wire and index compatibility version change](https://discuss.elastic.co/t/wire-and-index-compatibility-version-change/232646)

<div class="topic-metadata">

**Author:** [@dlonghi](https://discuss.elastic.co/u/dlonghi)\
**Replies:** 3\
**Last updated:** [May 15, 2020, 4:52am UTC](https://discuss.elastic.co/t/wire-and-index-compatibility-version-change/232646 "2020-05-15T04:52:34Z")

</div>

Hello, Is it possible to set minimum\_wire\_compatibility\_version and minimum\_index\_compatibility\_version to a particular version ? For instance: 7.7.0 Thanks,

---

## [When create index ,ela will create index catalog in all data path](https://discuss.elastic.co/t/when-create-index-ela-will-create-index-catalog-in-all-data-path/232745)

<div class="topic-metadata">

**Author:** [@wangdwcsd](https://discuss.elastic.co/u/wangdwcsd)\
**Replies:** 2\
**Last updated:** [May 15, 2020, 4:26am UTC](https://discuss.elastic.co/t/when-create-index-ela-will-create-index-catalog-in-all-data-path/232745 "2020-05-15T04:26:39Z")

</div>

my cluster has 10 nodes，every node has 24 disk , my cluster data path: path.data: /data1,/data2,/data3,/data4,/data5,/data6,/data7,/data8,/data9,/data10,/data11,/data12,/data13,/data14,/data15,/data16,/data17,/dat…

---

## [Date in index name doesn't change on rollover on the next day](https://discuss.elastic.co/t/date-in-index-name-doesnt-change-on-rollover-on-the-next-day/226701)

<div class="topic-metadata">

**Author:** [@EldrosKandar](https://discuss.elastic.co/u/EldrosKandar)\
**Replies:** 17\
**Last updated:** [May 15, 2020, 4:24am UTC](https://discuss.elastic.co/t/date-in-index-name-doesnt-change-on-rollover-on-the-next-day/226701 "2020-05-15T04:24:09Z")

</div>

For some reason, although the index naming convention is set in the Filebeat clients' configuration, the timestamp of the date isn't change when the index is rolled over on the next day. For example let's say I had inde…

---

## [Is the query syntax of elasticsearch javascript api different from dsl?](https://discuss.elastic.co/t/is-the-query-syntax-of-elasticsearch-javascript-api-different-from-dsl/232744)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 0\
**Last updated:** [May 15, 2020, 3:51am UTC](https://discuss.elastic.co/t/is-the-query-syntax-of-elasticsearch-javascript-api-different-from-dsl/232744 "2020-05-15T03:51:36Z")

</div>

I learned the DSL syntax, but the syntax of the client api seems to be different? https://www.elastic.co/guide/en/elasticsearch/client/javascript-api/current/search\_examples.html question 1 \> async function run ()…

---

## [Elastic search query for sorting results](https://discuss.elastic.co/t/elastic-search-query-for-sorting-results/232740)

<div class="topic-metadata">

**Author:** [@angryninja](https://discuss.elastic.co/u/angryninja)\
**Replies:** 0\
**Last updated:** [May 15, 2020, 3:21am UTC](https://discuss.elastic.co/t/elastic-search-query-for-sorting-results/232740 "2020-05-15T03:21:26Z")

</div>

Hi, I am trying to regular match search on a single field from the index which has n-gram analyzer. When I execute following query, the results are not sorted with string that has a perfect match on top. What can be d…

---

## [Error with Elasticsearch after prod config](https://discuss.elastic.co/t/error-with-elasticsearch-after-prod-config/230766)

<div class="topic-metadata">

**Author:** [@Luis\_Pereira1](https://discuss.elastic.co/u/Luis_Pereira1)\
**Replies:** 5\
**Last updated:** [May 15, 2020, 12:13am UTC](https://discuss.elastic.co/t/error-with-elasticsearch-after-prod-config/230766 "2020-05-15T00:13:46Z")

</div>

Hello, I'm having some problems on my docker cluster, today I've decided to change the config regarding the elastsicsearch services and after the configuration when I try to deploy the stack it gives the error bellow. e…

---

## [Elastic upgrade hosted on GCP](https://discuss.elastic.co/t/elastic-upgrade-hosted-on-gcp/231711)

<div class="topic-metadata">

**Author:** [@Atlas](https://discuss.elastic.co/u/Atlas)\
**Replies:** 9\
**Last updated:** [May 14, 2020, 10:52pm UTC](https://discuss.elastic.co/t/elastic-upgrade-hosted-on-gcp/231711 "2020-05-14T22:52:18Z")

</div>

Hi there, I am pretty new to Elasticsearch and I ran into an Upgrade task that gave me some doubts. I have a 3-nodes Cluster running Elasticsearch on Google Cloud (as a Google Click to Deploy deployment) ad I must upgr…

---

## [Logstash only node monitoring](https://discuss.elastic.co/t/logstash-only-node-monitoring/232086)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 6\
**Last updated:** [May 14, 2020, 10:51pm UTC](https://discuss.elastic.co/t/logstash-only-node-monitoring/232086 "2020-05-14T22:51:35Z")

</div>

I have two logstash nodes. which at this time only running logstash. no elasticsearch runs on it. each has about 15 pipeline running. in elk cluster I have 5 master node, 5 data node. Currently I can't see logstash no…

---

## [Query with exclusion list](https://discuss.elastic.co/t/query-with-exclusion-list/232717)

<div class="topic-metadata">

**Author:** [@malinal](https://discuss.elastic.co/u/malinal)\
**Replies:** 0\
**Last updated:** [May 14, 2020, 9:33pm UTC](https://discuss.elastic.co/t/query-with-exclusion-list/232717 "2020-05-14T21:33:05Z")

</div>

I’m still a beginner and I’ve run into a task I don’t know how to solve. We have a small system that has one index only. We store simple objects with many properties Most data types are simple keyword (or date) because …

---

## [Object mapping \[categories\] can't be changed from nested to non-nested](https://discuss.elastic.co/t/object-mapping-categories-cant-be-changed-from-nested-to-non-nested/232591)

<div class="topic-metadata">

**Author:** [@andrey1](https://discuss.elastic.co/u/andrey1)\
**Replies:** 9\
**Last updated:** [May 14, 2020, 9:02pm UTC](https://discuss.elastic.co/t/object-mapping-categories-cant-be-changed-from-nested-to-non-nested/232591 "2020-05-14T21:02:08Z")

</div>

Hi, I've got a legacy a project with old version of Elasticsearch and trying to get it working with ES 7.6.2. And encountered an error which I can't understand what is wrong. There is big index definition so I quote onl…

---

## [Elasticsearch snapshot retention](https://discuss.elastic.co/t/elasticsearch-snapshot-retention/232706)

<div class="topic-metadata">

**Author:** [@cm-vdp](https://discuss.elastic.co/u/cm-vdp)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 8:59pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-retention/232706 "2020-05-14T20:59:47Z")

</div>

Recently I am responsible for our ELK-environment (6.6). It has run for 2 years without any management. For me it's a black box but I'm learning. First thing I want to tackle is a correct backup solution. I know elast…

---

## [Unable to run Elasticsearch MR job facing the following error please help](https://discuss.elastic.co/t/unable-to-run-elasticsearch-mr-job-facing-the-following-error-please-help/231832)

<div class="topic-metadata">

**Author:** [@vkg0312](https://discuss.elastic.co/u/vkg0312)\
**Replies:** 2\
**Last updated:** [May 14, 2020, 8:32pm UTC](https://discuss.elastic.co/t/unable-to-run-elasticsearch-mr-job-facing-the-following-error-please-help/231832 "2020-05-14T20:32:24Z")

</div>

Using Hadoop Version 2.10.0 Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/httpclient/HttpConnectionManager at org.elasticsearch.hadoop.rest.commonshttp.CommonsHttpTransportFactory.create…

---

## [Getting records rejected during bulk insert, which are not related to the '400 Failed to parse' reason](https://discuss.elastic.co/t/getting-records-rejected-during-bulk-insert-which-are-not-related-to-the-400-failed-to-parse-reason/228695)

<div class="topic-metadata">

**Author:** [@gusuku](https://discuss.elastic.co/u/gusuku)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 8:26pm UTC](https://discuss.elastic.co/t/getting-records-rejected-during-bulk-insert-which-are-not-related-to-the-400-failed-to-parse-reason/228695 "2020-05-14T20:26:01Z")

</div>

Using Bulk API to upsert mini-batches of records to Elasticsearch 5.1 When I try to upsert a badly formatted record (hence getting a 400 Failed to parse), most times ES rejects just that record in that batch. But someti…

---

## [How search es using spark-sql with 'function match' or others](https://discuss.elastic.co/t/how-search-es-using-spark-sql-with-function-match-or-others/232340)

<div class="topic-metadata">

**Author:** [@ZBHdd](https://discuss.elastic.co/u/ZBHdd)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 8:24pm UTC](https://discuss.elastic.co/t/how-search-es-using-spark-sql-with-function-match-or-others/232340 "2020-05-14T20:24:39Z")

</div>

Issue description now,I want select es using 'spark-sql',but 'predicate pushdown' does not take effect Description Steps to reproduce Code: first I create a index curl -H "Content-Type: application/json" -XPOST 'htt…

---

## [Es.read.field.as.array.include multiple values](https://discuss.elastic.co/t/es-read-field-as-array-include-multiple-values/231812)

<div class="topic-metadata">

**Author:** [@Ramesh\_Nuthalapati](https://discuss.elastic.co/u/Ramesh_Nuthalapati)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 8:09pm UTC](https://discuss.elastic.co/t/es-read-field-as-array-include-multiple-values/231812 "2020-05-14T20:09:00Z")

</div>

I understand from documentation that when I get this error SparkException: Job aborted due to stage failure: Task 0 in stage 20.0 failed 4 times, most recent failure: Lost task 0.3 in stage 20.0 (TID 75, 10.244.241.30, …

---

## [How to set include\_type\_name HLClient GetIndexTemplatesRequest() or GetIndexRequest()](https://discuss.elastic.co/t/how-to-set-include-type-name-hlclient-getindextemplatesrequest-or-getindexrequest/232498)

<div class="topic-metadata">

**Author:** [@Cat](https://discuss.elastic.co/u/Cat)\
**Replies:** 5\
**Last updated:** [May 14, 2020, 4:56pm UTC](https://discuss.elastic.co/t/how-to-set-include-type-name-hlclient-getindextemplatesrequest-or-getindexrequest/232498 "2020-05-14T16:56:12Z")

</div>

I've tried both GetIndexTemplatesRequest() and GetIndexRequest() to retrieve the version number. I keep on getting the following exception: \[299 Elasticsearch-6.8.7-c63e621 "\[types removal\] The parameter include\_type\_n…

---

## [Node doesn't join cluster](https://discuss.elastic.co/t/node-doesnt-join-cluster/232691)

<div class="topic-metadata">

**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\
**Replies:** 5\
**Last updated:** [May 14, 2020, 7:13pm UTC](https://discuss.elastic.co/t/node-doesnt-join-cluster/232691 "2020-05-14T19:13:14Z")

</div>

Is there a guide on how to add new nodes to a cluster? Cause this ain't it. The issue is both nodes are running, displaying no errors, but shards are not getting assigned. Nodes in the cluster (cluster.name: local) ha…

---

## [Unwanted fields in indice](https://discuss.elastic.co/t/unwanted-fields-in-indice/232679)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 5\
**Last updated:** [May 14, 2020, 4:50pm UTC](https://discuss.elastic.co/t/unwanted-fields-in-indice/232679 "2020-05-14T16:50:34Z")

</div>

One of my indice has some field which are nowhere in my logstash config. yes that fields are from other config file. but both config files are separate pipeline. both has different document\_id how come they appear in t…

---

## [Query related to cluster.routing.allocation.enable](https://discuss.elastic.co/t/query-related-to-cluster-routing-allocation-enable/232684)

<div class="topic-metadata">

**Author:** [@NairitiSharma](https://discuss.elastic.co/u/NairitiSharma)\
**Replies:** 0\
**Last updated:** [May 14, 2020, 4:25pm UTC](https://discuss.elastic.co/t/query-related-to-cluster-routing-allocation-enable/232684 "2020-05-14T16:25:32Z")

</div>

I have ES 6.8 based pod that has 3 data nodes. I dont have cluster.routing.allocation.enable explicitly defined in my elasticsearch.yml or as a persistent / transient setting. While creating indexes, will shard allocati…

---

## [Merge field message and msg](https://discuss.elastic.co/t/merge-field-message-and-msg/232644)

<div class="topic-metadata">

**Author:** [@raulgs](https://discuss.elastic.co/u/raulgs)\
**Replies:** 3\
**Last updated:** [May 14, 2020, 2:37pm UTC](https://discuss.elastic.co/t/merge-field-message-and-msg/232644 "2020-05-14T14:37:53Z")

</div>

Hi guys, I noticed today that for some pods log messages are available in the message field, while for others they in the msg field. Is there some way to merge this field or make them all available over a pointer that l…

---

## [Hot / Cold replication shards allocation failed - Elasticsearch 7.4.0](https://discuss.elastic.co/t/hot-cold-replication-shards-allocation-failed-elasticsearch-7-4-0/232586)

<div class="topic-metadata">

**Author:** [@Thomas74](https://discuss.elastic.co/u/Thomas74)\
**Replies:** 4\
**Last updated:** [May 14, 2020, 2:09pm UTC](https://discuss.elastic.co/t/hot-cold-replication-shards-allocation-failed-elasticsearch-7-4-0/232586 "2020-05-14T14:09:34Z")

</div>

Hi all, I have a problem after configuring my cluster with hot / cold nodes. My goal is to separate hot indices with their replica into nodes tagged "hot" and the other one into nodes tagged "cold". My replicas can't …

---

## [Cant resolve hotst for Elastic search service](https://discuss.elastic.co/t/cant-resolve-hotst-for-elastic-search-service/232627)

<div class="topic-metadata">

**Author:** [@AndresL](https://discuss.elastic.co/u/AndresL)\
**Replies:** 2\
**Last updated:** [May 14, 2020, 12:52pm UTC](https://discuss.elastic.co/t/cant-resolve-hotst-for-elastic-search-service/232627 "2020-05-14T12:52:01Z")

</div>

HI, from a VM on Azure running logstash, i cant resolve the hostname for ESS adminuser@dazlog101:~$ wget https://xxxx.westeurope.azure.elastic-cloud --2020-05-14 11:34:28-- https://xxxx.westeurope.azure.elastic-clou…

---

## [Rollup - Store statistics (just a number)](https://discuss.elastic.co/t/rollup-store-statistics-just-a-number/232214)

<div class="topic-metadata">

**Author:** [@vdelcampo](https://discuss.elastic.co/u/vdelcampo)\
**Replies:** 9\
**Last updated:** [May 14, 2020, 12:48pm UTC](https://discuss.elastic.co/t/rollup-store-statistics-just-a-number/232214 "2020-05-14T12:48:56Z")

</div>

Hi. I need to store historical data from my indexes, exactly the number of request per minute that my webservices has along time. Its possible to store only this information? If i create a rollup job using only the file…

---

## [Getting from in search response](https://discuss.elastic.co/t/getting-from-in-search-response/232616)

<div class="topic-metadata">

**Author:** [@guruprasadkk](https://discuss.elastic.co/u/guruprasadkk)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 12:23pm UTC](https://discuss.elastic.co/t/getting-from-in-search-response/232616 "2020-05-14T12:23:31Z")

</div>

Previously we were using the solr, now we migrated to elastic search. We are using basic pagination with rows, offset. In solr from search response we can get the offset value we used for that query by using #SolrDocum…

---

## [Elastic Search integration with Magneto 2.3.3](https://discuss.elastic.co/t/elastic-search-integration-with-magneto-2-3-3/232636)

<div class="topic-metadata">

**Author:** [@parthipan\_p](https://discuss.elastic.co/u/parthipan_p)\
**Replies:** 2\
**Last updated:** [May 14, 2020, 12:19pm UTC](https://discuss.elastic.co/t/elastic-search-integration-with-magneto-2-3-3/232636 "2020-05-14T12:19:23Z")

</div>

I have tried to use and configure the Elastic search feature. I have installed the below packages and respective versions, Java - 11.0.7 Magento 2.3.3 Elastic search: 6.8.8 Module installed from git branch is: 2.8.x …

---

## [Where is the merge policy defined?](https://discuss.elastic.co/t/where-is-the-merge-policy-defined/232496)

<div class="topic-metadata">

**Author:** [@Emanuel\_Velzi](https://discuss.elastic.co/u/Emanuel_Velzi)\
**Replies:** 9\
**Last updated:** [May 14, 2020, 11:49am UTC](https://discuss.elastic.co/t/where-is-the-merge-policy-defined/232496 "2020-05-14T11:49:16Z")

</div>

Hi, I am using ES 7.6.2 and I can not find the merge policy for my indices. I don't see it in \_settings. In addition, I can not find the default merge policy in the elastic documentation. Can someone help me please?

---

## [Index template resulting in missing all fields in kibana](https://discuss.elastic.co/t/index-template-resulting-in-missing-all-fields-in-kibana/232601)

<div class="topic-metadata">

**Author:** [@Deny7](https://discuss.elastic.co/u/Deny7)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 11:12am UTC](https://discuss.elastic.co/t/index-template-resulting-in-missing-all-fields-in-kibana/232601 "2020-05-14T11:12:57Z")

</div>

Hi, I defined template on existing index. But when the template is applied on index creation, all fields dissapear in kibana. I cant see any error in logs. Without template defined its showing data. Can anybody help? Ki…

---

## [Cluster configuration, shards, and replica](https://discuss.elastic.co/t/cluster-configuration-shards-and-replica/232587)

<div class="topic-metadata">

**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\
**Replies:** 3\
**Last updated:** [May 14, 2020, 11:01am UTC](https://discuss.elastic.co/t/cluster-configuration-shards-and-replica/232587 "2020-05-14T11:01:33Z")

</div>

Hi, I have a cluster of 9 nodes, 3 master-hot, 3warm, and 3 cold, they have the same amount of ram 32GB but different disk-space, the hot is on SSD, the others on the mechanic. I haven't followed the ratio best practic…

---

## [Resource Management of all requests in the system](https://discuss.elastic.co/t/resource-management-of-all-requests-in-the-system/232354)

<div class="topic-metadata">

**Author:** [@sohami](https://discuss.elastic.co/u/sohami)\
**Replies:** 5\
**Last updated:** [May 14, 2020, 7:55am UTC](https://discuss.elastic.co/t/resource-management-of-all-requests-in-the-system/232354 "2020-05-14T07:55:27Z")

</div>

Hi, I am looking for some feedback on my understanding and question related to resource management done in ES. Today in ES, I see there are circuit breakers which provides a way to manage the high JVM heap usage and the…

---

## [Get the aggregation that measures unique users from different cities using elasticsearch event log index](https://discuss.elastic.co/t/get-the-aggregation-that-measures-unique-users-from-different-cities-using-elasticsearch-event-log-index/232237)

<div class="topic-metadata">

**Author:** [@Nisrein\_Sada](https://discuss.elastic.co/u/Nisrein_Sada)\
**Replies:** 6\
**Last updated:** [May 14, 2020, 10:23am UTC](https://discuss.elastic.co/t/get-the-aggregation-that-measures-unique-users-from-different-cities-using-elasticsearch-event-log-index/232237 "2020-05-14T10:23:38Z")

</div>

I am trying to measure the number of users from different countries by reading the events\_log\_index ES, this index has all the user interactions from a mobile. Therefore the user might have several records in the event i…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=920)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=922)
