# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=559

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 560

---

## [ElasticSearch Search-as-you-type field type field with partial search](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635)

<div class="topic-metadata">

**Author:** [@Jacques\_du\_Plessis](https://discuss.elastic.co/u/Jacques_du_Plessis)\
**Replies:** 0\
**Last updated:** [October 13, 2021, 2:34pm UTC](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635 "2021-10-13T14:34:40Z")

</div>

I recently updating my ngram implementation settings to use Search-as-you-type field type. Search-as-you-type field type | Elasticsearch Guide \[7.x\] | Elastic This worked great but I noticed that partial searching do…

---

## [Pipeline question](https://discuss.elastic.co/t/pipeline-question/286494)

<div class="topic-metadata">

**Author:** [@Worlock](https://discuss.elastic.co/u/Worlock)\
**Replies:** 13\
**Last updated:** [October 13, 2021, 1:00pm UTC](https://discuss.elastic.co/t/pipeline-question/286494 "2021-10-13T13:00:10Z")

</div>

Hi all, I have a field in my index that is named "Severity". The values can be either 2, 1 or 0. I want to rename those values to Critical, Warning or Informational. I looked into pipelines and also read the documentat…

---

## [ElasticSearch Data Redirection](https://discuss.elastic.co/t/elasticsearch-data-redirection/286036)

<div class="topic-metadata">

**Author:** [@jrpayne30506](https://discuss.elastic.co/u/jrpayne30506)\
**Replies:** 2\
**Last updated:** [October 13, 2021, 12:58pm UTC](https://discuss.elastic.co/t/elasticsearch-data-redirection/286036 "2021-10-13T12:58:02Z")

</div>

Hello All, New to Elasticsearch here and having an issue. I have an Ubuntu server (18.04) that I am using to send some security and firewall logs for period of retentions storage. I found an article on how to redirect t…

---

## [One Index is not recovering from the state INITIALIZING and UNASSIGNED](https://discuss.elastic.co/t/one-index-is-not-recovering-from-the-state-initializing-and-unassigned/286468)

<div class="topic-metadata">

**Author:** [@Programmer](https://discuss.elastic.co/u/Programmer)\
**Replies:** 4\
**Last updated:** [October 13, 2021, 12:46pm UTC](https://discuss.elastic.co/t/one-index-is-not-recovering-from-the-state-initializing-and-unassigned/286468 "2021-10-13T12:46:21Z")

</div>

curl -XGET http://localhost:9200/\_cat/shards app-all 1 r INITIALIZING 172.16.4.165 viepevrat02 app-all 1 p STARTED 85125705 67gb 172.16.4.164 viepevrat01 app-all 0 p RELOCATING…

---

## [Combination of filter and range](https://discuss.elastic.co/t/combination-of-filter-and-range/286392)

<div class="topic-metadata">

**Author:** [@smit\_vasava](https://discuss.elastic.co/u/smit_vasava)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 12:13pm UTC](https://discuss.elastic.co/t/combination-of-filter-and-range/286392 "2021-10-13T12:13:39Z")

</div>

hello everyone , i am newbie to Elasticsearch , i am having some issue with query searching .. here is my code GET /new\_product/\_search { "query": { "bool" : { "filter": \[ { "term": { "ca…

---

## [Moving ML jobs and their data](https://discuss.elastic.co/t/moving-ml-jobs-and-their-data/136635)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 7\
**Last updated:** [October 13, 2021, 11:38am UTC](https://discuss.elastic.co/t/moving-ml-jobs-and-their-data/136635 "2021-10-13T11:38:55Z")

</div>

I have a a few ml jobs saved and running in my local build. I would like to somehow export the same jobs on to another build that is running in a different machine. Is this possible? If so, how? Also, assuming that I've…

---

## [Migrating ML jobs to production environment?](https://discuss.elastic.co/t/migrating-ml-jobs-to-production-environment/286531)

<div class="topic-metadata">

**Author:** [@MLsuper](https://discuss.elastic.co/u/MLsuper)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 11:36am UTC](https://discuss.elastic.co/t/migrating-ml-jobs-to-production-environment/286531 "2021-10-13T11:36:46Z")

</div>

From 2018 Moving ML jobs and their data it was not possible, but now is it possible? looking at this However when i go to stack management -\> machine learning (jobs list) there is no option to export, or even in the …

---

## [Elastic cluster,set up security,password setup all collide-native authentication](https://discuss.elastic.co/t/elastic-cluster-set-up-security-password-setup-all-collide-native-authentication/286448)

<div class="topic-metadata">

**Author:** [@Netanelp](https://discuss.elastic.co/u/Netanelp)\
**Replies:** 6\
**Last updated:** [October 13, 2021, 11:08am UTC](https://discuss.elastic.co/t/elastic-cluster-set-up-security-password-setup-all-collide-native-authentication/286448 "2021-10-13T11:08:49Z")

</div>

Hey guys, I will start with my main goal here, trying to move my elastic cluster to use native security/authentication. I've recently taken over a project involving an elastic cluster(Gold plan) trying to make it work …

---

## [Tree node clustrering master\_not\_discovered\_exception issue](https://discuss.elastic.co/t/tree-node-clustrering-master-not-discovered-exception-issue/286604)

<div class="topic-metadata">

**Author:** [@Ali\_Panahian](https://discuss.elastic.co/u/Ali_Panahian)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 10:35am UTC](https://discuss.elastic.co/t/tree-node-clustrering-master-not-discovered-exception-issue/286604 "2021-10-13T10:35:37Z")

</div>

i have tree node cluster of ES, the issue is: when i stop one node the other nodes work fine and discover master node and everything works fine, but when is stop 2 node, the last one return master\_not\_discovered\_except…

---

## [Upgrade ES to 6.8 and Graylog to 4.0](https://discuss.elastic.co/t/upgrade-es-to-6-8-and-graylog-to-4-0/286586)

<div class="topic-metadata">

**Author:** [@vivir](https://discuss.elastic.co/u/vivir)\
**Replies:** 5\
**Last updated:** [October 13, 2021, 9:03am UTC](https://discuss.elastic.co/t/upgrade-es-to-6-8-and-graylog-to-4-0/286586 "2021-10-13T09:03:26Z")

</div>

I’m currently using graylog 3.3 and I’d like to upgrade to version 4.0. It looks like I need to upgrade Elasticsearch first ( currently using version 5.6). I’ve done research online but I can’t seem to find how to re-i…

---

## [Configuration parameter details \[cluster.initial\_master\_nodes\]](https://discuss.elastic.co/t/configuration-parameter-details-cluster-initial-master-nodes/286541)

<div class="topic-metadata">

**Author:** [@mrchile](https://discuss.elastic.co/u/mrchile)\
**Replies:** 2\
**Last updated:** [October 13, 2021, 8:49am UTC](https://discuss.elastic.co/t/configuration-parameter-details-cluster-initial-master-nodes/286541 "2021-10-13T08:49:50Z")

</div>

This is an excerpt from the official documentation and I would like to know. By cluster, I mean a combination of virtual machines on which one instance of elastic is installed. Node is a new instance of a virtual machine…

---

## [Unable to search for a Special Character using query\_string](https://discuss.elastic.co/t/unable-to-search-for-a-special-character-using-query-string/286596)

<div class="topic-metadata">

**Author:** [@paramzvik](https://discuss.elastic.co/u/paramzvik)\
**Replies:** 0\
**Last updated:** [October 13, 2021, 8:42am UTC](https://discuss.elastic.co/t/unable-to-search-for-a-special-character-using-query-string/286596 "2021-10-13T08:42:35Z")

</div>

Hi Developers, I am getting zero data after querying for a special character. Can some one help me with this. The query I am using is as follows. "query\_string" : { "query" : ""+"", "fields" : \[ "\_\_title" \], "defau…

---

## [Date histogram data precalculation](https://discuss.elastic.co/t/date-histogram-data-precalculation/286574)

<div class="topic-metadata">

**Author:** [@scorona85](https://discuss.elastic.co/u/scorona85)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 6:58am UTC](https://discuss.elastic.co/t/date-histogram-data-precalculation/286574 "2021-10-13T06:58:24Z")

</div>

Hi, is there a way to perform operations on the data before creating the aggregation? In my example the aggregation is created and then the aggregate data is multiplied \* 10. I have to multiply the data and than aggrega…

---

## [Date histogram filter different math operations](https://discuss.elastic.co/t/date-histogram-filter-different-math-operations/286569)

<div class="topic-metadata">

**Author:** [@scorona85](https://discuss.elastic.co/u/scorona85)\
**Replies:** 0\
**Last updated:** [October 13, 2021, 6:10am UTC](https://discuss.elastic.co/t/date-histogram-filter-different-math-operations/286569 "2021-10-13T06:10:57Z")

</div>

Hi, how can I create a date histogram where I have this source datas: { "\_index" : "test-data-2021-6-24", "\_type" : "\_doc", "\_id" : "wB0PDnwBqyyjw7qp6Ih\_", "\_score" : 1.0, "\_…

---

## [Elasticsearch ram size](https://discuss.elastic.co/t/elasticsearch-ram-size/286449)

<div class="topic-metadata">

**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\
**Replies:** 11\
**Last updated:** [October 13, 2021, 4:47am UTC](https://discuss.elastic.co/t/elasticsearch-ram-size/286449 "2021-10-13T04:47:28Z")

</div>

Hi Team, I have installed Elasticsearch on windows 2016 server for the first time with hardware configuration of 16GB ram, 64 - bit OS, 8 core. Now I want set the heap size of the elastic cluster. What heap size shoul…

---

## [Elasticsearch giving creating index, cause \[auto(bulk api)\]](https://discuss.elastic.co/t/elasticsearch-giving-creating-index-cause-auto-bulk-api/286560)

<div class="topic-metadata">

**Author:** [@Aashish\_Goyal](https://discuss.elastic.co/u/Aashish_Goyal)\
**Replies:** 9\
**Last updated:** [October 13, 2021, 2:57am UTC](https://discuss.elastic.co/t/elasticsearch-giving-creating-index-cause-auto-bulk-api/286560 "2021-10-13T02:57:05Z")

</div>

I am facing issues that old indices are getting created automatically, as I am using fluentd as a log shipper to Elasticsearch. I am facing this issue since 2 days, dig very much for this but no result till now. I delete…

---

## [The best way to export specific data to lucene file like snapshot file](https://discuss.elastic.co/t/the-best-way-to-export-specific-data-to-lucene-file-like-snapshot-file/286557)

<div class="topic-metadata">

**Author:** [@lec\_ssmi](https://discuss.elastic.co/u/lec_ssmi)\
**Replies:** 2\
**Last updated:** [October 13, 2021, 2:18am UTC](https://discuss.elastic.co/t/the-best-way-to-export-specific-data-to-lucene-file-like-snapshot-file/286557 "2021-10-13T02:18:08Z")

</div>

I want to export some data according to specific condititons. But the rest api has a bad performance. In order to export the file as soon as possible, I can use snapshot. But snapshot can only be exported incrementally,…

---

## [Index size increased after reindexing](https://discuss.elastic.co/t/index-size-increased-after-reindexing/286482)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 2\
**Last updated:** [October 13, 2021, 1:56am UTC](https://discuss.elastic.co/t/index-size-increased-after-reindexing/286482 "2021-10-13T01:56:40Z")

</div>

After the completion of reindex process,the size of new index is very big compare to original index.Although i force\_merge the index nothing happened. Original index size was 101.7gb and new index is 140gb around.We've …

---

## [Set password during deployment elasticsearch for my app](https://discuss.elastic.co/t/set-password-during-deployment-elasticsearch-for-my-app/286548)

<div class="topic-metadata">

**Author:** [@agonzalez](https://discuss.elastic.co/u/agonzalez)\
**Replies:** 4\
**Last updated:** [October 13, 2021, 1:53am UTC](https://discuss.elastic.co/t/set-password-during-deployment-elasticsearch-for-my-app/286548 "2021-10-13T01:53:04Z")

</div>

I am running my app as a container that need to access Elasticsearch deployed as container also, so in my app settings yaml i have to enter credentials and url for elastic that will be deployed also in docker. How can i…

---

## [Search query duration record](https://discuss.elastic.co/t/search-query-duration-record/286271)

<div class="topic-metadata">

**Author:** [@KiddoATOM](https://discuss.elastic.co/u/KiddoATOM)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 1:12am UTC](https://discuss.elastic.co/t/search-query-duration-record/286271 "2021-10-13T01:12:32Z")

</div>

Hi. I have a problem in an ES cluster, where due to heavy search queries the cluster stops responding. I want to adjust the global search timeout and we wanted to know if there was a way to obtain the duration of each se…

---

## [Elasticsearch: Duplicate Documents](https://discuss.elastic.co/t/elasticsearch-duplicate-documents/286478)

<div class="topic-metadata">

**Author:** [@Isekai](https://discuss.elastic.co/u/Isekai)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 1:10am UTC](https://discuss.elastic.co/t/elasticsearch-duplicate-documents/286478 "2021-10-13T01:10:38Z")

</div>

Hi everyone, I have an occasional problem that sometimes there are several duplicate documents generated. This is part of our CI and it should upload data to elastic with details about our build failure. After analysi…

---

## [How to find Mapping conflict?](https://discuss.elastic.co/t/how-to-find-mapping-conflict/286497)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 5\
**Last updated:** [October 13, 2021, 12:54am UTC](https://discuss.elastic.co/t/how-to-find-mapping-conflict/286497 "2021-10-13T00:54:17Z")

</div>

We upgraded cluster from 7.12 to 7.15 new index created metricbeat-7.15.0 but now in index pattern it says I have mapping conflict in older version there was a field type=conflict but no longer. how do I find which fi…

---

## [Automatic @timestamp in datastream](https://discuss.elastic.co/t/automatic-timestamp-in-datastream/286381)

<div class="topic-metadata">

**Author:** [@ggab31](https://discuss.elastic.co/u/ggab31)\
**Replies:** 2\
**Last updated:** [October 13, 2021, 12:21am UTC](https://discuss.elastic.co/t/automatic-timestamp-in-datastream/286381 "2021-10-13T00:21:04Z")

</div>

Hi The documentation says that documents must contain a @timestamp field in order to be accepted by a datastream. I'm trying to make it optional by declaring a default ingest\_pipeline in a datastream template that will…

---

## [Wazuh alerts not received in Kibana](https://discuss.elastic.co/t/wazuh-alerts-not-received-in-kibana/286524)

<div class="topic-metadata">

**Author:** [@Hocine\_Zaidi](https://discuss.elastic.co/u/Hocine_Zaidi)\
**Replies:** 1\
**Last updated:** [October 13, 2021, 12:19am UTC](https://discuss.elastic.co/t/wazuh-alerts-not-received-in-kibana/286524 "2021-10-13T00:19:46Z")

</div>

Gents, i receive Wazuh monitoring and statistics but not Alertes , i suspect certificates error if someone help me

---

## [Finding number of files in latest batch using aggregations](https://discuss.elastic.co/t/finding-number-of-files-in-latest-batch-using-aggregations/286553)

<div class="topic-metadata">

**Author:** [@Tim\_Estes](https://discuss.elastic.co/u/Tim_Estes)\
**Replies:** 0\
**Last updated:** [October 12, 2021, 10:35pm UTC](https://discuss.elastic.co/t/finding-number-of-files-in-latest-batch-using-aggregations/286553 "2021-10-12T22:35:58Z")

</div>

Hello, Here is the scenario: I have an index that contains documents representing files uploaded to a file store. These documents are uploaded in batches and each doc is tagged with a batch\_id field as well as the time…

---

## [Custom TopDocsCollector in plugin?](https://discuss.elastic.co/t/custom-topdocscollector-in-plugin/286546)

<div class="topic-metadata">

**Author:** [@larry\_benchling](https://discuss.elastic.co/u/larry_benchling)\
**Replies:** 2\
**Last updated:** [October 12, 2021, 10:18pm UTC](https://discuss.elastic.co/t/custom-topdocscollector-in-plugin/286546 "2021-10-12T22:18:50Z")

</div>

Hello! I'm working on a plugin to add some cheminformatics features to our Elasticsearch cluster. Several of these involve steps where there is an inverted index based screening stage (which fits well as a Lucene query)…

---

## [Understand ILM (shrink index)](https://discuss.elastic.co/t/understand-ilm-shrink-index/286407)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 4\
**Last updated:** [October 12, 2021, 9:00pm UTC](https://discuss.elastic.co/t/understand-ilm-shrink-index/286407 "2021-10-12T21:00:32Z")

</div>

I have used ILM policy on my metricbeat data and used shrink option. which worked and created new index called shrink-anre-metricbeat-7.15.0-2021.10.06-000010 but my index pattern is called "metricbeat-\*" how does it…

---

## [Failed to retrieve password hash for reserved user \[elastic\]](https://discuss.elastic.co/t/failed-to-retrieve-password-hash-for-reserved-user-elastic/286399)

<div class="topic-metadata">

**Author:** [@rachelyang](https://discuss.elastic.co/u/rachelyang)\
**Replies:** 6\
**Last updated:** [October 12, 2021, 8:51pm UTC](https://discuss.elastic.co/t/failed-to-retrieve-password-hash-for-reserved-user-elastic/286399 "2021-10-12T20:51:34Z")

</div>

I have verified the password of user elastic. curl -k -u elastic 'https://localhost:9200/\_xpack/security/\_authenticate?pretty' Enter host password for user 'elastic': { "username" : "elastic", "roles" : \[ "super…

---

## [What is best way for saving URL on Elasticsearch, only "keyword" type mapping?](https://discuss.elastic.co/t/what-is-best-way-for-saving-url-on-elasticsearch-only-keyword-type-mapping/286477)

<div class="topic-metadata">

**Author:** [@dan\_kim](https://discuss.elastic.co/u/dan_kim)\
**Replies:** 1\
**Last updated:** [October 12, 2021, 8:31pm UTC](https://discuss.elastic.co/t/what-is-best-way-for-saving-url-on-elasticsearch-only-keyword-type-mapping/286477 "2021-10-12T20:31:03Z")

</div>

Hello ~ Our team is going to save our product data in Elasticsearch and I got question when i type mapping schema. The url of "product image", or "product payment" is quite big compared to other attribute in Elasticse…

---

## [Questions about handling delete operations on a latest-data-only index](https://discuss.elastic.co/t/questions-about-handling-delete-operations-on-a-latest-data-only-index/286227)

<div class="topic-metadata">

**Author:** [@nivo](https://discuss.elastic.co/u/nivo)\
**Replies:** 5\
**Last updated:** [October 12, 2021, 6:54pm UTC](https://discuss.elastic.co/t/questions-about-handling-delete-operations-on-a-latest-data-only-index/286227 "2021-10-12T18:54:46Z")

</div>

Hi everyone, I have a question regarding our use case following this topic - In our case we use a single index per customer (without rolling it) and keeping its data up to date by indexing or deleting documents when t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=558)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=560)
