# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=762

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 763

---

## [Replacing Elasticsearch Node](https://discuss.elastic.co/t/replacing-elasticsearch-node/255654)

<div class="topic-metadata">

**Author:** [@junydania](https://discuss.elastic.co/u/junydania)\
**Replies:** 1\
**Last updated:** [November 17, 2020, 10:45pm UTC](https://discuss.elastic.co/t/replacing-elasticsearch-node/255654 "2020-11-17T22:45:17Z")

</div>

Hello, I have a 3 node elasticsearch cluster running on version 7.6.2 in a container environment. Three nodes used with each container running on unique host machines. Each node in the cluster is both a master and data…

---

## [Elasticsearch heap dump phd](https://discuss.elastic.co/t/elasticsearch-heap-dump-phd/255572)

<div class="topic-metadata">

**Author:** [@perezs](https://discuss.elastic.co/u/perezs)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 8:12pm UTC](https://discuss.elastic.co/t/elasticsearch-heap-dump-phd/255572 "2020-11-17T20:12:33Z")

</div>

Does Elasticsearch have plugin's to analyze Java heap dumps phd format?

---

## [Backwards update for transform data](https://discuss.elastic.co/t/backwards-update-for-transform-data/255668)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 7:16pm UTC](https://discuss.elastic.co/t/backwards-update-for-transform-data/255668 "2020-11-17T19:16:21Z")

</div>

Hello I wonder what's the best practices , in case of a failed transform (for example if a new index was created with wrong mapping or any reason), of completing the missing data. example: created a new transform at 2…

---

## [Elastisearch daterange filter - days of week](https://discuss.elastic.co/t/elastisearch-daterange-filter-days-of-week/255750)

<div class="topic-metadata">

**Author:** [@shifra](https://discuss.elastic.co/u/shifra)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 6:51pm UTC](https://discuss.elastic.co/t/elastisearch-daterange-filter-days-of-week/255750 "2020-11-17T18:51:28Z")

</div>

Hi! This is my first time on this forum, I hope my question is clear. Please let me know if I should add any details. My goal: Implement a filter on days of week and time I'm trying to implement a filter for open hour…

---

## [Python3 Large Query Cardinality & Query return different results](https://discuss.elastic.co/t/python3-large-query-cardinality-query-return-different-results/255717)

<div class="topic-metadata">

**Author:** [@stcdarrell](https://discuss.elastic.co/u/stcdarrell)\
**Replies:** 4\
**Last updated:** [November 17, 2020, 6:45pm UTC](https://discuss.elastic.co/t/python3-large-query-cardinality-query-return-different-results/255717 "2020-11-17T18:45:44Z")

</div>

hi, i'm using python3 and the elasticsearch library to query some very large ES indexes. I've been following this blog post as a reference: I'm getting some results i dont understand, the Cardnality returns a certa…

---

## [FVH Highlighter Not Being Used By Default](https://discuss.elastic.co/t/fvh-highlighter-not-being-used-by-default/255743)

<div class="topic-metadata">

**Author:** [@jdouty](https://discuss.elastic.co/u/jdouty)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 6:12pm UTC](https://discuss.elastic.co/t/fvh-highlighter-not-being-used-by-default/255743 "2020-11-17T18:12:16Z")

</div>

Hi everyone! I've been playing around with the FVH and noticed the highlighter isn't behaving as it's described in the term vector documention. Down at the bottom of that page it shows that you can use the default high…

---

## [Setting re-index batch size in curator tool](https://discuss.elastic.co/t/setting-re-index-batch-size-in-curator-tool/255579)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 4:30pm UTC](https://discuss.elastic.co/t/setting-re-index-batch-size-in-curator-tool/255579 "2020-11-17T16:30:46Z")

</div>

When using \_reindex api in Elasticsearch, we can set scroll batch size as below From https://www.elastic.co/guide/en/elasticsearch/reference/6.8/docs-reindex.html - By default \_reindex uses scroll batches of 1000. You c…

---

## [Full Index Rebuild with 5M documents on Elastic search 7.6 takes 1 week to complete](https://discuss.elastic.co/t/full-index-rebuild-with-5m-documents-on-elastic-search-7-6-takes-1-week-to-complete/255624)

<div class="topic-metadata">

**Author:** [@nimohara](https://discuss.elastic.co/u/nimohara)\
**Replies:** 14\
**Last updated:** [November 17, 2020, 2:46pm UTC](https://discuss.elastic.co/t/full-index-rebuild-with-5m-documents-on-elastic-search-7-6-takes-1-week-to-complete/255624 "2020-11-17T14:46:50Z")

</div>

Hey There Hope all are doing well Please have a look in to the below issue and provide your valuable suggestion on this. Currently Elastic 7.6 is running on cluster with 3 nodes and it's having 5M records in it. Whil…

---

## [Field analyzer for matching concepts and names](https://discuss.elastic.co/t/field-analyzer-for-matching-concepts-and-names/254521)

<div class="topic-metadata">

**Author:** [@jporzelt](https://discuss.elastic.co/u/jporzelt)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 2:38pm UTC](https://discuss.elastic.co/t/field-analyzer-for-matching-concepts-and-names/254521 "2020-11-17T14:38:12Z")

</div>

Dear Elasticsearch community, dear Elastic team, I have a question about field analyzers that I would like to discuss here. In our index we have fields (field cities in the below example) that store known concepts or n…

---

## [Garbage collection old vs young](https://discuss.elastic.co/t/garbage-collection-old-vs-young/255361)

<div class="topic-metadata">

**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\
**Replies:** 1\
**Last updated:** [November 17, 2020, 2:07pm UTC](https://discuss.elastic.co/t/garbage-collection-old-vs-young/255361 "2020-11-17T14:07:35Z")

</div>

Hi, Question, On my nodes (7.9.3) I see the following graph's in stackmonitoring: What strikes me is the 0 for old . As far as I know, the default ratio is 2? So I would not expect 0 here, but about double of what y…

---

## [How can a replica recover from another replica but not the primary shard](https://discuss.elastic.co/t/how-can-a-replica-recover-from-another-replica-but-not-the-primary-shard/255703)

<div class="topic-metadata">

**Author:** [@chemboking](https://discuss.elastic.co/u/chemboking)\
**Replies:** 1\
**Last updated:** [November 17, 2020, 2:03pm UTC](https://discuss.elastic.co/t/how-can-a-replica-recover-from-another-replica-but-not-the-primary-shard/255703 "2020-11-17T14:03:41Z")

</div>

Here is my scenario: create one index with 0 replica; merge this index to one segment; stop all the write operations and set the num of replica to 20; The question is that the replicas can only be recovere…

---

## [Downgrade from 7.9 to 7.8](https://discuss.elastic.co/t/downgrade-from-7-9-to-7-8/255672)

<div class="topic-metadata">

**Author:** [@amralieg](https://discuss.elastic.co/u/amralieg)\
**Replies:** 2\
**Last updated:** [November 17, 2020, 1:55pm UTC](https://discuss.elastic.co/t/downgrade-from-7-9-to-7-8/255672 "2020-11-17T13:55:57Z")

</div>

Hi All, need some thoughts on this. for some reasons I need to move from v7.9.3 to v7.8. I know I can not do a snapshot and restore. but what are my other options here? I thought for reindex from the old cluster to the …

---

## [Elasticsearch stopped allocating shards due to missing kuromoji\_part\_of\_speech filter](https://discuss.elastic.co/t/elasticsearch-stopped-allocating-shards-due-to-missing-kuromoji-part-of-speech-filter/254871)

<div class="topic-metadata">

**Author:** [@phoerious](https://discuss.elastic.co/u/phoerious)\
**Replies:** 2\
**Last updated:** [November 17, 2020, 1:49pm UTC](https://discuss.elastic.co/t/elasticsearch-stopped-allocating-shards-due-to-missing-kuromoji-part-of-speech-filter/254871 "2020-11-17T13:49:28Z")

</div>

Hi, We have a web index containing Japanese documents, which are using analyzers from the analysis-icu and analysis-kuromoji plugins. Our Elasticsearch cluster is deployed via ECK and pulls the plugins inside the init c…

---

## [Elasticsearch-certutil: generate both pem certificates and PKCS#12 keystores](https://discuss.elastic.co/t/elasticsearch-certutil-generate-both-pem-certificates-and-pkcs-12-keystores/255486)

<div class="topic-metadata">

**Author:** [@flavienbwk](https://discuss.elastic.co/u/flavienbwk)\
**Replies:** 4\
**Last updated:** [November 17, 2020, 1:00pm UTC](https://discuss.elastic.co/t/elasticsearch-certutil-generate-both-pem-certificates-and-pkcs-12-keystores/255486 "2020-11-17T13:00:38Z")

</div>

Hi, I am currently using elasticsearch-certutil to generate my PEM certificates (.crt and .key) for Elasticsearch and Kibana through a certutil .yml file. However I want to setup SSL for my Enterprise Search instance b…

---

## [Ingest node pipeline error](https://discuss.elastic.co/t/ingest-node-pipeline-error/255694)

<div class="topic-metadata">

**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\
**Replies:** 1\
**Last updated:** [November 17, 2020, 12:42pm UTC](https://discuss.elastic.co/t/ingest-node-pipeline-error/255694 "2020-11-17T12:42:46Z")

</div>

I want to set up an ingest node pipeline that will add new field based on host.hostname that is all lower cased. I made something like this But I got this error that I don't understand. 2020-11-17T13:31:41.473+0100 …

---

## [Failed to install S3 repository](https://discuss.elastic.co/t/failed-to-install-s3-repository/255566)

<div class="topic-metadata">

**Author:** [@jovan](https://discuss.elastic.co/u/jovan)\
**Replies:** 9\
**Last updated:** [November 17, 2020, 12:08pm UTC](https://discuss.elastic.co/t/failed-to-install-s3-repository/255566 "2020-11-17T12:08:33Z")

</div>

Hi team, recently we upgraded our cluster to be close to latest release. We are using OSS version of stack, with current version 7.9.1: rpm -qa | grep elasticsearch-oss elasticsearch-oss-7.9.1-1.x86\_64 However, we …

---

## [Per user data retention](https://discuss.elastic.co/t/per-user-data-retention/255552)

<div class="topic-metadata">

**Author:** [@10aRK](https://discuss.elastic.co/u/10aRK)\
**Replies:** 4\
**Last updated:** [November 17, 2020, 11:25am UTC](https://discuss.elastic.co/t/per-user-data-retention/255552 "2020-11-17T11:25:45Z")

</div>

Hi I've been looking into how best to model data whilst accounting for customisable data retention periods at a user / document level vs the whole index. ILM seems perfect when reasoning about the whole index, old vers…

---

## [Elastic ILM is not rolling](https://discuss.elastic.co/t/elastic-ilm-is-not-rolling/254527)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 2\
**Last updated:** [November 17, 2020, 10:39am UTC](https://discuss.elastic.co/t/elastic-ilm-is-not-rolling/254527 "2020-11-17T10:39:02Z")

</div>

Hello, I have configured my ILM to rollover when the indice size be 20GB or after passing 30 days in the hot node as it's mentioned in this pic : but my indice passed 20GB and still didn't pass to the cold node: a…

---

## [We can't find products matching the selection](https://discuss.elastic.co/t/we-cant-find-products-matching-the-selection/255653)

<div class="topic-metadata">

**Author:** [@AndrewsG](https://discuss.elastic.co/u/AndrewsG)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 10:34am UTC](https://discuss.elastic.co/t/we-cant-find-products-matching-the-selection/255653 "2020-11-17T10:34:34Z")

</div>

Hi, I have installed Elasticsearch onto a Magento 2.4 site. I keep receiving the error "We can't find products matching the selection" after a period of time of the Elasticsearch working. Please can anyone advise?

---

## [Elasticsearch cannot find a non-existing file](https://discuss.elastic.co/t/elasticsearch-cannot-find-a-non-existing-file/255636)

<div class="topic-metadata">

**Author:** [@vaclav1](https://discuss.elastic.co/u/vaclav1)\
**Replies:** 5\
**Last updated:** [November 17, 2020, 9:54am UTC](https://discuss.elastic.co/t/elasticsearch-cannot-find-a-non-existing-file/255636 "2020-11-17T09:54:43Z")

</div>

Hello, after enabling and configuring ES to use s3 repository plugin when we restart each node we got a following error right after restarting nodes and only. When I enter the directory the file is missing. Els process …

---

## [How to stop Ml Daily Maintenance Service in elasticsearch (SLM retention snapshot cleanup task)](https://discuss.elastic.co/t/how-to-stop-ml-daily-maintenance-service-in-elasticsearch-slm-retention-snapshot-cleanup-task/255623)

<div class="topic-metadata">

**Author:** [@sakthiskv](https://discuss.elastic.co/u/sakthiskv)\
**Replies:** 8\
**Last updated:** [November 17, 2020, 9:47am UTC](https://discuss.elastic.co/t/how-to-stop-ml-daily-maintenance-service-in-elasticsearch-slm-retention-snapshot-cleanup-task/255623 "2020-11-17T09:47:26Z")

</div>

Hai , How to turn off or disable automatic deletion (ML daily maintenance task) in ES ?. everyday its happening , anyone plz help on this. \[2020-08-19T01:30:00,036\]\[INFO \]\[o.e.x.s.SnapshotRetentionTask\] \[\] starting …

---

## [Elasticsearch and dynamic mappings](https://discuss.elastic.co/t/elasticsearch-and-dynamic-mappings/255643)

<div class="topic-metadata">

**Author:** [@BBQigniter](https://discuss.elastic.co/u/BBQigniter)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 9:04am UTC](https://discuss.elastic.co/t/elasticsearch-and-dynamic-mappings/255643 "2020-11-17T09:04:30Z")

</div>

I have two questions about dynamic mappings. I have set up a component template which looks like this: PUT \_component\_template/syslog-mappings-dynamic { "version": 1, "template": { "mappings": { "\_source"…

---

## [Elasticsearch cluster across different Geo Datacenters](https://discuss.elastic.co/t/elasticsearch-cluster-across-different-geo-datacenters/255639)

<div class="topic-metadata">

**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\
**Replies:** 1\
**Last updated:** [November 17, 2020, 8:44am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-across-different-geo-datacenters/255639 "2020-11-17T08:44:40Z")

</div>

We are in the process of setting up Elasticsearch as a Search Engine to consume customer data. The Elasticsearch nodes are across 5 VMs in 2 different Datacenters (3:2), and all of them are Master-Data and active nodes. …

---

## [Detecting deletes](https://discuss.elastic.co/t/detecting-deletes/255570)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 7:29am UTC](https://discuss.elastic.co/t/detecting-deletes/255570 "2020-11-17T07:29:21Z")

</div>

Hello, I was hoping to find a way to detect deletion of documents in our Elasticsearch audit logs. But I cannot find any reference or event related to me testing deletion of docs with for example: DELETE av-002-2020.10…

---

## [Averaging dense\_vectors within ES](https://discuss.elastic.co/t/averaging-dense-vectors-within-es/255637)

<div class="topic-metadata">

**Author:** [@fpug](https://discuss.elastic.co/u/fpug)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 8:27am UTC](https://discuss.elastic.co/t/averaging-dense-vectors-within-es/255637 "2020-11-17T08:27:20Z")

</div>

Hi! I'm designing a clustering algorithm, which leverages ES as a backend to retrieve close matches, using the recently introduced dense\_vector type and the cosineSimilarity function. So far so good, aside from the fac…

---

## [How to reindex data from cluster to another](https://discuss.elastic.co/t/how-to-reindex-data-from-cluster-to-another/255634)

<div class="topic-metadata">

**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 8:07am UTC](https://discuss.elastic.co/t/how-to-reindex-data-from-cluster-to-another/255634 "2020-11-17T08:07:12Z")

</div>

Hi Team, Greetings..! Hope you are safe and good in health. I want to reindex data of index 'A', from cluster 'X' to cluster 'Y'. I have whitelisted the 'X' cluster host in cluster 'Y' using reindex.remote.whitelist: i…

---

## [Terms aggregation doesn't return all hits](https://discuss.elastic.co/t/terms-aggregation-doesnt-return-all-hits/255353)

<div class="topic-metadata">

**Author:** [@Zining](https://discuss.elastic.co/u/Zining)\
**Replies:** 9\
**Last updated:** [November 17, 2020, 8:04am UTC](https://discuss.elastic.co/t/terms-aggregation-doesnt-return-all-hits/255353 "2020-11-17T08:04:39Z")

</div>

Hi, We are using Elasticsearch 5.6 to store track events. Recently we run Terms aggregation on one index to find out duplicated events which have same event type, device id, and event time. Then we remove the duplicated…

---

## [Hot CPUs on data nodes: action.ActionListener$1.onResponse is called recurisvely](https://discuss.elastic.co/t/hot-cpus-on-data-nodes-action-actionlistener-1-onresponse-is-called-recurisvely/255625)

<div class="topic-metadata">

**Author:** [@larryzhu](https://discuss.elastic.co/u/larryzhu)\
**Replies:** 3\
**Last updated:** [November 17, 2020, 8:03am UTC](https://discuss.elastic.co/t/hot-cpus-on-data-nodes-action-actionlistener-1-onresponse-is-called-recurisvely/255625 "2020-11-17T08:03:50Z")

</div>

we are seeing high CPUs on data nodes and the hot thread stacks suggest action.ActionListener$1.onResponse is called recursively. we are using "elastic" user and it should have access to all the indices. Is there any wa…

---

## [Unable to see elasticsearch.log file](https://discuss.elastic.co/t/unable-to-see-elasticsearch-log-file/255632)

<div class="topic-metadata">

**Author:** [@praveencdcx](https://discuss.elastic.co/u/praveencdcx)\
**Replies:** 0\
**Last updated:** [November 17, 2020, 7:51am UTC](https://discuss.elastic.co/t/unable-to-see-elasticsearch-log-file/255632 "2020-11-17T07:51:50Z")

</div>

After elasticsearch configuration i have restarted the service and service is up, but when i tried to see elasticsearch log i found below. wondering how log file is missing. Can some one help me on this. sudo tail -30f /…

---

## [Azure OpenID Login doesn't work](https://discuss.elastic.co/t/azure-openid-login-doesnt-work/255593)

<div class="topic-metadata">

**Author:** [@thetell75](https://discuss.elastic.co/u/thetell75)\
**Replies:** 6\
**Last updated:** [November 17, 2020, 7:14am UTC](https://discuss.elastic.co/t/azure-openid-login-doesnt-work/255593 "2020-11-17T07:14:29Z")

</div>

Hi everyone..... Unfortunately my azure openid configuration seems not to work. I've verified the openid Authentication with OpenID Connect Playground and everything seems to be ok. Also if I set only Realm check in R…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=761)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=763)
