# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=813

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 814

---

## [Pushing index templates fails on 7.9 with Java transport client](https://discuss.elastic.co/t/pushing-index-templates-fails-on-7-9-with-java-transport-client/248151)

<div class="topic-metadata">

**Author:** [@amugofjava](https://discuss.elastic.co/u/amugofjava)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 11:01am UTC](https://discuss.elastic.co/t/pushing-index-templates-fails-on-7-9-with-java-transport-client/248151 "2020-09-10T11:01:20Z")

</div>

I am in the progress of migrating from 6.8 to 7.9. I have updated my index templates to work with the 7.9 format and if I submit the template via REST it installs fine; however, if I use the PutIndexTemplateRequest with …

---

## [Elastic Cluster Good Configuration for better performance](https://discuss.elastic.co/t/elastic-cluster-good-configuration-for-better-performance/248144)

<div class="topic-metadata">

**Author:** [@Naveena1](https://discuss.elastic.co/u/Naveena1)\
**Replies:** 1\
**Last updated:** [September 10, 2020, 10:46am UTC](https://discuss.elastic.co/t/elastic-cluster-good-configuration-for-better-performance/248144 "2020-09-10T10:46:12Z")

</div>

Hi Team, Please help me with good configuration for the cluster to improve the performance. My requirement was :- we are using Cluster 7.9.1 We have an employee table which has around 30 columns and total records i…

---

## [Create Offline Index using File](https://discuss.elastic.co/t/create-offline-index-using-file/248145)

<div class="topic-metadata">

**Author:** [@Naveena1](https://discuss.elastic.co/u/Naveena1)\
**Replies:** 1\
**Last updated:** [September 10, 2020, 10:44am UTC](https://discuss.elastic.co/t/create-offline-index-using-file/248145 "2020-09-10T10:44:07Z")

</div>

Hi , Is it possible to create offline index ?. Can we create index using a file which has data in it.

---

## [Is it normal for cluster to turn "Yellow" daily briefly during heavy indexing to existing index?](https://discuss.elastic.co/t/is-it-normal-for-cluster-to-turn-yellow-daily-briefly-during-heavy-indexing-to-existing-index/248098)

<div class="topic-metadata">

**Author:** [@vorapoap](https://discuss.elastic.co/u/vorapoap)\
**Replies:** 3\
**Last updated:** [September 10, 2020, 9:59am UTC](https://discuss.elastic.co/t/is-it-normal-for-cluster-to-turn-yellow-daily-briefly-during-heavy-indexing-to-existing-index/248098 "2020-09-10T09:59:19Z")

</div>

Cluster configuration: 3 Dedicated Master Node 15 Data nodes 0-all Replica (meaning the replica on every data node) The index is pre created.

---

## [Restricting search on index](https://discuss.elastic.co/t/restricting-search-on-index/248141)

<div class="topic-metadata">

**Author:** [@Stephy\_Jacob](https://discuss.elastic.co/u/Stephy_Jacob)\
**Replies:** 1\
**Last updated:** [September 10, 2020, 9:56am UTC](https://discuss.elastic.co/t/restricting-search-on-index/248141 "2020-09-10T09:56:48Z")

</div>

Hi Team, We are using Standard Elastic cloud license to host our data with ES version 6.8. We are planning upgrade the ES version to 7.x soon. We have an upcoming requirement to ingest a new set of data that should no…

---

## [\[Elastic Cloud/ Elasticsearch service\] Latest change to Elasticsearch configuration failed](https://discuss.elastic.co/t/elastic-cloud-elasticsearch-service-latest-change-to-elasticsearch-configuration-failed/247781)

<div class="topic-metadata">

**Author:** [@Apollyon](https://discuss.elastic.co/u/Apollyon)\
**Replies:** 2\
**Last updated:** [September 10, 2020, 9:55am UTC](https://discuss.elastic.co/t/elastic-cloud-elasticsearch-service-latest-change-to-elasticsearch-configuration-failed/247781 "2020-09-10T09:55:13Z")

</div>

Hello, ELK 7.9.1 After a long weekend ... Have noticed something on our current deployment on Elastic Cloud/ Elasticsearch service. The below health warning as been issued and I am a little confused as to yet at the mo…

---

## [Unable to delete the Elasticsearch pods](https://discuss.elastic.co/t/unable-to-delete-the-elasticsearch-pods/248139)

<div class="topic-metadata">

**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 9:04am UTC](https://discuss.elastic.co/t/unable-to-delete-the-elasticsearch-pods/248139 "2020-09-10T09:04:25Z")

</div>

we are deleting the elasticsearch cluster (deleting elasticsearch\_cr and operator files by using kubectl commad). When I am doing 'kubectl get elasticsearch' not able to see anything .But pods(elastic operator, master, d…

---

## [Failed to execute \`flush synced\`](https://discuss.elastic.co/t/failed-to-execute-flush-synced/248138)

<div class="topic-metadata">

**Author:** [@vincentduan](https://discuss.elastic.co/u/vincentduan)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 9:00am UTC](https://discuss.elastic.co/t/failed-to-execute-flush-synced/248138 "2020-09-10T09:00:48Z")

</div>

Elasticsearch version 6.2.3 I execute curl -XPOST ''http://192.168.2.201:9203/myindex/\_flush/synced" . The result shows as follows: { "\_shards":{ "total": 10, "successful": 6, "failed": 4 }, "myindex" : { …

---

## [Auto-delete zipkin indices](https://discuss.elastic.co/t/auto-delete-zipkin-indices/247545)

<div class="topic-metadata">

**Author:** [@ajoshi83](https://discuss.elastic.co/u/ajoshi83)\
**Replies:** 6\
**Last updated:** [September 10, 2020, 9:00am UTC](https://discuss.elastic.co/t/auto-delete-zipkin-indices/247545 "2020-09-10T09:00:37Z")

</div>

Hi. I am using Elastic Search 7.3.1 as a storage engine for OpenZipkin. Zipkin creates a span index daily in the format "zipkin-span-YYYY-MM-dd". How I can automate the deletion of the Zipkin indices when its old than …

---

## [Very large delete\_by\_query - supported?](https://discuss.elastic.co/t/very-large-delete-by-query-supported/247891)

<div class="topic-metadata">

**Author:** [@aidofitz](https://discuss.elastic.co/u/aidofitz)\
**Replies:** 5\
**Last updated:** [September 10, 2020, 8:42am UTC](https://discuss.elastic.co/t/very-large-delete-by-query-supported/247891 "2020-09-10T08:42:25Z")

</div>

Hi, I'm trying to run a very large \_delete\_by\_query, targeting ~1.5 billion documents in an index, amounting to 100's of GB of data. This is from a single index and in the context of a overall ES cluster side of ~80Tb. …

---

## [Data Import not Analysing all Lines Present in Document](https://discuss.elastic.co/t/data-import-not-analysing-all-lines-present-in-document/248127)

<div class="topic-metadata">

**Author:** [@Broggy-Git](https://discuss.elastic.co/u/Broggy-Git)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 7:54am UTC](https://discuss.elastic.co/t/data-import-not-analysing-all-lines-present-in-document/248127 "2020-09-10T07:54:01Z")

</div>

Recently I have tried to import a json file to test the visualization feature. In Visual Studio, I see that the file reaches 954 lines in length. I have noticed, however, that when imported the lines of text at the end …

---

## [Identifying corrupt indices](https://discuss.elastic.co/t/identifying-corrupt-indices/248123)

<div class="topic-metadata">

**Author:** [@Nkrb](https://discuss.elastic.co/u/Nkrb)\
**Replies:** 1\
**Last updated:** [September 10, 2020, 7:51am UTC](https://discuss.elastic.co/t/identifying-corrupt-indices/248123 "2020-09-10T07:51:34Z")

</div>

Hi All, We have a single node elasticsearch having good amount of storage. It has been working fine since last one year and suddenly stopped working, seems due to data corruption. I can see few indices, for which state…

---

## [ES shards data rebalancing](https://discuss.elastic.co/t/es-shards-data-rebalancing/248001)

<div class="topic-metadata">

**Author:** [@gintek](https://discuss.elastic.co/u/gintek)\
**Replies:** 2\
**Last updated:** [September 10, 2020, 7:07am UTC](https://discuss.elastic.co/t/es-shards-data-rebalancing/248001 "2020-09-10T07:07:25Z")

</div>

Hello, I'm wondering how are you guys doing with data rebalancing on large clusters ? We have 3 masters, 3 hot nodes and 6 cold. Some cold nodes have 4T disk and few 2T. ES is rebalancing shards based on number shards p…

---

## [Plugin - How to intercept a shard query phase and reject?](https://discuss.elastic.co/t/plugin-how-to-intercept-a-shard-query-phase-and-reject/248108)

<div class="topic-metadata">

**Author:** [@araniera](https://discuss.elastic.co/u/araniera)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 5:32am UTC](https://discuss.elastic.co/t/plugin-how-to-intercept-a-shard-query-phase-and-reject/248108 "2020-09-10T05:32:00Z")

</div>

Hello, am toying with a plugin and am trying to add some behavior where I can intercept a query happening at the shard level. This can be done it seems through the SearchOperationListener with the onPreQueryPhase and on…

---

## [Elasticsearch Cluster in Docker](https://discuss.elastic.co/t/elasticsearch-cluster-in-docker/248105)

<div class="topic-metadata">

**Author:** [@muthucse](https://discuss.elastic.co/u/muthucse)\
**Replies:** 0\
**Last updated:** [September 10, 2020, 5:01am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-in-docker/248105 "2020-09-10T05:01:22Z")

</div>

Planning to setup a 3 node cluster in a containerized way. Is it good to have a single VM to deploy all the three nodes and Kibana or having 3 independent VM for elasticsearch nodes ? which one is the best approach ?

---

## [Can es shards allocate to nodes based on disk capacity？](https://discuss.elastic.co/t/can-es-shards-allocate-to-nodes-based-on-disk-capacity/248096)

<div class="topic-metadata">

**Author:** [@taidengpub](https://discuss.elastic.co/u/taidengpub)\
**Replies:** 2\
**Last updated:** [September 10, 2020, 3:25am UTC](https://discuss.elastic.co/t/can-es-shards-allocate-to-nodes-based-on-disk-capacity/248096 "2020-09-10T03:25:20Z")

</div>

https://www.elastic.co/guide/en/elasticsearch/reference/7.8/modules-cluster.html#cluster-shard-allocation-settings es doc said cluster.routing.allocation.disk.threshold\_enabled can control shard allocate when some node …

---

## [ElasticSearch(7.7.1) become unresponsive for sometime due to circuit breaker](https://discuss.elastic.co/t/elasticsearch-7-7-1-become-unresponsive-for-sometime-due-to-circuit-breaker/248004)

<div class="topic-metadata">

**Author:** [@het](https://discuss.elastic.co/u/het)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 11:47pm UTC](https://discuss.elastic.co/t/elasticsearch-7-7-1-become-unresponsive-for-sometime-due-to-circuit-breaker/248004 "2020-09-09T23:47:11Z")

</div>

Hi Team, I am using elasticsearch 7.7.1. I have 3 data nodes(31GB) and 3 master nodes(16GB). With a heavy load, I am getting below error and I can not see my data node on the monitoring tool for 10-15 mins, also at that…

---

## [How to lock the current allocation state](https://discuss.elastic.co/t/how-to-lock-the-current-allocation-state/248072)

<div class="topic-metadata">

**Author:** [@UDixit](https://discuss.elastic.co/u/UDixit)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 11:44pm UTC](https://discuss.elastic.co/t/how-to-lock-the-current-allocation-state/248072 "2020-09-09T23:44:18Z")

</div>

When cluster.routing.rebalance.enable is set to none, I understand that we are lokcing the current allocation state of the cluster. i.e. the currenlty allocated shards will not relocate to other nodes. But what happens …

---

## [Inaccessibility of Path.repo location cause primary shard corruption?](https://discuss.elastic.co/t/inaccessibility-of-path-repo-location-cause-primary-shard-corruption/248046)

<div class="topic-metadata">

**Author:** [@amit.karir](https://discuss.elastic.co/u/amit.karir)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 11:39pm UTC](https://discuss.elastic.co/t/inaccessibility-of-path-repo-location-cause-primary-shard-corruption/248046 "2020-09-09T23:39:45Z")

</div>

Hi, Can Inaccessibility of Path.repo location cause primary shard corruption or being unassigned?

---

## [ELK - xpack , watcher - what to use for advanced alerting and observability?](https://discuss.elastic.co/t/elk-xpack-watcher-what-to-use-for-advanced-alerting-and-observability/247946)

<div class="topic-metadata">

**Author:** [@AwesomeRoy](https://discuss.elastic.co/u/AwesomeRoy)\
**Replies:** 5\
**Last updated:** [September 9, 2020, 11:38pm UTC](https://discuss.elastic.co/t/elk-xpack-watcher-what-to-use-for-advanced-alerting-and-observability/247946 "2020-09-09T23:38:16Z")

</div>

Kibana alerting is basic . For advanced alerts in ELK stack what should I use ? Watcher plugin ? - Is this part of paid version only ? or can i install this separately within the open n source version as well ? x-pack…

---

## [Large data migration failure](https://discuss.elastic.co/t/large-data-migration-failure/246901)

<div class="topic-metadata">

**Author:** [@chen\_steven](https://discuss.elastic.co/u/chen_steven)\
**Replies:** 13\
**Last updated:** [September 9, 2020, 8:20pm UTC](https://discuss.elastic.co/t/large-data-migration-failure/246901 "2020-09-09T20:20:01Z")

</div>

Background: I need to migrate my data from 1 cloud service provider to another, and I pick the solution of add new nodes in current cluster, wait for data copy and rebalance and separate them into 2 clusters. But after…

---

## [Indexing the query reslut directly to the same elasticsearch](https://discuss.elastic.co/t/indexing-the-query-reslut-directly-to-the-same-elasticsearch/247953)

<div class="topic-metadata">

**Author:** [@Mohammadreza\_Niknam](https://discuss.elastic.co/u/Mohammadreza_Niknam)\
**Replies:** 3\
**Last updated:** [September 9, 2020, 10:49pm UTC](https://discuss.elastic.co/t/indexing-the-query-reslut-directly-to-the-same-elasticsearch/247953 "2020-09-09T22:49:56Z")

</div>

Hi all, I have only access to the Kibana (I don't have access to ES) and I was wondering whether it is possible to index the result of my query into a new index directly into the same ES? or I need to have access to ES …

---

## [Index Lifecycle Error index.lifecycle.rollover\_alias \[\< beat \>-\< version \>\] does not point to index issue](https://discuss.elastic.co/t/index-lifecycle-error-index-lifecycle-rollover-alias-beat-version-does-not-point-to-index-issue/241029)

<div class="topic-metadata">

**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\
**Replies:** 4\
**Last updated:** [September 9, 2020, 8:02pm UTC](https://discuss.elastic.co/t/index-lifecycle-error-index-lifecycle-rollover-alias-beat-version-does-not-point-to-index-issue/241029 "2020-09-09T20:02:46Z")

</div>

A while back I posted Index Lifecycle Management “does not point to index” error. I never did fully resolve my issue, and thanks to other work priorities, my dev stack I was working on died. Now, on a new stack that's a…

---

## [Trying to add an alias on Index Template using kibana Wizard](https://discuss.elastic.co/t/trying-to-add-an-alias-on-index-template-using-kibana-wizard/248037)

<div class="topic-metadata">

**Author:** [@olg32](https://discuss.elastic.co/u/olg32)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 7:32pm UTC](https://discuss.elastic.co/t/trying-to-add-an-alias-on-index-template-using-kibana-wizard/248037 "2020-09-09T19:32:22Z")

</div>

Hi, I just created an index template. Now, in order to to configure a lifecycle policy for rolling indices, I need to define an alias, so I'm using the Kibana Create template wizard to add it. I went to the "Aliases" …

---

## [Large amount of terms in Lucene query](https://discuss.elastic.co/t/large-amount-of-terms-in-lucene-query/248057)

<div class="topic-metadata">

**Author:** [@wpearson4](https://discuss.elastic.co/u/wpearson4)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:24pm UTC](https://discuss.elastic.co/t/large-amount-of-terms-in-lucene-query/248057 "2020-09-09T19:24:12Z")

</div>

Hello, I am using a Lucene query for building dynamic search queries. Let's assume a sample search will take the following format: Blockquote (Gender:"Female" AND AgeRange:\[17 TO 24\] AND Sports:"YES" AND State:"TX")…

---

## [Detecting Master\_Not\_Discovered faster](https://discuss.elastic.co/t/detecting-master-not-discovered-faster/248047)

<div class="topic-metadata">

**Author:** [@nicolaet](https://discuss.elastic.co/u/nicolaet)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 7:16pm UTC](https://discuss.elastic.co/t/detecting-master-not-discovered-faster/248047 "2020-09-09T19:16:30Z")

</div>

Hello, I have a 2 node cluster - and that means that there is a chance, that i will run into the situation where one node remains but it can't elect a master. That's OK. But what i want is to be able to detect this fas…

---

## [Elasticsearch SSL certificate error - javax.crypto.BadPaddingException: Given final block not properly padded](https://discuss.elastic.co/t/elasticsearch-ssl-certificate-error-javax-crypto-badpaddingexception-given-final-block-not-properly-padded/247783)

<div class="topic-metadata">

**Author:** [@fgomes](https://discuss.elastic.co/u/fgomes)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 5:10pm UTC](https://discuss.elastic.co/t/elasticsearch-ssl-certificate-error-javax-crypto-badpaddingexception-given-final-block-not-properly-padded/247783 "2020-09-09T17:10:10Z")

</div>

I'm trying to get user management and authentication in Kibana. For that it is required to enable the security module, and since we're running a 3 node cluster, SSL security must be enabled as well. I tried to use Docke…

---

## [Indexing weighted terms (or fake term frequency)](https://discuss.elastic.co/t/indexing-weighted-terms-or-fake-term-frequency/248034)

<div class="topic-metadata">

**Author:** [@Hannes\_Korte](https://discuss.elastic.co/u/Hannes_Korte)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 3:21pm UTC](https://discuss.elastic.co/t/indexing-weighted-terms-or-fake-term-frequency/248034 "2020-09-09T15:21:09Z")

</div>

Hi, I am looking for a way to fake the frequency of terms in a field at index time. It's kind of a boost for a specific term in a specific document. Imagine your docs are people with each having a map of weighted skill…

---

## [How to take snapshot of one elasticsearch instance and restore into another instance](https://discuss.elastic.co/t/how-to-take-snapshot-of-one-elasticsearch-instance-and-restore-into-another-instance/248030)

<div class="topic-metadata">

**Author:** [@aman97](https://discuss.elastic.co/u/aman97)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 2:48pm UTC](https://discuss.elastic.co/t/how-to-take-snapshot-of-one-elasticsearch-instance-and-restore-into-another-instance/248030 "2020-09-09T14:48:10Z")

</div>

hello, Everyone, I am trying to take a snapshot of an elasticsearch instance and restore on another elasticsearch instance for that, I followed the standard steps elastic\_01 and elastic\_02 have this folder "/elastics…

---

## [Elastic Ingestion problem](https://discuss.elastic.co/t/elastic-ingestion-problem/248022)

<div class="topic-metadata">

**Author:** [@Anthony\_Pope](https://discuss.elastic.co/u/Anthony_Pope)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 2:50pm UTC](https://discuss.elastic.co/t/elastic-ingestion-problem/248022 "2020-09-09T14:50:31Z")

</div>

Hi, I have a problem about ingestion process in elasticsearch. I use a Java program to ingest some documents in elasticsearch using HTTP node as a claster entry (I send request to an HTTP node). I have noticed that th…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=812)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=814)
