# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=838

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 839

---

## [Watching a Rollup indice?](https://discuss.elastic.co/t/watching-a-rollup-indice/244528)

<div class="topic-metadata">

**Author:** [@nesnoos](https://discuss.elastic.co/u/nesnoos)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 9:15pm UTC](https://discuss.elastic.co/t/watching-a-rollup-indice/244528 "2020-08-11T21:15:04Z")

</div>

Hello everybody, Is it possible to watch a rollup indice ? I try to do this , but it doesn't seem to work. Is there a workaround ? thks

---

## [How do I write logstash pipelines in elastic cloud?](https://discuss.elastic.co/t/how-do-i-write-logstash-pipelines-in-elastic-cloud/244612)

<div class="topic-metadata">

**Author:** [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Replies:** 2\
**Last updated:** [August 11, 2020, 7:34pm UTC](https://discuss.elastic.co/t/how-do-i-write-logstash-pipelines-in-elastic-cloud/244612 "2020-08-11T19:34:48Z")

</div>

I want to upload csv and json files to ES within ES Cloud version. I want to use logstash to do the data movement. How do I upload the csv and json files on EC to make the configuration work within logstash UI available. …

---

## [Is there some tools to visualize / debug the "explain" part of a DSL query result?](https://discuss.elastic.co/t/is-there-some-tools-to-visualize-debug-the-explain-part-of-a-dsl-query-result/244624)

<div class="topic-metadata">

**Author:** [@ClubberLang](https://discuss.elastic.co/u/ClubberLang)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 7:29pm UTC](https://discuss.elastic.co/t/is-there-some-tools-to-visualize-debug-the-explain-part-of-a-dsl-query-result/244624 "2020-08-11T19:29:28Z")

</div>

Hi, I have several DSL queries, I try to optimize/profile the scores... for now I use the "explain" option. The problem is that the JSON is so long that it is unreadable and very difficult to understand. Ideally, a ki…

---

## [Return specific fields in \_source when searching in multiple indicies](https://discuss.elastic.co/t/return-specific-fields-in-source-when-searching-in-multiple-indicies/244619)

<div class="topic-metadata">

**Author:** [@claudiug](https://discuss.elastic.co/u/claudiug)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 6:37pm UTC](https://discuss.elastic.co/t/return-specific-fields-in-source-when-searching-in-multiple-indicies/244619 "2020-08-11T18:37:55Z")

</div>

Hello all, I have 2 indicies, xxx , and yyy xxx has documents with: {id, content, name} yyy has document with {id, content, name, starred } i would like that my query should return only: name,content, and st…

---

## [Kibana and Elasticsearch Node configuration not working after moving data directory](https://discuss.elastic.co/t/kibana-and-elasticsearch-node-configuration-not-working-after-moving-data-directory/244467)

<div class="topic-metadata">

**Author:** [@userR](https://discuss.elastic.co/u/userR)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 5:58pm UTC](https://discuss.elastic.co/t/kibana-and-elasticsearch-node-configuration-not-working-after-moving-data-directory/244467 "2020-08-11T17:58:49Z")

</div>

I have two elasticsearch nodes and for one of them, I moved the the /var/lib/elasticsearch folder to a mount with more storage. I chown'd an elasticsearch user and changed the path.data in the elasticsearch.yml file and …

---

## [Monitoring Cluster - monitoring using metricbeat or xpack self default monitoring?](https://discuss.elastic.co/t/monitoring-cluster-monitoring-using-metricbeat-or-xpack-self-default-monitoring/244011)

<div class="topic-metadata">

**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 5:31pm UTC](https://discuss.elastic.co/t/monitoring-cluster-monitoring-using-metricbeat-or-xpack-self-default-monitoring/244011 "2020-08-11T17:31:32Z")

</div>

What are the pro and cons of monitoring using metricbeat vs default elasticseaech http export? I have a separate monitoring cluster? Why switch to metricbeat if default self xpack monitoring can also do the same job?

---

## [Update by query adds "ctx" in source of all the matching document](https://discuss.elastic.co/t/update-by-query-adds-ctx-in-source-of-all-the-matching-document/244570)

<div class="topic-metadata">

**Author:** [@ahmadimt07](https://discuss.elastic.co/u/ahmadimt07)\
**Replies:** 7\
**Last updated:** [August 11, 2020, 5:13pm UTC](https://discuss.elastic.co/t/update-by-query-adds-ctx-in-source-of-all-the-matching-document/244570 "2020-08-11T17:13:14Z")

</div>

We are using update\_by\_query to add/modify some of the fields in our documents. The update is working fine. However, it is adding an additional field "ctx" in each of the document: Here is the query I am using : POST …

---

## [Query to divide aggregation result by a parent value](https://discuss.elastic.co/t/query-to-divide-aggregation-result-by-a-parent-value/244552)

<div class="topic-metadata">

**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 4:14pm UTC](https://discuss.elastic.co/t/query-to-divide-aggregation-result-by-a-parent-value/244552 "2020-08-11T16:14:20Z")

</div>

Say I have a series of documents with an event type and a user\_id. Is there an Elasticsearch pipeline aggregation that allows me to divide the count of events by the unique total users (not total users per event)? I kn…

---

## [Rollover Fails of max\_size condition](https://discuss.elastic.co/t/rollover-fails-of-max-size-condition/244125)

<div class="topic-metadata">

**Author:** [@sai\_kiran1](https://discuss.elastic.co/u/sai_kiran1)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 2:56pm UTC](https://discuss.elastic.co/t/rollover-fails-of-max-size-condition/244125 "2020-08-11T14:56:48Z")

</div>

Greetings I Am trying to create a ilm policy that rolls over my index on size condition My ilm policy looks like : { "testing\_ilm\_dataloss" : { "version" : 7, "modified\_date" : "2020-08-06T14:25:09.434Z", "policy" : {…

---

## [Elastic Query](https://discuss.elastic.co/t/elastic-query/244572)

<div class="topic-metadata">

**Author:** [@thejaswani](https://discuss.elastic.co/u/thejaswani)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 2:39pm UTC](https://discuss.elastic.co/t/elastic-query/244572 "2020-08-11T14:39:39Z")

</div>

we are using elastic 5.6.2. In this version, how we do the term aggregation for nested objetcs with limit and offset? Please advice.. We have tried this query { "index": "sample\_mastercollection", "type": "collectio…

---

## [Reduced precision on date fields when used in field\_value\_factor score](https://discuss.elastic.co/t/reduced-precision-on-date-fields-when-used-in-field-value-factor-score/244497)

<div class="topic-metadata">

**Author:** [@zoellner](https://discuss.elastic.co/u/zoellner)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 6:51am UTC](https://discuss.elastic.co/t/reduced-precision-on-date-fields-when-used-in-field-value-factor-score/244497 "2020-08-11T06:51:03Z")

</div>

I am trying to do a custom scoring using a date field. I need the score to take the date into account with millisecond precision. However, when I run the code below, I get a result where the score for both 2020-01-01T00:…

---

## [Received ban for the parent , reason: \[by user request\]](https://discuss.elastic.co/t/received-ban-for-the-parent-reason-by-user-request/244566)

<div class="topic-metadata">

**Author:** [@Anis](https://discuss.elastic.co/u/Anis)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 1:50pm UTC](https://discuss.elastic.co/t/received-ban-for-the-parent-reason-by-user-request/244566 "2020-08-11T13:50:01Z")

</div>

I am experiencing the follwoig BUG/WARN when sporadically our searches appear to not be returning when these messages are seen. They all seem to begin with the "Received ban for the parent" message. Other times the same…

---

## [Imports cannot resolved to a type](https://discuss.elastic.co/t/imports-cannot-resolved-to-a-type/244551)

<div class="topic-metadata">

**Author:** [@mun-inder-jeet-singh](https://discuss.elastic.co/u/mun-inder-jeet-singh)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 12:52pm UTC](https://discuss.elastic.co/t/imports-cannot-resolved-to-a-type/244551 "2020-08-11T12:52:14Z")

</div>

Hi All I have cloned the repo from github and imported into eclipse. There are imports error for groovy classes only which i need to resolve. Kindly guide . P.S. All the necessary files which needs to be imported is…

---

## [Query Performance in ES](https://discuss.elastic.co/t/query-performance-in-es/244342)

<div class="topic-metadata">

**Author:** [@randidwiputra](https://discuss.elastic.co/u/randidwiputra)\
**Replies:** 5\
**Last updated:** [August 11, 2020, 12:24pm UTC](https://discuss.elastic.co/t/query-performance-in-es/244342 "2020-08-11T12:24:25Z")

</div>

Hi All, I need suggestions if we have data 6TB with 10 datanode ES, how about query performance in Elasticsearch. Can the query be successful in 2 seconds? Every nodes are 8 core, 64GB RAM, 6TB SSD. Thanks All

---

## [How to use ingest pipeline with logstash elaticsearch output update feature](https://discuss.elastic.co/t/how-to-use-ingest-pipeline-with-logstash-elaticsearch-output-update-feature/244314)

<div class="topic-metadata">

**Author:** [@nuwancs](https://discuss.elastic.co/u/nuwancs)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 12:19pm UTC](https://discuss.elastic.co/t/how-to-use-ingest-pipeline-with-logstash-elaticsearch-output-update-feature/244314 "2020-08-11T12:19:33Z")

</div>

I am using Logstash Elasticsearch output to publish data to Elasticsearch. Two records are merged to create a single record from a request and a response. This code is working with no issues. elasticsearch { hosts =\> …

---

## [Multi node fail](https://discuss.elastic.co/t/multi-node-fail/244244)

<div class="topic-metadata">

**Author:** [@cadirol](https://discuss.elastic.co/u/cadirol)\
**Replies:** 15\
**Last updated:** [August 11, 2020, 11:47am UTC](https://discuss.elastic.co/t/multi-node-fail/244244 "2020-08-11T11:47:35Z")

</div>

Hi All For operational continuity in an multinode cluster i have two questions in my head: the cluster contains, 14 nodes, 7 nodes on site A, 7 nodes on site B, ES Version 6.4 What if a) one site goes down unexpected …

---

## [Elasticsearch SSL Certificate Invalid](https://discuss.elastic.co/t/elasticsearch-ssl-certificate-invalid/244538)

<div class="topic-metadata">

**Author:** [@saravananselvamohan](https://discuss.elastic.co/u/saravananselvamohan)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 11:32am UTC](https://discuss.elastic.co/t/elasticsearch-ssl-certificate-invalid/244538 "2020-08-11T11:32:45Z")

</div>

Software: Elastics v5.5.0 Hardware: Ubuntu 20 I am trying to set up SSL/TLS on the cluster. Steps I followed: bin/x-pack/certgen Please enter the desired output file \[/home/es/config/x-pack/csr-bundle.zip\]:…

---

## [Load Balancing Elasticsearch Hot Nodes](https://discuss.elastic.co/t/load-balancing-elasticsearch-hot-nodes/244531)

<div class="topic-metadata">

**Author:** [@jijo.john](https://discuss.elastic.co/u/jijo.john)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 10:23am UTC](https://discuss.elastic.co/t/load-balancing-elasticsearch-hot-nodes/244531 "2020-08-11T10:23:13Z")

</div>

Hi All, We have a query for elasticsearch node redundancy. Can we use a AWS NLB/ALB to load balance the Hot Nodes so that in the Node failure data will still be pushed to another active hot node under the load balancer …

---

## [Cannot allocate because allocation is not permitted to any of the nodes](https://discuss.elastic.co/t/cannot-allocate-because-allocation-is-not-permitted-to-any-of-the-nodes/244530)

<div class="topic-metadata">

**Author:** [@Dipesh](https://discuss.elastic.co/u/Dipesh)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 10:16am UTC](https://discuss.elastic.co/t/cannot-allocate-because-allocation-is-not-permitted-to-any-of-the-nodes/244530 "2020-08-11T10:16:53Z")

</div>

Hi , we are facing issue on elasticsearch, when we are adding replica 1 and shrads 1 on templates then iml policy is not working properly. indices are not moving from warm to cold phase and delete phase. { "index" …

---

## [Query on Source only snapshot](https://discuss.elastic.co/t/query-on-source-only-snapshot/242919)

<div class="topic-metadata">

**Author:** [@jijo.john](https://discuss.elastic.co/u/jijo.john)\
**Replies:** 11\
**Last updated:** [August 11, 2020, 10:10am UTC](https://discuss.elastic.co/t/query-on-source-only-snapshot/242919 "2020-08-11T10:10:33Z")

</div>

Hello Team, I am currently testing snapshot and restore process in elasticsearch. After restoring a source only snapshot from s3 , it is not showing any doc counts and storage size. do we need to do any thing here to st…

---

## [Is it able to get rank (order number) of \_score in Elasticsearch script score?](https://discuss.elastic.co/t/is-it-able-to-get-rank-order-number-of-score-in-elasticsearch-script-score/244527)

<div class="topic-metadata">

**Author:** [@taichi](https://discuss.elastic.co/u/taichi)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 9:51am UTC](https://discuss.elastic.co/t/is-it-able-to-get-rank-order-number-of-score-in-elasticsearch-script-score/244527 "2020-08-11T09:51:44Z")

</div>

I would like to use \_score in script score, calculating its rank in entire hits. For example, if there are these 3 hit documents; { "\_id": 1, "\_score": 0.7 } { "\_id": 2, "\_score": 0.5 } { "\_id": 3, "\_score": 1.0 } I w…

---

## [Paging and sorting results after a term aggregation by doc fields](https://discuss.elastic.co/t/paging-and-sorting-results-after-a-term-aggregation-by-doc-fields/244526)

<div class="topic-metadata">

**Author:** [@Walter\_Chicca](https://discuss.elastic.co/u/Walter_Chicca)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 9:50am UTC](https://discuss.elastic.co/t/paging-and-sorting-results-after-a-term-aggregation-by-doc-fields/244526 "2020-08-11T09:50:38Z")

</div>

Hi everyone, what i'm trying to do is sorting the results from a term aggregation using the fields in the starting document, the final goal is to be able sorting and paging a datatable server side because there're too m…

---

## [Hot - Warm Architecture with 3 Node Cluster](https://discuss.elastic.co/t/hot-warm-architecture-with-3-node-cluster/244496)

<div class="topic-metadata">

**Author:** [@rakesh15](https://discuss.elastic.co/u/rakesh15)\
**Replies:** 6\
**Last updated:** [August 11, 2020, 8:48am UTC](https://discuss.elastic.co/t/hot-warm-architecture-with-3-node-cluster/244496 "2020-08-11T08:48:37Z")

</div>

Hi Team, I'm trying to create the 3 Node Elasticsearch Cluster to store the time series logging data. The shards will have only 1 replication count to minimize the storage utilization. Need help to understand the below…

---

## [Unable to install offline plugin analysis-icu-7.3.1.zip - error - NoSuchFileException](https://discuss.elastic.co/t/unable-to-install-offline-plugin-analysis-icu-7-3-1-zip-error-nosuchfileexception/244348)

<div class="topic-metadata">

**Author:** [@WaseemSiddiqui](https://discuss.elastic.co/u/WaseemSiddiqui)\
**Replies:** 2\
**Last updated:** [August 11, 2020, 8:08am UTC](https://discuss.elastic.co/t/unable-to-install-offline-plugin-analysis-icu-7-3-1-zip-error-nosuchfileexception/244348 "2020-08-11T08:08:56Z")

</div>

On Elastic Search 7.3.1 version I am installing Plugin - analysis-icu-7.3.1.zip in offline mode. while passing the command: elasticsearch-plugin.bat install file:///mypath/analysis-icu-7.3.1.zip Unfortunately I am ge…

---

## [Request Rate changes at a specific hour](https://discuss.elastic.co/t/request-rate-changes-at-a-specific-hour/244291)

<div class="topic-metadata">

**Author:** [@Burga](https://discuss.elastic.co/u/Burga)\
**Replies:** 5\
**Last updated:** [August 11, 2020, 8:05am UTC](https://discuss.elastic.co/t/request-rate-changes-at-a-specific-hour/244291 "2020-08-11T08:05:23Z")

</div>

Hi i'm handling request rate degradation and I noticed that some of my nodes behaving strange , exactly at 03:04 every night request rate Either drops from 900 to 200 or climb up from 200 to 900 I'm not sure this is …

---

## [Delete\_by\_query performance optimization](https://discuss.elastic.co/t/delete-by-query-performance-optimization/244437)

<div class="topic-metadata">

**Author:** [@nickgregz](https://discuss.elastic.co/u/nickgregz)\
**Replies:** 4\
**Last updated:** [August 11, 2020, 7:48am UTC](https://discuss.elastic.co/t/delete-by-query-performance-optimization/244437 "2020-08-11T07:48:03Z")

</div>

Hello, Multiple topics mention time-based indices as a go to method for clearing old (index) data but in cases where that is not possible the alternative is delete\_by\_query which poses a performance impact if we are wor…

---

## [Elasticsearch 7.6 is underperforming 6.8](https://discuss.elastic.co/t/elasticsearch-7-6-is-underperforming-6-8/244211)

<div class="topic-metadata">

**Author:** [@danksim](https://discuss.elastic.co/u/danksim)\
**Replies:** 17\
**Last updated:** [August 11, 2020, 7:18am UTC](https://discuss.elastic.co/t/elasticsearch-7-6-is-underperforming-6-8/244211 "2020-08-11T07:18:32Z")

</div>

Hello, I upgraded Elastic Stack from 6.8.2 to 7.6.2 (currently both clusters are running on EKS with kubernetes nodes on AWS m5.4xlarge machines 16CPUs 64GB - these are NOT SSDs) and I am experiencing degraded performan…

---

## [Is it possible to have an alias that points two multiple indexes with duplicate IDs with preference ordering?](https://discuss.elastic.co/t/is-it-possible-to-have-an-alias-that-points-two-multiple-indexes-with-duplicate-ids-with-preference-ordering/244480)

<div class="topic-metadata">

**Author:** [@jacobm](https://discuss.elastic.co/u/jacobm)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 7:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-have-an-alias-that-points-two-multiple-indexes-with-duplicate-ids-with-preference-ordering/244480 "2020-08-11T07:06:52Z")

</div>

My situation is: I have a big index (let's call it old) that allows search on documents that I derive from information in a relational database. I need to change the index mapping and add data to every document, and the …

---

## ["cluster\_concurrent\_rebalance" : "40" was ignored](https://discuss.elastic.co/t/cluster-concurrent-rebalance-40-was-ignored/243556)

<div class="topic-metadata">

**Author:** [@mannoj87](https://discuss.elastic.co/u/mannoj87)\
**Replies:** 18\
**Last updated:** [August 11, 2020, 6:17am UTC](https://discuss.elastic.co/t/cluster-concurrent-rebalance-40-was-ignored/243556 "2020-08-11T06:17:56Z")

</div>

"cluster\_concurrent\_rebalance" : "40" -\> We had this as the setting, when I changed cluster.routing.allocation.awareness.attributes=rack\_id After this I see relocating\_shards = 1000, and it was relocating almost all th…

---

## [What can cause heap size to fluctuate wildly (hacksaw graphs) on a new 7.8.0 cluster?](https://discuss.elastic.co/t/what-can-cause-heap-size-to-fluctuate-wildly-hacksaw-graphs-on-a-new-7-8-0-cluster/244120)

<div class="topic-metadata">

**Author:** [@Jacket](https://discuss.elastic.co/u/Jacket)\
**Replies:** 5\
**Last updated:** [August 11, 2020, 6:04am UTC](https://discuss.elastic.co/t/what-can-cause-heap-size-to-fluctuate-wildly-hacksaw-graphs-on-a-new-7-8-0-cluster/244120 "2020-08-11T06:04:52Z")

</div>

Hi there, I've recently migrated a medium sized cluster (15TB, 25B documents) from 6.8 to 7.8.0 and noticed the heap constantly fluctuates between \<1GB and the maximum set size (22GB). However the cluster is working per…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=837)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=839)
