# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=830

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 831

---

## [Elastic Search Remove Elements From Nested Object](https://discuss.elastic.co/t/elastic-search-remove-elements-from-nested-object/245587)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 11:25am UTC](https://discuss.elastic.co/t/elastic-search-remove-elements-from-nested-object/245587 "2020-08-19T11:25:04Z")

</div>

I have created an index in elastic search with a nested type field. and added documents into the index. Now I want to remove some elements from nested objects who match the condition using UpdateByQuery. I have tried the…

---

## [Issue setting up Index Lifecycle policy correctly](https://discuss.elastic.co/t/issue-setting-up-index-lifecycle-policy-correctly/241469)

<div class="topic-metadata">

**Author:** [@ozonshak](https://discuss.elastic.co/u/ozonshak)\
**Replies:** 4\
**Last updated:** [August 19, 2020, 11:05am UTC](https://discuss.elastic.co/t/issue-setting-up-index-lifecycle-policy-correctly/241469 "2020-08-19T11:05:20Z")

</div>

Hello. I'm new to setting up a proper Lifecycle policy, so I'm hoping someone can please give me a hand with this. So, I have an existing index getting created on a weekly basis. This is a third party integration (the…

---

## [How to fix heap size problem against big data (CircuitBreakingException)](https://discuss.elastic.co/t/how-to-fix-heap-size-problem-against-big-data-circuitbreakingexception/245554)

<div class="topic-metadata">

**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\
**Replies:** 3\
**Last updated:** [August 19, 2020, 10:55am UTC](https://discuss.elastic.co/t/how-to-fix-heap-size-problem-against-big-data-circuitbreakingexception/245554 "2020-08-19T10:55:45Z")

</div>

Hi I have an issue with my cluster. I want to know how can I fix the heap memory against big data? Consider that I can\`t increase the size or another memory... What is the solution?

---

## [Ways to run es on arm/alpha architecture with lower es-versions](https://discuss.elastic.co/t/ways-to-run-es-on-arm-alpha-architecture-with-lower-es-versions/245561)

<div class="topic-metadata">

**Author:** [@duanyongvictory](https://discuss.elastic.co/u/duanyongvictory)\
**Replies:** 1\
**Last updated:** [August 19, 2020, 10:43am UTC](https://discuss.elastic.co/t/ways-to-run-es-on-arm-alpha-architecture-with-lower-es-versions/245561 "2020-08-19T10:43:30Z")

</div>

Hi all: Does anyone know how to run es on arm/alpha architecture with lower es-version? my es version is 5.4.2 and with lots of application running on it. I can only found es version 7.8.0 which is suitable for arm, …

---

## [How to externalise painless scripts and call it](https://discuss.elastic.co/t/how-to-externalise-painless-scripts-and-call-it/245497)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 2\
**Last updated:** [August 19, 2020, 10:31am UTC](https://discuss.elastic.co/t/how-to-externalise-painless-scripts-and-call-it/245497 "2020-08-19T10:31:30Z")

</div>

hi I have looked into the few examples, of painless script https://www.elastic.co/guide/en/elasticsearch/painless/current/painless-execute-api.html A current example shown is POST /\_scripts/painless/\_execute { "scr…

---

## [How to filter a field with entries of different version number formats in Elasticsearch documents](https://discuss.elastic.co/t/how-to-filter-a-field-with-entries-of-different-version-number-formats-in-elasticsearch-documents/245427)

<div class="topic-metadata">

**Author:** [@siiman](https://discuss.elastic.co/u/siiman)\
**Replies:** 3\
**Last updated:** [August 19, 2020, 10:28am UTC](https://discuss.elastic.co/t/how-to-filter-a-field-with-entries-of-different-version-number-formats-in-elasticsearch-documents/245427 "2020-08-19T10:28:23Z")

</div>

Hello, everyone, how to filter and sort a field with entries of different version numbers in Elasticsearch documents? For example different documents contain the field version with entries like "10.0", "10.1.5", "9" or…

---

## [Help needed in refactoring Elasticsearch Query](https://discuss.elastic.co/t/help-needed-in-refactoring-elasticsearch-query/245581)

<div class="topic-metadata">

**Author:** [@prasad98](https://discuss.elastic.co/u/prasad98)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 10:23am UTC](https://discuss.elastic.co/t/help-needed-in-refactoring-elasticsearch-query/245581 "2020-08-19T10:23:41Z")

</div>

I am trying to refactor a elasticsearch query from written for 2.4 (it's a very old one) and want to make it compatible for elasticsearch 7.5 Here is my structured query: { 'query': { 'filtered': { 'filter'…

---

## [Elasticsearch query timeout](https://discuss.elastic.co/t/elasticsearch-query-timeout/245579)

<div class="topic-metadata">

**Author:** [@ubazu](https://discuss.elastic.co/u/ubazu)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 10:05am UTC](https://discuss.elastic.co/t/elasticsearch-query-timeout/245579 "2020-08-19T10:05:17Z")

</div>

I am running an ES node on a 8 cores/16G RAM Qbox server. I am doing some indexing and search operations. indexing(max 5/second), search(max 14/second). My index has around 2M records and 1.2G of data. Search query take…

---

## [GET query replacing "+" sign from document id](https://discuss.elastic.co/t/get-query-replacing-sign-from-document-id/245574)

<div class="topic-metadata">

**Author:** [@rahulkothanath](https://discuss.elastic.co/u/rahulkothanath)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 9:50am UTC](https://discuss.elastic.co/t/get-query-replacing-sign-from-document-id/245574 "2020-08-19T09:50:17Z")

</div>

when I am searching for a document using "\_id" ,GET query is replacing "+" sign in the id with empty space. below is my id and query. id: 2FDC1B4CF35B1A29A5F1FA232410B08887B40E46EMD5DOHcKn5R+q6Wiipsx8Hkg==202008180133…

---

## [Get the total number of fields of a given index](https://discuss.elastic.co/t/get-the-total-number-of-fields-of-a-given-index/245566)

<div class="topic-metadata">

**Author:** [@CanardMoussant](https://discuss.elastic.co/u/CanardMoussant)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 9:28am UTC](https://discuss.elastic.co/t/get-the-total-number-of-fields-of-a-given-index/245566 "2020-08-19T09:28:10Z")

</div>

I am facing update mapping errors on an ES (6.1) index because it seems we reached the limit index.mapping.total\_fields.limit. The error is: Limit of total fields \[1200\] in index \[coin\] has been exceeded However, if I …

---

## [Getting GC overhead on Elasticsearch](https://discuss.elastic.co/t/getting-gc-overhead-on-elasticsearch/245526)

<div class="topic-metadata">

**Author:** [@AshokBachchan](https://discuss.elastic.co/u/AshokBachchan)\
**Replies:** 6\
**Last updated:** [August 19, 2020, 9:15am UTC](https://discuss.elastic.co/t/getting-gc-overhead-on-elasticsearch/245526 "2020-08-19T09:15:40Z")

</div>

Hi, We were getting more GC on elasticsearch. Please help me, due to this issue, ES node crashing suddenly { "\_nodes": { "total": 9, "successful": 9, "failed": 0 }, "cluster\_name": "AWS-Pre-Productio…

---

## [Does IDF count documents that don't have a field](https://discuss.elastic.co/t/does-idf-count-documents-that-dont-have-a-field/245562)

<div class="topic-metadata">

**Author:** [@ivanibash](https://discuss.elastic.co/u/ivanibash)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 9:10am UTC](https://discuss.elastic.co/t/does-idf-count-documents-that-dont-have-a-field/245562 "2020-08-19T09:10:11Z")

</div>

First let me check my assumption is correct . As i understand ES calculates IDF across specific fields. So when I read things like "It is a ratio of all documents to documents containing the searched term." it really mea…

---

## [All nodes green, cluster yellow (or green?)](https://discuss.elastic.co/t/all-nodes-green-cluster-yellow-or-green/245485)

<div class="topic-metadata">

**Author:** [@tarkhil](https://discuss.elastic.co/u/tarkhil)\
**Replies:** 4\
**Last updated:** [August 19, 2020, 8:09am UTC](https://discuss.elastic.co/t/all-nodes-green-cluster-yellow-or-green/245485 "2020-08-19T08:09:02Z")

</div>

Hello I'm running ElasticSearch 6.8.(mix of 8 and 10). Kibana shows that all nodes are green, but cluster is yellow. Graylog disagrees with Kibana - "Elasticsearch cluster is green". What's happening, what should I f…

---

## [How to stop elastic search if number of data nodes are less than minimum?](https://discuss.elastic.co/t/how-to-stop-elastic-search-if-number-of-data-nodes-are-less-than-minimum/245535)

<div class="topic-metadata">

**Author:** [@Pavan\_Rajan](https://discuss.elastic.co/u/Pavan_Rajan)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 7:14am UTC](https://discuss.elastic.co/t/how-to-stop-elastic-search-if-number-of-data-nodes-are-less-than-minimum/245535 "2020-08-19T07:14:38Z")

</div>

Say I have deployed 2 data nodes with number of replicas as default 1. If the second node goes down, the cluster health will turn yellow, but will still continue to function. Is there any configuration to stop this beha…

---

## [\_reindex call - Access current object in destination](https://discuss.elastic.co/t/reindex-call-access-current-object-in-destination/245527)

<div class="topic-metadata">

**Author:** [@anitabee](https://discuss.elastic.co/u/anitabee)\
**Replies:** 0\
**Last updated:** [August 19, 2020, 6:19am UTC](https://discuss.elastic.co/t/reindex-call-access-current-object-in-destination/245527 "2020-08-19T06:19:44Z")

</div>

Hi, During reindex call is it possible to access current object in destination that is going to be overridden? What I'm trying to achieve is this: POST \_reindex { "source": { "remote": { "host": "https://e…

---

## [Getting ssl error while trying to create httpclient](https://discuss.elastic.co/t/getting-ssl-error-while-trying-to-create-httpclient/245327)

<div class="topic-metadata">

**Author:** [@elastic78](https://discuss.elastic.co/u/elastic78)\
**Replies:** 16\
**Last updated:** [August 19, 2020, 6:12am UTC](https://discuss.elastic.co/t/getting-ssl-error-while-trying-to-create-httpclient/245327 "2020-08-19T06:12:59Z")

</div>

I am getting the below error while trying to create new http client in 7.8.1 version. Please help. code : RestHighLevelClient client = new RestHighLevelClient(RestClient. builder ( new HttpHost(getLocalHost(), getPort(…

---

## [Data node CPU utilization goes very high](https://discuss.elastic.co/t/data-node-cpu-utilization-goes-very-high/245464)

<div class="topic-metadata">

**Author:** [@sheetal.nainwal](https://discuss.elastic.co/u/sheetal.nainwal)\
**Replies:** 3\
**Last updated:** [August 19, 2020, 6:06am UTC](https://discuss.elastic.co/t/data-node-cpu-utilization-goes-very-high/245464 "2020-08-19T06:06:42Z")

</div>

I am using AWS ElasticSearch service and the problem I am facing while ingestion happens on one index, it serves Very high CPU utilization (sometimes 1 or 2 master/data node goes down and sometimes ingestion fails). As r…

---

## [Logstash + Elasticsearch Architecture Tips](https://discuss.elastic.co/t/logstash-elasticsearch-architecture-tips/245490)

<div class="topic-metadata">

**Author:** [@sergle](https://discuss.elastic.co/u/sergle)\
**Replies:** 2\
**Last updated:** [August 19, 2020, 5:13am UTC](https://discuss.elastic.co/t/logstash-elasticsearch-architecture-tips/245490 "2020-08-19T05:13:18Z")

</div>

Hey, very new to LS and ES, and ELK in general so while I am setting up my system I have a few questions regarding the advised architecture and looking for recommendations and tips for best implementation/use. The plan …

---

## [Slow Indexing speed / Bottleneck](https://discuss.elastic.co/t/slow-indexing-speed-bottleneck/245378)

<div class="topic-metadata">

**Author:** [@Anirbaan\_Chowdhury](https://discuss.elastic.co/u/Anirbaan_Chowdhury)\
**Replies:** 5\
**Last updated:** [August 19, 2020, 3:49am UTC](https://discuss.elastic.co/t/slow-indexing-speed-bottleneck/245378 "2020-08-19T03:49:23Z")

</div>

Hi Experts, I know there are many threads opened for this but I haven't been able to fix my issue with them. I am new to this. In our ES cluster, there are 4 data, 1 master and 1 ingest nodes. The index rate is curre…

---

## [Elasticsearch](https://discuss.elastic.co/t/elasticsearch/245461)

<div class="topic-metadata">

**Author:** [@Ben\_said](https://discuss.elastic.co/u/Ben_said)\
**Replies:** 1\
**Last updated:** [August 19, 2020, 3:47am UTC](https://discuss.elastic.co/t/elasticsearch/245461 "2020-08-19T03:47:35Z")

</div>

can someone help me please ? i try to set fileddata to true but its failed. { "took": 26, "timed\_out": false, "\_shards": { "total": 2, "successful": 1, "skipped": 1, "failed": 1, "failures": \[ { "shard": 0, …

---

## [How retain certain index for more time than the other?](https://discuss.elastic.co/t/how-retain-certain-index-for-more-time-than-the-other/245469)

<div class="topic-metadata">

**Author:** [@srbhklkrn](https://discuss.elastic.co/u/srbhklkrn)\
**Replies:** 7\
**Last updated:** [August 19, 2020, 3:22am UTC](https://discuss.elastic.co/t/how-retain-certain-index-for-more-time-than-the-other/245469 "2020-08-19T03:22:44Z")

</div>

I'm on Elasticsearch 6.4, I have 4 indexes out of which for 2 I need to set the retention period to be 60 days, how do I set that?

---

## [Need to do sum aggregation with probable null values of field](https://discuss.elastic.co/t/need-to-do-sum-aggregation-with-probable-null-values-of-field/245373)

<div class="topic-metadata">

**Author:** [@\_ite\_iew](https://discuss.elastic.co/u/_ite_iew)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 8:21am UTC](https://discuss.elastic.co/t/need-to-do-sum-aggregation-with-probable-null-values-of-field/245373 "2020-08-18T08:21:26Z")

</div>

Hi, I have a field in my elastic index with a probable null value for that field. But when I do sum aggregation on that field, even with all the values as null it returns 0 as the value from elasticsearch. I need to h…

---

## [Fundamental of securing elastic search |why self signed certificate is failing while querying using curl](https://discuss.elastic.co/t/fundamental-of-securing-elastic-search-why-self-signed-certificate-is-failing-while-querying-using-curl/245325)

<div class="topic-metadata">

**Author:** [@manojb1-in.ibm.com](https://discuss.elastic.co/u/manojb1-in.ibm.com)\
**Replies:** 1\
**Last updated:** [August 19, 2020, 1:59am UTC](https://discuss.elastic.co/t/fundamental-of-securing-elastic-search-why-self-signed-certificate-is-failing-while-querying-using-curl/245325 "2020-08-19T01:59:35Z")

</div>

using "elasticsearch-certutil" I created ca file and the p12 certificates. I could query the elasticsearch ip using curl in insecure mode (using -k) option But querying is not working when specify the path of cacert! Wh…

---

## [Time based rollover vs Time based routing](https://discuss.elastic.co/t/time-based-rollover-vs-time-based-routing/245509)

<div class="topic-metadata">

**Author:** [@joropito](https://discuss.elastic.co/u/joropito)\
**Replies:** 1\
**Last updated:** [August 19, 2020, 12:20am UTC](https://discuss.elastic.co/t/time-based-rollover-vs-time-based-routing/245509 "2020-08-19T00:20:10Z")

</div>

Hi everyone I wonder what's better in my use case. A single large index, a time based rollover (monthly maybe) or a time based (monthly) shard routing? The case 10million documents each month (daily ingestion). Some of…

---

## [Performance characteristics and implementation details of context/completion suggester](https://discuss.elastic.co/t/performance-characteristics-and-implementation-details-of-context-completion-suggester/245508)

<div class="topic-metadata">

**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 11:58pm UTC](https://discuss.elastic.co/t/performance-characteristics-and-implementation-details-of-context-completion-suggester/245508 "2020-08-18T23:58:03Z")

</div>

Hi Everyone I would like to understand the performance characteristics of context suggester. I am planning to use completion suggester for a very big index (billions of documents - but only for few fields). the field is…

---

## [Running cURL commands from desktop to access ES on AWS](https://discuss.elastic.co/t/running-curl-commands-from-desktop-to-access-es-on-aws/245501)

<div class="topic-metadata">

**Author:** [@mikedee](https://discuss.elastic.co/u/mikedee)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 10:46pm UTC](https://discuss.elastic.co/t/running-curl-commands-from-desktop-to-access-es-on-aws/245501 "2020-08-18T22:46:26Z")

</div>

I am trying to run a scheduled cron job with a cURL command from my desktop terminal, however, when I run the command it returns this error: "curl: (7) Failed to connect to localhost port 9200: Connection refused". We a…

---

## [ElasticSearch: Logic to alert based on dynamic threshold specified in a csv file](https://discuss.elastic.co/t/elasticsearch-logic-to-alert-based-on-dynamic-threshold-specified-in-a-csv-file/245449)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 9:49pm UTC](https://discuss.elastic.co/t/elasticsearch-logic-to-alert-based-on-dynamic-threshold-specified-in-a-csv-file/245449 "2020-08-18T21:49:23Z")

</div>

folks, I've got a requirement, Get error codes from raw data within a particular time period if the count of error codes is greater than count specified in a lookup/csv list, then alert I understand there is NO looku…

---

## [How to do summary indexing in Elasticsearch](https://discuss.elastic.co/t/how-to-do-summary-indexing-in-elasticsearch/245491)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 9:45pm UTC](https://discuss.elastic.co/t/how-to-do-summary-indexing-in-elasticsearch/245491 "2020-08-18T21:45:08Z")

</div>

hi, we have a massive index, few reference indexes and we wanted to summarise from these multiple indexes into a single "summary index" . This way we are planning to join the queries So the questions Can output of a …

---

## [Skip Scoring more than once if search term appears multiple time in Document](https://discuss.elastic.co/t/skip-scoring-more-than-once-if-search-term-appears-multiple-time-in-document/245399)

<div class="topic-metadata">

**Author:** [@AmitaS](https://discuss.elastic.co/u/AmitaS)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 9:23pm UTC](https://discuss.elastic.co/t/skip-scoring-more-than-once-if-search-term-appears-multiple-time-in-document/245399 "2020-08-18T21:23:02Z")

</div>

HI Is it possible not to increase score if the search term appears in document more than once? to implement similar to this ,which is implemented on db int rank = 100; var isMatched = false; …

---

## [Sort by country with one specific country first](https://discuss.elastic.co/t/sort-by-country-with-one-specific-country-first/245100)

<div class="topic-metadata">

**Author:** [@steff7](https://discuss.elastic.co/u/steff7)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 9:20pm UTC](https://discuss.elastic.co/t/sort-by-country-with-one-specific-country-first/245100 "2020-08-18T21:20:48Z")

</div>

Hello, I am new to Elastic and I am trying to get a list of products. My bool query works in general but now i want to solve the following sorting problem. The multilanguage website shows products of different countrie…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=829)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=831)
