# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1251

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1252

---

## [Reindex - Renaming nested fields](https://discuss.elastic.co/t/reindex-renaming-nested-fields/187363)

<div class="topic-metadata">

**Author:** [@sudhithra](https://discuss.elastic.co/u/sudhithra)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 2:16pm UTC](https://discuss.elastic.co/t/reindex-renaming-nested-fields/187363 "2019-06-25T14:16:48Z")

</div>

Hi, I am not able to rename a nested field while reindexing My nested field in the source index: "nestField" : { "type" : "nested", "properties" : { "fieldOne" : { "type" : "string", "store" : true, "analyzer" :…

---

## [An id must be provided if version type or value are set](https://discuss.elastic.co/t/an-id-must-be-provided-if-version-type-or-value-are-set/187344)

<div class="topic-metadata">

**Author:** [@utkarsh](https://discuss.elastic.co/u/utkarsh)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 1:29pm UTC](https://discuss.elastic.co/t/an-id-must-be-provided-if-version-type-or-value-are-set/187344 "2019-06-25T13:29:47Z")

</div>

I am upgrading the code to version 5.6.2 of ES from v2.3.3 . While I am trying to run the re-indexing utility(using java api's) I am getting error- "an id must be provided if version type or value are set". The possible…

---

## [Elastic lib jars disappear and elasticsearch service stops working](https://discuss.elastic.co/t/elastic-lib-jars-disappear-and-elasticsearch-service-stops-working/187226)

<div class="topic-metadata">

**Author:** [@HPVRNP](https://discuss.elastic.co/u/HPVRNP)\
**Replies:** 9\
**Last updated:** [June 25, 2019, 1:12pm UTC](https://discuss.elastic.co/t/elastic-lib-jars-disappear-and-elasticsearch-service-stops-working/187226 "2019-06-25T13:12:32Z")

</div>

Hi, Whenever elasticsearch service dies with the following lines of logs, all the jar files inside lib folder gone missing. After this, the elasticsearch services stop working and not starting. Why do elasticsearch jar…

---

## [Job soft limit](https://discuss.elastic.co/t/job-soft-limit/187182)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 1:03pm UTC](https://discuss.elastic.co/t/job-soft-limit/187182 "2019-06-25T13:03:58Z")

</div>

While the job I created was running, suddenly its memory status changed to soft\_limit. Can you explain the cause and remedy for this situation? My Elasticsearch is running on an ec2 instance(can this be a reason for this…

---

## [Elasticsearch aggregation time range on streaming data](https://discuss.elastic.co/t/elasticsearch-aggregation-time-range-on-streaming-data/187330)

<div class="topic-metadata">

**Author:** [@havjers](https://discuss.elastic.co/u/havjers)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 12:28pm UTC](https://discuss.elastic.co/t/elasticsearch-aggregation-time-range-on-streaming-data/187330 "2019-06-25T12:28:58Z")

</div>

Hello everyone, We are developing an external ML analysis tool which pulls existing data from an ES index, creates a model from it, and then keeps querying the engine for new (more recent) data to assess the model and o…

---

## [Fix:upgrade elasticsearch from 6.2.2 to 7.11 in mac docker compose ,and "unsupported version: \[6.4.3\] minimal compatible version is: \[6.8.0\]"](https://discuss.elastic.co/t/fix-upgrade-elasticsearch-from-6-2-2-to-7-11-in-mac-docker-compose-and-unsupported-version-6-4-3-minimal-compatible-version-is-6-8-0/187328)

<div class="topic-metadata">

**Author:** [@unkown](https://discuss.elastic.co/u/unkown)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 12:22pm UTC](https://discuss.elastic.co/t/fix-upgrade-elasticsearch-from-6-2-2-to-7-11-in-mac-docker-compose-and-unsupported-version-6-4-3-minimal-compatible-version-is-6-8-0/187328 "2019-06-25T12:22:50Z")

</div>

upgrade elasticsearch from 6.2.2 to 7.11 in mac docker run test docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:7.1.1 \[mac run error\] \[linux ok\] er…

---

## [Suggestion for \_source field documentation](https://discuss.elastic.co/t/suggestion-for-source-field-documentation/187327)

<div class="topic-metadata">

**Author:** [@notxcain](https://discuss.elastic.co/u/notxcain)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 12:17pm UTC](https://discuss.elastic.co/t/suggestion-for-source-field-documentation/187327 "2019-06-25T12:17:22Z")

</div>

Warning section at https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-source-field.html should mention that removing \_source makes it impossible to see document in Kibana, you can search for it thoug…

---

## [Zip File for offline installation of Ingest Attachment Plugin with ES 6.7.1](https://discuss.elastic.co/t/zip-file-for-offline-installation-of-ingest-attachment-plugin-with-es-6-7-1/187312)

<div class="topic-metadata">

**Author:** [@V.krae](https://discuss.elastic.co/u/V.krae)\
**Replies:** 2\
**Last updated:** [June 25, 2019, 11:41am UTC](https://discuss.elastic.co/t/zip-file-for-offline-installation-of-ingest-attachment-plugin-with-es-6-7-1/187312 "2019-06-25T11:41:24Z")

</div>

Hi everyone, I am still using ES version 6.7.1 and need the Ingest Attachment Plugin as a .zip file for offline installation. The official documentation only provides the plugin for version 6.7.2 and I wasn't able to fi…

---

## [Document already exists](https://discuss.elastic.co/t/document-already-exists/187317)

<div class="topic-metadata">

**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 11:35am UTC](https://discuss.elastic.co/t/document-already-exists/187317 "2019-06-25T11:35:30Z")

</div>

Working with elastic 5.4.3 on 3 nodes cluster with 1 shard and 2 replicas. During a test, node-3 was killed. At the same time, tried to index a document. This scenario should result in creating the document successfull…

---

## [Search API limiting output](https://discuss.elastic.co/t/search-api-limiting-output/187301)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 7\
**Last updated:** [June 25, 2019, 11:22am UTC](https://discuss.elastic.co/t/search-api-limiting-output/187301 "2019-06-25T11:22:10Z")

</div>

How do I use the search API to query over a period of time? (last 15mins) and also to limit the output to a size of 1. I have the below working, but that searches for everything up to 10,000 docs. POST index/\_search?q…

---

## [Send bucket documets results](https://discuss.elastic.co/t/send-bucket-documets-results/187308)

<div class="topic-metadata">

**Author:** [@Alexander\_Zhilko](https://discuss.elastic.co/u/Alexander_Zhilko)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 10:56am UTC](https://discuss.elastic.co/t/send-bucket-documets-results/187308 "2019-06-25T10:56:45Z")

</div>

i trying to make aggregation for buckets so i did "aggs": { "name": { "terms": { "field": "client.name" } } } and the response is key : name1 doc count key name 2 doc count i need different response i hav…

---

## [MLT - boost IDF in detriment of TF?](https://discuss.elastic.co/t/mlt-boost-idf-in-detriment-of-tf/187307)

<div class="topic-metadata">

**Author:** [@jmngpt](https://discuss.elastic.co/u/jmngpt)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 10:54am UTC](https://discuss.elastic.co/t/mlt-boost-idf-in-detriment-of-tf/187307 "2019-06-25T10:54:49Z")

</div>

Is it possible to write an MLT query that assigns higher "priority" to terms that are rare across all documents than to terms that are frequent on the specific document? From what I could gather the boost\_terms parameter…

---

## [Is weighted avg aggregation is used for relevancy ranking?](https://discuss.elastic.co/t/is-weighted-avg-aggregation-is-used-for-relevancy-ranking/187292)

<div class="topic-metadata">

**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 10:42am UTC](https://discuss.elastic.co/t/is-weighted-avg-aggregation-is-used-for-relevancy-ranking/187292 "2019-06-25T10:42:07Z")

</div>

Hello, Can anyone explain what is the us of weighted avg. aggregation in ES? Is this used for relevancy ranking? Regards, Priyanka

---

## [Auto generated auto-incremented document id in numeric form](https://discuss.elastic.co/t/auto-generated-auto-incremented-document-id-in-numeric-form/187245)

<div class="topic-metadata">

**Author:** [@Roobal\_Jindal](https://discuss.elastic.co/u/Roobal_Jindal)\
**Replies:** 3\
**Last updated:** [June 25, 2019, 10:33am UTC](https://discuss.elastic.co/t/auto-generated-auto-incremented-document-id-in-numeric-form/187245 "2019-06-25T10:33:10Z")

</div>

How can I assign auto-incremented number id to my every new document? I don't want to have that auto generated long non-readable id from elastic search. I want elastic search to handle/assign numeric values to my docume…

---

## [Add weight to chosen completion suggestion](https://discuss.elastic.co/t/add-weight-to-chosen-completion-suggestion/187277)

<div class="topic-metadata">

**Author:** [@Niels\_van\_Rijn](https://discuss.elastic.co/u/Niels_van_Rijn)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 9:08am UTC](https://discuss.elastic.co/t/add-weight-to-chosen-completion-suggestion/187277 "2019-06-25T09:08:42Z")

</div>

Hi! On a lot of websites with completion suggesters the most popular suggestions are at the top. To my understanding this is why if you type 'iPhone' on a webshop the latest iPhone model will show up at the top, and not…

---

## [Excluding inner\_hits from top\_hits aggregation](https://discuss.elastic.co/t/excluding-inner-hits-from-top-hits-aggregation/187274)

<div class="topic-metadata">

**Author:** [@mortenbock](https://discuss.elastic.co/u/mortenbock)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 9:05am UTC](https://discuss.elastic.co/t/excluding-inner-hits-from-top-hits-aggregation/187274 "2019-06-25T09:05:05Z")

</div>

I have the following query into a product index, where the product has nested variants. { "size": 10, "\_source": { "excludes": "variants" }, "query": { "bool": { "must": \[ { "nest…

---

## [Significant\_text sorting](https://discuss.elastic.co/t/significant-text-sorting/186463)

<div class="topic-metadata">

**Author:** [@slovan9](https://discuss.elastic.co/u/slovan9)\
**Replies:** 14\
**Last updated:** [June 25, 2019, 9:00am UTC](https://discuss.elastic.co/t/significant-text-sorting/186463 "2019-06-25T09:00:41Z")

</div>

Hello, Im new to Elasticsearch and I cannot solve following issue. I used sampler and significant\_text aggregations to find most popular words in my dataset and it worked very well. However, I would like to order the c…

---

## [How to install watcher in elasticsearch 6.7.0](https://discuss.elastic.co/t/how-to-install-watcher-in-elasticsearch-6-7-0/187257)

<div class="topic-metadata">

**Author:** [@quangvublog](https://discuss.elastic.co/u/quangvublog)\
**Replies:** 3\
**Last updated:** [June 25, 2019, 8:46am UTC](https://discuss.elastic.co/t/how-to-install-watcher-in-elasticsearch-6-7-0/187257 "2019-06-25T08:46:37Z")

</div>

Hello everyone! I want to install watcher in elasticsearch 6.7.0 following this url: Download Watcher | Alerting for Elasticsearch Firstly: I move to /usr/share/elasticsearch The second: I use this command to install …

---

## [Composite Aggregation bucket sorting by max score](https://discuss.elastic.co/t/composite-aggregation-bucket-sorting-by-max-score/187021)

<div class="topic-metadata">

**Author:** [@Jarrod\_C](https://discuss.elastic.co/u/Jarrod_C)\
**Replies:** 5\
**Last updated:** [June 25, 2019, 8:41am UTC](https://discuss.elastic.co/t/composite-aggregation-bucket-sorting-by-max-score/187021 "2019-06-25T08:41:26Z")

</div>

Hopefully I've overlooking something easy. I recently replaced the TermsAggregation with a Composite agg and I can't get the bucket sorting to work. With the terms agg there was an order directly in the agg builder tha…

---

## [High CPU usage of the elastic](https://discuss.elastic.co/t/high-cpu-usage-of-the-elastic/186991)

<div class="topic-metadata">

**Author:** [@Behzad\_Rezaie](https://discuss.elastic.co/u/Behzad_Rezaie)\
**Replies:** 8\
**Last updated:** [June 25, 2019, 8:05am UTC](https://discuss.elastic.co/t/high-cpu-usage-of-the-elastic/186991 "2019-06-25T08:05:47Z")

</div>

Hi pals, I have installed a single node of the elastic on a server with following configuration: OS: Windows Server 2016 Processors: 2 processors of the Intel(R) Xeon CPU E5-2699 v4 @ 2.20GHZ RAM: 32 GB (16 GB dedica…

---

## [Are documents with similar ids stored together?](https://discuss.elastic.co/t/are-documents-with-similar-ids-stored-together/187259)

<div class="topic-metadata">

**Author:** [@Paul-Matthieu](https://discuss.elastic.co/u/Paul-Matthieu)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 8:24am UTC](https://discuss.elastic.co/t/are-documents-with-similar-ids-stored-together/187259 "2019-06-25T08:24:39Z")

</div>

Hi Does the id (the \_id field) of a document have any consequence on where and how it is stored and compressed, ie will 2 documents with "close" ids be stored together or not ? In other words, I'm trying to figure out …

---

## [Elasticsearch query - documents ingested across all indexes in last 1h](https://discuss.elastic.co/t/elasticsearch-query-documents-ingested-across-all-indexes-in-last-1h/186875)

<div class="topic-metadata">

**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\
**Replies:** 2\
**Last updated:** [June 25, 2019, 8:00am UTC](https://discuss.elastic.co/t/elasticsearch-query-documents-ingested-across-all-indexes-in-last-1h/186875 "2019-06-25T08:00:42Z")

</div>

Hello. I am attempting to write a query that will count me a documents across all indexes starting with url\* in last 1h. GET urls\*/\_count { "query": { "range" : { "@timestamp" : { "gte" : "now-5m", "lt" : "now…

---

## [Why the returned field does not support aliases](https://discuss.elastic.co/t/why-the-returned-field-does-not-support-aliases/187242)

<div class="topic-metadata">

**Author:** [@GJZL](https://discuss.elastic.co/u/GJZL)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 7:53am UTC](https://discuss.elastic.co/t/why-the-returned-field-does-not-support-aliases/187242 "2019-06-25T07:53:21Z")

</div>

I didn't find the api that returned the field using the alias。I think es should support returning fields using aliases。

---

## [Elastic score as percentage](https://discuss.elastic.co/t/elastic-score-as-percentage/187252)

<div class="topic-metadata">

**Author:** [@Roobal\_Jindal](https://discuss.elastic.co/u/Roobal_Jindal)\
**Replies:** 0\
**Last updated:** [June 25, 2019, 7:26am UTC](https://discuss.elastic.co/t/elastic-score-as-percentage/187252 "2019-06-25T07:26:57Z")

</div>

Use case: We have thousands of user records in an index. We have configurable rules for searching users which defines user's attributes and their weightage. Lets say, Rule is having following fields with their boost/wei…

---

## [How to use the terms filter for a whitelist (or blacklist) for a search](https://discuss.elastic.co/t/how-to-use-the-terms-filter-for-a-whitelist-or-blacklist-for-a-search/187223)

<div class="topic-metadata">

**Author:** [@wengsengtam](https://discuss.elastic.co/u/wengsengtam)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 7:12am UTC](https://discuss.elastic.co/t/how-to-use-the-terms-filter-for-a-whitelist-or-blacklist-for-a-search/187223 "2019-06-25T07:12:17Z")

</div>

Can somebody please explain how the terms filter can be used as a Whitelist / Blacklist for a search. I tried the following, but it did not work. Thanks. PUT iplist/\_doc/\_bulk { "index":{}} { "type" : "C2", "so…

---

## [Calling a pipeline on deletion operations](https://discuss.elastic.co/t/calling-a-pipeline-on-deletion-operations/187116)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 3\
**Last updated:** [June 25, 2019, 7:04am UTC](https://discuss.elastic.co/t/calling-a-pipeline-on-deletion-operations/187116 "2019-06-25T07:04:11Z")

</div>

hello All, quick question: can we call a pipeline on document deletion? Thanks!

---

## [In this below query,the fieldname which is in string type.when i use GET query there is no issue but when i use PUT query it show a error(which attached below) v 6.4.0](https://discuss.elastic.co/t/in-this-below-query-the-fieldname-which-is-in-string-type-when-i-use-get-query-there-is-no-issue-but-when-i-use-put-query-it-show-a-error-which-attached-below-v-6-4-0/187231)

<div class="topic-metadata">

**Author:** [@Sakthivanan](https://discuss.elastic.co/u/Sakthivanan)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 6:26am UTC](https://discuss.elastic.co/t/in-this-below-query-the-fieldname-which-is-in-string-type-when-i-use-get-query-there-is-no-issue-but-when-i-use-put-query-it-show-a-error-which-attached-below-v-6-4-0/187231 "2019-06-25T06:26:49Z")

</div>

PUT elastic\_queries/\_doc/21019 { "queryName": "grade\_2\_olsat\_report", "indexName": "t\_student\_grade\_2\_olsat\_index", "query": { "sort": \[ { "school\_year.keyword": { "order": "desc" …

---

## [Behavior of ForceMerge](https://discuss.elastic.co/t/behavior-of-forcemerge/187219)

<div class="topic-metadata">

**Author:** [@Taaaak](https://discuss.elastic.co/u/Taaaak)\
**Replies:** 1\
**Last updated:** [June 25, 2019, 5:56am UTC](https://discuss.elastic.co/t/behavior-of-forcemerge/187219 "2019-06-25T05:56:18Z")

</div>

Let me ask about the behavior of \_forcemerge API including parameter only\_expunge\_deletes=true. I'm planning to execute \_forcemerge?only\_expunge\_deletes=true to large index (more over 500GB/10 datanodes) to clean up a d…

---

## [Elastic URL Dead](https://discuss.elastic.co/t/elastic-url-dead/187068)

<div class="topic-metadata">

**Author:** [@prasath\_rao](https://discuss.elastic.co/u/prasath_rao)\
**Replies:** 4\
**Last updated:** [June 25, 2019, 5:37am UTC](https://discuss.elastic.co/t/elastic-url-dead/187068 "2019-06-25T05:37:21Z")

</div>

Hi Team, Working on 3 node cluster Architecture Environment - AWS t2.xlarge instances Disk - EBS io1 300GB 15k IOPS APP Servers Elastic Nodes - 3 (a,a1,b) Logstash - 1 (a) WEB Servers Rabbit MQ - 2 (a.b) Issue :…

---

## [Enabling TLS - NotSslRecordException](https://discuss.elastic.co/t/enabling-tls-notsslrecordexception/187026)

<div class="topic-metadata">

**Author:** [@c95mbq](https://discuss.elastic.co/u/c95mbq)\
**Replies:** 2\
**Last updated:** [June 25, 2019, 3:18am UTC](https://discuss.elastic.co/t/enabling-tls-notsslrecordexception/187026 "2019-06-25T03:18:10Z")

</div>

Hi, I keep receiving an error when enabling xpack.security.http.ssl My elasticsearch.yml settings are as per below - running elasticsearch-7.1.1 node.name: hiu-test discovery.type: single-node xpack.security.enabled:…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1250)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1252)
