# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=973

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 974

---

## [How to get average document size in an index?](https://discuss.elastic.co/t/how-to-get-average-document-size-in-an-index/225610)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 6:07am UTC](https://discuss.elastic.co/t/how-to-get-average-document-size-in-an-index/225610 "2020-03-30T06:07:29Z")

</div>

HI, I am using Elastic Stack v6.3.0. I have multiple indices. Is is possible to get average document size (the size of a single entry in an index) of a particular index? Thank you

---

## [Ho wo get the average number of write events per second to all indices in my elasticsearch cluster](https://discuss.elastic.co/t/ho-wo-get-the-average-number-of-write-events-per-second-to-all-indices-in-my-elasticsearch-cluster/225392)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 5:36am UTC](https://discuss.elastic.co/t/ho-wo-get-the-average-number-of-write-events-per-second-to-all-indices-in-my-elasticsearch-cluster/225392 "2020-03-30T05:36:15Z")

</div>

Hi, I am using elasticserach 6.3.0. I have Kibana 6.3.0 with monitoring enabled. Is it possible to get the average write events to all indices in my elasticsearch cluster (i am pushing using multiple Logstash instances…

---

## [Getting Current date in Painless](https://discuss.elastic.co/t/getting-current-date-in-painless/225227)

<div class="topic-metadata">

**Author:** [@Be1](https://discuss.elastic.co/u/Be1)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 2:56am UTC](https://discuss.elastic.co/t/getting-current-date-in-painless/225227 "2020-03-30T02:56:54Z")

</div>

Hello, I want to get the difference of current today and another date field as 'age' field.(new field) So i was trying to add a dynamic script field in elastic search.Below is the query i used curl -XPOST 'localhost:9…

---

## [org.elasticsearch.cluster.block.ClusterBlockException: blocked by: \[SERVICE\_UNAVAILABLE/1/state not recovered / initialized, SERVICE\_UNAVAILABLE/2/no master\];](https://discuss.elastic.co/t/org-elasticsearch-cluster-block-clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized-service-unavailable-2-no-master/225114)

<div class="topic-metadata">

**Author:** [@StruggleYang](https://discuss.elastic.co/u/StruggleYang)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 12:03am UTC](https://discuss.elastic.co/t/org-elasticsearch-cluster-block-clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized-service-unavailable-2-no-master/225114 "2020-03-30T00:03:36Z")

</div>

\[2020-03-26 13:16:25.897\] \[WARN\] \[elasticsearch\[es-node1-master\]\[generic\]\[T#288\]\] \[rest.suppressed\] - \[es-node1-master\] path: /\_bulk, params: {} org.elasticsearch.cluster.block.ClusterBlockException: blocked by: \[SERVI…

---

## [Oracle Cloud Control (OSB, CC&B) - Integration](https://discuss.elastic.co/t/oracle-cloud-control-osb-cc-b-integration/225198)

<div class="topic-metadata">

**Author:** [@Bruno\_Antunes](https://discuss.elastic.co/u/Bruno_Antunes)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 12:02am UTC](https://discuss.elastic.co/t/oracle-cloud-control-osb-cc-b-integration/225198 "2020-03-30T00:02:24Z")

</div>

Hi, its possible get the logs collect by Oracle Cloud Control to elasticsearch, or i have to collect it by database or VM individually? exist one service capable do this, StreamWeaver, but i want know if is possible wit…

---

## [Multiple filed sorting does not work](https://discuss.elastic.co/t/multiple-filed-sorting-does-not-work/224110)

<div class="topic-metadata">

**Author:** [@neeraj142](https://discuss.elastic.co/u/neeraj142)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 9:07pm UTC](https://discuss.elastic.co/t/multiple-filed-sorting-does-not-work/224110 "2020-03-29T21:07:03Z")

</div>

mapping for the index { "settings": { "analysis": { "analyzer": { "my\_analyzer": { "type": "standard" } } } }, "mappings": { "properties": { "category": …

---

## [Docker max virtual memory areas vm.max\_map\_count is too low,](https://discuss.elastic.co/t/docker-max-virtual-memory-areas-vm-max-map-count-is-too-low/221779)

<div class="topic-metadata">

**Author:** [@Andres\_Guerrero](https://discuss.elastic.co/u/Andres_Guerrero)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 5:52pm UTC](https://discuss.elastic.co/t/docker-max-virtual-memory-areas-vm-max-map-count-is-too-low/221779 "2020-03-29T17:52:42Z")

</div>

Hello, what is the correct way to add the following settings to my container "vm.max\_map\_count=262144" I've added to my project the Official dockerfile Then i added the following line on the dockerfile without suc…

---

## [Is it needed a paid license to use the Java Transport Client in Elasticsearch 7.4?](https://discuss.elastic.co/t/is-it-needed-a-paid-license-to-use-the-java-transport-client-in-elasticsearch-7-4/225536)

<div class="topic-metadata">

**Author:** [@alexmm](https://discuss.elastic.co/u/alexmm)\
**Replies:** 6\
**Last updated:** [March 29, 2020, 4:21pm UTC](https://discuss.elastic.co/t/is-it-needed-a-paid-license-to-use-the-java-transport-client-in-elasticsearch-7-4/225536 "2020-03-29T16:21:04Z")

</div>

Hi, we are using the Java Transport Client against an Elasticsearch 6.8. But we are going to install a new cluster with an Elasticsearch 7.4 and are going to connect the application to it. We know that the Java High Le…

---

## [How to Normalize across multiple search results](https://discuss.elastic.co/t/how-to-normalize-across-multiple-search-results/225454)

<div class="topic-metadata">

**Author:** [@Abhinav\_Keshri](https://discuss.elastic.co/u/Abhinav_Keshri)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 3:15pm UTC](https://discuss.elastic.co/t/how-to-normalize-across-multiple-search-results/225454 "2020-03-29T15:15:38Z")

</div>

I need some help in normalizing the score using Elastic Search. Before I proceed on to problem, some variables that are making an already difficult process even more difficult are discussed below. I use the following whi…

---

## [More and more Nested query is progressively getting slower and slower](https://discuss.elastic.co/t/more-and-more-nested-query-is-progressively-getting-slower-and-slower/222855)

<div class="topic-metadata">

**Author:** [@NewHere](https://discuss.elastic.co/u/NewHere)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 2:46pm UTC](https://discuss.elastic.co/t/more-and-more-nested-query-is-progressively-getting-slower-and-slower/222855 "2020-03-29T14:46:30Z")

</div>

We have a few millions of documents, each can have zero to hundred of nested objects (thankfully its just one level of nesting, the rest are just text fields). When issuing a boolean should match query with one nested q…

---

## [Updating settings for all indices in an Amazon Hosted Elasticsearch Cluster](https://discuss.elastic.co/t/updating-settings-for-all-indices-in-an-amazon-hosted-elasticsearch-cluster/224285)

<div class="topic-metadata">

**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 2:27pm UTC](https://discuss.elastic.co/t/updating-settings-for-all-indices-in-an-amazon-hosted-elasticsearch-cluster/224285 "2020-03-29T14:27:40Z")

</div>

Hi, I'm trying to update a particular setting for all indices on one of our Elasticsearch clusters with a PUT request for \_settings without specifying the index, which according to the documentation updates the specifie…

---

## [High jvm memory](https://discuss.elastic.co/t/high-jvm-memory/224605)

<div class="topic-metadata">

**Author:** [@jof300](https://discuss.elastic.co/u/jof300)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 2:23pm UTC](https://discuss.elastic.co/t/high-jvm-memory/224605 "2020-03-29T14:23:47Z")

</div>

Hello, We have a cluster composed of 3 masters and 4 data nodes. Each data node's jvm has 30Go memory allowed. The disk usage on 4 data nodes is around 17 To. There is actually no indexes closed. We see 2 things : d…

---

## [Multi field mapping and mapping explosion](https://discuss.elastic.co/t/multi-field-mapping-and-mapping-explosion/225005)

<div class="topic-metadata">

**Author:** [@dao](https://discuss.elastic.co/u/dao)\
**Replies:** 2\
**Last updated:** [March 29, 2020, 2:06pm UTC](https://discuss.elastic.co/t/multi-field-mapping-and-mapping-explosion/225005 "2020-03-29T14:06:03Z")

</div>

By default, it seems that all my strings are dynamically mapped to a multifield like below. I am concerned with mapping explosion Does those multi fields are counted as 2 fields? here below, REG and REG.keyword are cons…

---

## [Reduce update\_by\_query memory use](https://discuss.elastic.co/t/reduce-update-by-query-memory-use/225381)

<div class="topic-metadata">

**Author:** [@Jesus\_Rodriguez](https://discuss.elastic.co/u/Jesus_Rodriguez)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 1:57pm UTC](https://discuss.elastic.co/t/reduce-update-by-query-memory-use/225381 "2020-03-29T13:57:54Z")

</div>

Hi. In one of the use cases I currently have for Elastic I have an index with relatively large documents. Initially, we chose to go with update\_by\_query. However, we recently had an OOM problem caused by one of those up…

---

## [Index aliases are there any impact on the cluster when updating it?](https://discuss.elastic.co/t/index-aliases-are-there-any-impact-on-the-cluster-when-updating-it/225395)

<div class="topic-metadata">

**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\
**Replies:** 1\
**Last updated:** [March 29, 2020, 1:56pm UTC](https://discuss.elastic.co/t/index-aliases-are-there-any-impact-on-the-cluster-when-updating-it/225395 "2020-03-29T13:56:33Z")

</div>

Hello, For example, if I create an index alias, like in the example POST /\_aliases { "actions" : \[ { "add" : { "index" : "test1", "alias" : "alias1" } } \] } but then i want to preserve the alias1 and s…

---

## [Handle Frequently updated geo data in Elastic Search](https://discuss.elastic.co/t/handle-frequently-updated-geo-data-in-elastic-search/225036)

<div class="topic-metadata">

**Author:** [@Nishant\_Gauttam](https://discuss.elastic.co/u/Nishant_Gauttam)\
**Replies:** 4\
**Last updated:** [March 29, 2020, 1:10pm UTC](https://discuss.elastic.co/t/handle-frequently-updated-geo-data-in-elastic-search/225036 "2020-03-29T13:10:48Z")

</div>

I have the location(geo points) data updated every 5 minutes for millions of users. We have to search users with specific attributes(age,interests,languages) & in particular geo range. Wanted to understand the right stra…

---

## [Indexing Large Documents in ES](https://discuss.elastic.co/t/indexing-large-documents-in-es/225385)

<div class="topic-metadata">

**Author:** [@Shweta\_Patel](https://discuss.elastic.co/u/Shweta_Patel)\
**Replies:** 9\
**Last updated:** [March 29, 2020, 12:41pm UTC](https://discuss.elastic.co/t/indexing-large-documents-in-es/225385 "2020-03-29T12:41:17Z")

</div>

Hello ES Team, I am using elastic search version 6.5.4 . When I crowl 11,000 documents Crawling stops at 555 and I got following exception. Exception :-' \[2020-03-24T23:38:48,325\]\[DEBUG\]\[o.e.a.b.TransportShardBulkActi…

---

## [Only highest field's score is returned as the item score not the sum](https://discuss.elastic.co/t/only-highest-fields-score-is-returned-as-the-item-score-not-the-sum/225542)

<div class="topic-metadata">

**Author:** [@slim-souissi](https://discuss.elastic.co/u/slim-souissi)\
**Replies:** 0\
**Last updated:** [March 29, 2020, 10:02am UTC](https://discuss.elastic.co/t/only-highest-fields-score-is-returned-as-the-item-score-not-the-sum/225542 "2020-03-29T10:02:51Z")

</div>

Hello , I query elasticsearch with a bool query . When I have a match , only the field the highest score is returned . Imagine my query matches on two fields , I want the score to be the sum of the scores of matched fi…

---

## [Interactions between more\_like\_this and child documents](https://discuss.elastic.co/t/interactions-between-more-like-this-and-child-documents/225514)

<div class="topic-metadata">

**Author:** [@bobtpawn](https://discuss.elastic.co/u/bobtpawn)\
**Replies:** 0\
**Last updated:** [March 28, 2020, 10:41pm UTC](https://discuss.elastic.co/t/interactions-between-more-like-this-and-child-documents/225514 "2020-03-28T22:41:33Z")

</div>

I'm encountering a difficulty related to more\_like\_this with nested properties. What I would like to do is find similar parent documents where similarity is based on having many similar children. This seems like a stan…

---

## [Pls i try securing my elk stack and after everything am getting this error, pls advice with clear solution thank you. elk 7.6.1 version](https://discuss.elastic.co/t/pls-i-try-securing-my-elk-stack-and-after-everything-am-getting-this-error-pls-advice-with-clear-solution-thank-you-elk-7-6-1-version/224990)

<div class="topic-metadata">

**Author:** [@dessy53](https://discuss.elastic.co/u/dessy53)\
**Replies:** 5\
**Last updated:** [March 28, 2020, 6:04pm UTC](https://discuss.elastic.co/t/pls-i-try-securing-my-elk-stack-and-after-everything-am-getting-this-error-pls-advice-with-clear-solution-thank-you-elk-7-6-1-version/224990 "2020-03-28T18:04:58Z")

</div>

\[root@elk1 elasticsearch\]# curl http://192.168.40.131:9200/\_cat/nodes?v -u elastic -k Enter host password for user 'elastic': {"error":{"root\_cause":\[{"type":"security\_exception","reason":"failed to authenticate user …

---

## [Enrich policy with integrated sort/search query](https://discuss.elastic.co/t/enrich-policy-with-integrated-sort-search-query/225349)

<div class="topic-metadata">

**Author:** [@winlamp](https://discuss.elastic.co/u/winlamp)\
**Replies:** 7\
**Last updated:** [March 28, 2020, 2:04pm UTC](https://discuss.elastic.co/t/enrich-policy-with-integrated-sort-search-query/225349 "2020-03-28T14:04:48Z")

</div>

Hi, I'm trying to integrate a search query into my enrich policy. This step is required since I only require the most recent data from my index. Therefore i would like to do a sort based on the index @timestamp. I alre…

---

## [Unforseen data loss in ES Cluster. Need help recovering it!](https://discuss.elastic.co/t/unforseen-data-loss-in-es-cluster-need-help-recovering-it/225266)

<div class="topic-metadata">

**Author:** [@Vinay\_Kumar3](https://discuss.elastic.co/u/Vinay_Kumar3)\
**Replies:** 6\
**Last updated:** [March 28, 2020, 11:39am UTC](https://discuss.elastic.co/t/unforseen-data-loss-in-es-cluster-need-help-recovering-it/225266 "2020-03-28T11:39:38Z")

</div>

Our scenario below. Self-Managed ES 3-node cluster on AWS EC2. How can we recover this data loss described below? Can your team of experts help? The loss of all user data was confirmed by looking at elasticsearch and …

---

## [Dealing with IPs and the end of mapping types](https://discuss.elastic.co/t/dealing-with-ips-and-the-end-of-mapping-types/225460)

<div class="topic-metadata">

**Author:** [@joaociocca](https://discuss.elastic.co/u/joaociocca)\
**Replies:** 4\
**Last updated:** [March 28, 2020, 2:56am UTC](https://discuss.elastic.co/t/dealing-with-ips-and-the-end-of-mapping-types/225460 "2020-03-28T02:56:52Z")

</div>

So, I've been reading a lot about how the mapping types are "in extinction" and will be gone in 8.x, but I don't understand is how do we deal with searching related to IP types when it's gone. Maybe there's something ab…

---

## [Spell check Questions](https://discuss.elastic.co/t/spell-check-questions/225474)

<div class="topic-metadata">

**Author:** [@vijay2](https://discuss.elastic.co/u/vijay2)\
**Replies:** 0\
**Last updated:** [March 27, 2020, 11:55pm UTC](https://discuss.elastic.co/t/spell-check-questions/225474 "2020-03-27T23:55:07Z")

</div>

Hello, Which one is good for spell correction?? Term suggest or Phrase suggest?? I did a search Case 1: Input:- guci walet Phrase Suggester test:- Output:- 1st result : Gucci walet. 2nd result: guci wallet In t…

---

## [Query ideas for my usecase to find order status](https://discuss.elastic.co/t/query-ideas-for-my-usecase-to-find-order-status/225469)

<div class="topic-metadata">

**Author:** [@rajsolanki](https://discuss.elastic.co/u/rajsolanki)\
**Replies:** 0\
**Last updated:** [March 27, 2020, 10:30pm UTC](https://discuss.elastic.co/t/query-ideas-for-my-usecase-to-find-order-status/225469 "2020-03-27T22:30:38Z")

</div>

Firstly sorry if i m asking elementary questions and bit long question. So i have a need for some sort of join query ( i know Elasticsearch is not RDBMS ) so i m looking for ideas. So here are my few sample docs. { …

---

## [Timestamp auto create](https://discuss.elastic.co/t/timestamp-auto-create/225433)

<div class="topic-metadata">

**Author:** [@edkash](https://discuss.elastic.co/u/edkash)\
**Replies:** 1\
**Last updated:** [March 27, 2020, 6:58pm UTC](https://discuss.elastic.co/t/timestamp-auto-create/225433 "2020-03-27T18:58:12Z")

</div>

Hello guys. I creating index on elasticsearch, inserting json files. So, how can i configure index to creating timestamp automatically? Because dont wanna inserting json date filed on all json post requests, if possib…

---

## [In Discover, set interesting data to be displayed and hide other data](https://discuss.elastic.co/t/in-discover-set-interesting-data-to-be-displayed-and-hide-other-data/225456)

<div class="topic-metadata">

**Author:** [@Gary\_Blackwell](https://discuss.elastic.co/u/Gary_Blackwell)\
**Replies:** 0\
**Last updated:** [March 27, 2020, 6:29pm UTC](https://discuss.elastic.co/t/in-discover-set-interesting-data-to-be-displayed-and-hide-other-data/225456 "2020-03-27T18:29:02Z")

</div>

The default display "\_source" has a lot of uninteresting data. So I went to advanced settings and modified the default columns to be "winlog.event\_id, event.action, winlog.event\_data.SubjectUserName, winlog.event\_data.S…

---

## [Elasticsearch bulk slows down after a certain amount of documents](https://discuss.elastic.co/t/elasticsearch-bulk-slows-down-after-a-certain-amount-of-documents/225434)

<div class="topic-metadata">

**Author:** [@Ivan\_Janev](https://discuss.elastic.co/u/Ivan_Janev)\
**Replies:** 3\
**Last updated:** [March 27, 2020, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-bulk-slows-down-after-a-certain-amount-of-documents/225434 "2020-03-27T17:41:03Z")

</div>

Hello, I'm experiencing problems when using the bulk feature of Elastic but I'm still very novice in ES so I don't know how to even debug it properly. The problem: I'm trying to index 2 million documents using the bul…

---

## [Generic search between docs added with Logstash or Filebeat](https://discuss.elastic.co/t/generic-search-between-docs-added-with-logstash-or-filebeat/225080)

<div class="topic-metadata">

**Author:** [@jason26](https://discuss.elastic.co/u/jason26)\
**Replies:** 2\
**Last updated:** [March 27, 2020, 4:53pm UTC](https://discuss.elastic.co/t/generic-search-between-docs-added-with-logstash-or-filebeat/225080 "2020-03-27T16:53:49Z")

</div>

I don't have control over how the JSON logs I'm trying to search get added to ElasticSearch, but its always Filebeat or Logstash. Something I've noticed, is for a specific field Filebeat has the mapping: "si…

---

## [Rollover logs indexed daily](https://discuss.elastic.co/t/rollover-logs-indexed-daily/225421)

<div class="topic-metadata">

**Author:** [@hongphuc95](https://discuss.elastic.co/u/hongphuc95)\
**Replies:** 6\
**Last updated:** [March 27, 2020, 4:47pm UTC](https://discuss.elastic.co/t/rollover-logs-indexed-daily/225421 "2020-03-27T16:47:14Z")

</div>

Hello every, I hope you all doing well during this time of confinement So basically what I have is a series of logs indexed daily into Elasticsearch, my logs index pattern is logs-YYYY.MM.DD I'm trying to set up a rol…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=972)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=974)
