# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1281

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1282

---

## [ES 5.6 gobbles up entire OS RAM after 30-40 mins of bulk indexing and no searching](https://discuss.elastic.co/t/es-5-6-gobbles-up-entire-os-ram-after-30-40-mins-of-bulk-indexing-and-no-searching/182940)

<div class="topic-metadata">

**Author:** [@jiouser](https://discuss.elastic.co/u/jiouser)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 4:25pm UTC](https://discuss.elastic.co/t/es-5-6-gobbles-up-entire-os-ram-after-30-40-mins-of-bulk-indexing-and-no-searching/182940 "2019-05-29T16:25:59Z")

</div>

Dear All, We are using Elastic Search in production environment on 6 servers each of which have 80vcpus, 286GB of RAM and with 2 ES 5.6 Data nodes running on each of them. Each data node is given just less than 32GB of…

---

## [ELK life cycle management erroring on all indecies](https://discuss.elastic.co/t/elk-life-cycle-management-erroring-on-all-indecies/179123)

<div class="topic-metadata">

**Author:** [@SETI](https://discuss.elastic.co/u/SETI)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 4:20pm UTC](https://discuss.elastic.co/t/elk-life-cycle-management-erroring-on-all-indecies/179123 "2019-05-29T16:20:48Z")

</div>

I'm getting this error: illegal\_argument\_exception: index.lifecycle.rollover\_alias Not sure what it means, looking at a previous ticket it seems like it needs to have an alias setup for something? Documentation hasn't…

---

## [Zero Downtime Reindex in both a Read and Write Heavy Environment](https://discuss.elastic.co/t/zero-downtime-reindex-in-both-a-read-and-write-heavy-environment/183375)

<div class="topic-metadata">

**Author:** [@micah.williamson](https://discuss.elastic.co/u/micah.williamson)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 3:43pm UTC](https://discuss.elastic.co/t/zero-downtime-reindex-in-both-a-read-and-write-heavy-environment/183375 "2019-05-29T15:43:37Z")

</div>

Over the last year we've made several changes to the schema of our index which required a reindexing. Our indexes are both read and write heavy, but this hasn't been a problem because we have used aliases from the beginn…

---

## [Elastic Search Query Merging multiple documents](https://discuss.elastic.co/t/elastic-search-query-merging-multiple-documents/183373)

<div class="topic-metadata">

**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 3:35pm UTC](https://discuss.elastic.co/t/elastic-search-query-merging-multiple-documents/183373 "2019-05-29T15:35:38Z")

</div>

I am trying to merge multiple documents together if they contain the same src IP Address within the last 10 minutes. The situation is zscaler sends us multiple document ( per request ) for each blocked botnet request I…

---

## [Terms Query proportion of results?](https://discuss.elastic.co/t/terms-query-proportion-of-results/183372)

<div class="topic-metadata">

**Author:** [@davidbiller](https://discuss.elastic.co/u/davidbiller)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 3:25pm UTC](https://discuss.elastic.co/t/terms-query-proportion-of-results/183372 "2019-05-29T15:25:05Z")

</div>

GET \_search { "size": 100, "query": { "bool": { "must": \[ { "range": { "createdAt": { "gte": "now-30d/d" } } }, { "terms": { "jobBerufId": \[ …

---

## [Snapshots recovery](https://discuss.elastic.co/t/snapshots-recovery/182152)

<div class="topic-metadata">

**Author:** [@rodrigue](https://discuss.elastic.co/u/rodrigue)\
**Replies:** 6\
**Last updated:** [May 29, 2019, 3:20pm UTC](https://discuss.elastic.co/t/snapshots-recovery/182152 "2019-05-29T15:20:20Z")

</div>

Hello, I have a special problem. I can't find a solution because I have problems to explain it. I'm using ELK and I create a new index every day. In order to free space on my production system, I'm creating compressed …

---

## [How to fix Validation Failed: 1: mapping type is missing](https://discuss.elastic.co/t/how-to-fix-validation-failed-1-mapping-type-is-missing/183367)

<div class="topic-metadata">

**Author:** [@Aymen\_Ben\_Moussa](https://discuss.elastic.co/u/Aymen_Ben_Moussa)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 3:05pm UTC](https://discuss.elastic.co/t/how-to-fix-validation-failed-1-mapping-type-is-missing/183367 "2019-05-29T15:05:01Z")

</div>

this is my index default mapping \> { \> "yoyo4y" : { \> "mappings" : { \> "doc" : { \> "properties" : { \> "@timestamp" : { \> "type" : "date" \> }, \> "@version" : { \> "type" : "text",…

---

## [Search keyword classification problem](https://discuss.elastic.co/t/search-keyword-classification-problem/182999)

<div class="topic-metadata">

**Author:** [@Dmitry\_Uglatch](https://discuss.elastic.co/u/Dmitry_Uglatch)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 2:03pm UTC](https://discuss.elastic.co/t/search-keyword-classification-problem/182999 "2019-05-29T14:03:44Z")

</div>

Dear guys. I have ~10M product index with bunch of fields (mpn, gtin, family, series, brandName, categoryName, summary) And I'm just trying to find the answer to the next question: what is the best way to parse and claa…

---

## [Elasticsearch aggregation return location](https://discuss.elastic.co/t/elasticsearch-aggregation-return-location/183179)

<div class="topic-metadata">

**Author:** [@EliuFlorez](https://discuss.elastic.co/u/EliuFlorez)\
**Replies:** 2\
**Last updated:** [May 29, 2019, 2:03pm UTC](https://discuss.elastic.co/t/elasticsearch-aggregation-return-location/183179 "2019-05-29T14:03:18Z")

</div>

Hi guys, a query on aggregation in which way I can return the location in the aggregation result. to then place it on the maps.

---

## [Create New cluster](https://discuss.elastic.co/t/create-new-cluster/183301)

<div class="topic-metadata">

**Author:** [@karthick\_moorthy](https://discuss.elastic.co/u/karthick_moorthy)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 1:51pm UTC](https://discuss.elastic.co/t/create-new-cluster/183301 "2019-05-29T13:51:14Z")

</div>

Hi, Im new to elasticsearch , I need to create a cluster with 3 nodes. my Query is How many master nodes i suppose to have ? How many data nodes i suppose to have ? is ingest node is required ? How many shards, i n…

---

## [Difference between index and update with doc\_as\_upsert](https://discuss.elastic.co/t/difference-between-index-and-update-with-doc-as-upsert/183345)

<div class="topic-metadata">

**Author:** [@elastic\_26](https://discuss.elastic.co/u/elastic_26)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 1:49pm UTC](https://discuss.elastic.co/t/difference-between-index-and-update-with-doc-as-upsert/183345 "2019-05-29T13:49:28Z")

</div>

Hello, I am trying to find out what is the difference between using "index" versus using "update with doc\_as\_upsert set to true". Which one is better from a performance perspective? Thank you

---

## [Best way for add comma separated field value in Elasticsearch index](https://discuss.elastic.co/t/best-way-for-add-comma-separated-field-value-in-elasticsearch-index/183332)

<div class="topic-metadata">

**Author:** [@jignesh.panchal](https://discuss.elastic.co/u/jignesh.panchal)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 12:35pm UTC](https://discuss.elastic.co/t/best-way-for-add-comma-separated-field-value-in-elasticsearch-index/183332 "2019-05-29T12:35:27Z")

</div>

In our mysql data we have one column with comma separated integer value. and I am using this value in where condition also using find\_in\_set for get specific result. I need option like this in Elasticsearch also. Curren…

---

## [Working on "values" in field to return result](https://discuss.elastic.co/t/working-on-values-in-field-to-return-result/183190)

<div class="topic-metadata">

**Author:** [@Dunkirk](https://discuss.elastic.co/u/Dunkirk)\
**Replies:** 6\
**Last updated:** [May 29, 2019, 12:31pm UTC](https://discuss.elastic.co/t/working-on-values-in-field-to-return-result/183190 "2019-05-29T12:31:01Z")

</div>

I'm trying to build a search script that returns true or false based on a strange criteria. One of my fields is a JSON array of strings. For particular records, the first string represents an integer which is a bitfield.…

---

## [Elasticsearch master/slave replication](https://discuss.elastic.co/t/elasticsearch-master-slave-replication/183324)

<div class="topic-metadata">

**Author:** [@nuwan](https://discuss.elastic.co/u/nuwan)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 12:01pm UTC](https://discuss.elastic.co/t/elasticsearch-master-slave-replication/183324 "2019-05-29T12:01:27Z")

</div>

Hi team, I have 3 nodes Elasticsearch cluster on Rackspace infrastructure(Production) and I have setup DR 3 nodes Elasticsearch cluster on AWS(DR). Now I need to replicate Production cluster to DR. Appreciate if you gu…

---

## [Filter with best match approach](https://discuss.elastic.co/t/filter-with-best-match-approach/182936)

<div class="topic-metadata">

**Author:** [@AvishaiK](https://discuss.elastic.co/u/AvishaiK)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 11:37am UTC](https://discuss.elastic.co/t/filter-with-best-match-approach/182936 "2019-05-29T11:37:10Z")

</div>

Hello, I'm struggling with the correct operator for this query logic: I need to match the exact value or to treat it as a null and filter/demote that option For example i have this data in elastic: document | fiel…

---

## [How to handle bulk data in "Terms Query"](https://discuss.elastic.co/t/how-to-handle-bulk-data-in-terms-query/183312)

<div class="topic-metadata">

**Author:** [@Balasubramani\_A](https://discuss.elastic.co/u/Balasubramani_A)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 11:21am UTC](https://discuss.elastic.co/t/how-to-handle-bulk-data-in-terms-query/183312 "2019-05-29T11:21:26Z")

</div>

Hi, Need to check the list of 10000 ids available in my indexed doc? How to achieve that efficiently. I am using java apis for elastic search "query" : { "terms" : { "DestCountry" : \["US","IT"\] // =\> How to give lak…

---

## [Port 9200 web site not displaying](https://discuss.elastic.co/t/port-9200-web-site-not-displaying/183308)

<div class="topic-metadata">

**Author:** [@jeremy\_rank](https://discuss.elastic.co/u/jeremy_rank)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 10:50am UTC](https://discuss.elastic.co/t/port-9200-web-site-not-displaying/183308 "2019-05-29T10:50:21Z")

</div>

I have tried many of the posts on here with changing the network.host to either 0.0.0.0, local, 127.0.0.1, site but none seem to be working. Some assistance would be appreciated. Current elasticsearch.yml: bootstrap.m…

---

## [Indexing error after elasticsearch upgrade](https://discuss.elastic.co/t/indexing-error-after-elasticsearch-upgrade/182961)

<div class="topic-metadata">

**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 10:29am UTC](https://discuss.elastic.co/t/indexing-error-after-elasticsearch-upgrade/182961 "2019-05-29T10:29:01Z")

</div>

Hi, I recently upgraded elasticsearch cluster from 5.x to 7.x. Post this upgrade, I'm seeing below error while indexing data: \*\*00:42:53\*\* File "/usr/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", l…

---

## [Elasticsearch JVM Memory Pressure Issue](https://discuss.elastic.co/t/elasticsearch-jvm-memory-pressure-issue/181621)

<div class="topic-metadata">

**Author:** [@dey\_subhro](https://discuss.elastic.co/u/dey_subhro)\
**Replies:** 28\
**Last updated:** [May 29, 2019, 10:04am UTC](https://discuss.elastic.co/t/elasticsearch-jvm-memory-pressure-issue/181621 "2019-05-29T10:04:33Z")

</div>

Hi, I am using m4.large.elasticsearch with 2 nodes having 512 GB of EBS Volume.In total of 1TB disk space. I have setup the fielddata cache limit to 40%. We are continuously experiencing Cluster Index Blocking issue wh…

---

## [Elastic search has problem with the java](https://discuss.elastic.co/t/elastic-search-has-problem-with-the-java/183265)

<div class="topic-metadata">

**Author:** [@Navaneetha\_Krishnan](https://discuss.elastic.co/u/Navaneetha_Krishnan)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 9:40am UTC](https://discuss.elastic.co/t/elastic-search-has-problem-with-the-java/183265 "2019-05-29T09:40:06Z")

</div>

Error: Could not find or load main class org.elasticsearch.tools.JavaVersionChecker Elasticsearch requires at least Java 8 but your Java version from C:/Program Files/Java/jdk1.8.0\_201/bin/java does not meet this requir…

---

## [Why is there a default boost of 2.2?](https://discuss.elastic.co/t/why-is-there-a-default-boost-of-2-2/183174)

<div class="topic-metadata">

**Author:** [@slumx](https://discuss.elastic.co/u/slumx)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 9:27am UTC](https://discuss.elastic.co/t/why-is-there-a-default-boost-of-2-2/183174 "2019-05-29T09:27:57Z")

</div>

In Elasticsearch 7.1 when no boost is added (index or query) the explanation still says there is a boost of 2.2. Steps to reproduce: follow the steps described here https://www.elastic.co/guide/en/elasticsearch/refer…

---

## [How to modify snapshot settings](https://discuss.elastic.co/t/how-to-modify-snapshot-settings/183287)

<div class="topic-metadata">

**Author:** [@elk3](https://discuss.elastic.co/u/elk3)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 9:11am UTC](https://discuss.elastic.co/t/how-to-modify-snapshot-settings/183287 "2019-05-29T09:11:47Z")

</div>

i created the snapshot, but column data type mismatch when i try to update setting ,not able to update ,how to update snapshot setting i.e read-only:true, to read\_only:false it is possible to update snapshot setting …

---

## [Scaling \*always-hot\* indices automatically? Multiple shards or indices?](https://discuss.elastic.co/t/scaling-always-hot-indices-automatically-multiple-shards-or-indices/182759)

<div class="topic-metadata">

**Author:** [@cdekker](https://discuss.elastic.co/u/cdekker)\
**Replies:** 2\
**Last updated:** [May 29, 2019, 8:56am UTC](https://discuss.elastic.co/t/scaling-always-hot-indices-automatically-multiple-shards-or-indices/182759 "2019-05-29T08:56:55Z")

</div>

I have a SaaS system where each client has their own separate index. There are about 400 indices on 8 nodes with a total of 5TB of data. Data is not a time series, but always 'hot'. There are constant inserts, updates a…

---

## [Increased disk writes on elasticsearch](https://discuss.elastic.co/t/increased-disk-writes-on-elasticsearch/182949)

<div class="topic-metadata">

**Author:** [@camjesus2](https://discuss.elastic.co/u/camjesus2)\
**Replies:** 6\
**Last updated:** [May 29, 2019, 8:56am UTC](https://discuss.elastic.co/t/increased-disk-writes-on-elasticsearch/182949 "2019-05-29T08:56:51Z")

</div>

Hi all, kinda new to ES, so please bear with me. I've noticed a clear increse in disk WRITES more or less (but not quite) coincident with the upgrade to ES 7. I have only one node with around 150 shards ingesting data …

---

## [Kibana is unable to fetch data from Elasticsearch](https://discuss.elastic.co/t/kibana-is-unable-to-fetch-data-from-elasticsearch/183275)

<div class="topic-metadata">

**Author:** [@arnav\_anand](https://discuss.elastic.co/u/arnav_anand)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 8:36am UTC](https://discuss.elastic.co/t/kibana-is-unable-to-fetch-data-from-elasticsearch/183275 "2019-05-29T08:36:57Z")

</div>

Elasticsearch version: 6.7.1 Kibana version: 6.7.1 Elastic search URL: 10.0.2.15:9200 I've also updated the kibana.yml file to point to the elasticsearch url as follows: elasticsearch.url: http: 10.0.2.15:9200 http:…

---

## [Combining data from two indexes with common field (ID)](https://discuss.elastic.co/t/combining-data-from-two-indexes-with-common-field-id/183187)

<div class="topic-metadata">

**Author:** [@saif3r](https://discuss.elastic.co/u/saif3r)\
**Replies:** 2\
**Last updated:** [May 29, 2019, 8:24am UTC](https://discuss.elastic.co/t/combining-data-from-two-indexes-with-common-field-id/183187 "2019-05-29T08:24:47Z")

</div>

Hello All, I have two different indexes, one contains a list of items, along with their ID, something like: Items: itemID: int itemName: text itemDescription: text Second index contains orders with a reference to…

---

## [Doc\_values description mentioned in different chapter](https://discuss.elastic.co/t/doc-values-description-mentioned-in-different-chapter/183272)

<div class="topic-metadata">

**Author:** [@chigix](https://discuss.elastic.co/u/chigix)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 8:18am UTC](https://discuss.elastic.co/t/doc-values-description-mentioned-in-different-chapter/183272 "2019-05-29T08:18:15Z")

</div>

I've used that it said doc\_values is not supported in text fields in the document of fielddata: Most fields can use index-time, on-disk doc\_values for this data access pattern, but text fields do not support doc\_v…

---

## [How to use total hit count in bucket\_script aggregation under the terms aggregation?](https://discuss.elastic.co/t/how-to-use-total-hit-count-in-bucket-script-aggregation-under-the-terms-aggregation/183268)

<div class="topic-metadata">

**Author:** [@murat](https://discuss.elastic.co/u/murat)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 8:05am UTC](https://discuss.elastic.co/t/how-to-use-total-hit-count-in-bucket-script-aggregation-under-the-terms-aggregation/183268 "2019-05-29T08:05:12Z")

</div>

I'm trying to use total hit count with the bucket\_script aggregation as sub aggregation of terms aggregation. Any suggestions are welcome. I also tried value\_count and terms aggregation on the package id field. But it a…

---

## [Have queue in Refresh](https://discuss.elastic.co/t/have-queue-in-refresh/183266)

<div class="topic-metadata">

**Author:** [@saeednasehi](https://discuss.elastic.co/u/saeednasehi)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 7:58am UTC](https://discuss.elastic.co/t/have-queue-in-refresh/183266 "2019-05-29T07:58:34Z")

</div>

Hi, I have a cluster of three elasticsearch nodes. one of them has HDD disk and the others have SSD. Unfortunately some times I have queue in refresh section and I cannot see any of the newly inserted documents. Is there…

---

## [Monitor pm2 process list usage in elastic search](https://discuss.elastic.co/t/monitor-pm2-process-list-usage-in-elastic-search/183264)

<div class="topic-metadata">

**Author:** [@Muiz\_Aludin](https://discuss.elastic.co/u/Muiz_Aludin)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 7:53am UTC](https://discuss.elastic.co/t/monitor-pm2-process-list-usage-in-elastic-search/183264 "2019-05-29T07:53:44Z")

</div>

My apps running on pm2, however, pm2 only record the process list usage in real time value. I plan to use the elastic search to monitor all the process list. Can I store the value and monitor using elastic search APM o…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1280)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1282)
