# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1773

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1774

---

## [ElasticSearch S3 Snapshot - Which node to run this on?](https://discuss.elastic.co/t/elasticsearch-s3-snapshot-which-node-to-run-this-on/121701)

<div class="topic-metadata">

**Author:** [@titan1978](https://discuss.elastic.co/u/titan1978)\
**Replies:** 3\
**Last updated:** [February 27, 2018, 5:40pm UTC](https://discuss.elastic.co/t/elasticsearch-s3-snapshot-which-node-to-run-this-on/121701 "2018-02-27T17:40:06Z")

</div>

Hello All, I have this ES stack configuration - am implementing the s3-repository plugin. I had a question around this! This is my Stack Config (AWS EC2): 2X CO Nodes (running curator for Rollover/Delete Indexes) 5X…

---

## [JVM Memory Always at 50% and Above](https://discuss.elastic.co/t/jvm-memory-always-at-50-and-above/121365)

<div class="topic-metadata">

**Author:** [@rajivchodisetti](https://discuss.elastic.co/u/rajivchodisetti)\
**Replies:** 7\
**Last updated:** [February 27, 2018, 5:31pm UTC](https://discuss.elastic.co/t/jvm-memory-always-at-50-and-above/121365 "2018-02-27T17:31:37Z")

</div>

\[35%20AM\] Hi, We have a 3 master and 6 Data Node ES setup, where data node is of config 30 GB RAM and 8 Core and where 16GB RAM is allocated for heap and rest for file system cache (i.e Lucene index caching) We use ES…

---

## [How to prevent logs missing](https://discuss.elastic.co/t/how-to-prevent-logs-missing/117157)

<div class="topic-metadata">

**Author:** [@cwt](https://discuss.elastic.co/u/cwt)\
**Replies:** 6\
**Last updated:** [February 27, 2018, 5:18pm UTC](https://discuss.elastic.co/t/how-to-prevent-logs-missing/117157 "2018-02-27T17:18:37Z")

</div>

Hi folks, Please share your experience and tips, how to protect from losing logs, when the Logstash or Elastic falls. RabbitMQ? Redis? I have one standalone ELK stack. Thank you

---

## [Lack of documentation: What are the accepted values for "boundary\_scanner\_locale"?](https://discuss.elastic.co/t/lack-of-documentation-what-are-the-accepted-values-for-boundary-scanner-locale/121683)

<div class="topic-metadata">

**Author:** [@aguyinmontreal](https://discuss.elastic.co/u/aguyinmontreal)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 4:58pm UTC](https://discuss.elastic.co/t/lack-of-documentation-what-are-the-accepted-values-for-boundary-scanner-locale/121683 "2018-02-27T16:58:26Z")

</div>

So, what are the accepted values for "boundary\_scanner\_locale"? see my question here: https://github.com/elastic/elasticsearch/issues/28816

---

## [Sending html by email](https://discuss.elastic.co/t/sending-html-by-email/121540)

<div class="topic-metadata">

**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 4:28pm UTC](https://discuss.elastic.co/t/sending-html-by-email/121540 "2018-02-27T16:28:08Z")

</div>

I was trying to send the email notification whose content is a html page. I tried "body": { "html" : "........" } But it only shows the link of the html not loading the html page when I receive the email.

---

## [X-pack elastic cloud](https://discuss.elastic.co/t/x-pack-elastic-cloud/121673)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 3:29pm UTC](https://discuss.elastic.co/t/x-pack-elastic-cloud/121673 "2018-02-27T15:29:27Z")

</div>

Hey guys, Is X-Pack (more importantly Machine Learning) set to be released to the elastic cloud any time in the future? Thanks, Jason

---

## [Merge different sites in one global node](https://discuss.elastic.co/t/merge-different-sites-in-one-global-node/120891)

<div class="topic-metadata">

**Author:** [@Hanen](https://discuss.elastic.co/u/Hanen)\
**Replies:** 8\
**Last updated:** [February 27, 2018, 3:24pm UTC](https://discuss.elastic.co/t/merge-different-sites-in-one-global-node/120891 "2018-02-27T15:24:34Z")

</div>

Hi, I would like to make sure about if it is possible to merge different sites in one global node Elasticsearch (PS: sites are related by VPN Connections). Is that something feasible please? If so, could you please men…

---

## [ElasticSearch - indexing and searching BinaryPoints](https://discuss.elastic.co/t/elasticsearch-indexing-and-searching-binarypoints/121679)

<div class="topic-metadata">

**Author:** [@dominik.safaric](https://discuss.elastic.co/u/dominik.safaric)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 2:39pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-and-searching-binarypoints/121679 "2018-02-27T14:39:01Z")

</div>

Lucene version 6.x introduced PointValues allowing to persist multi-dimensional values, including but not limited to BinaryPoint. According to the official documentation of Lucene, a BinaryPoint is An indexed binary fiel…

---

## [How can I change the type with the reindex api](https://discuss.elastic.co/t/how-can-i-change-the-type-with-the-reindex-api/121639)

<div class="topic-metadata">

**Author:** [@T3rm11](https://discuss.elastic.co/u/T3rm11)\
**Replies:** 3\
**Last updated:** [February 27, 2018, 2:38pm UTC](https://discuss.elastic.co/t/how-can-i-change-the-type-with-the-reindex-api/121639 "2018-02-27T14:38:59Z")

</div>

I need to reindex some indices because of the update to version 6. The new index needs to be of the type "doc" because Logstash is writing to it. How can I do this when the type is different in the source index? I norma…

---

## [ElasticSearch Write TPS?](https://discuss.elastic.co/t/elasticsearch-write-tps/121676)

<div class="topic-metadata">

**Author:** [@titan1978](https://discuss.elastic.co/u/titan1978)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 2:32pm UTC](https://discuss.elastic.co/t/elasticsearch-write-tps/121676 "2018-02-27T14:32:43Z")

</div>

Hello : I have an upcoming requirement wherein I need to bulk upload to Elasticsearch at a massive scale. While I've seen instances of people claiming million writes per sec is supported, I couldnt find a resource on how…

---

## [Elastic search Indexes](https://discuss.elastic.co/t/elastic-search-indexes/121648)

<div class="topic-metadata">

**Author:** [@Manjunatha\_Reddy](https://discuss.elastic.co/u/Manjunatha_Reddy)\
**Replies:** 3\
**Last updated:** [February 27, 2018, 2:32pm UTC](https://discuss.elastic.co/t/elastic-search-indexes/121648 "2018-02-27T14:32:18Z")

</div>

Hi Team, I am new to elastic search and ELK configuration. By following the documentation i was able to configure the ELK. I am pushing my application logs to Elastic search and the view the data in Kibana. Now i want…

---

## [ELK 6 and Future 7 and single type indexes](https://discuss.elastic.co/t/elk-6-and-future-7-and-single-type-indexes/121341)

<div class="topic-metadata">

**Author:** [@eperry](https://discuss.elastic.co/u/eperry)\
**Replies:** 9\
**Last updated:** [February 27, 2018, 2:27pm UTC](https://discuss.elastic.co/t/elk-6-and-future-7-and-single-type-indexes/121341 "2018-02-27T14:27:06Z")

</div>

I am trying to figure out the details on a single type index as I am on Elk 5 and upgrading to ELK6 and will upgrade to elk7 as soon as it is in beta. My question is, since the \_type field is getting removed, but I am …

---

## [MAPR and elasticsearch](https://discuss.elastic.co/t/mapr-and-elasticsearch/121618)

<div class="topic-metadata">

**Author:** [@Gaurav\_Agarwal](https://discuss.elastic.co/u/Gaurav_Agarwal)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 1:59pm UTC](https://discuss.elastic.co/t/mapr-and-elasticsearch/121618 "2018-02-27T13:59:25Z")

</div>

Can we directly use data from elasticsearch on MAPR some what similar to how we use the elasticsearch data in kibana and grafana. If yes please let me know how Regards Gaurav

---

## [Sum aggregation](https://discuss.elastic.co/t/sum-aggregation/121667)

<div class="topic-metadata">

**Author:** [@robbe482](https://discuss.elastic.co/u/robbe482)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 1:59pm UTC](https://discuss.elastic.co/t/sum-aggregation/121667 "2018-02-27T13:59:09Z")

</div>

Hi, I cant figure out how to make the following aggregation. (This is on 1.7) I have objects that look like following: {"currencyRate": 2, "orderRow": \[{"value": 1000, "productId": 1},{"value": 1000, "productId": 1}, {…

---

## [Elasticsearch Cost!](https://discuss.elastic.co/t/elasticsearch-cost/121623)

<div class="topic-metadata">

**Author:** [@Hassan\_Shaitou](https://discuss.elastic.co/u/Hassan_Shaitou)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 1:55pm UTC](https://discuss.elastic.co/t/elasticsearch-cost/121623 "2018-02-27T13:55:04Z")

</div>

Hello there, I have a question regarding the cost my company would pay forelastic search cluster. The company will receive 2 billion of data per year, in the future it is gonna be tough to handle them with single node e…

---

## [Conditional action only if list exists](https://discuss.elastic.co/t/conditional-action-only-if-list-exists/121213)

<div class="topic-metadata">

**Author:** [@Steve\_Stevens](https://discuss.elastic.co/u/Steve_Stevens)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 1:41pm UTC](https://discuss.elastic.co/t/conditional-action-only-if-list-exists/121213 "2018-02-27T13:41:10Z")

</div>

I have a watcher that performs a transform on matched records and then posts the result into a different index. I am making use of "ctx.payload.\_doc" to insert into the index. Depending on a complex action in the transfo…

---

## [Cannot update cluster settings](https://discuss.elastic.co/t/cannot-update-cluster-settings/121515)

<div class="topic-metadata">

**Author:** [@seyhmus](https://discuss.elastic.co/u/seyhmus)\
**Replies:** 3\
**Last updated:** [February 27, 2018, 1:26pm UTC](https://discuss.elastic.co/t/cannot-update-cluster-settings/121515 "2018-02-27T13:26:45Z")

</div>

Hi all, I've upgraded my cluster from 5.6 to 6.2.2 and using x-pack tls only. After upgrade cluster status is yellow and i am trying to enable routing shard allocation. PUT \_cluster/settings { "transient": { "clu…

---

## [Removing strangely named indexes](https://discuss.elastic.co/t/removing-strangely-named-indexes/121575)

<div class="topic-metadata">

**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 1:09pm UTC](https://discuss.elastic.co/t/removing-strangely-named-indexes/121575 "2018-02-27T13:09:34Z")

</div>

Hello, After wrongly confguring logstash I ended up with indices with the following format %{\[@file\[beat\]}-2017.11.30 is there a way that I can remove them? Thanks in advance.

---

## [When are inverted indexes generated](https://discuss.elastic.co/t/when-are-inverted-indexes-generated/121562)

<div class="topic-metadata">

**Author:** [@mvienne](https://discuss.elastic.co/u/mvienne)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 1:08pm UTC](https://discuss.elastic.co/t/when-are-inverted-indexes-generated/121562 "2018-02-27T13:08:58Z")

</div>

When are inverted indexes used by Elasticsearch to reply efficiently to search queries generated ? Is it at index time, or are they generated on the go from doc values ? Are they stored on the disk as well ?

---

## [ES2.4.6 - 22 Nodes m4.2xlarge data cluster max cpu and threads](https://discuss.elastic.co/t/es2-4-6-22-nodes-m4-2xlarge-data-cluster-max-cpu-and-threads/121587)

<div class="topic-metadata">

**Author:** [@Tim\_Curtin](https://discuss.elastic.co/u/Tim_Curtin)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 1:06pm UTC](https://discuss.elastic.co/t/es2-4-6-22-nodes-m4-2xlarge-data-cluster-max-cpu-and-threads/121587 "2018-02-27T13:06:10Z")

</div>

Hi All, Some details about our issue currently seen, we are at a loss and looking for help We run a 22 data node cluster, on aws EC2, on m4.2xlarge We are not memory bound when our issue occurs (ES gets approx 32GB al…

---

## [Sorting by language field in multilanguage scenario](https://discuss.elastic.co/t/sorting-by-language-field-in-multilanguage-scenario/121654)

<div class="topic-metadata">

**Author:** [@jnatten](https://discuss.elastic.co/u/jnatten)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 12:24pm UTC](https://discuss.elastic.co/t/sorting-by-language-field-in-multilanguage-scenario/121654 "2018-02-27T12:24:59Z")

</div>

Hi there, I'm in a situation where i need to store searchable multi-language documents. As of now the mapping looks something like: this. Now that is fine as long as you search for a single language, however when you …

---

## [Creating a Watcher Alert to a Webhook](https://discuss.elastic.co/t/creating-a-watcher-alert-to-a-webhook/121538)

<div class="topic-metadata">

**Author:** [@dmdm](https://discuss.elastic.co/u/dmdm)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 12:52pm UTC](https://discuss.elastic.co/t/creating-a-watcher-alert-to-a-webhook/121538 "2018-02-27T12:52:13Z")

</div>

Need a little help, new to Elastisearch and Kibana. Could someone tell me what I'm doing wrong I tried changing the example send an email on cluster status to use a web hook, but just keep getting errors: { "trigger"…

---

## [Search command](https://discuss.elastic.co/t/search-command/121581)

<div class="topic-metadata">

**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 12:49pm UTC](https://discuss.elastic.co/t/search-command/121581 "2018-02-27T12:49:43Z")

</div>

This is my watcher setting. PUT \_xpack/watcher/watch/EmailTest { "trigger" : { "schedule" : { "interval" : "1m" } }, "input" : { "search" : { "query" : { "bool" : { "filte…

---

## [Email alerting (html)](https://discuss.elastic.co/t/email-alerting-html/121406)

<div class="topic-metadata">

**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\
**Replies:** 1\
**Last updated:** [February 27, 2018, 12:48pm UTC](https://discuss.elastic.co/t/email-alerting-html/121406 "2018-02-27T12:48:17Z")

</div>

I am not sure how to set body.html in email notification of watcher. Here is what I did, but when I received the email, it did not show the content of html. It only shows the link of html. "actions": { "email\_adm…

---

## [Email alerting](https://discuss.elastic.co/t/email-alerting/121168)

<div class="topic-metadata">

**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\
**Replies:** 8\
**Last updated:** [February 27, 2018, 12:47pm UTC](https://discuss.elastic.co/t/email-alerting/121168 "2018-02-27T12:47:49Z")

</div>

I was trying to set the email alerting according to the official doc. The configuration for email has been set up successfully. Here is my code segment. POST \_xpack/watcher/watches/email\_test { "trigger" : { "sc…

---

## [Parent child implementation using join fields](https://discuss.elastic.co/t/parent-child-implementation-using-join-fields/121646)

<div class="topic-metadata">

**Author:** [@pamara](https://discuss.elastic.co/u/pamara)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 11:50am UTC](https://discuss.elastic.co/t/parent-child-implementation-using-join-fields/121646 "2018-02-27T11:50:56Z")

</div>

Hi Team, Currently we implemented parent/child relationship in elastic search by creating multiple types within same index. We created mapping such a way that Candidates as index and it has child types namely "person,s…

---

## [Facing query, sorting related issues on string/text type fields](https://discuss.elastic.co/t/facing-query-sorting-related-issues-on-string-text-type-fields/121644)

<div class="topic-metadata">

**Author:** [@nmathur](https://discuss.elastic.co/u/nmathur)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 11:43am UTC](https://discuss.elastic.co/t/facing-query-sorting-related-issues-on-string-text-type-fields/121644 "2018-02-27T11:43:14Z")

</div>

Hello All, I am working in ASP.NET MVC5 C# using Nest library. I have some important columns with text/string type and have to apply in clause/query on it and also need to apply sort based on them. I am using below te…

---

## [Segments Size in ES cluster](https://discuss.elastic.co/t/segments-size-in-es-cluster/121634)

<div class="topic-metadata">

**Author:** [@moni15moni](https://discuss.elastic.co/u/moni15moni)\
**Replies:** 0\
**Last updated:** [February 27, 2018, 10:58am UTC](https://discuss.elastic.co/t/segments-size-in-es-cluster/121634 "2018-02-27T10:58:32Z")

</div>

Hi My cluster has a volume of 16 Billion data with 1300 Shards and 12 TB of data and Data Nodes of,Each (16 GB ,2 TB & 4 Cores). The no of segments are increased to ==\> 19734 . IS there lead to any I/O issues. Because…

---

## [Reindexing after creating a new mapping](https://discuss.elastic.co/t/reindexing-after-creating-a-new-mapping/119851)

<div class="topic-metadata">

**Author:** [@Raghu19](https://discuss.elastic.co/u/Raghu19)\
**Replies:** 2\
**Last updated:** [February 27, 2018, 10:57am UTC](https://discuss.elastic.co/t/reindexing-after-creating-a-new-mapping/119851 "2018-02-27T10:57:47Z")

</div>

hi all, In our elasticsearch dEV instance, the indexes are getting created like "appid-2018.01.02", "appid-2018.01.05 " ( appid-yyyy.mm.dd format) - one index for each day's data. In a few indexes, one of the field - …

---

## [How to get count of document with its range using DSL query](https://discuss.elastic.co/t/how-to-get-count-of-document-with-its-range-using-dsl-query/121609)

<div class="topic-metadata">

**Author:** [@saineshwar\_bageri](https://discuss.elastic.co/u/saineshwar_bageri)\
**Replies:** 3\
**Last updated:** [February 27, 2018, 10:56am UTC](https://discuss.elastic.co/t/how-to-get-count-of-document-with-its-range-using-dsl-query/121609 "2018-02-27T10:56:46Z")

</div>

I want count of document between particular range. if i take appstatusid from range 1 to 500 then count of document will be 500. Document Sample "Indexname" :applicationstatus and unique id which i am inserting is "ap…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1772)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1774)
