# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1282

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1283

---

## [Reindex with text replace](https://discuss.elastic.co/t/reindex-with-text-replace/182908)

<div class="topic-metadata">

**Author:** [@Martin\_Fredriksson](https://discuss.elastic.co/u/Martin_Fredriksson)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 7:40am UTC](https://discuss.elastic.co/t/reindex-with-text-replace/182908 "2019-05-29T07:40:17Z")

</div>

I was trying to reindex a large index when I discovered that there are trailing \\r\\n in the end of all values of a field. Since the mapping in the new index for this field is a double, and not a string, it crashes. How …

---

## [Indexing and searching special characters java](https://discuss.elastic.co/t/indexing-and-searching-special-characters-java/183257)

<div class="topic-metadata">

**Author:** [@sahilkumar](https://discuss.elastic.co/u/sahilkumar)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 7:34am UTC](https://discuss.elastic.co/t/indexing-and-searching-special-characters-java/183257 "2019-05-29T07:34:19Z")

</div>

I need to index the my documents as they are without removing the special characters. I also need to search for the exact phrase such as: s\*\* When I search for s\*\* using mathphrase query it removes \*\* from the phrase an…

---

## [Ingest pipeline for creating custom fields](https://discuss.elastic.co/t/ingest-pipeline-for-creating-custom-fields/183058)

<div class="topic-metadata">

**Author:** [@mansoor](https://discuss.elastic.co/u/mansoor)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 7:35am UTC](https://discuss.elastic.co/t/ingest-pipeline-for-creating-custom-fields/183058 "2019-05-29T07:35:25Z")

</div>

resolved. so removing this

---

## [Index rate peaking at 4 p\\s on index of 2.2m documents](https://discuss.elastic.co/t/index-rate-peaking-at-4-p-s-on-index-of-2-2m-documents/183129)

<div class="topic-metadata">

**Author:** [@chappers72](https://discuss.elastic.co/u/chappers72)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 7:25am UTC](https://discuss.elastic.co/t/index-rate-peaking-at-4-p-s-on-index-of-2-2m-documents/183129 "2019-05-29T07:25:07Z")

</div>

I have an index of 2.2m records. My index rate is at best 4 per second and periodically 0 ps. The settings are below. Any insight gratefully received. { "dev-es-cdb": { "settings": { "index": { "refresh\_interval": …

---

## [Need help to write elasticsearch query which should search based on text of one field and another array field with (passed values or null)](https://discuss.elastic.co/t/need-help-to-write-elasticsearch-query-which-should-search-based-on-text-of-one-field-and-another-array-field-with-passed-values-or-null/183250)

<div class="topic-metadata">

**Author:** [@milankamboya](https://discuss.elastic.co/u/milankamboya)\
**Replies:** 0\
**Last updated:** [May 29, 2019, 7:21am UTC](https://discuss.elastic.co/t/need-help-to-write-elasticsearch-query-which-should-search-based-on-text-of-one-field-and-another-array-field-with-passed-values-or-null/183250 "2019-05-29T07:21:35Z")

</div>

I have data in the mysql database which have been stored into elasticsearch as documents using logstash job. \*\*Data example in database:\*\* firstname(text), lastname(text), email(text), tags(text & nullable) Here, tags …

---

## [How to deal with mapping conflicts?](https://discuss.elastic.co/t/how-to-deal-with-mapping-conflicts/181536)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 7:20am UTC](https://discuss.elastic.co/t/how-to-deal-with-mapping-conflicts/181536 "2019-05-29T07:20:44Z")

</div>

Hi, I have mutliple indices, one per logfile type. All application log indices are starting with the same prefix. I have an index pattern with that prefix, so that I am searching through all application indices at once …

---

## [Analysis to get key=value tokens](https://discuss.elastic.co/t/analysis-to-get-key-value-tokens/183153)

<div class="topic-metadata">

**Author:** [@agosmaker](https://discuss.elastic.co/u/agosmaker)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 7:16am UTC](https://discuss.elastic.co/t/analysis-to-get-key-value-tokens/183153 "2019-05-29T07:16:01Z")

</div>

Hello, I can have message like this Some object id=3 created by user=123 What is the best way to get tokens id=3, user=123 after analysis? I think about splitting with standard delimiters (with Tokenizer) excluding…

---

## [Modify watcher email config](https://discuss.elastic.co/t/modify-watcher-email-config/182995)

<div class="topic-metadata">

**Author:** [@hyhong](https://discuss.elastic.co/u/hyhong)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 7:03am UTC](https://discuss.elastic.co/t/modify-watcher-email-config/182995 "2019-05-29T07:03:12Z")

</div>

I need modify email config in elasticsearch.yml,and I wantn't restart elasticsearch.Have some suggestions?

---

## [Change the shards for index and terms aggregation query](https://discuss.elastic.co/t/change-the-shards-for-index-and-terms-aggregation-query/182467)

<div class="topic-metadata">

**Author:** [@klaus82](https://discuss.elastic.co/u/klaus82)\
**Replies:** 6\
**Last updated:** [May 29, 2019, 6:45am UTC](https://discuss.elastic.co/t/change-the-shards-for-index-and-terms-aggregation-query/182467 "2019-05-29T06:45:02Z")

</div>

Currently, I have two nodes on Elastic Cloud and my indexes have one shard and one replica each. If I'd increase to 3 the number of nodes and I'd reindex my indexes with two shards and one replica, could I have a differ…

---

## [Elasticsearch (6.4.1) - JVM OutOfMemoryError](https://discuss.elastic.co/t/elasticsearch-6-4-1-jvm-outofmemoryerror/183229)

<div class="topic-metadata">

**Author:** [@Sarika](https://discuss.elastic.co/u/Sarika)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 6:44am UTC](https://discuss.elastic.co/t/elasticsearch-6-4-1-jvm-outofmemoryerror/183229 "2019-05-29T06:44:10Z")

</div>

Hi Team, We have a elasticsearch cluster with 4 nodes, each node having total ~16 GB memory ES service memory assigned as below - export ES\_HEAP\_SIZE=10180m export ES\_JAVA\_OPTS="-Xms10180m -Xmx10180m" ES version - 6.…

---

## [Using Index Life cycle Management](https://discuss.elastic.co/t/using-index-life-cycle-management/183234)

<div class="topic-metadata">

**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Replies:** 6\
**Last updated:** [May 29, 2019, 6:42am UTC](https://discuss.elastic.co/t/using-index-life-cycle-management/183234 "2019-05-29T06:42:32Z")

</div>

I have created a index life cycle management which is working absolutely fine..now I am planning to attach ilm policy during the indices creation. I guess this can be achieved via creating template but I am confused here…

---

## [How can I connect two Elastic silos together?](https://discuss.elastic.co/t/how-can-i-connect-two-elastic-silos-together/183236)

<div class="topic-metadata">

**Author:** [@dhourani](https://discuss.elastic.co/u/dhourani)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 6:38am UTC](https://discuss.elastic.co/t/how-can-i-connect-two-elastic-silos-together/183236 "2019-05-29T06:38:48Z")

</div>

I have two teams each running their Elastic deployments and I need to have a centralized way of accessing the data and run my ML algorithms. I'm thinking maybe data virtualization could do this ? Please help.

---

## [Cannot access \_score in expression script with 7.x](https://discuss.elastic.co/t/cannot-access-score-in-expression-script-with-7-x/183134)

<div class="topic-metadata">

**Author:** [@cbley](https://discuss.elastic.co/u/cbley)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 6:10am UTC](https://discuss.elastic.co/t/cannot-access-score-in-expression-script-with-7-x/183134 "2019-05-29T06:10:13Z")

</div>

Hi. We used to order a terms aggregation by a "max\_score" sub-aggregation in Elasticsearch 6.5: { "size": 0, "query": { ... }, "aggregations": { "assets": { "terms": { "field": "type\_of", …

---

## [Elastic-stack 6.7 index to elastic-cloud](https://discuss.elastic.co/t/elastic-stack-6-7-index-to-elastic-cloud/182820)

<div class="topic-metadata">

**Author:** [@heiber](https://discuss.elastic.co/u/heiber)\
**Replies:** 7\
**Last updated:** [May 29, 2019, 6:04am UTC](https://discuss.elastic.co/t/elastic-stack-6-7-index-to-elastic-cloud/182820 "2019-05-29T06:04:20Z")

</div>

Hi every one, I'm new in cloud services, I have elastic stack on premise, and I want to run machine learning for one index from my stack into cloud services. I must replicate the index in the cloud ? or cloud cant conec…

---

## [Data search error](https://discuss.elastic.co/t/data-search-error/183218)

<div class="topic-metadata">

**Author:** [@Mahaveer\_Ws](https://discuss.elastic.co/u/Mahaveer_Ws)\
**Replies:** 3\
**Last updated:** [May 29, 2019, 5:49am UTC](https://discuss.elastic.co/t/data-search-error/183218 "2019-05-29T05:49:31Z")

</div>

Hello Greeting of the day :slight\_smile: When I'm searching data not search properly. I'm getting this error (No alive nodes found in your cluster) Thanks

---

## [Elastic Search cluster node backup](https://discuss.elastic.co/t/elastic-search-cluster-node-backup/183219)

<div class="topic-metadata">

**Author:** [@tamil6593](https://discuss.elastic.co/u/tamil6593)\
**Replies:** 1\
**Last updated:** [May 29, 2019, 5:35am UTC](https://discuss.elastic.co/t/elastic-search-cluster-node-backup/183219 "2019-05-29T05:35:53Z")

</div>

hi, i am creating cluster with 2 nodes in some server. backup any one node or both node should be backup?

---

## [Template defining makes the elasticsearch slower](https://discuss.elastic.co/t/template-defining-makes-the-elasticsearch-slower/182306)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 8\
**Last updated:** [May 29, 2019, 5:27am UTC](https://discuss.elastic.co/t/template-defining-makes-the-elasticsearch-slower/182306 "2019-05-29T05:27:15Z")

</div>

hi all, when i start logstash without defining any templates, elasticsearch makes a template as following:

---

## [Delay in data shiping to ELK](https://discuss.elastic.co/t/delay-in-data-shiping-to-elk/181942)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 7\
**Last updated:** [May 29, 2019, 4:47am UTC](https://discuss.elastic.co/t/delay-in-data-shiping-to-elk/181942 "2019-05-29T04:47:00Z")

</div>

hi all, I have three servers which one elasticesearch , one logstash and one kibana is installed in each server. therefore, the ELK cluster has three nodes. the resource of servers is as following: servers1: RAM 12, CP…

---

## [How to change \_id as GUID during reindex](https://discuss.elastic.co/t/how-to-change-id-as-guid-during-reindex/182552)

<div class="topic-metadata">

**Author:** [@SudevPK](https://discuss.elastic.co/u/SudevPK)\
**Replies:** 4\
**Last updated:** [May 29, 2019, 3:43am UTC](https://discuss.elastic.co/t/how-to-change-id-as-guid-during-reindex/182552 "2019-05-29T03:43:34Z")

</div>

I have two different elastic search nodes.I need to reindex 10 indices from one node to 1 index in another node.But there is not unique id's in the 10 indices, so i need to generate \_id as GUID while reindexing

---

## [Apply LifeCycle Policy To Many Indices](https://discuss.elastic.co/t/apply-lifecycle-policy-to-many-indices/182261)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 2\
**Last updated:** [May 28, 2019, 10:21pm UTC](https://discuss.elastic.co/t/apply-lifecycle-policy-to-many-indices/182261 "2019-05-28T22:21:18Z")

</div>

I have about 200 older indices that do not have my ILM policy applied to them. Instead of going through Kibana and adding the policy one by one, what's the API endpoint and syntax for adding a policy to an index?

---

## [How to deal with Data changing](https://discuss.elastic.co/t/how-to-deal-with-data-changing/183100)

<div class="topic-metadata">

**Author:** [@Aymen\_Ben\_Moussa](https://discuss.elastic.co/u/Aymen_Ben_Moussa)\
**Replies:** 0\
**Last updated:** [May 28, 2019, 1:01pm UTC](https://discuss.elastic.co/t/how-to-deal-with-data-changing/183100 "2019-05-28T13:01:28Z")

</div>

I have kafka pushing logs from mongodb to logstash and logstash outputting to elasticsearch, i have fields added like the after and patch fields, they are both in the string format, the first one contains all the fields…

---

## [Apache Reverse Proxy - passing Multifactor authorization back](https://discuss.elastic.co/t/apache-reverse-proxy-passing-multifactor-authorization-back/183166)

<div class="topic-metadata">

**Author:** [@S\_Chase](https://discuss.elastic.co/u/S_Chase)\
**Replies:** 0\
**Last updated:** [May 28, 2019, 6:42pm UTC](https://discuss.elastic.co/t/apache-reverse-proxy-passing-multifactor-authorization-back/183166 "2019-05-28T18:42:33Z")

</div>

Has anyone implemented on Apache a reverse proxy - passing credentials back like this does with nginx?

---

## [Cross-cluster search between ECE2.2 cluster and non-ECE cluster not working](https://discuss.elastic.co/t/cross-cluster-search-between-ece2-2-cluster-and-non-ece-cluster-not-working/183131)

<div class="topic-metadata">

**Author:** [@jethropickering](https://discuss.elastic.co/u/jethropickering)\
**Replies:** 2\
**Last updated:** [May 28, 2019, 6:05pm UTC](https://discuss.elastic.co/t/cross-cluster-search-between-ece2-2-cluster-and-non-ece-cluster-not-working/183131 "2019-05-28T18:05:53Z")

</div>

Environment: ECE 2.2, Elastic 7.1 Cluster Non-ECE, Elastic 6.7.1 Cluster So according to docs 6.7.1 should be able to CCS to 7.1. However I am getting "General SSLEngine problem" and "unable to find valid certificatio…

---

## [Discovery with ECS, Dynamic Initial Master Nodes](https://discuss.elastic.co/t/discovery-with-ecs-dynamic-initial-master-nodes/183149)

<div class="topic-metadata">

**Author:** [@brhardwick](https://discuss.elastic.co/u/brhardwick)\
**Replies:** 12\
**Last updated:** [May 28, 2019, 6:05pm UTC](https://discuss.elastic.co/t/discovery-with-ecs-dynamic-initial-master-nodes/183149 "2019-05-28T18:05:28Z")

</div>

I am trying to setup a cluster with Elastic 7 on Amazon ECS. But I would like to get a bit of understanding on an approach for setting up the initial master nodes. I can bring up my stack if i explicitely assign each con…

---

## [Elasticsearch cluster down due to Elasticsearch:java.lang.OutOfMemoryError: Java heap space](https://discuss.elastic.co/t/elasticsearch-cluster-down-due-to-elasticsearch-java-lang-outofmemoryerror-java-heap-space/183154)

<div class="topic-metadata">

**Author:** [@gsagwan](https://discuss.elastic.co/u/gsagwan)\
**Replies:** 3\
**Last updated:** [May 28, 2019, 5:39pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-down-due-to-elasticsearch-java-lang-outofmemoryerror-java-heap-space/183154 "2019-05-28T17:39:00Z")

</div>

We are encountering an issue, wherein multiple nodes in our elasticsearch cluster goes down due to Elasticsearch:java.lang.OutOfMemoryError: Java heap space. As a result of this all the shards get unassigned and takes a…

---

## [Basic Users when SAML Enabled](https://discuss.elastic.co/t/basic-users-when-saml-enabled/182431)

<div class="topic-metadata">

**Author:** [@shaunm](https://discuss.elastic.co/u/shaunm)\
**Replies:** 5\
**Last updated:** [May 28, 2019, 4:48pm UTC](https://discuss.elastic.co/t/basic-users-when-saml-enabled/182431 "2019-05-28T16:48:45Z")

</div>

Hi I am having issues getting a non reserved basic user to work with SAML SSO enabled. I have created a logstash\_internal user for logstash to use in output. I am not able to authenticate with this user, or any other…

---

## [Parsing/storing networkupstools (nut) metrics](https://discuss.elastic.co/t/parsing-storing-networkupstools-nut-metrics/182056)

<div class="topic-metadata">

**Author:** [@lolli78](https://discuss.elastic.co/u/lolli78)\
**Replies:** 1\
**Last updated:** [May 28, 2019, 4:12pm UTC](https://discuss.elastic.co/t/parsing-storing-networkupstools-nut-metrics/182056 "2019-05-28T16:12:17Z")

</div>

Hi, I would like to store the metrics of my UPS (managed by https://networkupstools.org) in ES. There is a client "upsc" with the following output, which should be easily parsable: battery.capacity: 9.00 battery.charg…

---

## [EC2 Discovery Plugin and cluster.initial\_master\_nodes settings](https://discuss.elastic.co/t/ec2-discovery-plugin-and-cluster-initial-master-nodes-settings/183136)

<div class="topic-metadata">

**Author:** [@Martin\_H\_Andersen](https://discuss.elastic.co/u/Martin_H_Andersen)\
**Replies:** 0\
**Last updated:** [May 28, 2019, 3:26pm UTC](https://discuss.elastic.co/t/ec2-discovery-plugin-and-cluster-initial-master-nodes-settings/183136 "2019-05-28T15:26:18Z")

</div>

I am trying to get the EC2 Discovery Plugin to work. But first. Do I have to set the cluster.initial\_master\_nodes? I don't like to hardcode the ip addresse is there a way to avoid that? cat \> /etc/elasticsearch/elastics…

---

## [Elasticsearch timeout after 30000ms](https://discuss.elastic.co/t/elasticsearch-timeout-after-30000ms/183126)

<div class="topic-metadata">

**Author:** [@matheusribeirogarcia](https://discuss.elastic.co/u/matheusribeirogarcia)\
**Replies:** 6\
**Last updated:** [May 28, 2019, 3:22pm UTC](https://discuss.elastic.co/t/elasticsearch-timeout-after-30000ms/183126 "2019-05-28T15:22:47Z")

</div>

Hello everyone, basically i'm importing several totalized indices into one indice, but after sometime I get this timeout, and it also totally freezes my elastic cluster. I'm using a RestHighLevelClient like this: …

---

## [Create a geo-shape document from several other location documents](https://discuss.elastic.co/t/create-a-geo-shape-document-from-several-other-location-documents/182921)

<div class="topic-metadata">

**Author:** [@dao](https://discuss.elastic.co/u/dao)\
**Replies:** 1\
**Last updated:** [May 28, 2019, 3:21pm UTC](https://discuss.elastic.co/t/create-a-geo-shape-document-from-several-other-location-documents/182921 "2019-05-28T15:21:29Z")

</div>

Hello, I get several documents with a location inside. At the end of a period, I want to collect all the locations to create a new document which will be the route of those points (linestring) How can I do that? Pipeli…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1281)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1283)
