# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1521

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1522

---

## [Performance of Term Query vs Terms Query with 1 value](https://discuss.elastic.co/t/performance-of-term-query-vs-terms-query-with-1-value/150818)

<div class="topic-metadata">

**Author:** [@Mohit\_Kathuria](https://discuss.elastic.co/u/Mohit_Kathuria)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 11:23am UTC](https://discuss.elastic.co/t/performance-of-term-query-vs-terms-query-with-1-value/150818 "2018-10-11T11:23:43Z")

</div>

We have an Elasticsearch cluster setup of 5 data nodes, 3 master with version 5.2.2. The cluster has 10 indices, namely txn\_0, txn\_1 ... txn\_9 where Ith index has all transactions of a user with modulus of 10 as I. For e…

---

## [Elasticsearch huge buff/cache usage](https://discuss.elastic.co/t/elasticsearch-huge-buff-cache-usage/152025)

<div class="topic-metadata">

**Author:** [@Zerobot](https://discuss.elastic.co/u/Zerobot)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 10:23am UTC](https://discuss.elastic.co/t/elasticsearch-huge-buff-cache-usage/152025 "2018-10-11T10:23:43Z")

</div>

Hello, Recently we spotted that our dedicated elasticsearch vm's with 15GB RAM each / 7GB Elasticsearch heap have a huge buff/cache usage. At somepoint it reaches almost 8GB and we have 150MB of free memory on our machi…

---

## [6.4.1: Delete By Query API](https://discuss.elastic.co/t/6-4-1-delete-by-query-api/151975)

<div class="topic-metadata">

**Author:** [@pokaleshrey](https://discuss.elastic.co/u/pokaleshrey)\
**Replies:** 4\
**Last updated:** [October 11, 2018, 9:45am UTC](https://discuss.elastic.co/t/6-4-1-delete-by-query-api/151975 "2018-10-11T09:45:43Z")

</div>

Hi, I am using 6.4.1 APIs and need to know how does one 'delete by query' in this version. I have initialized my HighLevelRestClient using two coordinating nodes? I don't want to use REST call, because i want to connec…

---

## [Modelling data and query](https://discuss.elastic.co/t/modelling-data-and-query/151633)

<div class="topic-metadata">

**Author:** [@ellonde](https://discuss.elastic.co/u/ellonde)\
**Replies:** 2\
**Last updated:** [October 11, 2018, 9:43am UTC](https://discuss.elastic.co/t/modelling-data-and-query/151633 "2018-10-11T09:43:28Z")

</div>

Hello there, Im pretty new to the ES stack and im not quite sure how to model my problem, right now it seems like an endless amount of options for modelling the queries and data. The case is quite simple: I have a bunc…

---

## [ES Benchmark using rally to stress a 2 node setup](https://discuss.elastic.co/t/es-benchmark-using-rally-to-stress-a-2-node-setup/150020)

<div class="topic-metadata">

**Author:** [@Jorge\_Betancourt](https://discuss.elastic.co/u/Jorge_Betancourt)\
**Replies:** 5\
**Last updated:** [October 11, 2018, 9:41am UTC](https://discuss.elastic.co/t/es-benchmark-using-rally-to-stress-a-2-node-setup/150020 "2018-10-11T09:41:00Z")

</div>

Currently, we’re trying to use rally to test how much data I can ingest in a 2 node setup (1 data node, 1 dedicated master node). Our ES setup is running in Docker. With rally we get a maximum ingestion of ~150k docs/s u…

---

## [Can't reindex from Remote \[Solved\]](https://discuss.elastic.co/t/cant-reindex-from-remote-solved/151800)

<div class="topic-metadata">

**Author:** [@geppo](https://discuss.elastic.co/u/geppo)\
**Replies:** 2\
**Last updated:** [October 11, 2018, 9:18am UTC](https://discuss.elastic.co/t/cant-reindex-from-remote-solved/151800 "2018-10-11T09:18:23Z")

</div>

Hi, I'm trying to use the reindex api from remote. I add to my locale elasticsearch.yml the ip and the port from remote source in reindex.remote.whitelist Then i retrieve the mapping of my index from remote and I have…

---

## [\[Performance\]Document security vs multiple indeces?](https://discuss.elastic.co/t/performance-document-security-vs-multiple-indeces/152011)

<div class="topic-metadata">

**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 8:51am UTC](https://discuss.elastic.co/t/performance-document-security-vs-multiple-indeces/152011 "2018-10-11T08:51:34Z")

</div>

Hi, I have some data, all the same kind, but from different sources, that I need to secure. My initial plan was to create a separate index for each source and use roles to limit access to a index. But I realized the sam…

---

## [Copy indices from elastic 5 to 6](https://discuss.elastic.co/t/copy-indices-from-elastic-5-to-6/151756)

<div class="topic-metadata">

**Author:** [@Unmil\_Bind](https://discuss.elastic.co/u/Unmil_Bind)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 8:49am UTC](https://discuss.elastic.co/t/copy-indices-from-elastic-5-to-6/151756 "2018-10-11T08:49:31Z")

</div>

Hello, Currently I am using elasticsearch 5.6.4 which has some production indices which is in one standalone instance. And another standalone elasticsearch 6.3.2 with same production indices as well. I want to shift …

---

## [Elasticsearch remove column/attribute from a document](https://discuss.elastic.co/t/elasticsearch-remove-column-attribute-from-a-document/151786)

<div class="topic-metadata">

**Author:** [@Waleed\_Malik](https://discuss.elastic.co/u/Waleed_Malik)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 8:43am UTC](https://discuss.elastic.co/t/elasticsearch-remove-column-attribute-from-a-document/151786 "2018-10-11T08:43:06Z")

</div>

Hi, I am using elastic-search Java API in my spring application. I have created multiple elastic-search repositories in it. Now what i want to do is against a certain repository lets say TestRepository, i want to remove…

---

## [Continuous high CPU and load + EsRejectedExecutionException](https://discuss.elastic.co/t/continuous-high-cpu-and-load-esrejectedexecutionexception/151905)

<div class="topic-metadata">

**Author:** [@Roni\_T](https://discuss.elastic.co/u/Roni_T)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 8:22am UTC](https://discuss.elastic.co/t/continuous-high-cpu-and-load-esrejectedexecutionexception/151905 "2018-10-11T08:22:09Z")

</div>

Hi all, We're running a cluster with the following configuration: 6 data nodes (each has 31G RAM allocated to ES heap, and 16 vCPU - m4.4xlarge on AWS) 1 main index (others are very small) 21 shards 1 replica ~600,000…

---

## [Getting GC error from elasticsearch](https://discuss.elastic.co/t/getting-gc-error-from-elasticsearch/151186)

<div class="topic-metadata">

**Author:** [@gayathri](https://discuss.elastic.co/u/gayathri)\
**Replies:** 5\
**Last updated:** [October 11, 2018, 7:54am UTC](https://discuss.elastic.co/t/getting-gc-error-from-elasticsearch/151186 "2018-10-11T07:54:20Z")

</div>

Hi Team, Kindly suggest any solutions for below errors. Our cluster is in Red state due to this: 2018-10-05T01:30:58,403\]\[WARN \]\[o.e.m.j.JvmGcMonitorService\] \[Node\_ELK\] \[gc\]\[young\]\[1301721\]\[238872\] duration \[2.2s\], col…

---

## [Logstash/ long datatype returning String](https://discuss.elastic.co/t/logstash-long-datatype-returning-string/151789)

<div class="topic-metadata">

**Author:** [@Lakshmi\_Deepak\_Katar](https://discuss.elastic.co/u/Lakshmi_Deepak_Katar)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 7:00am UTC](https://discuss.elastic.co/t/logstash-long-datatype-returning-string/151789 "2018-10-11T07:00:57Z")

</div>

Hi, Please help me, I am very new to ELK, I am trying to change file-size field value to long data type but it is returning as string. log message: 19-09-2018 18:25:12.676 type:interface::filename:AccountsDetails.csv:…

---

## [Authentication credentials of the Elastic Hosted Server](https://discuss.elastic.co/t/authentication-credentials-of-the-elastic-hosted-server/151953)

<div class="topic-metadata">

**Author:** [@Benjamin\_Roffey](https://discuss.elastic.co/u/Benjamin_Roffey)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 6:41am UTC](https://discuss.elastic.co/t/authentication-credentials-of-the-elastic-hosted-server/151953 "2018-10-11T06:41:44Z")

</div>

Hi All, I'm currently experimenting with the Elastic Hosted Server, and our system spits out custom formatted JSON posts that the plan is to ingest directly into Elastic Search, bypassing the Logstack pipeline. My issu…

---

## [Which one should I choose between ES and MongoDB?](https://discuss.elastic.co/t/which-one-should-i-choose-between-es-and-mongodb/151728)

<div class="topic-metadata">

**Author:** [@nandan\_bigdata](https://discuss.elastic.co/u/nandan_bigdata)\
**Replies:** 2\
**Last updated:** [October 11, 2018, 6:25am UTC](https://discuss.elastic.co/t/which-one-should-i-choose-between-es-and-mongodb/151728 "2018-10-11T06:25:00Z")

</div>

Hi All, Just for discussion purpose, I am asking this question. I am building a single customer view product . Total numbers of customer is around 10 millions. For this building a single customer view which one will b…

---

## [How to Map Greek Word to Multiple English Words](https://discuss.elastic.co/t/how-to-map-greek-word-to-multiple-english-words/151985)

<div class="topic-metadata">

**Author:** [@Aniruddha\_Deshpande](https://discuss.elastic.co/u/Aniruddha_Deshpande)\
**Replies:** 0\
**Last updated:** [October 11, 2018, 6:22am UTC](https://discuss.elastic.co/t/how-to-map-greek-word-to-multiple-english-words/151985 "2018-10-11T06:22:40Z")

</div>

In My application English name consist of Greek word. For example i have title field called Test αβ γ, people in application search by keyword Test ab or Test alphab or Test alphabeta gamma. I have followed this link - h…

---

## [Elactic & Logstash infrastructure for diferent retention requeriment](https://discuss.elastic.co/t/elactic-logstash-infrastructure-for-diferent-retention-requeriment/151966)

<div class="topic-metadata">

**Author:** [@cdra](https://discuss.elastic.co/u/cdra)\
**Replies:** 6\
**Last updated:** [October 11, 2018, 6:21am UTC](https://discuss.elastic.co/t/elactic-logstash-infrastructure-for-diferent-retention-requeriment/151966 "2018-10-11T06:21:03Z")

</div>

We have a computer (C1) with elacticsearch and Kibana. Other computer (C2) with logstash installed. Network computers send syslog messages to logstash. Logstash send messages to C1.These logs have some información: User…

---

## [Search-queued-tasks more than 1000](https://discuss.elastic.co/t/search-queued-tasks-more-than-1000/151734)

<div class="topic-metadata">

**Author:** [@minhua1983](https://discuss.elastic.co/u/minhua1983)\
**Replies:** 4\
**Last updated:** [October 11, 2018, 6:13am UTC](https://discuss.elastic.co/t/search-queued-tasks-more-than-1000/151734 "2018-10-11T06:13:17Z")

</div>

I found that the search-queued-tasks was usually more than 1000. There are several visualizes in my dashboard. Each of them set an aggregation at least. I have no idea what caused this issue. Is this situation normal？

---

## [Certificates and keys for Kibana and Logstash with X-Pack](https://discuss.elastic.co/t/certificates-and-keys-for-kibana-and-logstash-with-x-pack/150390)

<div class="topic-metadata">

**Author:** [@lcui\_dxc](https://discuss.elastic.co/u/lcui_dxc)\
**Replies:** 11\
**Last updated:** [October 11, 2018, 5:00am UTC](https://discuss.elastic.co/t/certificates-and-keys-for-kibana-and-logstash-with-x-pack/150390 "2018-10-11T05:00:29Z")

</div>

Hello there, I'm setting up the ELK security using X-Pack, I generated the CA and Certs as suggested by the docs: bin/elasticsearch-certutil ca bin/elasticsearch-certutil cert --ca elastic-stack-ca.p12 Shipped them t…

---

## [When is the ValuesSourceAggregationBuilder constructor that takes a StreamInput executed?](https://discuss.elastic.co/t/when-is-the-valuessourceaggregationbuilder-constructor-that-takes-a-streaminput-executed/151713)

<div class="topic-metadata">

**Author:** [@Brett\_Anderson](https://discuss.elastic.co/u/Brett_Anderson)\
**Replies:** 1\
**Last updated:** [October 11, 2018, 1:39am UTC](https://discuss.elastic.co/t/when-is-the-valuessourceaggregationbuilder-constructor-that-takes-a-streaminput-executed/151713 "2018-10-11T01:39:04Z")

</div>

I'm having an error with a custom plugin I'm working on. The problem is the error only occurs on a development cluster that takes a long time to make changes to. To develop efficiently I debug everything on a local Elast…

---

## [SAML configuration in a Elasticsearch cluster](https://discuss.elastic.co/t/saml-configuration-in-a-elasticsearch-cluster/151858)

<div class="topic-metadata">

**Author:** [@talon](https://discuss.elastic.co/u/talon)\
**Replies:** 2\
**Last updated:** [October 11, 2018, 12:41am UTC](https://discuss.elastic.co/t/saml-configuration-in-a-elasticsearch-cluster/151858 "2018-10-11T00:41:35Z")

</div>

Hi I have a question, i have enable SAML in my Elasticsearch cluster. and i enable SAML in each node, that is i write the SAML configuration in each node's elasticsearch.yml. I want to ask if this is necessary, or i j…

---

## [Aggregation Results in Column format](https://discuss.elastic.co/t/aggregation-results-in-column-format/151923)

<div class="topic-metadata">

**Author:** [@nightmouse](https://discuss.elastic.co/u/nightmouse)\
**Replies:** 1\
**Last updated:** [October 10, 2018, 10:44pm UTC](https://discuss.elastic.co/t/aggregation-results-in-column-format/151923 "2018-10-10T22:44:21Z")

</div>

Does the ElasticSearch Java API have a way to convert Aggregation output to a Column/Row representation? The SQL API does this, but I don't see a way to do it with search API. Thanks!

---

## [How to correlate costly queries with intense garbage collection leading to out of memory](https://discuss.elastic.co/t/how-to-correlate-costly-queries-with-intense-garbage-collection-leading-to-out-of-memory/148396)

<div class="topic-metadata">

**Author:** [@Joseph\_Smith1](https://discuss.elastic.co/u/Joseph_Smith1)\
**Replies:** 4\
**Last updated:** [October 10, 2018, 9:35pm UTC](https://discuss.elastic.co/t/how-to-correlate-costly-queries-with-intense-garbage-collection-leading-to-out-of-memory/148396 "2018-10-10T21:35:15Z")

</div>

I have an ES cluster that is being used by multiple analysts who are issuing ad-hoc queries to perform data analysis. These analysts often formulate complex queries. Most of the time the cluster is stable, but occasional…

---

## [Create Index with Python and Login](https://discuss.elastic.co/t/create-index-with-python-and-login/151838)

<div class="topic-metadata">

**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\
**Replies:** 0\
**Last updated:** [October 10, 2018, 11:53am UTC](https://discuss.elastic.co/t/create-index-with-python-and-login/151838 "2018-10-10T11:53:17Z")

</div>

UPDATE. SOLVED by bypassing the RequestsHttpConnection I am trying to create a index using python import elasticsearch from elasticsearch import Elasticsearch,RequestsHttpConnection es = elasticsearch.Elasticsearch(\[…

---

## [Can i set 70% of memory?](https://discuss.elastic.co/t/can-i-set-70-of-memory/151896)

<div class="topic-metadata">

**Author:** [@merceskoba](https://discuss.elastic.co/u/merceskoba)\
**Replies:** 6\
**Last updated:** [October 10, 2018, 6:55pm UTC](https://discuss.elastic.co/t/can-i-set-70-of-memory/151896 "2018-10-10T18:55:44Z")

</div>

Hello Guys... I have upgraded my elasticsearch specification. Now, it has 8 Cores, 32 GB Memory, 1 TB Data. Is a must to set these settings -Xms16g and -Xmx16g ? Could i set those to be -Xms22g and -Xmx22g? Or should…

---

## [How to know when cluster is Down](https://discuss.elastic.co/t/how-to-know-when-cluster-is-down/151901)

<div class="topic-metadata">

**Author:** [@anveshdd](https://discuss.elastic.co/u/anveshdd)\
**Replies:** 1\
**Last updated:** [October 10, 2018, 5:44pm UTC](https://discuss.elastic.co/t/how-to-know-when-cluster-is-down/151901 "2018-10-10T17:44:41Z")

</div>

Hi, How can we setup a notification when Cluster is Down .Does all nodes knows whenever cluster is Down?

---

## [Cluster status turned to red after generated about 2TB indices data](https://discuss.elastic.co/t/cluster-status-turned-to-red-after-generated-about-2tb-indices-data/151866)

<div class="topic-metadata">

**Author:** [@netvmdb](https://discuss.elastic.co/u/netvmdb)\
**Replies:** 2\
**Last updated:** [October 10, 2018, 5:28pm UTC](https://discuss.elastic.co/t/cluster-status-turned-to-red-after-generated-about-2tb-indices-data/151866 "2018-10-10T17:28:31Z")

</div>

elasticsearch / logstash / kibana oss 6.2.4 23GB log/day. Initially the cluster was ok to ingest data, but slow on building large index. But after ingest 2TB of index data, it slows down more. Eventually cluster status…

---

## [Angular JS App using ES 5.2 upgrade to 6.x](https://discuss.elastic.co/t/angular-js-app-using-es-5-2-upgrade-to-6-x/151900)

<div class="topic-metadata">

**Author:** [@juiip](https://discuss.elastic.co/u/juiip)\
**Replies:** 0\
**Last updated:** [October 10, 2018, 5:11pm UTC](https://discuss.elastic.co/t/angular-js-app-using-es-5-2-upgrade-to-6-x/151900 "2018-10-10T17:11:18Z")

</div>

Hi, I'm relatively new to ES and I've been put in charge of an Angular JS application that runs Elasticsearch v 5.2 queries to then use in data visualizations. I'm wondering whether to upgrade to version 6. It seems lik…

---

## [Hits without Aggs](https://discuss.elastic.co/t/hits-without-aggs/151898)

<div class="topic-metadata">

**Author:** [@rubend](https://discuss.elastic.co/u/rubend)\
**Replies:** 0\
**Last updated:** [October 10, 2018, 4:50pm UTC](https://discuss.elastic.co/t/hits-without-aggs/151898 "2018-10-10T16:50:28Z")

</div>

Given an index OrderItems OrderDateTm OrderId CustId OrderItem Qty 10/10 9:11am 123456 acme Shirt 2 10/10 9:11am 123456 acme Pants 1 10/10 9:11am 123456 acme Hat 3 10/10 9:10am 101234 jones iphone 1 10/10 9:0…

---

## [Index threadpool vs write threadpool](https://discuss.elastic.co/t/index-threadpool-vs-write-threadpool/151864)

<div class="topic-metadata">

**Author:** [@bli](https://discuss.elastic.co/u/bli)\
**Replies:** 3\
**Last updated:** [October 10, 2018, 4:50pm UTC](https://discuss.elastic.co/t/index-threadpool-vs-write-threadpool/151864 "2018-10-10T16:50:27Z")

</div>

According to https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-threadpool.html, a node holds: index threadpool For index/delete operations. Thread pool type is fixed with a size of # of availab…

---

## [Regex Email in Elastic Search](https://discuss.elastic.co/t/regex-email-in-elastic-search/151867)

<div class="topic-metadata">

**Author:** [@mhsankar](https://discuss.elastic.co/u/mhsankar)\
**Replies:** 7\
**Last updated:** [October 10, 2018, 4:28pm UTC](https://discuss.elastic.co/t/regex-email-in-elastic-search/151867 "2018-10-10T16:28:41Z")

</div>

Hi Every Body I have a Text field it have a lot of text . I want to extract Email Address from this text. how can extract Email Address using Regex in Elastic Search?

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1520)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1522)
