# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1272

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1273

---

## [Aggregating on related fields across documents](https://discuss.elastic.co/t/aggregating-on-related-fields-across-documents/184460)

<div class="topic-metadata">

**Author:** [@mconner](https://discuss.elastic.co/u/mconner)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 2:00pm UTC](https://discuss.elastic.co/t/aggregating-on-related-fields-across-documents/184460 "2019-06-06T14:00:52Z")

</div>

BACKGROUND I'm trying to determine the average number of images created for an event, defined by patient and body part, but also createTime, where an event's duration is derived from the createTimes that are "close" to …

---

## [ES 6.5: How should I reindex with millions of documents?](https://discuss.elastic.co/t/es-6-5-how-should-i-reindex-with-millions-of-documents/184485)

<div class="topic-metadata">

**Author:** [@revolve3](https://discuss.elastic.co/u/revolve3)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 1:54pm UTC](https://discuss.elastic.co/t/es-6-5-how-should-i-reindex-with-millions-of-documents/184485 "2019-06-06T13:54:54Z")

</div>

I'd like to resolve a simple mapping conflict, only it may not be so simple since I have many daily indexes and each contains millions of documents. For now I'm just trying to figure out how I can, as quickly as possible…

---

## [Elasticsearch: failed to execute bulk item (index) index](https://discuss.elastic.co/t/elasticsearch-failed-to-execute-bulk-item-index-index/184579)

<div class="topic-metadata">

**Author:** [@Yashwant\_Shettigar](https://discuss.elastic.co/u/Yashwant_Shettigar)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 1:35pm UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-execute-bulk-item-index-index/184579 "2019-06-06T13:35:17Z")

</div>

Hi All, All of sudden, I am getting this error in elastic\_logs. Haven't made any changes. Also, the heap size is set to 8 gb : -Xms8g -Xmx8g Logs: - \[2019-06-06T06:54:42,935\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\]…

---

## [Resharding a Production cluster with modification in IndexRotaionPeriod](https://discuss.elastic.co/t/resharding-a-production-cluster-with-modification-in-indexrotaionperiod/184473)

<div class="topic-metadata">

**Author:** [@dey\_subhro](https://discuss.elastic.co/u/dey_subhro)\
**Replies:** 6\
**Last updated:** [June 6, 2019, 1:28pm UTC](https://discuss.elastic.co/t/resharding-a-production-cluster-with-modification-in-indexrotaionperiod/184473 "2019-06-06T13:28:16Z")

</div>

Hi, I need help on the below production scenario Note : Cluster running on AWS ES with 2 nodes Existing Settings The indices are hourly ones (24 in a day) with 5 Primary shards and 1 replica running on 2 nodes with…

---

## [Visio Stencils for Elastic](https://discuss.elastic.co/t/visio-stencils-for-elastic/184565)

<div class="topic-metadata">

**Author:** [@rahulkumar1](https://discuss.elastic.co/u/rahulkumar1)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 1:19pm UTC](https://discuss.elastic.co/t/visio-stencils-for-elastic/184565 "2019-06-06T13:19:15Z")

</div>

Where can I find Visio Stencils for Elastic -- for all components like Logstash, Kibana, Master Nodes, Data Nodes, etc..

---

## [How to create devops dashboard using ELK](https://discuss.elastic.co/t/how-to-create-devops-dashboard-using-elk/184559)

<div class="topic-metadata">

**Author:** [@Karthick\_Cse](https://discuss.elastic.co/u/Karthick_Cse)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 1:03pm UTC](https://discuss.elastic.co/t/how-to-create-devops-dashboard-using-elk/184559 "2019-06-06T13:03:10Z")

</div>

how to create devops dashboard using ELK Need to get information from GitHub , jira ,sonar qube ,cloud (AWS)

---

## [Contribution in ElasticSearch](https://discuss.elastic.co/t/contribution-in-elasticsearch/184581)

<div class="topic-metadata">

**Author:** [@Muniinder](https://discuss.elastic.co/u/Muniinder)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 12:52pm UTC](https://discuss.elastic.co/t/contribution-in-elasticsearch/184581 "2019-06-06T12:52:01Z")

</div>

Hi all I am looking to make a contribution to the Open Source Software. Can anyone please suggest me some work/issue to get started on this journey.

---

## [How to rename a field in Kibana console (6.4.2). Is there a direct GUI level configuration option. Pls help](https://discuss.elastic.co/t/how-to-rename-a-field-in-kibana-console-6-4-2-is-there-a-direct-gui-level-configuration-option-pls-help/184573)

<div class="topic-metadata">

**Author:** [@premchand](https://discuss.elastic.co/u/premchand)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 12:28pm UTC](https://discuss.elastic.co/t/how-to-rename-a-field-in-kibana-console-6-4-2-is-there-a-direct-gui-level-configuration-option-pls-help/184573 "2019-06-06T12:28:19Z")

</div>

From the snippet can we change the servername to SERVER.

---

## [Setting the pipeline in Fluentd](https://discuss.elastic.co/t/setting-the-pipeline-in-fluentd/184379)

<div class="topic-metadata">

**Author:** [@nicks1993](https://discuss.elastic.co/u/nicks1993)\
**Replies:** 4\
**Last updated:** [June 6, 2019, 12:14pm UTC](https://discuss.elastic.co/t/setting-the-pipeline-in-fluentd/184379 "2019-06-06T12:14:48Z")

</div>

Hello, this is part of a long running discussion I've been having here with the most recent post being https://discuss.elastic.co/t/how-to-use-pipelines-and-processors/183719/10 I'm having a hard time finding where to …

---

## [Iterate entries in ctx.payload](https://discuss.elastic.co/t/iterate-entries-in-ctx-payload/184337)

<div class="topic-metadata">

**Author:** [@muraliv](https://discuss.elastic.co/u/muraliv)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 11:27am UTC](https://discuss.elastic.co/t/iterate-entries-in-ctx-payload/184337 "2019-06-06T11:27:56Z")

</div>

Hi, I have the following entries in ctx.payload and the entries are by user id. The first entry is the timestamp and the 2nd entry is the number of times the user failed to login in that bucket. mydomain\\user1=\[155966…

---

## [Using cluster settings to reduce log level on a package](https://discuss.elastic.co/t/using-cluster-settings-to-reduce-log-level-on-a-package/184566)

<div class="topic-metadata">

**Author:** [@Rajiv](https://discuss.elastic.co/u/Rajiv)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 11:02am UTC](https://discuss.elastic.co/t/using-cluster-settings-to-reduce-log-level-on-a-package/184566 "2019-06-06T11:02:21Z")

</div>

Hello: We run on ES cluster (version 6.6.2) with the following log settings (I will post the complete log4j properties file separately due to size restrictions): logger.action.level = debug rootLogger.level = info logg…

---

## [Machine Learning error when creating and openning new Job](https://discuss.elastic.co/t/machine-learning-error-when-creating-and-openning-new-job/184325)

<div class="topic-metadata">

**Author:** [@jonathanfr84](https://discuss.elastic.co/u/jonathanfr84)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 10:38am UTC](https://discuss.elastic.co/t/machine-learning-error-when-creating-and-openning-new-job/184325 "2019-06-06T10:38:56Z")

</div>

Hello, I've installed a metricbeat which is garthering information about a linux system and I want to try the machine learning forecast feautre using the index generated by metricbeat. I've created a Job using the metr…

---

## [Get all documents from index - like in Kibana (even if accualy showing some of them)](https://discuss.elastic.co/t/get-all-documents-from-index-like-in-kibana-even-if-accualy-showing-some-of-them/184548)

<div class="topic-metadata">

**Author:** [@yishain11](https://discuss.elastic.co/u/yishain11)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 10:31am UTC](https://discuss.elastic.co/t/get-all-documents-from-index-like-in-kibana-even-if-accualy-showing-some-of-them/184548 "2019-06-06T10:31:33Z")

</div>

Hi everyone! I have a conceptual question: I understand that when sending a query to elasticsearch, ether by URI search or by queryDSL, there is a limit to the number of results that will be returned. From what I gath…

---

## [License information from the X-Pack plugin could not be obtained from Elasticsearch for the \[data\] cluster. \[security\_exception\] missing authentication credentials for REST request \[/\_xpack\]](https://discuss.elastic.co/t/license-information-from-the-x-pack-plugin-could-not-be-obtained-from-elasticsearch-for-the-data-cluster-security-exception-missing-authentication-credentials-for-rest-request-xpack/184382)

<div class="topic-metadata">

**Author:** [@KatiukOleg](https://discuss.elastic.co/u/KatiukOleg)\
**Replies:** 4\
**Last updated:** [June 6, 2019, 9:38am UTC](https://discuss.elastic.co/t/license-information-from-the-x-pack-plugin-could-not-be-obtained-from-elasticsearch-for-the-data-cluster-security-exception-missing-authentication-credentials-for-rest-request-xpack/184382 "2019-06-06T09:38:20Z")

</div>

Hi guys, I have some trouble with Elastic and Kibana. I launched them in Azure through Azure Kubernetes Service and was using standard (not oss) images for it. So, Elasticsearch is up and running. I configured passwords …

---

## [Store data - Write $ and € in an integer](https://discuss.elastic.co/t/store-data-write-and-in-an-integer/184526)

<div class="topic-metadata">

**Author:** [@simple\_commentateur](https://discuss.elastic.co/u/simple_commentateur)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 9:16am UTC](https://discuss.elastic.co/t/store-data-write-and-in-an-integer/184526 "2019-06-06T09:16:29Z")

</div>

Hello, I see in the sample data ecommerce of Kibana that it's possible to store price with his device and it's still an integer, not a string. How can i do that?

---

## [Increasing JVM for heap sizing](https://discuss.elastic.co/t/increasing-jvm-for-heap-sizing/184496)

<div class="topic-metadata">

**Author:** [@Prabhav](https://discuss.elastic.co/u/Prabhav)\
**Replies:** 5\
**Last updated:** [June 6, 2019, 9:08am UTC](https://discuss.elastic.co/t/increasing-jvm-for-heap-sizing/184496 "2019-06-06T09:08:46Z")

</div>

The default heap memory for the elasticsearch is 1GB, which is not sufficient to load the data with logstash which ends up showing "script unresponsive". I have a Virtual Box setup which has 4GB allocated memory, how c…

---

## [Index Templates... where do they come from?](https://discuss.elastic.co/t/index-templates-where-do-they-come-from/184401)

<div class="topic-metadata">

**Author:** [@eskorte](https://discuss.elastic.co/u/eskorte)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 8:52am UTC](https://discuss.elastic.co/t/index-templates-where-do-they-come-from/184401 "2019-06-06T08:52:01Z")

</div>

Hello! I see three index templates filebeat-6.7.1, filebeat-7.0.0 and filebeat-7.0.1. Each with corresponding index patterns like filebeat-7.0.1- \*. Until now my logstash config was set to output.elasticsearch.index =\> …

---

## [Garbage collection issue](https://discuss.elastic.co/t/garbage-collection-issue/184126)

<div class="topic-metadata">

**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\
**Replies:** 10\
**Last updated:** [June 6, 2019, 8:41am UTC](https://discuss.elastic.co/t/garbage-collection-issue/184126 "2019-06-06T08:41:26Z")

</div>

I am trying to bulk index data of size 6GB , but garbage collection is taking long time so process is getting killed. cluster.name: Elastic-Demo node.name: es-node-1 node.master: true path.data: /var/lib/elasticsearch p…

---

## [XPack IP filtering and TLS authentication in Elastic Cloud](https://discuss.elastic.co/t/xpack-ip-filtering-and-tls-authentication-in-elastic-cloud/183616)

<div class="topic-metadata">

**Author:** [@michal2](https://discuss.elastic.co/u/michal2)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 8:28am UTC](https://discuss.elastic.co/t/xpack-ip-filtering-and-tls-authentication-in-elastic-cloud/183616 "2019-06-06T08:28:52Z")

</div>

Hello, I was wondering if there is any progress on IP filtering and TLS authentication in Elastic Cloud? Looking at this topic: https://discuss.elastic.co/t/elastic-cloud-kibana-ip-source-filtering/140811 and this list …

---

## [Analyzing Hebrew string](https://discuss.elastic.co/t/analyzing-hebrew-string/183850)

<div class="topic-metadata">

**Author:** [@ProxyMasterMerger](https://discuss.elastic.co/u/ProxyMasterMerger)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 7:04am UTC](https://discuss.elastic.co/t/analyzing-hebrew-string/183850 "2019-06-06T07:04:41Z")

</div>

Hey guys. I need help with writing an analyzer for a hebrew string. Basically, hebrew words can contain prefix/postfix characters that I want to tokenize. But the thing is that I want my list of terms to include both wo…

---

## [How to stem, remove stop words from my index data?](https://discuss.elastic.co/t/how-to-stem-remove-stop-words-from-my-index-data/184501)

<div class="topic-metadata">

**Author:** [@princesahu04](https://discuss.elastic.co/u/princesahu04)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 8:12am UTC](https://discuss.elastic.co/t/how-to-stem-remove-stop-words-from-my-index-data/184501 "2019-06-06T08:12:13Z")

</div>

I want to stem, remove stop words from my index data (\_doc/1). My analyzer, mapping is: \> PUT my\_index { "settings": { "index":{ "analysis":{ "filter":{ "synonym":{ "type":"s…

---

## [How to do a full update each day](https://discuss.elastic.co/t/how-to-do-a-full-update-each-day/184504)

<div class="topic-metadata">

**Author:** [@Hiven](https://discuss.elastic.co/u/Hiven)\
**Replies:** 1\
**Last updated:** [June 6, 2019, 8:06am UTC](https://discuss.elastic.co/t/how-to-do-a-full-update-each-day/184504 "2019-06-06T08:06:13Z")

</div>

Hello, I use Kibana with elasticsearch. I’m new to Elasticsearch. I have a php rest api with analytic values. Although this sounds very inefficient, my plan is to query my php rest api to get hourly data year to date, …

---

## [Full cluster restart of 400 node cluster](https://discuss.elastic.co/t/full-cluster-restart-of-400-node-cluster/184070)

<div class="topic-metadata">

**Author:** [@erikstephens](https://discuss.elastic.co/u/erikstephens)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 7:47am UTC](https://discuss.elastic.co/t/full-cluster-restart-of-400-node-cluster/184070 "2019-06-06T07:47:13Z")

</div>

Since I'm able to stop writes, performing updates via full cluster restart seems more attractive than rolling. However, I'm running into problems getting the cluster out of red. From the current master, I'll see even a…

---

## [ELK curl: (7) Failed to connect to localhost port 9200: Connection refused](https://discuss.elastic.co/t/elk-curl-7-failed-to-connect-to-localhost-port-9200-connection-refused/184500)

<div class="topic-metadata">

**Author:** [@Yuna\_YU](https://discuss.elastic.co/u/Yuna_YU)\
**Replies:** 14\
**Last updated:** [June 6, 2019, 7:44am UTC](https://discuss.elastic.co/t/elk-curl-7-failed-to-connect-to-localhost-port-9200-connection-refused/184500 "2019-06-06T07:44:56Z")

</div>

Hi There, I met some problem while installing elk on 3 different server on Google cloud Platform. First, I build 2 servers based on Debian GNU/Linux 9 (stretch), after installing elasticsearch and kibana respectively, …

---

## [Elasticsearch 7.1 index shards getting assigned on warm nodes](https://discuss.elastic.co/t/elasticsearch-7-1-index-shards-getting-assigned-on-warm-nodes/184466)

<div class="topic-metadata">

**Author:** [@ElkNovice](https://discuss.elastic.co/u/ElkNovice)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 7:43am UTC](https://discuss.elastic.co/t/elasticsearch-7-1-index-shards-getting-assigned-on-warm-nodes/184466 "2019-06-06T07:43:20Z")

</div>

Using Elastic 7.1 stack. Trying to use hot-warm architecture. I have started all my nodes with node.attr.data set to hot or warm, depending on the node. However, I have observed that the current/active index shards are g…

---

## [ElasticSearch: Service start error](https://discuss.elastic.co/t/elasticsearch-service-start-error/184370)

<div class="topic-metadata">

**Author:** [@narendral](https://discuss.elastic.co/u/narendral)\
**Replies:** 0\
**Last updated:** [June 5, 2019, 1:36pm UTC](https://discuss.elastic.co/t/elasticsearch-service-start-error/184370 "2019-06-05T13:36:04Z")

</div>

I'm facing some issue while start elasticsearch service using Linux command line sudo systemctl status elasticsearch.service. Service status saying: elasticsearch\[31315\]: java.security.policy: error adding Entry: elasti…

---

## [How do I force the deletion of version-conflicting data](https://discuss.elastic.co/t/how-do-i-force-the-deletion-of-version-conflicting-data/184486)

<div class="topic-metadata">

**Author:** [@crazyyanchao](https://discuss.elastic.co/u/crazyyanchao)\
**Replies:** 2\
**Last updated:** [June 6, 2019, 4:09am UTC](https://discuss.elastic.co/t/how-do-i-force-the-deletion-of-version-conflicting-data/184486 "2019-06-06T04:09:21Z")

</div>

Hi, We are now using \_delete\_by\_query to do the batch deletion of data. But in the process I see the VersionConflictEngineException \[type\]\[id\]: version conflict, current version \[2\] is different than the one provided \[…

---

## [Combine Filter the records from nested query - Elastic Search](https://discuss.elastic.co/t/combine-filter-the-records-from-nested-query-elastic-search/184484)

<div class="topic-metadata">

**Author:** [@vnrj1995](https://discuss.elastic.co/u/vnrj1995)\
**Replies:** 0\
**Last updated:** [June 6, 2019, 2:41am UTC](https://discuss.elastic.co/t/combine-filter-the-records-from-nested-query-elastic-search/184484 "2019-06-06T02:41:02Z")

</div>

I am having nested array fields, I need to query and filter the records for that. Sample payload "test":\[ "name":\[ { "name": "vanaraj", "Age" : 26 }, { "name": "vanaraj", "Ag…

---

## [0-all replicas and multiple es nodes per host never goes green](https://discuss.elastic.co/t/0-all-replicas-and-multiple-es-nodes-per-host-never-goes-green/184441)

<div class="topic-metadata">

**Author:** [@Andy\_Wick](https://discuss.elastic.co/u/Andy_Wick)\
**Replies:** 3\
**Last updated:** [June 6, 2019, 12:35am UTC](https://discuss.elastic.co/t/0-all-replicas-and-multiple-es-nodes-per-host-never-goes-green/184441 "2019-06-06T00:35:21Z")

</div>

I'm playing with the terms lookup feature (https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-terms-query.html#query-dsl-terms-lookup) which suggests my lookups index should be on all nodes. If I …

---

## [Why elastic node use only 50-60 % of cpu?](https://discuss.elastic.co/t/why-elastic-node-use-only-50-60-of-cpu/184463)

<div class="topic-metadata">

**Author:** [@tfe2012](https://discuss.elastic.co/u/tfe2012)\
**Replies:** 4\
**Last updated:** [June 5, 2019, 11:02pm UTC](https://discuss.elastic.co/t/why-elastic-node-use-only-50-60-of-cpu/184463 "2019-06-05T23:02:32Z")

</div>

Hi, I have a cluster of 1 coordinator and 16 data node. 48 shard 1 replica. 1.4 TB data. I send a request like: GET twitter/\_search { "query": { "term": { "url": "https://twitter/twit" } } } Kibana l…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1271)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1273)
