# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1071

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1072

---

## [Clear text password exposed in environment](https://discuss.elastic.co/t/clear-text-password-exposed-in-environment/211284)

<div class="topic-metadata">

**Author:** [@amitrap](https://discuss.elastic.co/u/amitrap)\
**Replies:** 2\
**Last updated:** [December 10, 2019, 1:04pm UTC](https://discuss.elastic.co/t/clear-text-password-exposed-in-environment/211284 "2019-12-10T13:04:12Z")

</div>

./elasticsearch/config/node1/elasticsearch.yml contains plain text for the following sensitive data: xpack.ssl.keystore.password: xpack.ssl.truststore.password: Can those parameter be encrypted?

---

## [Check elastic task status](https://discuss.elastic.co/t/check-elastic-task-status/211301)

<div class="topic-metadata">

**Author:** [@Thedsk8](https://discuss.elastic.co/u/Thedsk8)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 12:56pm UTC](https://discuss.elastic.co/t/check-elastic-task-status/211301 "2019-12-10T12:56:55Z")

</div>

I want to check the status of the Re-index API and for that I'm setting wait for completion to false. This API returns the task id through which I can check the status of the task. Which field do I need to check to ident…

---

## [Delete data from index based on log.file.path](https://discuss.elastic.co/t/delete-data-from-index-based-on-log-file-path/211158)

<div class="topic-metadata">

**Author:** [@NogNeetMachinaal](https://discuss.elastic.co/u/NogNeetMachinaal)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:53pm UTC](https://discuss.elastic.co/t/delete-data-from-index-based-on-log-file-path/211158 "2019-12-10T12:53:21Z")

</div>

Team, Is there a way to delete all data that is read from a specific folder? For example, I would like to delete all data that was indexed from the logs in folder /home/will/logs. This folder name is found in the field…

---

## [Can i enable emails in Elasticsearch evaluation version](https://discuss.elastic.co/t/can-i-enable-emails-in-elasticsearch-evaluation-version/211215)

<div class="topic-metadata">

**Author:** [@sankarn](https://discuss.elastic.co/u/sankarn)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:43pm UTC](https://discuss.elastic.co/t/can-i-enable-emails-in-elasticsearch-evaluation-version/211215 "2019-12-10T12:43:25Z")

</div>

Hi , I would like to know, was ther any restriction in enabling EMails from Elasticsearch / Kibana. i am using Evaluation version Elasticsearch 7.4.2 . I am getting Email Disabled option in my Kibana dashboard. Kindly…

---

## [Indexing in Remote ElasticSearch cluster connection using Python Client using http](https://discuss.elastic.co/t/indexing-in-remote-elasticsearch-cluster-connection-using-python-client-using-http/211224)

<div class="topic-metadata">

**Author:** [@dpzx11](https://discuss.elastic.co/u/dpzx11)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:42pm UTC](https://discuss.elastic.co/t/indexing-in-remote-elasticsearch-cluster-connection-using-python-client-using-http/211224 "2019-12-10T12:42:46Z")

</div>

I am trying to index data to a node in a remote cluster using the ElasticSearch python client. I have the details of the cluster. I have tried the following: client= Elasticsearch( \['http://user:secretkey@clustername:…

---

## [Using Ingest node Enrich your data with "multiple" match fields](https://discuss.elastic.co/t/using-ingest-node-enrich-your-data-with-multiple-match-fields/211300)

<div class="topic-metadata">

**Author:** [@cho](https://discuss.elastic.co/u/cho)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 12:42pm UTC](https://discuss.elastic.co/t/using-ingest-node-enrich-your-data-with-multiple-match-fields/211300 "2019-12-10T12:42:24Z")

</div>

Hey there. I've been experimenting with the newly added data enrichment funtions in ES 7.5 and came up with the following problem. Let's pretend we have those indices: article\_to\_group { "article\_key": 123456, "a…

---

## [Understanding Elasticsearch scoring between versions](https://discuss.elastic.co/t/understanding-elasticsearch-scoring-between-versions/211246)

<div class="topic-metadata">

**Author:** [@robs24](https://discuss.elastic.co/u/robs24)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:38pm UTC](https://discuss.elastic.co/t/understanding-elasticsearch-scoring-between-versions/211246 "2019-12-10T12:38:46Z")

</div>

We're currently in the midst of an upgrade from v5.2 to v6.8 and I'm seeing some noticeable differences in scoring of records during searches. I can't quite decide if there are possibly some deprecated features as part o…

---

## [Ingest Pipeline fails with no error or warning](https://discuss.elastic.co/t/ingest-pipeline-fails-with-no-error-or-warning/211291)

<div class="topic-metadata">

**Author:** [@Radu\_Murzea](https://discuss.elastic.co/u/Radu_Murzea)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:10pm UTC](https://discuss.elastic.co/t/ingest-pipeline-fails-with-no-error-or-warning/211291 "2019-12-10T12:10:21Z")

</div>

Everything mentioned here (ELK, filebeat etc.) is version 6.8.3. I run 1 single node of Elasticsearch. I'm trying to use the ingest-pipelines that are included with FileBeat. As an example, I started with the one that p…

---

## [Why All shards failed](https://discuss.elastic.co/t/why-all-shards-failed/211288)

<div class="topic-metadata">

**Author:** [@david3721](https://discuss.elastic.co/u/david3721)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:01pm UTC](https://discuss.elastic.co/t/why-all-shards-failed/211288 "2019-12-10T12:01:00Z")

</div>

why my Kibana like this... help please! version is 7.1.1 { \*\* "message": "all shards failed: \[search\_phase\_execution\_exception\] all shards failed",\*\* \*\* "statusCode": 503,\*\* \*\* "error": "Service Unavailable"\*\* }…

---

## [List dynamic field mapping](https://discuss.elastic.co/t/list-dynamic-field-mapping/211141)

<div class="topic-metadata">

**Author:** [@gborg](https://discuss.elastic.co/u/gborg)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 12:00pm UTC](https://discuss.elastic.co/t/list-dynamic-field-mapping/211141 "2019-12-10T12:00:04Z")

</div>

Hello, for my main index I have pre-defined fields using ECS and defining my own expanded fields. There are however some fields in there that I did not define and they get in via dynamic mapping and get mapped as keywo…

---

## [Filter items of array field with query while aggregating values](https://discuss.elastic.co/t/filter-items-of-array-field-with-query-while-aggregating-values/211287)

<div class="topic-metadata">

**Author:** [@phoenix616](https://discuss.elastic.co/u/phoenix616)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 11:29am UTC](https://discuss.elastic.co/t/filter-items-of-array-field-with-query-while-aggregating-values/211287 "2019-12-10T11:29:10Z")

</div>

Hi! I ran into a problem for which I can not find an acceptable solution: Input: I have index of documents { "profile": { "mappings": { "properties": { ... "skills": { …

---

## [Question about the relation between indices number and search latency](https://discuss.elastic.co/t/question-about-the-relation-between-indices-number-and-search-latency/210807)

<div class="topic-metadata">

**Author:** [@Hyunsoo\_Shim](https://discuss.elastic.co/u/Hyunsoo_Shim)\
**Replies:** 3\
**Last updated:** [December 10, 2019, 11:46am UTC](https://discuss.elastic.co/t/question-about-the-relation-between-indices-number-and-search-latency/210807 "2019-12-10T11:46:46Z")

</div>

\[System ENV\] instance : 6ea : each instance -\> 16 cpu, 32GB Ram, 1TB SSD node : 6ea indices : total indices number is 75 -\> each index has only 1 shard and about 600,000 docs (2~3GB) replica number for each index i…

---

## [How to include a system field in watcher](https://discuss.elastic.co/t/how-to-include-a-system-field-in-watcher/211281)

<div class="topic-metadata">

**Author:** [@Nicholas\_Aysen](https://discuss.elastic.co/u/Nicholas_Aysen)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 11:09am UTC](https://discuss.elastic.co/t/how-to-include-a-system-field-in-watcher/211281 "2019-12-10T11:09:13Z")

</div>

Quite new to Kibana and the whole ELK stack. We have Kibana v7.2 currently, and we have a visual built to watch our memory usage on some servers. I'm trying to use the watcher feature to setup alerts if the memory shou…

---

## [Mix free and paid licenses](https://discuss.elastic.co/t/mix-free-and-paid-licenses/211250)

<div class="topic-metadata">

**Author:** [@Neal\_Sebastian](https://discuss.elastic.co/u/Neal_Sebastian)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 10:48am UTC](https://discuss.elastic.co/t/mix-free-and-paid-licenses/211250 "2019-12-10T10:48:42Z")

</div>

Is it possible to mix licenses of different nodes of a cluster? For example, I have gold licenses for my master, ingest and collab nodes, but basic for the data nodes. If this is possible, would there be negative implica…

---

## [Max\_thread\_count can increase to num of HDD](https://discuss.elastic.co/t/max-thread-count-can-increase-to-num-of-hdd/211270)

<div class="topic-metadata">

**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 10:19am UTC](https://discuss.elastic.co/t/max-thread-count-can-increase-to-num-of-hdd/211270 "2019-12-10T10:19:19Z")

</div>

Hi I have a machine with 4 HDD's and RAID 0 enabled. Can i increase the below conf to 4? equals to num of HDD's? index.merge.scheduler.max\_thread\_count https://www.elastic.co/guide/en/elasticsearch/reference/6.6/inde…

---

## [Need help Elastic installation 7.3](https://discuss.elastic.co/t/need-help-elastic-installation-7-3/210905)

<div class="topic-metadata">

**Author:** [@Daniel1909](https://discuss.elastic.co/u/Daniel1909)\
**Replies:** 2\
**Last updated:** [December 10, 2019, 9:59am UTC](https://discuss.elastic.co/t/need-help-elastic-installation-7-3/210905 "2019-12-10T09:59:07Z")

</div>

Hello everybody, I am a newcomer to Elasticsearch and need it for another software. I have a guide to install Elasticsearch latest stable version 7. Operating system is Ubuntu 18.04. Now I need it for version 7.3.0. I…

---

## [Max disk size used for single ES node](https://discuss.elastic.co/t/max-disk-size-used-for-single-es-node/208261)

<div class="topic-metadata">

**Author:** [@ragnar1290](https://discuss.elastic.co/u/ragnar1290)\
**Replies:** 3\
**Last updated:** [December 10, 2019, 9:27am UTC](https://discuss.elastic.co/t/max-disk-size-used-for-single-es-node/208261 "2019-12-10T09:27:24Z")

</div>

Hi Team, Currently, we have a 3TB data node, my question is do we have any restriction regarding disk size on ES node. And what would be the consequences of creating nodes with larger disks?

---

## [Running aggregation over more than 10,000 documents](https://discuss.elastic.co/t/running-aggregation-over-more-than-10-000-documents/211257)

<div class="topic-metadata">

**Author:** [@1fe60245fe160bc0f8ab](https://discuss.elastic.co/u/1fe60245fe160bc0f8ab)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 9:21am UTC](https://discuss.elastic.co/t/running-aggregation-over-more-than-10-000-documents/211257 "2019-12-10T09:21:01Z")

</div>

Hi all, Somewhat similar to this (https://discuss.elastic.co/t/terms-aggregation-on-billions-of-documents/103326) - I'm trying to run a simple query against my 10 billion documents index, something that looks like this: …

---

## [Suggestion field not updated](https://discuss.elastic.co/t/suggestion-field-not-updated/211245)

<div class="topic-metadata">

**Author:** [@jenson.mak](https://discuss.elastic.co/u/jenson.mak)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 8:32am UTC](https://discuss.elastic.co/t/suggestion-field-not-updated/211245 "2019-12-10T08:32:55Z")

</div>

I have a problem where the elastic search is providing autocomplete suggestion for value which I already remove in the index field. For example, previously I have field ARR:. TEST in talents.name field. I have updated th…

---

## [Ignore gracefully a specific character](https://discuss.elastic.co/t/ignore-gracefully-a-specific-character/210920)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 2\
**Last updated:** [December 10, 2019, 8:34am UTC](https://discuss.elastic.co/t/ignore-gracefully-a-specific-character/210920 "2019-12-10T08:34:20Z")

</div>

hi guys, I was playing with the predefined index kibana\_sample\_data\_ecommerce. In the field category I can find some not standard character, for instance apostrophe. Is there a way to ignore it (so, a query on values …

---

## [Version Conflict Engine Exception : due to simultaneous updates](https://discuss.elastic.co/t/version-conflict-engine-exception-due-to-simultaneous-updates/211244)

<div class="topic-metadata">

**Author:** [@tarunwx](https://discuss.elastic.co/u/tarunwx)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 8:27am UTC](https://discuss.elastic.co/t/version-conflict-engine-exception-due-to-simultaneous-updates/211244 "2019-12-10T08:27:22Z")

</div>

I have APIs\[application\] which update documents partially as per the action on the client side. Now the issue that I am facing is "type": "version\_conflict\_engine\_exception", "reason": "\[5dede8546cce890029d8dfa6…

---

## [【HELP】All shards failed regularly](https://discuss.elastic.co/t/help-all-shards-failed-regularly/211045)

<div class="topic-metadata">

**Author:** [@weiwei107](https://discuss.elastic.co/u/weiwei107)\
**Replies:** 11\
**Last updated:** [December 10, 2019, 7:38am UTC](https://discuss.elastic.co/t/help-all-shards-failed-regularly/211045 "2019-12-10T07:38:53Z")

</div>

Hi, our ES broke down automatically after running for a few days. We had to delete the indices first, then restart it to make it work normally again. But the problem still occurred after a few days. Would really apprecia…

---

## [Esrally-configration of elasticsearch official benchmarks](https://discuss.elastic.co/t/esrally-configration-of-elasticsearch-official-benchmarks/209472)

<div class="topic-metadata">

**Author:** [@jinhaowen](https://discuss.elastic.co/u/jinhaowen)\
**Replies:** 2\
**Last updated:** [December 10, 2019, 7:13am UTC](https://discuss.elastic.co/t/esrally-configration-of-elasticsearch-official-benchmarks/209472 "2019-12-10T07:13:51Z")

</div>

Hi, I had seen the data of Elasticsearch official benchmarks by esrally, and I wondered what is the configration of these esrally benchmarks, for example, the number of clients can affect the result of index rate, and t…

---

## [.NET ElasticLowLevelClient 7.4.1 serializer extremely slow](https://discuss.elastic.co/t/net-elasticlowlevelclient-7-4-1-serializer-extremely-slow/210332)

<div class="topic-metadata">

**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 6:41am UTC](https://discuss.elastic.co/t/net-elasticlowlevelclient-7-4-1-serializer-extremely-slow/210332 "2019-12-10T06:41:07Z")

</div>

Hi, I recently switched from ES 6.8.5 to 7.4.2. I noticed that bulk loading became extremely slow. I narrowed down the problem to the .NET's ElasticLowLevelClient serialization. For example, serializing the following c…

---

## [Elasticsearch not create heap dump file when outofmemory](https://discuss.elastic.co/t/elasticsearch-not-create-heap-dump-file-when-outofmemory/211226)

<div class="topic-metadata">

**Author:** [@saiergon](https://discuss.elastic.co/u/saiergon)\
**Replies:** 0\
**Last updated:** [December 10, 2019, 6:14am UTC](https://discuss.elastic.co/t/elasticsearch-not-create-heap-dump-file-when-outofmemory/211226 "2019-12-10T06:14:56Z")

</div>

my elasticsearch encounterd outofmemory exception, but it not create heap dump file the log: \[2019-12-09T20:33:16,878\]\[ERROR\]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[node-xxx\] fatal error in thread \[elasticsearch…

---

## [ES 7.4.2 - Failed to perform search \[Upgrading from 6.4.3\]](https://discuss.elastic.co/t/es-7-4-2-failed-to-perform-search-upgrading-from-6-4-3/211012)

<div class="topic-metadata">

**Author:** [@AsfK](https://discuss.elastic.co/u/AsfK)\
**Replies:** 1\
**Last updated:** [December 10, 2019, 6:17am UTC](https://discuss.elastic.co/t/es-7-4-2-failed-to-perform-search-upgrading-from-6-4-3/211012 "2019-12-10T06:17:07Z")

</div>

I'm in a middle of migration from 6.4.3 to 7.4.2 and we've a simple search (that worked before the upgrade) that looks like this: SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder(); QueryBuilder matchQu…

---

## [Error Handling while Adding Data](https://discuss.elastic.co/t/error-handling-while-adding-data/211068)

<div class="topic-metadata">

**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\
**Replies:** 2\
**Last updated:** [December 10, 2019, 4:30am UTC](https://discuss.elastic.co/t/error-handling-while-adding-data/211068 "2019-12-10T04:30:07Z")

</div>

Hi, I have created a entity definition with a date time field. And if I'm entering any other value than date time type, then that record is not getting added into elastic and it is throwing an error. But I'm getting suc…

---

## [ES Cross Cluster Replication Issue](https://discuss.elastic.co/t/es-cross-cluster-replication-issue/206950)

<div class="topic-metadata">

**Author:** [@sidsniper](https://discuss.elastic.co/u/sidsniper)\
**Replies:** 5\
**Last updated:** [December 10, 2019, 2:17am UTC](https://discuss.elastic.co/t/es-cross-cluster-replication-issue/206950 "2019-12-10T02:17:00Z")

</div>

Hi, I am getting below error while trying to setup ccr: "fatal\_exception" : { "type" : "es\_rejected\_execution\_exception", "reason" : "rejected execution of org.elasticsearch.common.util.concurrent.TimedRunnable@1e0fb…

---

## [Error from \_cat APIs stemming from one bad data node](https://discuss.elastic.co/t/error-from-cat-apis-stemming-from-one-bad-data-node/210919)

<div class="topic-metadata">

**Author:** [@nickcanz](https://discuss.elastic.co/u/nickcanz)\
**Replies:** 3\
**Last updated:** [December 9, 2019, 11:24pm UTC](https://discuss.elastic.co/t/error-from-cat-apis-stemming-from-one-bad-data-node/210919 "2019-12-09T23:24:54Z")

</div>

Elasticsearch cluster running 7.3.1. I was adding/removing some nodes to the cluster, but no other config changes took place. The \_cat/nodes API started returning an error from all nodes. Nothing in any of the log files …

---

## [These old indices should be deleted by ES according to ILM policy, right?](https://discuss.elastic.co/t/these-old-indices-should-be-deleted-by-es-according-to-ilm-policy-right/211189)

<div class="topic-metadata">

**Author:** [@EricJohnson](https://discuss.elastic.co/u/EricJohnson)\
**Replies:** 6\
**Last updated:** [December 9, 2019, 10:57pm UTC](https://discuss.elastic.co/t/these-old-indices-should-be-deleted-by-es-according-to-ilm-policy-right/211189 "2019-12-09T22:57:03Z")

</div>

Greetings. I have implemented index lifecycle management on beats. Here's the configuration we are using: PUT /\_ilm/policy/beat\_default\_lifecycle\_policy { "policy": { "phases": { "hot": { …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1070)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1072)
