# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=526

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 527

---

## [ECK Operator not resetting shard\_allocation setting to "all"](https://discuss.elastic.co/t/eck-operator-not-resetting-shard-allocation-setting-to-all/291763)

<div class="topic-metadata">

**Author:** [@phoerious](https://discuss.elastic.co/u/phoerious)\
**Replies:** 0\
**Last updated:** [December 14, 2021, 8:40am UTC](https://discuss.elastic.co/t/eck-operator-not-resetting-shard-allocation-setting-to-all/291763 "2021-12-14T08:40:08Z")

</div>

Hi, I've always had the the problem that the ECK operator does not reset the shard\_allocation cluster setting after restarting a node. The result is that after a rolling restart over night, I end up with hundreds of una…

---

## [Scripted\_fields for child records in elasticsearch](https://discuss.elastic.co/t/scripted-fields-for-child-records-in-elasticsearch/291761)

<div class="topic-metadata">

**Author:** [@BIRENDRA](https://discuss.elastic.co/u/BIRENDRA)\
**Replies:** 0\
**Last updated:** [December 14, 2021, 8:25am UTC](https://discuss.elastic.co/t/scripted-fields-for-child-records-in-elasticsearch/291761 "2021-12-14T08:25:10Z")

</div>

Hi Team, I have a requirement where I have to put a flag as True or False if my parent record has child records exists in the elastic index. For this purpose I am making use of scripted field but I guess I cannot use it…

---

## [Using Elasticsearch as primary database](https://discuss.elastic.co/t/using-elasticsearch-as-primary-database/291694)

<div class="topic-metadata">

**Author:** [@Lylian1](https://discuss.elastic.co/u/Lylian1)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 5:01pm UTC](https://discuss.elastic.co/t/using-elasticsearch-as-primary-database/291694 "2021-12-13T17:01:53Z")

</div>

Some blogs say that Elasticsearch is reliable enough to be used as a primary database and some say that Elasticsearch has issues and can loose data. In order to implement a new project , we have as requirements: store…

---

## [Alert trigger monitor new index](https://discuss.elastic.co/t/alert-trigger-monitor-new-index/291757)

<div class="topic-metadata">

**Author:** [@Anatolii\_Huliaiev](https://discuss.elastic.co/u/Anatolii_Huliaiev)\
**Replies:** 0\
**Last updated:** [December 14, 2021, 7:34am UTC](https://discuss.elastic.co/t/alert-trigger-monitor-new-index/291757 "2021-12-14T07:34:43Z")

</div>

I configured trigger inside my alerting panel of Kibana for processing events detected from logs which uses index and it worked fine for a month But after a month of successful work new indices was created by ELK an…

---

## [Regarding log4j with Elasticsearch 2.x which uses log4j 1.2](https://discuss.elastic.co/t/regarding-log4j-with-elasticsearch-2-x-which-uses-log4j-1-2/291751)

<div class="topic-metadata">

**Author:** [@nipun\_reddy](https://discuss.elastic.co/u/nipun_reddy)\
**Replies:** 0\
**Last updated:** [December 14, 2021, 6:50am UTC](https://discuss.elastic.co/t/regarding-log4j-with-elasticsearch-2-x-which-uses-log4j-1-2/291751 "2021-12-14T06:50:47Z")

</div>

Hi All, I am looking for impact analysis of Elasticsearch 2.4.1 with the newly detected vulnerabilities. As per update from elastic, there is no impact on Elasticsearch 2 and below with cve-2021-44228. But based on CVE-2…

---

## [Esrally gets stuck on check-cluster-health](https://discuss.elastic.co/t/esrally-gets-stuck-on-check-cluster-health/291264)

<div class="topic-metadata">

**Author:** [@vtex](https://discuss.elastic.co/u/vtex)\
**Replies:** 3\
**Last updated:** [December 14, 2021, 6:32am UTC](https://discuss.elastic.co/t/esrally-gets-stuck-on-check-cluster-health/291264 "2021-12-14T06:32:58Z")

</div>

Hi, I'm running a local/single-node esrally. My esrally version is 2.30. When I run the below command the execution hangs while checking the status of the cluster -- i.e. in check-cluster-health. $ esrally race --distr…

---

## [Issues with jvm lock](https://discuss.elastic.co/t/issues-with-jvm-lock/291318)

<div class="topic-metadata">

**Author:** [@dominbdg](https://discuss.elastic.co/u/dominbdg)\
**Replies:** 9\
**Last updated:** [December 14, 2021, 6:25am UTC](https://discuss.elastic.co/t/issues-with-jvm-lock/291318 "2021-12-14T06:25:33Z")

</div>

Hello, I have below issues, after start Elasticsearch I see warnings "message": "Unable to lock JVM Memory: error=12, reason=Cannot allocate memory" "message": "This can result in part of the JVM being swapped out." "…

---

## [Data node vs level of data](https://discuss.elastic.co/t/data-node-vs-level-of-data/291708)

<div class="topic-metadata">

**Author:** [@INS](https://discuss.elastic.co/u/INS)\
**Replies:** 1\
**Last updated:** [December 14, 2021, 5:46am UTC](https://discuss.elastic.co/t/data-node-vs-level-of-data/291708 "2021-12-14T05:46:47Z")

</div>

How do I equalize data levels between data nodes?

---

## [Count the occurrence of words in ElasticSearch](https://discuss.elastic.co/t/count-the-occurrence-of-words-in-elasticsearch/291595)

<div class="topic-metadata">

**Author:** [@Ashrut](https://discuss.elastic.co/u/Ashrut)\
**Replies:** 4\
**Last updated:** [December 14, 2021, 5:20am UTC](https://discuss.elastic.co/t/count-the-occurrence-of-words-in-elasticsearch/291595 "2021-12-14T05:20:31Z")

</div>

Hello Everyone, I am a newbie in Elasticsearch. I was wondering if there is any technique to search for the count of occurrence of a word (or an array of words) in a document. For e.g. if I want to search for the arra…

---

## [Elasticsearch upgrade using Ansible with https](https://discuss.elastic.co/t/elasticsearch-upgrade-using-ansible-with-https/291741)

<div class="topic-metadata">

**Author:** [@Roberto\_Chacon](https://discuss.elastic.co/u/Roberto_Chacon)\
**Replies:** 0\
**Last updated:** [December 14, 2021, 3:32am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-using-ansible-with-https/291741 "2021-12-14T03:32:10Z")

</div>

Hello I have been following the following post, there is one response that provide an ansible script that seems to do all the magic. Question on Elasticsearch upgrade using Ansible I have found a blocker that my setup…

---

## [Regression: Painless script fails for BinaryOperator lamdba](https://discuss.elastic.co/t/regression-painless-script-fails-for-binaryoperator-lamdba/291714)

<div class="topic-metadata">

**Author:** [@Sebastian\_Bathke](https://discuss.elastic.co/u/Sebastian_Bathke)\
**Replies:** 2\
**Last updated:** [December 13, 2021, 11:24pm UTC](https://discuss.elastic.co/t/regression-painless-script-fails-for-binaryoperator-lamdba/291714 "2021-12-13T23:24:56Z")

</div>

Hey there, we noticed previously working painless scripts that make use of the Java Stream API passing lamdbas for BinaryOperator parameters to fail with Elasticsearch 7.16.0 onwards. E.g. the following sample works fi…

---

## [Data displayed in Watcher email having issue with float values](https://discuss.elastic.co/t/data-displayed-in-watcher-email-having-issue-with-float-values/291722)

<div class="topic-metadata">

**Author:** [@keyu](https://discuss.elastic.co/u/keyu)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 10:20pm UTC](https://discuss.elastic.co/t/data-displayed-in-watcher-email-having-issue-with-float-values/291722 "2021-12-13T22:20:31Z")

</div>

Hi, I am new to Elasticsearch cloud. I have used aggregations in watchers to accumulate a float field. But the value of the aggregated amount is displaying incorrectly The value should be displayed as 10,800,050 but i…

---

## ["invalid sequence of tokens near \['for'\]" error in painless script query](https://discuss.elastic.co/t/invalid-sequence-of-tokens-near-for-error-in-painless-script-query/291709)

<div class="topic-metadata">

**Author:** [@aashini](https://discuss.elastic.co/u/aashini)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 7:45pm UTC](https://discuss.elastic.co/t/invalid-sequence-of-tokens-near-for-error-in-painless-script-query/291709 "2021-12-13T19:45:40Z")

</div>

I an getting error while executing this script query using Nest : new ScriptQuery { Lang = "painless", …

---

## [Can't get nodes communicate to each other via TLS-secured transport](https://discuss.elastic.co/t/cant-get-nodes-communicate-to-each-other-via-tls-secured-transport/291676)

<div class="topic-metadata">

**Author:** [@v\_melnyk](https://discuss.elastic.co/u/v_melnyk)\
**Replies:** 1\
**Last updated:** [December 13, 2021, 6:00pm UTC](https://discuss.elastic.co/t/cant-get-nodes-communicate-to-each-other-via-tls-secured-transport/291676 "2021-12-13T18:00:18Z")

</div>

Hello, I have a question regarding deploying of a cluster of nodes and stuck with an inter-node communications issue. It seems that my mistake and the solution are pretty obvious, but somewhy I can't grasp what exactly …

---

## [Docker images for elasticsearch compatibility with Amazon ARM based EC2 machines?](https://discuss.elastic.co/t/docker-images-for-elasticsearch-compatibility-with-amazon-arm-based-ec2-machines/291693)

<div class="topic-metadata">

**Author:** [@Ritesh\_Uniyal](https://discuss.elastic.co/u/Ritesh_Uniyal)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 4:58pm UTC](https://discuss.elastic.co/t/docker-images-for-elasticsearch-compatibility-with-amazon-arm-based-ec2-machines/291693 "2021-12-13T16:58:10Z")

</div>

Are docker images for Elasticsearch provided at location (elasticsearch | Docker @ Elastic) compatible with Amazon ARM based EC2 machines?

---

## [Fscrawler refuses connection over https](https://discuss.elastic.co/t/fscrawler-refuses-connection-over-https/291689)

<div class="topic-metadata">

**Author:** [@ehsan\_kabiri\_33](https://discuss.elastic.co/u/ehsan_kabiri_33)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 4:18pm UTC](https://discuss.elastic.co/t/fscrawler-refuses-connection-over-https/291689 "2021-12-13T16:18:50Z")

</div>

I've studied this page and really do not not how to make and use .cer certificate, so can't launch fscrawler over secured connection. I created a certificate like this: sudo ./elasticsearch-certutil ca -out /etc/elasti…

---

## [ES-hadoop serialize org.apache.hadoop.io.ShortWritable failed](https://discuss.elastic.co/t/es-hadoop-serialize-org-apache-hadoop-io-shortwritable-failed/276894)

<div class="topic-metadata">

**Author:** [@zjd-melo](https://discuss.elastic.co/u/zjd-melo)\
**Replies:** 3\
**Last updated:** [December 13, 2021, 2:50pm UTC](https://discuss.elastic.co/t/es-hadoop-serialize-org-apache-hadoop-io-shortwritable-failed/276894 "2021-12-13T14:50:32Z")

</div>

Hi I am using pyspark with es-hadoop process es data ES 7.4.0 spark 2.3.1 PUT test { "mappings": { "properties": { "price": { "type": "short" } } } } P…

---

## [Duplicates were found \[.kibana (alias of \[.kibana\_2/gSBnpInZS6KXHw6xXlP7AA\])\]"](https://discuss.elastic.co/t/duplicates-were-found-kibana-alias-of-kibana-2-gsbnpinzs6kxhw6xxlp7aa/291671)

<div class="topic-metadata">

**Author:** [@siva1233](https://discuss.elastic.co/u/siva1233)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 2:26pm UTC](https://discuss.elastic.co/t/duplicates-were-found-kibana-alias-of-kibana-2-gsbnpinzs6kxhw6xxlp7aa/291671 "2021-12-13T14:26:27Z")

</div>

Hi All, i'm using Elasticsearch 7.3.0 in kubernetes and Openshift with client,data and master pods, whenever data pod is deleted and after recreated pod i'm getting below error. {"type": "server", "timestamp": "2021-12-…

---

## [Logstash concatenar dos campos strig](https://discuss.elastic.co/t/logstash-concatenar-dos-campos-strig/291657)

<div class="topic-metadata">

**Author:** [@Javier\_Garcia\_Alvare](https://discuss.elastic.co/u/Javier_Garcia_Alvare)\
**Replies:** 2\
**Last updated:** [December 13, 2021, 1:52pm UTC](https://discuss.elastic.co/t/logstash-concatenar-dos-campos-strig/291657 "2021-12-13T13:52:28Z")

</div>

Hola, Necesito concatenar dos campos tipo string en el fichero de logtash ¿alguien me puede ayudar? es decir, los campos ya exiten del csv. filter.. mutate { add\_field =\> {"CANALITSOFT" =\> ""} } ruby{ code =\> " …

---

## [Move to ultrawarm aws managed elasticsearch](https://discuss.elastic.co/t/move-to-ultrawarm-aws-managed-elasticsearch/291319)

<div class="topic-metadata">

**Author:** [@rizvaughan](https://discuss.elastic.co/u/rizvaughan)\
**Replies:** 4\
**Last updated:** [December 13, 2021, 1:07pm UTC](https://discuss.elastic.co/t/move-to-ultrawarm-aws-managed-elasticsearch/291319 "2021-12-13T13:07:18Z")

</div>

Hello all, We have aws managed Elasticsearch(now opensearch) with weekly indices. We use curator for index retention. Here is what were are doing now --- actions: 1: action: delete\_indices description: \>- …

---

## [Add comment in kibana elasticsearch](https://discuss.elastic.co/t/add-comment-in-kibana-elasticsearch/291624)

<div class="topic-metadata">

**Author:** [@Aitor\_MtzAm](https://discuss.elastic.co/u/Aitor_MtzAm)\
**Replies:** 2\
**Last updated:** [December 13, 2021, 12:01pm UTC](https://discuss.elastic.co/t/add-comment-in-kibana-elasticsearch/291624 "2021-12-13T12:01:09Z")

</div>

Hi! is there any chance to comment in elastic? like you can comment in sql or java with /\* \*/ or --

---

## [Unable to access 'path.repo'](https://discuss.elastic.co/t/unable-to-access-path-repo/291633)

<div class="topic-metadata">

**Author:** [@WTrois](https://discuss.elastic.co/u/WTrois)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 11:12am UTC](https://discuss.elastic.co/t/unable-to-access-path-repo/291633 "2021-12-13T11:12:55Z")

</div>

Hi, I'm having problems uploading indices from a snapshot. I'm running Elasticsearch version 7.16.0 I have: path.repo: \["/home/user/Downloads/snapshot1"\] in my yml file. The Elasticsearch cluster fails to start. The …

---

## [Use of caps in query with field names while perform search](https://discuss.elastic.co/t/use-of-caps-in-query-with-field-names-while-perform-search/291598)

<div class="topic-metadata">

**Author:** [@BIRENDRA](https://discuss.elastic.co/u/BIRENDRA)\
**Replies:** 2\
**Last updated:** [December 13, 2021, 10:39am UTC](https://discuss.elastic.co/t/use-of-caps-in-query-with-field-names-while-perform-search/291598 "2021-12-13T10:39:25Z")

</div>

Hi Team, I have seen caps in field names while doing a search. Specially inside should block which contributes to score. I tried doing similar thing to see the effect but score remained same whatever number I gave after…

---

## [Get the entire sub-tree / tree structure for a document based on a field](https://discuss.elastic.co/t/get-the-entire-sub-tree-tree-structure-for-a-document-based-on-a-field/291614)

<div class="topic-metadata">

**Author:** [@olivebranch](https://discuss.elastic.co/u/olivebranch)\
**Replies:** 2\
**Last updated:** [December 13, 2021, 10:30am UTC](https://discuss.elastic.co/t/get-the-entire-sub-tree-tree-structure-for-a-document-based-on-a-field/291614 "2021-12-13T10:30:06Z")

</div>

I have a hierarchical structure (much like categories contained within categories) in my document like following: 1(parent for root category is: -1) / \\ 2 3 …

---

## [Why do non ASCII characters cause problems in elastic search?](https://discuss.elastic.co/t/why-do-non-ascii-characters-cause-problems-in-elastic-search/291617)

<div class="topic-metadata">

**Author:** [@Pineirin](https://discuss.elastic.co/u/Pineirin)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 9:56am UTC](https://discuss.elastic.co/t/why-do-non-ascii-characters-cause-problems-in-elastic-search/291617 "2021-12-13T09:56:52Z")

</div>

Greetings. I have found a problem in the search bar of my application (that uses Elasticsearch for the search bar). If I do a fuzzy search of a text (in this case the title of a book) that is quite long (more than 96 c…

---

## [Github URL to set on op.jwkset\_path parameter](https://discuss.elastic.co/t/github-url-to-set-on-op-jwkset-path-parameter/291474)

<div class="topic-metadata">

**Author:** [@Fabio\_Peruchi](https://discuss.elastic.co/u/Fabio_Peruchi)\
**Replies:** 5\
**Last updated:** [December 13, 2021, 8:12am UTC](https://discuss.elastic.co/t/github-url-to-set-on-op-jwkset-path-parameter/291474 "2021-12-13T08:12:38Z")

</div>

Hello. I'm struggling to find where is the GitHub URL to set here on this parameter from this documentation: Configuring single sign-on to the Elastic Stack using OpenID Connect | Elasticsearch Guide \[7.16\] | Elastic o…

---

## [Fscrawler - update existing record](https://discuss.elastic.co/t/fscrawler-update-existing-record/291597)

<div class="topic-metadata">

**Author:** [@Andrej\_K](https://discuss.elastic.co/u/Andrej_K)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 7:37am UTC](https://discuss.elastic.co/t/fscrawler-update-existing-record/291597 "2021-12-13T07:37:18Z")

</div>

Hello, I need to search documents by its content and some custom customer data. So my idea is to use fscrawler to extract content from documents and keep it with custom customer data in one index for easy searching. So…

---

## [How to get the field names which have no data or null in elasticsearch dynamically?](https://discuss.elastic.co/t/how-to-get-the-field-names-which-have-no-data-or-null-in-elasticsearch-dynamically/291591)

<div class="topic-metadata">

**Author:** [@Saurabh\_A](https://discuss.elastic.co/u/Saurabh_A)\
**Replies:** 0\
**Last updated:** [December 13, 2021, 6:17am UTC](https://discuss.elastic.co/t/how-to-get-the-field-names-which-have-no-data-or-null-in-elasticsearch-dynamically/291591 "2021-12-13T06:17:53Z")

</div>

How do we get the field names with no data in them? For example, in an index, there is a field that is present in the mapping but no data is indexed in this case. So I want a list of all the field names or keys where the…

---

## [Resources for learning ElasticSearch](https://discuss.elastic.co/t/resources-for-learning-elasticsearch/291536)

<div class="topic-metadata">

**Author:** [@rav3n](https://discuss.elastic.co/u/rav3n)\
**Replies:** 2\
**Last updated:** [December 12, 2021, 7:19pm UTC](https://discuss.elastic.co/t/resources-for-learning-elasticsearch/291536 "2021-12-12T19:19:50Z")

</div>

Hey people, Just started using Elasticsearch for my personal use. So, last night I picked one of the tool from Elastic stack and started reading about it. I came across to this book named "Elasticsearch: The Definitive …

---

## [Increase timeouts between ES and logstash](https://discuss.elastic.co/t/increase-timeouts-between-es-and-logstash/291550)

<div class="topic-metadata">

**Author:** [@dominbdg](https://discuss.elastic.co/u/dominbdg)\
**Replies:** 0\
**Last updated:** [December 12, 2021, 4:15pm UTC](https://discuss.elastic.co/t/increase-timeouts-between-es-and-logstash/291550 "2021-12-12T16:15:52Z")

</div>

hello, I'm facing the issues means: \[\[main\]\>worker5\] elasticsearch - Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down! {:error\_message=\>"Elasticsearch Unreachable:…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=525)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=527)
