# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=779 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 780 --- ## [Use ES as a backed for a dash Application](https://discuss.elastic.co/t/use-es-as-a-backed-for-a-dash-application/252872)
**Author:** [@yasvanth](https://discuss.elastic.co/u/yasvanth)\ **Replies:** 1\ **Last updated:** [October 24, 2020, 10:06am UTC](https://discuss.elastic.co/t/use-es-as-a-backed-for-a-dash-application/252872 "2020-10-24T10:06:02Z")
Hi Team, ES Version: 6.5.4 Python Version : 3 I am writing a dash app to generate reports that uses elasticsearch as a backend/data source, to connect my app to elasticsearch I use elasticsearch-dsl python module. Whe… --- ## [Search unmapped fields](https://discuss.elastic.co/t/search-unmapped-fields/253188)
**Author:** [@anantvir](https://discuss.elastic.co/u/anantvir)\ **Replies:** 0\ **Last updated:** [October 24, 2020, 2:00am UTC](https://discuss.elastic.co/t/search-unmapped-fields/253188 "2020-10-24T02:00:56Z")
Hello Everyone, I want to add a new field mapping in existing index. The new field called 'transactions' is supposed to be an array of objects. Below is the sample 'transactions' field I want to store. TRANSACTIONS… --- ## [How expensive is Composite Aggregation?](https://discuss.elastic.co/t/how-expensive-is-composite-aggregation/253184)
**Author:** [@shreedhan](https://discuss.elastic.co/u/shreedhan)\ **Replies:** 1\ **Last updated:** [October 23, 2020, 10:53pm UTC](https://discuss.elastic.co/t/how-expensive-is-composite-aggregation/253184 "2020-10-23T22:53:19Z")
I'm planning to use Composite Aggregation in one of my projects and wanted to know how expensive these operations are. Specifically, I wanted to see how does the compute and memory cost increase along with following valu… --- ## [How to optimize regexp filter](https://discuss.elastic.co/t/how-to-optimize-regexp-filter/252903)
**Author:** [@junhuangli](https://discuss.elastic.co/u/junhuangli)\ **Replies:** 5\ **Last updated:** [October 23, 2020, 9:09pm UTC](https://discuss.elastic.co/t/how-to-optimize-regexp-filter/252903 "2020-10-23T21:09:58Z")
The following is one of our slow queries, I got from our slow query log. I tried run it locally which takes 38 seconds and return 6 records, but if I removed the "regexp" filter, it only takes like 8 miliseconds to finis… --- ## [\[Roll up index\] Roll up index stopped processing documents](https://discuss.elastic.co/t/roll-up-index-roll-up-index-stopped-processing-documents/252434)
**Author:** [@zaratustra689](https://discuss.elastic.co/u/zaratustra689)\ **Replies:** 1\ **Last updated:** [October 23, 2020, 8:41pm UTC](https://discuss.elastic.co/t/roll-up-index-roll-up-index-stopped-processing-documents/252434 "2020-10-23T20:41:58Z")
Hello, I have running now 3 different jobs for their respective index. In one of them, docs are being processed but on the other 2, they are not. The thing is that they 3 have the exactly same configuration for the rol… --- ## [Securing ELK](https://discuss.elastic.co/t/securing-elk/253175)
**Author:** [@jcor](https://discuss.elastic.co/u/jcor)\ **Replies:** 1\ **Last updated:** [October 23, 2020, 7:50pm UTC](https://discuss.elastic.co/t/securing-elk/253175 "2020-10-23T19:50:50Z")
Hi all, I'm working on securing my lab elk stack and running into a roadblock. I've been following this guide very closely https://www.elastic.co/blog/configuring-ssl-tls-and-https-to-secure-elasticsearch-kibana-beats-… --- ## [Events coming into Log Stream but not Kibana Discover](https://discuss.elastic.co/t/events-coming-into-log-stream-but-not-kibana-discover/253082)
**Author:** [@allieg](https://discuss.elastic.co/u/allieg)\ **Replies:** 2\ **Last updated:** [October 23, 2020, 5:50pm UTC](https://discuss.elastic.co/t/events-coming-into-log-stream-but-not-kibana-discover/253082 "2020-10-23T17:50:52Z")
Hi, Basically what the title of this post says. I can see various events coming into the Log under the Observability tab: However, when I go to the Discover tab, nothing is showing up: Since we can assume Filebe… --- ## [Hidden indicies wrongly matching with template with wildcard pattern](https://discuss.elastic.co/t/hidden-indicies-wrongly-matching-with-template-with-wildcard-pattern/252184)
**Author:** [@raulgs](https://discuss.elastic.co/u/raulgs)\ **Replies:** 2\ **Last updated:** [October 23, 2020, 4:31pm UTC](https://discuss.elastic.co/t/hidden-indicies-wrongly-matching-with-template-with-wildcard-pattern/252184 "2020-10-23T16:31:11Z")
Hi elastic-team, I am currently a bit confused. We do have a template that looks like this: PUT \_template/denic-index-template?include\_type\_name { "order": 100, "index\_patterns": \[ "\*" \], "settings": { … --- ## [Please help me to understand mapping templates](https://discuss.elastic.co/t/please-help-me-to-understand-mapping-templates/253027)
**Author:** [@Gosforth](https://discuss.elastic.co/u/Gosforth)\ **Replies:** 6\ **Last updated:** [October 23, 2020, 11:29am UTC](https://discuss.elastic.co/t/please-help-me-to-understand-mapping-templates/253027 "2020-10-23T11:29:43Z")
In documentation we have information that: "index templates are deprecated and will be replaced by the composable templates". But when we enter composable templates documentation we have statement: "You cannot dire… --- ## [Elasticsearch snapshots](https://discuss.elastic.co/t/elasticsearch-snapshots/253121)
**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\ **Replies:** 1\ **Last updated:** [October 23, 2020, 11:24am UTC](https://discuss.elastic.co/t/elasticsearch-snapshots/253121 "2020-10-23T11:24:50Z")
I have many (10+) Elasticsearch clusters, and this clusters is use for different purposes (storing logs, storing some business and analytical data) So for example i have a 3-node elasticsearch cluster used for some busin… --- ## [Similarity scoring based on array length and matching terms](https://discuss.elastic.co/t/similarity-scoring-based-on-array-length-and-matching-terms/253116)
**Author:** [@KoPee](https://discuss.elastic.co/u/KoPee)\ **Replies:** 0\ **Last updated:** [October 23, 2020, 10:29am UTC](https://discuss.elastic.co/t/similarity-scoring-based-on-array-length-and-matching-terms/253116 "2020-10-23T10:29:52Z")
I need to end up with a score where doc 1 and doc 2 both score 100% while document 3 scores 50%. I'd like to score based on "Matching keywords" divided by length of keywords array. BM25 with a k1 and b of 0 comes clo… --- ## [Error on sudo systemctl enable --now elasticsearch](https://discuss.elastic.co/t/error-on-sudo-systemctl-enable-now-elasticsearch/252199)
**Author:** [@robin76](https://discuss.elastic.co/u/robin76)\ **Replies:** 3\ **Last updated:** [October 23, 2020, 9:30am UTC](https://discuss.elastic.co/t/error-on-sudo-systemctl-enable-now-elasticsearch/252199 "2020-10-23T09:30:02Z")
Hi, I am new here. I am trying to install elasticsearch on my Centos 7.8 to support Magento 2.4\] I followed all instruction but on enabling it with command sudo systemctl enable --now elasticsearch I have this error … --- ## [Issue with highlighting a sentence in ElasticSearch cut off](https://discuss.elastic.co/t/issue-with-highlighting-a-sentence-in-elasticsearch-cut-off/253099)
**Author:** [@Deepukeloth](https://discuss.elastic.co/u/Deepukeloth)\ **Replies:** 0\ **Last updated:** [October 23, 2020, 8:31am UTC](https://discuss.elastic.co/t/issue-with-highlighting-a-sentence-in-elasticsearch-cut-off/253099 "2020-10-23T08:31:56Z")
Hi, I am facing an issue with highlighting of multi-synonym word in search response. Our ES version is 5.x .The issue is that if a synonym word is present at the beginning or at the end of the sentence, then part of th… --- ## [How to optimize memory and heap usage for Single node Elastic Search](https://discuss.elastic.co/t/how-to-optimize-memory-and-heap-usage-for-single-node-elastic-search/252492)
**Author:** [@avadhut](https://discuss.elastic.co/u/avadhut)\ **Replies:** 6\ **Last updated:** [October 23, 2020, 6:32am UTC](https://discuss.elastic.co/t/how-to-optimize-memory-and-heap-usage-for-single-node-elastic-search/252492 "2020-10-23T06:32:07Z")
Hi everyone, I have set up a single node latest version elasticsearch cluster with Xpack and Kibana UI on the same VM. The VM has 23 GB RAM. I have provided 12 GB of JAVA heap space. But still, elastic search uses all o… --- ## [Which class and functions in Java code to use for Aggregation queries using Low Level Rest Client for elastic](https://discuss.elastic.co/t/which-class-and-functions-in-java-code-to-use-for-aggregation-queries-using-low-level-rest-client-for-elastic/253037)
**Author:** [@daviddavid](https://discuss.elastic.co/u/daviddavid)\ **Replies:** 3\ **Last updated:** [October 23, 2020, 5:28am UTC](https://discuss.elastic.co/t/which-class-and-functions-in-java-code-to-use-for-aggregation-queries-using-low-level-rest-client-for-elastic/253037 "2020-10-23T05:28:08Z")
Which class and functions in Java code to use for Aggregation queries using Low Level Rest Client for elastic. Which Class to be used. AggregationBuilder class seems to be not present in older version like in High Level … --- ## [Searching with special characters](https://discuss.elastic.co/t/searching-with-special-characters/253083)
**Author:** [@Alex\_Pravdin](https://discuss.elastic.co/u/Alex_Pravdin)\ **Replies:** 0\ **Last updated:** [October 23, 2020, 4:08am UTC](https://discuss.elastic.co/t/searching-with-special-characters/253083 "2020-10-23T04:08:53Z")
I'm trying to make an autocomplete search that will account for special characters and add weights to the results which match a query with these characters. Index: { "institution\_test":{ "settings":{ … --- ## [Can not add mapping](https://discuss.elastic.co/t/can-not-add-mapping/252979)
**Author:** [@Alex\_Pravdin](https://discuss.elastic.co/u/Alex_Pravdin)\ **Replies:** 1\ **Last updated:** [October 23, 2020, 2:46am UTC](https://discuss.elastic.co/t/can-not-add-mapping/252979 "2020-10-23T02:46:46Z")
I'm using Elasticsearch 5.6 (I know it's outdated but I can not switch it right now). I'm doing the following request: { "settings":{ "index":{ "analysis":{ "filter":{ … --- ## [Difference between PluginCLI and PluginManager used in Plugin.bat](https://discuss.elastic.co/t/difference-between-plugincli-and-pluginmanager-used-in-plugin-bat/253080)
**Author:** [@Varsha\_Muzumdar](https://discuss.elastic.co/u/Varsha_Muzumdar)\ **Replies:** 0\ **Last updated:** [October 23, 2020, 2:16am UTC](https://discuss.elastic.co/t/difference-between-plugincli-and-pluginmanager-used-in-plugin-bat/253080 "2020-10-23T02:16:57Z")
I am new to ES community and I have been using ES on Windows. I see that some distributions of ElasticSearch plugin.bat reference org.elasticsearch.plugins.PluginManager whereas some others reference org.elasticsearch.pl… --- ## [Memory -Xmx and -Xms "should" be the same... how severely "should" we heed this recommendation?](https://discuss.elastic.co/t/memory-xmx-and-xms-should-be-the-same-how-severely-should-we-heed-this-recommendation/252737)
**Author:** [@cjcjameson](https://discuss.elastic.co/u/cjcjameson)\ **Replies:** 2\ **Last updated:** [October 23, 2020, 12:33am UTC](https://discuss.elastic.co/t/memory-xmx-and-xms-should-be-the-same-how-severely-should-we-heed-this-recommendation/252737 "2020-10-23T00:33:35Z")
https://github.com/elastic/elasticsearch/blob/master/docs/reference/setup/important-settings/heap-size.asciidoc#heap-size-settings mentions: Elasticsearch will assign the entire heap specified in jvm.options via the Xms… --- ## [Pass batch size in deleteByQuery \[elasticsearch\] \[scala\]](https://discuss.elastic.co/t/pass-batch-size-in-deletebyquery-elasticsearch-scala/253067)
**Author:** [@Priya3](https://discuss.elastic.co/u/Priya3)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 8:46pm UTC](https://discuss.elastic.co/t/pass-batch-size-in-deletebyquery-elasticsearch-scala/253067 "2020-10-22T20:46:03Z")
I need to pass batch size while using deletebyQuery. My requirement is: Get x rows based on filters Run DeletebyQuery on them Return this list While doing search using filters, there can 1000 rows but I need only bat… --- ## [Mapper for \[someField\] conflicts with existing mapping: \[mapper \[someField\] has different \[norms\] values, cannot change from disable to enabled](https://discuss.elastic.co/t/mapper-for-somefield-conflicts-with-existing-mapping-mapper-somefield-has-different-norms-values-cannot-change-from-disable-to-enabled/253064)
**Author:** [@b0redom](https://discuss.elastic.co/u/b0redom)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 8:02pm UTC](https://discuss.elastic.co/t/mapper-for-somefield-conflicts-with-existing-mapping-mapper-somefield-has-different-norms-values-cannot-change-from-disable-to-enabled/253064 "2020-10-22T20:02:10Z")
Hi, I'm reasonably new to ElasticSearch, and I've been Googling and reading, but I've not found anything to help. I use Index Templates to ingest data. I have one with well defined mapped fields, but 2 in particular: a… --- ## [High CPU usage 80/90% on elastic search cluster](https://discuss.elastic.co/t/high-cpu-usage-80-90-on-elastic-search-cluster/253062)
**Author:** [@Isa](https://discuss.elastic.co/u/Isa)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 7:35pm UTC](https://discuss.elastic.co/t/high-cpu-usage-80-90-on-elastic-search-cluster/253062 "2020-10-22T19:35:46Z")
Hi Disclaimer: I'm new to elastic and have inheritted this cluster so please excuse my ignorance. Our cluster is used for logs. We create an index for each system each day and some indexes are huge 500GB. We started n… --- ## [Configuring ES coordinating only nodes in Kubernetes](https://discuss.elastic.co/t/configuring-es-coordinating-only-nodes-in-kubernetes/253053)
**Author:** [@jdevilla20](https://discuss.elastic.co/u/jdevilla20)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 6:29pm UTC](https://discuss.elastic.co/t/configuring-es-coordinating-only-nodes-in-kubernetes/253053 "2020-10-22T18:29:23Z")
Hi I want to create coordinating only nodes on my ES cluster. How do I configure client only nodes? For example, in my data nodes, I do this: config: node.master: false node.data: true n… --- ## [Huge ES query logging issue](https://discuss.elastic.co/t/huge-es-query-logging-issue/253055)
**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 6:31pm UTC](https://discuss.elastic.co/t/huge-es-query-logging-issue/253055 "2020-10-22T18:31:06Z")
We use elasticsearch 7.2.0 Yesterday we had an incident where nearly 4-5mb (request size) query was fired by one of our client. We use master nodes as our coordinating nodes ( i know, bad practice ) One of our master n… --- ## [Primary shard is not active Timeout: \[1m\]](https://discuss.elastic.co/t/primary-shard-is-not-active-timeout-1m/253051)
**Author:** [@jaraws](https://discuss.elastic.co/u/jaraws)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 6:16pm UTC](https://discuss.elastic.co/t/primary-shard-is-not-active-timeout-1m/253051 "2020-10-22T18:16:50Z")
I have got a single node(unix machine) where we have setup ELK 6.8.6. However while sending the logs from logstash to elasticsearch I am getting following exception s repeatedly. \[2020-10-22T13:59:23,500\]\[INFO \]\[logstas… --- ## [Elasticsearch and logstash on AWS EC2](https://discuss.elastic.co/t/elasticsearch-and-logstash-on-aws-ec2/253052)
**Author:** [@Kishan](https://discuss.elastic.co/u/Kishan)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 6:21pm UTC](https://discuss.elastic.co/t/elasticsearch-and-logstash-on-aws-ec2/253052 "2020-10-22T18:21:04Z")
HI, I am setting up elasticsearch and logstash using AWS EC2 with auto scaling option . Private IPs of EC2 are dynamic for each EC2 Instance creation during Auto scaling . i am looking for any information on how to c… --- ## [Matches query equivalent to terms query](https://discuss.elastic.co/t/matches-query-equivalent-to-terms-query/253030)
**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\ **Replies:** 2\ **Last updated:** [October 22, 2020, 6:19pm UTC](https://discuss.elastic.co/t/matches-query-equivalent-to-terms-query/253030 "2020-10-22T18:19:56Z")
I'd like to know why elasticsearch doesn't support array of values for different kinds of queries. As of now i'm only looking for something like matches (something similar to terms query where array of terms are accepte… --- ## [Elasticsearch will not start](https://discuss.elastic.co/t/elasticsearch-will-not-start/253039)
**Author:** [@rgibson\_27](https://discuss.elastic.co/u/rgibson_27)\ **Replies:** 0\ **Last updated:** [October 22, 2020, 4:00pm UTC](https://discuss.elastic.co/t/elasticsearch-will-not-start/253039 "2020-10-22T16:00:08Z")
I am having an issue with Elasticsearch starting on Ubuntu 20.04 while trying to start the service doing the following: systemctl restart elasticsearch Job for elasticsearch.service failed because a fatal signal was de… --- ## [Meachine learning anomaly detection error: no node found](https://discuss.elastic.co/t/meachine-learning-anomaly-detection-error-no-node-found/252525)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 7\ **Last updated:** [October 22, 2020, 3:19pm UTC](https://discuss.elastic.co/t/meachine-learning-anomaly-detection-error-no-node-found/252525 "2020-10-22T15:19:32Z")
Hello, I am trying elastic machine learning, I tried to run default job for audibeat and I am getting this error in kibana logs : server log \[11:59:16.059\] \[error\]\[data\]\[elasticsearch\] \[status\_exception\]: No node … --- ## [ES JDBC Client compatible with specific minor versions only](https://discuss.elastic.co/t/es-jdbc-client-compatible-with-specific-minor-versions-only/252991)
**Author:** [@Mahdy\_S](https://discuss.elastic.co/u/Mahdy_S)\ **Replies:** 1\ **Last updated:** [October 22, 2020, 3:16pm UTC](https://discuss.elastic.co/t/es-jdbc-client-compatible-with-specific-minor-versions-only/252991 "2020-10-22T15:16:17Z")
Hi All, We have an Elasticsearch cluster in version 6. We are planning an upgrade to version 7. For one of our applications, we are using Elastic's JDBC client to get data from ES. We have unfortunately no other way to … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=778) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=780)