# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=802

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 803

---

## [How to return unmatched record with different score](https://discuss.elastic.co/t/how-to-return-unmatched-record-with-different-score/248704)

<div class="topic-metadata">

**Author:** [@Ankit\_Pradhan](https://discuss.elastic.co/u/Ankit_Pradhan)\
**Replies:** 2\
**Last updated:** [September 23, 2020, 8:16am UTC](https://discuss.elastic.co/t/how-to-return-unmatched-record-with-different-score/248704 "2020-09-23T08:16:52Z")

</div>

i have 2 document ... document 1 { "field1": "Value1", "field2": "Value2", "field3": "Value3" } document 2 { "field1": "Value1", "field2": "Value2" } When I do a search with "field1": "Value1" and "field2": …

---

## ["old" log files.log max number retained](https://discuss.elastic.co/t/old-log-files-log-max-number-retained/249589)

<div class="topic-metadata">

**Author:** [@ginolegigot](https://discuss.elastic.co/u/ginolegigot)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 10:22pm UTC](https://discuss.elastic.co/t/old-log-files-log-max-number-retained/249589 "2020-09-22T22:22:22Z")

</div>

Hello! My problem is about setting properly a max number of retained files (\*.log). Here the beginning my log4j.j2: status = error # log action execution errors for easier debugging logger.action.name = org.elasticse…

---

## [Nested array contain many problem](https://discuss.elastic.co/t/nested-array-contain-many-problem/249610)

<div class="topic-metadata">

**Author:** [@mich4s](https://discuss.elastic.co/u/mich4s)\
**Replies:** 1\
**Last updated:** [September 23, 2020, 6:11am UTC](https://discuss.elastic.co/t/nested-array-contain-many-problem/249610 "2020-09-23T06:11:00Z")

</div>

Hello, I cannot find anywhere example of that kind of query. What I need to achieve is filter that kind of documents: { "id": "11097a6a-2f9c-4717-9b21-4d675727b879", "options": \[ "ONE", "TWO", "FOUR" …

---

## [Need help in elasticsearch snapshot](https://discuss.elastic.co/t/need-help-in-elasticsearch-snapshot/249605)

<div class="topic-metadata">

**Author:** [@kasim123](https://discuss.elastic.co/u/kasim123)\
**Replies:** 8\
**Last updated:** [September 23, 2020, 5:41am UTC](https://discuss.elastic.co/t/need-help-in-elasticsearch-snapshot/249605 "2020-09-23T05:41:44Z")

</div>

Hi Team, I am planning to migrate data from one cluster to another cluster by taking snapshot of indices. In current k8s cluster, I do not have shared storage which is needed to define repo location. We are using rook…

---

## [Short read of DER length](https://discuss.elastic.co/t/short-read-of-der-length/249343)

<div class="topic-metadata">

**Author:** [@AkatsukiPain](https://discuss.elastic.co/u/AkatsukiPain)\
**Replies:** 2\
**Last updated:** [September 23, 2020, 5:17am UTC](https://discuss.elastic.co/t/short-read-of-der-length/249343 "2020-09-23T05:17:02Z")

</div>

I was running this command to generate certificate and the problem occurs /usr/share/elasticsearch/bin/elasticsearch-certutil cert --ca /home/elastic-stack-ca.p12 Could you guys help me this problem?

---

## [How elastic search support encryption of data at Rest](https://discuss.elastic.co/t/how-elastic-search-support-encryption-of-data-at-rest/249573)

<div class="topic-metadata">

**Author:** [@Vivek\_Sagar](https://discuss.elastic.co/u/Vivek_Sagar)\
**Replies:** 3\
**Last updated:** [September 23, 2020, 5:13am UTC](https://discuss.elastic.co/t/how-elastic-search-support-encryption-of-data-at-rest/249573 "2020-09-23T05:13:57Z")

</div>

How does ES support encryption of data at Rest? I read in many prior discussions that it can be achieved by OS level encryption like dm-crypt which is supported in Elastic Search platinum subscription. But still data wi…

---

## [S3\_repository error](https://discuss.elastic.co/t/s3-repository-error/249340)

<div class="topic-metadata">

**Author:** [@prashanth\_sri](https://discuss.elastic.co/u/prashanth_sri)\
**Replies:** 4\
**Last updated:** [September 23, 2020, 3:54am UTC](https://discuss.elastic.co/t/s3-repository-error/249340 "2020-09-23T03:54:57Z")

</div>

{"error":{"root\_cause":\[{"type":"repository\_exception","reason":"\[s3\_repository\] could not read repository data from index blob"}\], "type":"repository\_exception","reason":"\[s3\_repository\] could not read repository data …

---

## [ElasticSearch 7 start up error - the default discovery settings are unsuitable for production use](https://discuss.elastic.co/t/elasticsearch-7-start-up-error-the-default-discovery-settings-are-unsuitable-for-production-use/249222)

<div class="topic-metadata">

**Author:** [@linfordwoode](https://discuss.elastic.co/u/linfordwoode)\
**Replies:** 3\
**Last updated:** [September 23, 2020, 1:07am UTC](https://discuss.elastic.co/t/elasticsearch-7-start-up-error-the-default-discovery-settings-are-unsuitable-for-production-use/249222 "2020-09-23T01:07:40Z")

</div>

I am having this issue( the default discovery settings are unsuitable for production use: at least one of \[discovery.seed\_hosts, discovery.seed\_providers, cluster.initial\_master\_nodes\] must be configured) with my Elastic…

---

## [Is it possible to limit retrieved documents based on a sum aggregation?](https://discuss.elastic.co/t/is-it-possible-to-limit-retrieved-documents-based-on-a-sum-aggregation/249582)

<div class="topic-metadata">

**Author:** [@jmwilkinson](https://discuss.elastic.co/u/jmwilkinson)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 11:18pm UTC](https://discuss.elastic.co/t/is-it-possible-to-limit-retrieved-documents-based-on-a-sum-aggregation/249582 "2020-09-22T23:18:49Z")

</div>

Lets say i have the documents: {"name": "foo", "size": 1} {"name": "bar", "size": 10} {"name": "baz", "size": 2} {"name": "fred", "size": 5} I could perform the following aggregation: POST /my-docs/\_search?size=0 { …

---

## [Increase the query per sec and latency for very less data](https://discuss.elastic.co/t/increase-the-query-per-sec-and-latency-for-very-less-data/249345)

<div class="topic-metadata">

**Author:** [@Nupur](https://discuss.elastic.co/u/Nupur)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 10:26pm UTC](https://discuss.elastic.co/t/increase-the-query-per-sec-and-latency-for-very-less-data/249345 "2020-09-22T22:26:41Z")

</div>

how to do horizontal scaling to increase the query/s and latency when i have very less data(less than 50 mb) and only one shard

---

## [Filter array values using painless script](https://discuss.elastic.co/t/filter-array-values-using-painless-script/249468)

<div class="topic-metadata">

**Author:** [@askids](https://discuss.elastic.co/u/askids)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 7:53am UTC](https://discuss.elastic.co/t/filter-array-values-using-painless-script/249468 "2020-09-22T07:53:49Z")

</div>

hi, I am trying to get some stats for field that has array values. Just for overall stats, I am using the stats api (sample given below). But now, I want to apply a filter on values within the array and get stats only w…

---

## [Language Identification in Elastic Cloud](https://discuss.elastic.co/t/language-identification-in-elastic-cloud/249498)

<div class="topic-metadata">

**Author:** [@antony\_kavin](https://discuss.elastic.co/u/antony_kavin)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 10:19pm UTC](https://discuss.elastic.co/t/language-identification-in-elastic-cloud/249498 "2020-09-22T22:19:36Z")

</div>

Hi team, I am currently on platinum plan of Elastic cloud. I want to use the Language Identification feature in elasticsearch.I would like to use identify the language of a text field and add it as a separate column be…

---

## [Elasticsearch in Geoportal](https://discuss.elastic.co/t/elasticsearch-in-geoportal/249323)

<div class="topic-metadata">

**Author:** [@Durga07](https://discuss.elastic.co/u/Durga07)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 9:53pm UTC](https://discuss.elastic.co/t/elasticsearch-in-geoportal/249323 "2020-09-22T21:53:20Z")

</div>

Hi I am using Elasticsearch in Geoportal. I don't have much knowledge on Search engines. I went through the Lucene Search Text Queries(Lucene Search Syntax) in which it is mentioned that we should use double quotes ("w…

---

## [Docker image for Elasticsearch - Raspberry PI](https://discuss.elastic.co/t/docker-image-for-elasticsearch-raspberry-pi/249584)

<div class="topic-metadata">

**Author:** [@javidr](https://discuss.elastic.co/u/javidr)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 9:09pm UTC](https://discuss.elastic.co/t/docker-image-for-elasticsearch-raspberry-pi/249584 "2020-09-22T21:09:38Z")

</div>

Hi I did open a topic the other day asking for support to run ELK in a raspberry pi and i had little support there. For me this is a great functionality for pi so i was surprised to see so little info about it I have c…

---

## [Data node not able to discover master node](https://discuss.elastic.co/t/data-node-not-able-to-discover-master-node/249570)

<div class="topic-metadata">

**Author:** [@srbhklkrn](https://discuss.elastic.co/u/srbhklkrn)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 7:04pm UTC](https://discuss.elastic.co/t/data-node-not-able-to-discover-master-node/249570 "2020-09-22T19:04:55Z")

</div>

I have 1 master eligible node and 1 data node Master config: # ---------------------------------- Cluster ----------------------------------- cluster.name: ELS\_Cluster # ------------------------------------ Node ------…

---

## [Including Metricbeat Custom Field in Watch](https://discuss.elastic.co/t/including-metricbeat-custom-field-in-watch/249130)

<div class="topic-metadata">

**Author:** [@butchkelley](https://discuss.elastic.co/u/butchkelley)\
**Replies:** 7\
**Last updated:** [September 22, 2020, 2:55pm UTC](https://discuss.elastic.co/t/including-metricbeat-custom-field-in-watch/249130 "2020-09-22T14:55:24Z")

</div>

Hello - I have the following Watch which triggers when Metricbeat shows system.cpu.total.pct is over 75%. PUT \_watcher/watch/testwatch { "trigger": { "schedule": { "interval": "10s" } }, "metadata":…

---

## [UnsupportedOperationException causes snapshots to fail](https://discuss.elastic.co/t/unsupportedoperationexception-causes-snapshots-to-fail/249181)

<div class="topic-metadata">

**Author:** [@OliviaTrewin](https://discuss.elastic.co/u/OliviaTrewin)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 2:25pm UTC](https://discuss.elastic.co/t/unsupportedoperationexception-causes-snapshots-to-fail/249181 "2020-09-22T14:25:58Z")

</div>

We have an Elasticsearch 7.9.1 cluster that suddenly started to fail snapshotting with a strange exception. Here's the details for one of the machines in the cluster: $ uname -a Linux \[REDACTED\] 4.4.0-1095-aws #106-Ubun…

---

## [Watchguard firewall on ingestion manager](https://discuss.elastic.co/t/watchguard-firewall-on-ingestion-manager/249482)

<div class="topic-metadata">

**Author:** [@JLT](https://discuss.elastic.co/u/JLT)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 1:49pm UTC](https://discuss.elastic.co/t/watchguard-firewall-on-ingestion-manager/249482 "2020-09-22T13:49:05Z")

</div>

The ingestion manager was long due and i am quite pleased with what i see. For this client there is a request to on-board watchguard devices, can i contribute to an effort of creating an ingestion profile for watchguard…

---

## [ElasticSearch. Select by date range in array of dates and sort by matching dates](https://discuss.elastic.co/t/elasticsearch-select-by-date-range-in-array-of-dates-and-sort-by-matching-dates/249509)

<div class="topic-metadata">

**Author:** [@AHeavyObject](https://discuss.elastic.co/u/AHeavyObject)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 1:38pm UTC](https://discuss.elastic.co/t/elasticsearch-select-by-date-range-in-array-of-dates-and-sort-by-matching-dates/249509 "2020-09-22T13:38:36Z")

</div>

Every document has several dates. I want to select documents withing a date range (any of dates fits the range - the document matches). This part works. And I want to sort the selected document by date, but sorting inc…

---

## [How to match documents that don't have a specific nested object](https://discuss.elastic.co/t/how-to-match-documents-that-dont-have-a-specific-nested-object/249514)

<div class="topic-metadata">

**Author:** [@thomashiron](https://discuss.elastic.co/u/thomashiron)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 1:34pm UTC](https://discuss.elastic.co/t/how-to-match-documents-that-dont-have-a-specific-nested-object/249514 "2020-09-22T13:34:20Z")

</div>

Hi! I'd like to find documents with nested objects that don't match a specific query. For example, I want to match documents that don't have an Alice user. If I follow the documentation, and execute the query below, I…

---

## [Export data from elasticsearch index to a file](https://discuss.elastic.co/t/export-data-from-elasticsearch-index-to-a-file/249525)

<div class="topic-metadata">

**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 1:10pm UTC](https://discuss.elastic.co/t/export-data-from-elasticsearch-index-to-a-file/249525 "2020-09-22T13:10:59Z")

</div>

Hello, I'd like to get all data that I have in index to a file (text or json) or use logstash to fetch the data and transport the data directly to another database (InfluxDB in particular) by using elasticsearch input a…

---

## [Is there any way not to use Elasticsearch's Clustering system? (in docker)](https://discuss.elastic.co/t/is-there-any-way-not-to-use-elasticsearchs-clustering-system-in-docker/249505)

<div class="topic-metadata">

**Author:** [@mcarthcat](https://discuss.elastic.co/u/mcarthcat)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 12:40pm UTC](https://discuss.elastic.co/t/is-there-any-way-not-to-use-elasticsearchs-clustering-system-in-docker/249505 "2020-09-22T12:40:19Z")

</div>

first.. I'm not good at english. execuse me.. Hello. I don't want to manage Cluster(nods or shards). Please tell me how to set Docker-compose? (or any way in Docker) Thanks...

---

## [Querying and sorting using painless script and nested fields](https://discuss.elastic.co/t/querying-and-sorting-using-painless-script-and-nested-fields/249408)

<div class="topic-metadata">

**Author:** [@Emanuel\_Velzi](https://discuss.elastic.co/u/Emanuel_Velzi)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 12:26pm UTC](https://discuss.elastic.co/t/querying-and-sorting-using-painless-script-and-nested-fields/249408 "2020-09-22T12:26:10Z")

</div>

Hi, I am querying an index in my ES cluster 7.9.1: { "query": { "multi\_match": { "query": "Ciudad Boli", "fields": \[ "name.\*.single" \], "type": "phrase\_prefix" …

---

## [Handling TB's of data in Elasticsearch](https://discuss.elastic.co/t/handling-tbs-of-data-in-elasticsearch/249455)

<div class="topic-metadata">

**Author:** [@Jayabal\_K](https://discuss.elastic.co/u/Jayabal_K)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 12:19pm UTC](https://discuss.elastic.co/t/handling-tbs-of-data-in-elasticsearch/249455 "2020-09-22T12:19:57Z")

</div>

Hi all, In my case, I need to handle 3TB of data in elaticsearch, We have a job to rotate the index daily once. Each day a new index will be created, which is of size 100 GB. For 30 days we have 30 indices( 30 \* 100GB =…

---

## [Coordinator node failed to join the cluster](https://discuss.elastic.co/t/coordinator-node-failed-to-join-the-cluster/249517)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 12:14pm UTC](https://discuss.elastic.co/t/coordinator-node-failed-to-join-the-cluster/249517 "2020-09-22T12:14:27Z")

</div>

Hello, I am trying to add a coordinator node to my cluster, but I am facing this error when I run it : \[2020-09-22T14:03:00,808\]\[INFO \]\[o.e.c.c.JoinHelper \] \[coordinator-node\] failed to join {VSELK-MASTER-02}{7ZS…

---

## [Which Spring Data design when the total\_fields limit is reached?](https://discuss.elastic.co/t/which-spring-data-design-when-the-total-fields-limit-is-reached/248315)

<div class="topic-metadata">

**Author:** [@juherr](https://discuss.elastic.co/u/juherr)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 12:09pm UTC](https://discuss.elastic.co/t/which-spring-data-design-when-the-total-fields-limit-is-reached/248315 "2020-09-22T12:09:58Z")

</div>

Hi, We are using Elasticsearch through Spring Data and we reached the default "index.mapping.total\_fields.limit". We are indexing 5 different types of documents (via Java types, not index types). Each document has many…

---

## [Elasticsearch eat 100% of cpu](https://discuss.elastic.co/t/elasticsearch-eat-100-of-cpu/249076)

<div class="topic-metadata">

**Author:** [@vodka\_pivo](https://discuss.elastic.co/u/vodka_pivo)\
**Replies:** 5\
**Last updated:** [September 22, 2020, 12:02pm UTC](https://discuss.elastic.co/t/elasticsearch-eat-100-of-cpu/249076 "2020-09-22T12:02:12Z")

</div>

I have 3 node Elasticsearch cluster (7 verion) on this HW vCPU: 8 RAM 16 ( 8GB HEAP) disk SSD 300gb OS CentOS 7 so totally in my cluster i have 24 vCPU, 48 RAM, and 1,2 TB i have 70 indices (all of indices has 3 primar…

---

## [Elastic Agent 7.9.1 doesn´t send data on Windows](https://discuss.elastic.co/t/elastic-agent-7-9-1-doesn-t-send-data-on-windows/248273)

<div class="topic-metadata">

**Author:** [@hofrichterovak](https://discuss.elastic.co/u/hofrichterovak)\
**Replies:** 14\
**Last updated:** [September 22, 2020, 11:32am UTC](https://discuss.elastic.co/t/elastic-agent-7-9-1-doesn-t-send-data-on-windows/248273 "2020-09-22T11:32:03Z")

</div>

Hello, I have problem with Elastic Agent 7.9.1 on Windows. Agent doesn´t generate any data. I don´t see generated dataset on tab Datasets in Kibana. GET metrics-/\_search; GET logs-/\_search is without data too. At the b…

---

## [Search Query Help](https://discuss.elastic.co/t/search-query-help/249469)

<div class="topic-metadata">

**Author:** [@tolar](https://discuss.elastic.co/u/tolar)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 10:33am UTC](https://discuss.elastic.co/t/search-query-help/249469 "2020-09-22T10:33:54Z")

</div>

I inserted records with below commands: POST dnmindex1/doc/ { "matches": \[ { "XURI": "xcp:4.1:a:abcv12:abcp12:6.0:\*:\*:\*:\*:\*:\*:\*" }, { …

---

## [ElasticSearch 7.4 taking 100% cpu usage](https://discuss.elastic.co/t/elasticsearch-7-4-taking-100-cpu-usage/249241)

<div class="topic-metadata">

**Author:** [@Pavan\_Kalyan\_Ladi](https://discuss.elastic.co/u/Pavan_Kalyan_Ladi)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 8:39am UTC](https://discuss.elastic.co/t/elasticsearch-7-4-taking-100-cpu-usage/249241 "2020-09-22T08:39:07Z")

</div>

Recently we migrated from ES-5.1 to ES7.4 and the CPU usage too high in ES7.4 compared to ES5.1 With a given load the max. cpu usage of 5.1 is in between 0% to 10%. However the performance and max. cpu usage of 7.4 is …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=801)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=803)
