# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=907

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 908

---

## [ElasticSearch term Aggregation on text fields](https://discuss.elastic.co/t/elasticsearch-term-aggregation-on-text-fields/234737)

<div class="topic-metadata">

**Author:** [@Dharmendra\_Arya](https://discuss.elastic.co/u/Dharmendra_Arya)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 12:01pm UTC](https://discuss.elastic.co/t/elasticsearch-term-aggregation-on-text-fields/234737 "2020-05-28T12:01:19Z")

</div>

I have a requirement to do find out TOP 10 keywords from text data ( short strings only... limited to 5 to 6 keywords). in order to do aggregate the tokens from text data - There are two approach I think of : enabl…

---

## [Updating field as index = true with large document set](https://discuss.elastic.co/t/updating-field-as-index-true-with-large-document-set/234731)

<div class="topic-metadata">

**Author:** [@Virajsl](https://discuss.elastic.co/u/Virajsl)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 11:29am UTC](https://discuss.elastic.co/t/updating-field-as-index-true-with-large-document-set/234731 "2020-05-28T11:29:31Z")

</div>

I have large set of documents in index. Earlier some fields are mapped as index = false since client do not wanted to search on these. As per new changes certain fields needs to be set as searchable ( setting index = tru…

---

## [Cannot search for field](https://discuss.elastic.co/t/cannot-search-for-field/234723)

<div class="topic-metadata">

**Author:** [@ankitjha](https://discuss.elastic.co/u/ankitjha)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 10:52am UTC](https://discuss.elastic.co/t/cannot-search-for-field/234723 "2020-05-28T10:52:36Z")

</div>

Hi i have a field keyword which is of type string.on calling this search api i am not able to search this specific field. url:https://api.swiftype.com/api/v1/public/engines/search allKeywordSearch: "proshield, Sha…

---

## [Deleting documents from index](https://discuss.elastic.co/t/deleting-documents-from-index/234511)

<div class="topic-metadata">

**Author:** [@reddy1262](https://discuss.elastic.co/u/reddy1262)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 11:07am UTC](https://discuss.elastic.co/t/deleting-documents-from-index/234511 "2020-05-28T11:07:29Z")

</div>

Hi Team, we want to delete documents which are older than 30 days for an index from Kibana. Please suggest us how can we do this better. We tried below POST elastalert\_status\_status/\_delete\_by\_query { "query": { "ra…

---

## [Multiple independent instances on one server](https://discuss.elastic.co/t/multiple-independent-instances-on-one-server/234573)

<div class="topic-metadata">

**Author:** [@davidpustai](https://discuss.elastic.co/u/davidpustai)\
**Replies:** 5\
**Last updated:** [May 28, 2020, 10:24am UTC](https://discuss.elastic.co/t/multiple-independent-instances-on-one-server/234573 "2020-05-28T10:24:22Z")

</div>

I have one VPS running two PHP applications (resp. production and test/staging environment of one application) that are using Elasticsearch. Until now I only had one cluster with one node, that was shared between both ap…

---

## [Elasticsearch not respecting the default timeout in bulk api](https://discuss.elastic.co/t/elasticsearch-not-respecting-the-default-timeout-in-bulk-api/234711)

<div class="topic-metadata">

**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 10:03am UTC](https://discuss.elastic.co/t/elasticsearch-not-respecting-the-default-timeout-in-bulk-api/234711 "2020-05-28T10:03:27Z")

</div>

The default value for timeout in bulk api is 30s in 7.2 elasticsearch https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html Our bulk request usually contain 5-10 actions. However we've observed…

---

## [\[SOLVED\]After upgrade to 7.7.0 in a cluster of 3 nodes. - failed to retrieve password hash for reserved user \[elastic\]](https://discuss.elastic.co/t/solved-after-upgrade-to-7-7-0-in-a-cluster-of-3-nodes-failed-to-retrieve-password-hash-for-reserved-user-elastic/234700)

<div class="topic-metadata">

**Author:** [@Andreas\_Falk](https://discuss.elastic.co/u/Andreas_Falk)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 9:47am UTC](https://discuss.elastic.co/t/solved-after-upgrade-to-7-7-0-in-a-cluster-of-3-nodes-failed-to-retrieve-password-hash-for-reserved-user-elastic/234700 "2020-05-28T09:47:22Z")

</div>

Hi, We have a small cluster that we upgraded from 7.6.2 to 7.7.0 with .deb's. Everything went fine with the upgrade. Plugins were updated and all was rainbows and ponies :slight\_smile: Then when I tried to update the…

---

## [Failing to connect my java class with Elastic Search Using API](https://discuss.elastic.co/t/failing-to-connect-my-java-class-with-elastic-search-using-api/230428)

<div class="topic-metadata">

**Author:** [@Rahul\_layall](https://discuss.elastic.co/u/Rahul_layall)\
**Replies:** 2\
**Last updated:** [April 30, 2020, 8:56am UTC](https://discuss.elastic.co/t/failing-to-connect-my-java-class-with-elastic-search-using-api/230428 "2020-04-30T08:56:36Z")

</div>

Sir, How can i use the given query in my java class with sql format POST \_sql?format=txt { "query": "select name, from index\_name" } How to write its equivalent query in my java class

---

## [Can we limit number of unique values per fields?](https://discuss.elastic.co/t/can-we-limit-number-of-unique-values-per-fields/234662)

<div class="topic-metadata">

**Author:** [@Nishan\_Maharjan1](https://discuss.elastic.co/u/Nishan_Maharjan1)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 8:09am UTC](https://discuss.elastic.co/t/can-we-limit-number-of-unique-values-per-fields/234662 "2020-05-28T08:09:14Z")

</div>

The company i work for has had some query regarding this matter. They want to check if elasticsearch is capable of limiting the number of unique values allowed in a field. EX: the fields "source\_ip" may only have three …

---

## [ILM Daily indices with date retention](https://discuss.elastic.co/t/ilm-daily-indices-with-date-retention/234520)

<div class="topic-metadata">

**Author:** [@Jiri\_Petak](https://discuss.elastic.co/u/Jiri_Petak)\
**Replies:** 4\
**Last updated:** [May 28, 2020, 8:02am UTC](https://discuss.elastic.co/t/ilm-daily-indices-with-date-retention/234520 "2020-05-28T08:02:39Z")

</div>

Hi, i wanna ask about ILM creating daily indices. Or more likely i am confused about ILM concept with indices based on size. For example: We are logging infrastructure logs from syslog with filebeat. When i use ILM like: …

---

## [Elasticsearch doesn't recover data from NAS storage volume](https://discuss.elastic.co/t/elasticsearch-doesnt-recover-data-from-nas-storage-volume/234681)

<div class="topic-metadata">

**Author:** [@tmporary](https://discuss.elastic.co/u/tmporary)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 7:57am UTC](https://discuss.elastic.co/t/elasticsearch-doesnt-recover-data-from-nas-storage-volume/234681 "2020-05-28T07:57:18Z")

</div>

Hi, Our elasticsearch instance starts up fine and in the logs I can see that it found the mounted storage but it doesn't recover any indices info into the cluster. \[2020-05-28T06:51:41,853\]\[INFO \]\[o.e.e.NodeEnvironment…

---

## [Custom headers](https://discuss.elastic.co/t/custom-headers/234669)

<div class="topic-metadata">

**Author:** [@vincent.arnaud90](https://discuss.elastic.co/u/vincent.arnaud90)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 7:13am UTC](https://discuss.elastic.co/t/custom-headers/234669 "2020-05-28T07:13:06Z")

</div>

Hello, I have a custom elasticsearch plugin that requires custom HTTP headers. So I'd like to know if there's a way for rally to passe custom headers other than using raw-request (exemple using --client-options or a head…

---

## [Inserting big numbers into Elasticsearch](https://discuss.elastic.co/t/inserting-big-numbers-into-elasticsearch/234667)

<div class="topic-metadata">

**Author:** [@danielledd](https://discuss.elastic.co/u/danielledd)\
**Replies:** 7\
**Last updated:** [May 28, 2020, 7:08am UTC](https://discuss.elastic.co/t/inserting-big-numbers-into-elasticsearch/234667 "2020-05-28T07:08:19Z")

</div>

Hi, I have tried to insert this number -1.e+99 into Elasticsearch but I can't. I take this values from a text file. There is a way to convert this number? Thanks!

---

## [ILM and rollover in hot-warm issue](https://discuss.elastic.co/t/ilm-and-rollover-in-hot-warm-issue/233913)

<div class="topic-metadata">

**Author:** [@antimonio85](https://discuss.elastic.co/u/antimonio85)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 6:38am UTC](https://discuss.elastic.co/t/ilm-and-rollover-in-hot-warm-issue/233913 "2020-05-28T06:38:51Z")

</div>

Hello all, I keep having errors in the rollover and I don't know how to fix them. I have 2 elastic node and I configure it in HOT-WARM. The index are automatically created by filebeat - logstash and they are split by …

---

## [Elasticsearch ILM go straight from hot to delete](https://discuss.elastic.co/t/elasticsearch-ilm-go-straight-from-hot-to-delete/234448)

<div class="topic-metadata">

**Author:** [@Lumotheninja](https://discuss.elastic.co/u/Lumotheninja)\
**Replies:** 2\
**Last updated:** [May 28, 2020, 5:43am UTC](https://discuss.elastic.co/t/elasticsearch-ilm-go-straight-from-hot-to-delete/234448 "2020-05-28T05:43:58Z")

</div>

Can I skip the warm and cold phases and go straight from hot to delete? I am having some metricbeats/filebeats/logstash indices on dev environment with ILM configured for hot and delete phase, but for some reason they al…

---

## [Too\_Complex\_To\_Determinize Exception: Determinizing automaton with 57621 states and 60867 transitions would result in more than 10000 states](https://discuss.elastic.co/t/too-complex-to-determinize-exception-determinizing-automaton-with-57621-states-and-60867-transitions-would-result-in-more-than-10000-states/234653)

<div class="topic-metadata">

**Author:** [@Drurvesh](https://discuss.elastic.co/u/Drurvesh)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 5:15am UTC](https://discuss.elastic.co/t/too-complex-to-determinize-exception-determinizing-automaton-with-57621-states-and-60867-transitions-would-result-in-more-than-10000-states/234653 "2020-05-28T05:15:52Z")

</div>

As seen on the community page last year this was the limitation as mentioned by @nik9000 "This is a side effect of the internal implementation of wildards as NFAs that are determinized to DFAs. The determinization proce…

---

## [Ship Logs from application server to ELK server with beats](https://discuss.elastic.co/t/ship-logs-from-application-server-to-elk-server-with-beats/234647)

<div class="topic-metadata">

**Author:** [@vijazy](https://discuss.elastic.co/u/vijazy)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 4:36am UTC](https://discuss.elastic.co/t/ship-logs-from-application-server-to-elk-server-with-beats/234647 "2020-05-28T04:36:48Z")

</div>

Hi ELK team, I am building log analyzer for production environment. My scenario is, i need to setupelasticsearch,Logstash and kibana on one centos7 server which is going to use ELK server another one is apache server(re…

---

## [Enum Indexing As Number Instead Of Text](https://discuss.elastic.co/t/enum-indexing-as-number-instead-of-text/234624)

<div class="topic-metadata">

**Author:** [@Nathaniel\_Jones](https://discuss.elastic.co/u/Nathaniel_Jones)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 12:24am UTC](https://discuss.elastic.co/t/enum-indexing-as-number-instead-of-text/234624 "2020-05-28T00:24:47Z")

</div>

We just upgraded from Elasticsearch/Nest 5.1.1 to 7.6.2 and are seeing a difference in how C# enums are being indexed. Previously, the JsonConverter attribute would store the enum in the index as a text string that we wo…

---

## [Can the size of the specified query result be obtained in the queryBuilder implemented by inheriting the AbstractQueryBuilder class, or can I specify the size of the query result in queryBuilder？](https://discuss.elastic.co/t/can-the-size-of-the-specified-query-result-be-obtained-in-the-querybuilder-implemented-by-inheriting-the-abstractquerybuilder-class-or-can-i-specify-the-size-of-the-query-result-in-querybuilder/234551)

<div class="topic-metadata">

**Author:** [@Huang\_James](https://discuss.elastic.co/u/Huang_James)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 2:00am UTC](https://discuss.elastic.co/t/can-the-size-of-the-specified-query-result-be-obtained-in-the-querybuilder-implemented-by-inheriting-the-abstractquerybuilder-class-or-can-i-specify-the-size-of-the-query-result-in-querybuilder/234551 "2020-05-28T02:00:52Z")

</div>

Can the size of the specified query result be obtained in the queryBuilder implemented by inheriting the AbstractQueryBuilder class, or can I specify the size of the query result in queryBuilder？

---

## [IOException: Server returned HTTP response code: 451 on plugin download. Legal issues in Germany](https://discuss.elastic.co/t/ioexception-server-returned-http-response-code-451-on-plugin-download-legal-issues-in-germany/234141)

<div class="topic-metadata">

**Author:** [@Bil\_Bo](https://discuss.elastic.co/u/Bil_Bo)\
**Replies:** 4\
**Last updated:** [May 28, 2020, 1:04am UTC](https://discuss.elastic.co/t/ioexception-server-returned-http-response-code-451-on-plugin-download-legal-issues-in-germany/234141 "2020-05-28T01:04:21Z")

</div>

Hi, After the recent update of elasticsearch I started to experience problems dowloading plugins when I build docker container for the search. In particular, I receive 451 Unavailable For Legal Reasons when I try to dow…

---

## [How much cpu/memory/storage at least I need to use ELK](https://discuss.elastic.co/t/how-much-cpu-memory-storage-at-least-i-need-to-use-elk/234595)

<div class="topic-metadata">

**Author:** [@zhangruixue8080](https://discuss.elastic.co/u/zhangruixue8080)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 12:30am UTC](https://discuss.elastic.co/t/how-much-cpu-memory-storage-at-least-i-need-to-use-elk/234595 "2020-05-28T00:30:45Z")

</div>

Our project has requirement for log aggregation of different micro-services, and ELK is great tool to do that. However our project has requirement of privatization deployment, which means we need to deploy the whole solu…

---

## [Is it possible](https://discuss.elastic.co/t/is-it-possible/234455)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 6\
**Last updated:** [May 27, 2020, 11:44pm UTC](https://discuss.elastic.co/t/is-it-possible/234455 "2020-05-27T23:44:24Z")

</div>

Hi, I have just started on transforms and while doing this I am wondering if something like this (It is what my transform is looking like now): Can be converted via Painless scripts (since I am introducing new durati…

---

## [Fetching Tokens Created by Analyzer?](https://discuss.elastic.co/t/fetching-tokens-created-by-analyzer/234627)

<div class="topic-metadata">

**Author:** [@nicowens](https://discuss.elastic.co/u/nicowens)\
**Replies:** 0\
**Last updated:** [May 27, 2020, 10:36pm UTC](https://discuss.elastic.co/t/fetching-tokens-created-by-analyzer/234627 "2020-05-27T22:36:00Z")

</div>

I'm completely new here so, first off, I apologize if I do things the wrong way. I'd like to learn the right way as we are just beginning our road with Elastic Search. In troubleshooting why a document is not being retu…

---

## [Automatic dashboard export from command line - using python](https://discuss.elastic.co/t/automatic-dashboard-export-from-command-line-using-python/234076)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 3\
**Last updated:** [May 27, 2020, 10:16pm UTC](https://discuss.elastic.co/t/automatic-dashboard-export-from-command-line-using-python/234076 "2020-05-27T22:16:49Z")

</div>

Many people has ask this questions in past. I have search around for same for many days and didn't find right answer or proper explanation. I am not good in python but used it and implemented my solution. posting it he…

---

## [Correctly applying criteria for sum aggregation](https://discuss.elastic.co/t/correctly-applying-criteria-for-sum-aggregation/234620)

<div class="topic-metadata">

**Author:** [@jaekim06450](https://discuss.elastic.co/u/jaekim06450)\
**Replies:** 0\
**Last updated:** [May 27, 2020, 9:10pm UTC](https://discuss.elastic.co/t/correctly-applying-criteria-for-sum-aggregation/234620 "2020-05-27T21:10:52Z")

</div>

Hello, I am dealing with a use case where, given an elastic index with information of a number of people, I am querying for those that have the first name of "John" and get the sum of their ages. The query in question l…

---

## [Preventing document field from getting updated in Elastic Search](https://discuss.elastic.co/t/preventing-document-field-from-getting-updated-in-elastic-search/234300)

<div class="topic-metadata">

**Author:** [@viralshah1494](https://discuss.elastic.co/u/viralshah1494)\
**Replies:** 4\
**Last updated:** [May 27, 2020, 9:52pm UTC](https://discuss.elastic.co/t/preventing-document-field-from-getting-updated-in-elastic-search/234300 "2020-05-27T21:52:36Z")

</div>

I have the following requirement. In the system there is a job running that fetches the documents from another system every 15 mins. Once those documents are fetched, I have my own job which runs and updates the document…

---

## [Create new cert and key from existing ca.crt : elasticsearch-certutil](https://discuss.elastic.co/t/create-new-cert-and-key-from-existing-ca-crt-elasticsearch-certutil/232529)

<div class="topic-metadata">

**Author:** [@dexterac](https://discuss.elastic.co/u/dexterac)\
**Replies:** 2\
**Last updated:** [May 27, 2020, 7:58pm UTC](https://discuss.elastic.co/t/create-new-cert-and-key-from-existing-ca-crt-elasticsearch-certutil/232529 "2020-05-27T19:58:18Z")

</div>

Initially when I created the ELK cluster I missed to include the Logstash and filebeat servers to generate the certificates: https://www.elastic.co/blog/configuring-ssl-tls-and-https-to-secure-elasticsearch-kibana-beats-…

---

## [Canvas filter dropdown empty](https://discuss.elastic.co/t/canvas-filter-dropdown-empty/231376)

<div class="topic-metadata">

**Author:** [@aherabit](https://discuss.elastic.co/u/aherabit)\
**Replies:** 8\
**Last updated:** [May 27, 2020, 7:50pm UTC](https://discuss.elastic.co/t/canvas-filter-dropdown-empty/231376 "2020-05-27T19:50:23Z")

</div>

Hi Folks. The filter element has a SQL query that shows valid and grouped results but the drop-down filter show nothing but '-- ANY --' essql query="SELECT vNF FROM \\"train\_nc\_e2e\\" where vNF not like 'NA' group by vNF…

---

## [NumberFormatException for query field in simple\_query\_string](https://discuss.elastic.co/t/numberformatexception-for-query-field-in-simple-query-string/234602)

<div class="topic-metadata">

**Author:** [@weilandia](https://discuss.elastic.co/u/weilandia)\
**Replies:** 2\
**Last updated:** [May 27, 2020, 7:01pm UTC](https://discuss.elastic.co/t/numberformatexception-for-query-field-in-simple-query-string/234602 "2020-05-27T19:01:23Z")

</div>

I'm getting NumberFormatException\[For input string: \\"AZURE\\"\] when validating this query. This is an issue that's popped up recently using ES 7.6.2. This doesn't make sense to me since "query" is not a field with a ma…

---

## [Persist data- Index pattern, dashboards gets wiped when container restarted](https://discuss.elastic.co/t/persist-data-index-pattern-dashboards-gets-wiped-when-container-restarted/233616)

<div class="topic-metadata">

**Author:** [@Mehak\_Bhargava](https://discuss.elastic.co/u/Mehak_Bhargava)\
**Replies:** 4\
**Last updated:** [May 27, 2020, 6:14pm UTC](https://discuss.elastic.co/t/persist-data-index-pattern-dashboards-gets-wiped-when-container-restarted/233616 "2020-05-27T18:14:10Z")

</div>

I am running my ELK and Beats services inside a docker container. I have created multiple index patterns and dashboards. But whenever I restart the docker container, the data gets wiped out. Is there a way to persist all…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=906)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=908)
