# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1264

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1265

---

## [How to use "aggs" on a text type field](https://discuss.elastic.co/t/how-to-use-aggs-on-a-text-type-field/185619)

<div class="topic-metadata">

**Author:** [@zatom](https://discuss.elastic.co/u/zatom)\
**Replies:** 6\
**Last updated:** [June 13, 2019, 12:51pm UTC](https://discuss.elastic.co/t/how-to-use-aggs-on-a-text-type-field/185619 "2019-06-13T12:51:07Z")

</div>

Hi everyone! I have a problem that I have been unable to solve for the past couple of months. I am using ES 6. In my index, there is a field of type "text". Documents keep increasing every day. I want to check & count a…

---

## [Configuration of ELK Stack](https://discuss.elastic.co/t/configuration-of-elk-stack/185571)

<div class="topic-metadata">

**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 12:36pm UTC](https://discuss.elastic.co/t/configuration-of-elk-stack/185571 "2019-06-13T12:36:27Z")

</div>

Hello everyone, me and my collegue are trying to run ELK STACK for managing logs from three maybe four servers with approximately 120GB logs per day and more. I was wondering if someone could help us with hardware rquir…

---

## [Conccurency in data](https://discuss.elastic.co/t/conccurency-in-data/184328)

<div class="topic-metadata">

**Author:** [@makos63](https://discuss.elastic.co/u/makos63)\
**Replies:** 5\
**Last updated:** [June 13, 2019, 12:34pm UTC](https://discuss.elastic.co/t/conccurency-in-data/184328 "2019-06-13T12:34:06Z")

</div>

Hello, we want to see what was the maximum and the minimum of parallel event we had in given interval. I know that is possible in Splunk. I tried this already, but could not rewrite Groovy script in Painless successful…

---

## [Some times data Loss in elasticsearch](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624)

<div class="topic-metadata">

**Author:** [@Rajitha](https://discuss.elastic.co/u/Rajitha)\
**Replies:** 4\
**Last updated:** [June 13, 2019, 12:25pm UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624 "2019-06-13T12:25:23Z")

</div>

sometimes we are having a data loss issue in our elastic environment. when we debug the environment we have found out that all the data that is sent by the filebeat is going through the logstash filter and the out put pl…

---

## [Load a few logs line to a single row in Elastic](https://discuss.elastic.co/t/load-a-few-logs-line-to-a-single-row-in-elastic/185587)

<div class="topic-metadata">

**Author:** [@ZehavaRachip](https://discuss.elastic.co/u/ZehavaRachip)\
**Replies:** 1\
**Last updated:** [June 13, 2019, 12:05pm UTC](https://discuss.elastic.co/t/load-a-few-logs-line-to-a-single-row-in-elastic/185587 "2019-06-13T12:05:51Z")

</div>

I'm new to the ELK stack , My task is to load asterisk logs file into the elastic search online (whenever the file get changed). generally every line in the log is a row in a DB , but I want that A few lines would be co…

---

## [Extract the results of a ML job](https://discuss.elastic.co/t/extract-the-results-of-a-ml-job/185414)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 5\
**Last updated:** [June 13, 2019, 12:01pm UTC](https://discuss.elastic.co/t/extract-the-results-of-a-ml-job/185414 "2019-06-13T12:01:32Z")

</div>

Is there any way to extract the results of a ML job(i.e, the detected anomalies in input data) using languages like python with their Elasticsearch client?

---

## [Xpack.Security.Audit.Index-Information](https://discuss.elastic.co/t/xpack-security-audit-index-information/185472)

<div class="topic-metadata">

**Author:** [@bkasrai](https://discuss.elastic.co/u/bkasrai)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 12:00pm UTC](https://discuss.elastic.co/t/xpack-security-audit-index-information/185472 "2019-06-13T12:00:17Z")

</div>

Good afternoon, I am looking to have the xpack.security.audit.enabled on my ES cluster however I was looking to understand where this should be enabled at\\on. I have multiple nodes within my cluster, each with different…

---

## [Missing texts](https://discuss.elastic.co/t/missing-texts/185631)

<div class="topic-metadata">

**Author:** [@brendachi](https://discuss.elastic.co/u/brendachi)\
**Replies:** 0\
**Last updated:** [June 13, 2019, 11:52am UTC](https://discuss.elastic.co/t/missing-texts/185631 "2019-06-13T11:52:24Z")

</div>

hello. When i load my data from logstash to elasticsearch all i am seeing in the elasticsearch on my browser is 1 document. But when i perform a search query on the commandline i see all the documents. When i perform que…

---

## [Get parent via child without parent id](https://discuss.elastic.co/t/get-parent-via-child-without-parent-id/185629)

<div class="topic-metadata">

**Author:** [@Ernesto](https://discuss.elastic.co/u/Ernesto)\
**Replies:** 0\
**Last updated:** [June 13, 2019, 11:46am UTC](https://discuss.elastic.co/t/get-parent-via-child-without-parent-id/185629 "2019-06-13T11:46:48Z")

</div>

I am new to elasticsearch, but can not find the information about one issue which is: Imagine: You have Entity A and it has mapping to Entity B (for example ManyToOne), but Entity B has no mapping to Entity A. I am spe…

---

## [Problem configuring repository-s3 plugin](https://discuss.elastic.co/t/problem-configuring-repository-s3-plugin/185607)

<div class="topic-metadata">

**Author:** [@haitham00n](https://discuss.elastic.co/u/haitham00n)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 11:33am UTC](https://discuss.elastic.co/t/problem-configuring-repository-s3-plugin/185607 "2019-06-13T11:33:42Z")

</div>

Hello, I have installed Elasticsearch 7.1.1 and also installed repository-s3 plugin. I'm trying to define the bucket in elasticsearch.yml as below: s3.client.default.bucket: mybucket Then after restarting Elasticsear…

---

## [SSLHandshakeException when using High Level REST Client from Docker](https://discuss.elastic.co/t/sslhandshakeexception-when-using-high-level-rest-client-from-docker/184891)

<div class="topic-metadata">

**Author:** [@Ewoks](https://discuss.elastic.co/u/Ewoks)\
**Replies:** 11\
**Last updated:** [June 13, 2019, 11:26am UTC](https://discuss.elastic.co/t/sslhandshakeexception-when-using-high-level-rest-client-from-docker/184891 "2019-06-13T11:26:24Z")

</div>

I am trying to access 6.x ES instance using High Level REST Client 6.7.2. Access to this ES instance is provided to me via hostname (https://\*\*\*\*.azureedge.net), username & password. My Spring Boot application is getti…

---

## [Elasticsearch install error: dpkg: error processing package elasticsearch (--install)](https://discuss.elastic.co/t/elasticsearch-install-error-dpkg-error-processing-package-elasticsearch-install/185098)

<div class="topic-metadata">

**Author:** [@Janith](https://discuss.elastic.co/u/Janith)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 11:25am UTC](https://discuss.elastic.co/t/elasticsearch-install-error-dpkg-error-processing-package-elasticsearch-install/185098 "2019-06-13T11:25:54Z")

</div>

After removing the existing elasticsearch version 6. I got an error in installing elasticsearch version 7. Here is the error message: #dpkg -i elasticsearch-7.1.1-amd64.deb (Reading database ... 113568 files and direc…

---

## [Insert data to index via xpack SQL || elasticsearch](https://discuss.elastic.co/t/insert-data-to-index-via-xpack-sql-elasticsearch/185170)

<div class="topic-metadata">

**Author:** [@suryadeep\_tiwari](https://discuss.elastic.co/u/suryadeep_tiwari)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 11:08am UTC](https://discuss.elastic.co/t/insert-data-to-index-via-xpack-sql-elasticsearch/185170 "2019-06-13T11:08:15Z")

</div>

Hi Team, I am trying to create an index in Elastic using the output of the following Elastic SQL i.e. using Xpack Elasticsearch aggregation (through the translate option in Xpack SQL) I searched a lot but could…

---

## [Merge 500 daily indices to weekly / Reindex data](https://discuss.elastic.co/t/merge-500-daily-indices-to-weekly-reindex-data/185614)

<div class="topic-metadata">

**Author:** [@test\_qweqwe](https://discuss.elastic.co/u/test_qweqwe)\
**Replies:** 6\
**Last updated:** [June 13, 2019, 11:05am UTC](https://discuss.elastic.co/t/merge-500-daily-indices-to-weekly-reindex-data/185614 "2019-06-13T11:05:24Z")

</div>

Hi there. How to merge 500 daily indices to weekly? Will this increase the search speed? If it possible? 1.1) What can increase speed of search expect of my hardware? :sweat\_smile: What is the best way to reindex dat…

---

## [Adding custom rules for anomaly detection in X-pack](https://discuss.elastic.co/t/adding-custom-rules-for-anomaly-detection-in-x-pack/185410)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 3\
**Last updated:** [June 13, 2019, 11:04am UTC](https://discuss.elastic.co/t/adding-custom-rules-for-anomaly-detection-in-x-pack/185410 "2019-06-13T11:04:17Z")

</div>

Hey, I'm using X-pack for Anomaly Detection.Is there any way to alter the conditions/rules in my ML job for which the anomaly is detected in my data? For example, i want anomalies to be detected only for zero/null values…

---

## [When creating keyword field it gets changed to text field + .keyword?](https://discuss.elastic.co/t/when-creating-keyword-field-it-gets-changed-to-text-field-keyword/185599)

<div class="topic-metadata">

**Author:** [@kim\_huizing](https://discuss.elastic.co/u/kim_huizing)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 11:02am UTC](https://discuss.elastic.co/t/when-creating-keyword-field-it-gets-changed-to-text-field-keyword/185599 "2019-06-13T11:02:01Z")

</div>

Hi, I am using Elasticsearch 6.5 . I have an existing index with a mapping. I want to add a field to this mapping called documentYear which is of type keyword. This field is not relevant for full-text search so I want i…

---

## [Query\_string 'OR' doesn't work with keyword fields unless explicitly queried with OR](https://discuss.elastic.co/t/query-string-or-doesnt-work-with-keyword-fields-unless-explicitly-queried-with-or/185604)

<div class="topic-metadata">

**Author:** [@varundbest](https://discuss.elastic.co/u/varundbest)\
**Replies:** 2\
**Last updated:** [June 13, 2019, 10:57am UTC](https://discuss.elastic.co/t/query-string-or-doesnt-work-with-keyword-fields-unless-explicitly-queried-with-or/185604 "2019-06-13T10:57:44Z")

</div>

ES versions tested with: 6.5.4, 7.0.0. Mapping: { "index-name": { "aliases": {}, "mappings": { "doc": { "dynamic": "false", "properties": { "content": { "type": "text" …

---

## ['Error in load generator', The provided corpus does not match any of the corpora](https://discuss.elastic.co/t/error-in-load-generator-the-provided-corpus-does-not-match-any-of-the-corpora/185540)

<div class="topic-metadata">

**Author:** [@Dileep\_Kumar\_Dora](https://discuss.elastic.co/u/Dileep_Kumar_Dora)\
**Replies:** 1\
**Last updated:** [June 13, 2019, 10:44am UTC](https://discuss.elastic.co/t/error-in-load-generator-the-provided-corpus-does-not-match-any-of-the-corpora/185540 "2019-06-13T10:44:38Z")

</div>

I have a custom tracks where I have 2 corpora defined lets say dataset1 and dataset2, when I run the challenge rally is recognising the corpora and preparing offset tables also in the corresponding directory. But it's th…

---

## [How to use ldap realm for authorisation for SAML realm](https://discuss.elastic.co/t/how-to-use-ldap-realm-for-authorisation-for-saml-realm/183095)

<div class="topic-metadata">

**Author:** [@Ronnie16](https://discuss.elastic.co/u/Ronnie16)\
**Replies:** 18\
**Last updated:** [June 13, 2019, 10:41am UTC](https://discuss.elastic.co/t/how-to-use-ldap-realm-for-authorisation-for-saml-realm/183095 "2019-06-13T10:41:19Z")

</div>

Hi team, I have ldap realm configured to allow access to elasticsearch APIs. I also have SAML configured for kibana. Now I want to setup user authorisation in saml using ldap realm instead of api based role mapping. I …

---

## [DateHistogram not working as expected](https://discuss.elastic.co/t/datehistogram-not-working-as-expected/185602)

<div class="topic-metadata">

**Author:** [@umeshmishra099](https://discuss.elastic.co/u/umeshmishra099)\
**Replies:** 1\
**Last updated:** [June 13, 2019, 10:16am UTC](https://discuss.elastic.co/t/datehistogram-not-working-as-expected/185602 "2019-06-13T10:16:02Z")

</div>

Mapping: { "test\_2e311eff-97c0-4270-b254-0c43cd5f2acc": { "mappings": { "test\_2e311eff-97c0-4270-b254-0c43cd5f2acc\_type": { "properties": { "…

---

## [JWT token support with ELK 7.1](https://discuss.elastic.co/t/jwt-token-support-with-elk-7-1/185312)

<div class="topic-metadata">

**Author:** [@chenww](https://discuss.elastic.co/u/chenww)\
**Replies:** 5\
**Last updated:** [June 13, 2019, 9:16am UTC](https://discuss.elastic.co/t/jwt-token-support-with-elk-7-1/185312 "2019-06-13T09:16:15Z")

</div>

Wonder if JWT token is supported in new ELK . 7.1 release or not with security packs. Please confirm this as open distro branches for this already. thanks

---

## [Get list of all values for nested doc-properties](https://discuss.elastic.co/t/get-list-of-all-values-for-nested-doc-properties/185588)

<div class="topic-metadata">

**Author:** [@Philipp\_Loew](https://discuss.elastic.co/u/Philipp_Loew)\
**Replies:** 0\
**Last updated:** [June 13, 2019, 8:58am UTC](https://discuss.elastic.co/t/get-list-of-all-values-for-nested-doc-properties/185588 "2019-06-13T08:58:23Z")

</div>

Hi there, We have an product index with nested fields for variants. We have a new variant for each color, material, size, price (we aggregate offers). RIght now i am facing an issue, that skipping through variants is …

---

## [Group field by name and date](https://discuss.elastic.co/t/group-field-by-name-and-date/185460)

<div class="topic-metadata">

**Author:** [@Jan\_O](https://discuss.elastic.co/u/Jan_O)\
**Replies:** 1\
**Last updated:** [June 13, 2019, 8:50am UTC](https://discuss.elastic.co/t/group-field-by-name-and-date/185460 "2019-06-13T08:50:00Z")

</div>

Hi, I have been looking for a way to group information by name and date. We have a setup with thousands of tests running on different products, what I want to do is fetch all failing test cases but only count them once…

---

## [How to retrieve matching text field in multi level nested document](https://discuss.elastic.co/t/how-to-retrieve-matching-text-field-in-multi-level-nested-document/185577)

<div class="topic-metadata">

**Author:** [@tombka](https://discuss.elastic.co/u/tombka)\
**Replies:** 0\
**Last updated:** [June 13, 2019, 8:27am UTC](https://discuss.elastic.co/t/how-to-retrieve-matching-text-field-in-multi-level-nested-document/185577 "2019-06-13T08:27:47Z")

</div>

Hi everybody, I have some problem with retrieving data with multi level nested document : { "myindex": { "mappings": { "properties": { "analyzed": { "properti…

---

## [How does bulk API utilize active threads of write thread pool?](https://discuss.elastic.co/t/how-does-bulk-api-utilize-active-threads-of-write-thread-pool/185444)

<div class="topic-metadata">

**Author:** [@NairitiSharma](https://discuss.elastic.co/u/NairitiSharma)\
**Replies:** 3\
**Last updated:** [June 13, 2019, 8:05am UTC](https://discuss.elastic.co/t/how-does-bulk-api-utilize-active-threads-of-write-thread-pool/185444 "2019-06-13T08:05:40Z")

</div>

How does bulk API utilize active threads of thread pool? I have an index with 1 shard and 1 replica. When I push , say 100 documents, using bulk API to this index, will it employ 1 thread of write thread pool to do the i…

---

## [Error create index template in ES 6.7](https://discuss.elastic.co/t/error-create-index-template-in-es-6-7/185370)

<div class="topic-metadata">

**Author:** [@tatdat](https://discuss.elastic.co/u/tatdat)\
**Replies:** 3\
**Last updated:** [June 13, 2019, 7:12am UTC](https://discuss.elastic.co/t/error-create-index-template-in-es-6-7/185370 "2019-06-13T07:12:54Z")

</div>

I created index template in ES 6.7 and got error . { "mappings" : { "date\_detection": false, "dynamic\_templates": \[ { "labels": { "mapping": { "type": "keyword" },…

---

## [Not able to retrieve doc using transport client but works through REST](https://discuss.elastic.co/t/not-able-to-retrieve-doc-using-transport-client-but-works-through-rest/183006)

<div class="topic-metadata">

**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\
**Replies:** 7\
**Last updated:** [June 13, 2019, 7:03am UTC](https://discuss.elastic.co/t/not-able-to-retrieve-doc-using-transport-client-but-works-through-rest/183006 "2019-06-13T07:03:22Z")

</div>

Hi Initially we were using ES 2.4, recently upgraded to ES 6.6, but facing an issue with specific document type. We have a index with name logs-2019.05.28.14 have multiple types of data, but for simplicity we had kept …

---

## [Machine Learning on Web server logs](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569)

<div class="topic-metadata">

**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Replies:** 8\
**Last updated:** [June 13, 2019, 5:56am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569 "2019-06-13T05:56:59Z")

</div>

I am new to this machine learning features. I am having my web access logs. Could you help me with what kind of anomalies or single metric data or how can I use forecasting mechanism

---

## [Getting errors related to ILM](https://discuss.elastic.co/t/getting-errors-related-to-ilm/182256)

<div class="topic-metadata">

**Author:** [@dfinn](https://discuss.elastic.co/u/dfinn)\
**Replies:** 4\
**Last updated:** [June 13, 2019, 4:58am UTC](https://discuss.elastic.co/t/getting-errors-related-to-ilm/182256 "2019-06-13T04:58:34Z")

</div>

currently running ES 6.7.1 and we use the logstash-\* indexes I recently setup ILM through the UI, using these settings: { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "rollover": { "max\_age":…

---

## [Dynamic Template not working](https://discuss.elastic.co/t/dynamic-template-not-working/185247)

<div class="topic-metadata">

**Author:** [@jaya](https://discuss.elastic.co/u/jaya)\
**Replies:** 4\
**Last updated:** [June 13, 2019, 4:22am UTC](https://discuss.elastic.co/t/dynamic-template-not-working/185247 "2019-06-13T04:22:37Z")

</div>

I want to apply custom analyzer to all fields in an existing mapping to enable search with special characters. I created custom ngram analyzer and a dynamic template to apply custom\_analyzer on all text fields to do so. …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1263)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1265)
