# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=545

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 546

---

## [Likely root cause: ElasticsearchSecurityException\[Cannot find metadata for entity http://xxx.xxx.xx\]](https://discuss.elastic.co/t/likely-root-cause-elasticsearchsecurityexception-cannot-find-metadata-for-entity-http-xxx-xxx-xx/288639)

<div class="topic-metadata">

**Author:** [@slashlinux](https://discuss.elastic.co/u/slashlinux)\
**Replies:** 2\
**Last updated:** [November 9, 2021, 7:13am UTC](https://discuss.elastic.co/t/likely-root-cause-elasticsearchsecurityexception-cannot-find-metadata-for-entity-http-xxx-xxx-xx/288639 "2021-11-09T07:13:45Z")

</div>

Hello, I'm trying to integrate ELK with Keycloak and I've encountered some problems, I'm not expert on elk side so I did some configuration on Kibana/Elasticsearch YML: Elasticsearch.yml xpack.security.enabled: true x…

---

## [Space saving for index=false](https://discuss.elastic.co/t/space-saving-for-index-false/288184)

<div class="topic-metadata">

**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\
**Replies:** 5\
**Last updated:** [November 9, 2021, 6:14am UTC](https://discuss.elastic.co/t/space-saving-for-index-false/288184 "2021-11-09T06:14:40Z")

</div>

Hi I have an index that is 300gb in size with all 30 fields index=true. I tried setting 15 of the fields with index=false on another index and did a reindexing to compare the size. The end result is that there seems to…

---

## [Python Elasticsearch : Index mapping inconsistencies between 'es.index' and 'es.indices.create'](https://discuss.elastic.co/t/python-elasticsearch-index-mapping-inconsistencies-between-es-index-and-es-indices-create/288584)

<div class="topic-metadata">

**Author:** [@corndog](https://discuss.elastic.co/u/corndog)\
**Replies:** 5\
**Last updated:** [November 9, 2021, 5:31am UTC](https://discuss.elastic.co/t/python-elasticsearch-index-mapping-inconsistencies-between-es-index-and-es-indices-create/288584 "2021-11-09T05:31:57Z")

</div>

I'm trying to implement a custom index mapping (my\_mapping) in Python, BUT, I do not get the expected index mapping after the python file is run! file.py ---------- my\_mapping = """ { "settings": { "number\_…

---

## [Running cold tier on NFS storage](https://discuss.elastic.co/t/running-cold-tier-on-nfs-storage/288707)

<div class="topic-metadata">

**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\
**Replies:** 3\
**Last updated:** [November 9, 2021, 4:51am UTC](https://discuss.elastic.co/t/running-cold-tier-on-nfs-storage/288707 "2021-11-09T04:51:48Z")

</div>

Hi, I understand that NFS storage should be avoided. However, my task was to write fresh data into HOT SSD and potential spill to WARM spin disk. The NFS storage will be used as COLD tier with very minimal write. Does …

---

## [Esrally will hang if I use elasticsearch 8.0.0-alpha1](https://discuss.elastic.co/t/esrally-will-hang-if-i-use-elasticsearch-8-0-0-alpha1/288082)

<div class="topic-metadata">

**Author:** [@shankang](https://discuss.elastic.co/u/shankang)\
**Replies:** 11\
**Last updated:** [November 9, 2021, 3:39am UTC](https://discuss.elastic.co/t/esrally-will-hang-if-i-use-elasticsearch-8-0-0-alpha1/288082 "2021-11-09T03:39:10Z")

</div>

Hi, My OS is Ubuntu 21.04. esrally will hang when I tried the following command. esrally --pipeline=from-distribution --distribution-version=8.0.0-alpha1 --track=geonames --challenge=append-no-conflicts --include-tasks…

---

## [JVM setting](https://discuss.elastic.co/t/jvm-setting/287954)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 5\
**Last updated:** [November 9, 2021, 1:49am UTC](https://discuss.elastic.co/t/jvm-setting/287954 "2021-11-09T01:49:56Z")

</div>

What should be prefer jvm option for cluster? using elasicsearch java three node x 100gig ram each, 20core each host -Xms24g -Xmx24g -XX:+UseG1GC -XX:G1ReservePercent=25 -XX:InitiatingHeapOccupancyPercent=30 or follo…

---

## [Catenate\_numbers - way to avoid joining on space and comma?](https://discuss.elastic.co/t/catenate-numbers-way-to-avoid-joining-on-space-and-comma/288690)

<div class="topic-metadata">

**Author:** [@fcntl](https://discuss.elastic.co/u/fcntl)\
**Replies:** 0\
**Last updated:** [November 9, 2021, 1:19am UTC](https://discuss.elastic.co/t/catenate-numbers-way-to-avoid-joining-on-space-and-comma/288690 "2021-11-09T01:19:24Z")

</div>

catenate\_numbers is useful for joining numbers separated by hyphen, as it allows a non-segmented search term to match against segmented numbers in the document, e.g. Document: 02 6287-1455 Search term: 0262871455 (wil…

---

## [Increased latency with query cache](https://discuss.elastic.co/t/increased-latency-with-query-cache/288619)

<div class="topic-metadata">

**Author:** [@Ain\_Ryushika](https://discuss.elastic.co/u/Ain_Ryushika)\
**Replies:** 1\
**Last updated:** [November 9, 2021, 12:34am UTC](https://discuss.elastic.co/t/increased-latency-with-query-cache/288619 "2021-11-09T00:34:59Z")

</div>

Cluster stats: Version: OpenDistro 6.8.17 Elasticsearch: 6 data nodes, 202 primary shards, 412 total shards CPU model: Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz CPU total logical cores: 8 Memory : 32GB (16gb heap) H…

---

## [\[ES 2.4\] cluster ignores docker-compose variables](https://discuss.elastic.co/t/es-2-4-cluster-ignores-docker-compose-variables/288530)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 6\
**Last updated:** [November 8, 2021, 11:44pm UTC](https://discuss.elastic.co/t/es-2-4-cluster-ignores-docker-compose-variables/288530 "2021-11-08T23:44:45Z")

</div>

Hey there, Is it possible to set environment variables using docker-compose on Elasticsearch 2.4.4? I am trying to set cluster-name with classic method environment: - cluster-name=test but the cluster is ignoring …

---

## [OIDC SocketTimeoutException](https://discuss.elastic.co/t/oidc-sockettimeoutexception/288685)

<div class="topic-metadata">

**Author:** [@ibrooes](https://discuss.elastic.co/u/ibrooes)\
**Replies:** 2\
**Last updated:** [November 8, 2021, 11:18pm UTC](https://discuss.elastic.co/t/oidc-sockettimeoutexception/288685 "2021-11-08T23:18:54Z")

</div>

Getting this error message in logs. Does anyone have an idea what could this be indicating? I have checked my token endpoint through postman, and it works. \[instance-0000000001\] Authentication to realm oidc1 failed - F…

---

## [ARM64 builds for Elasticsearch 5.6?](https://discuss.elastic.co/t/arm64-builds-for-elasticsearch-5-6/288665)

<div class="topic-metadata">

**Author:** [@cjbottaro](https://discuss.elastic.co/u/cjbottaro)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 10:58pm UTC](https://discuss.elastic.co/t/arm64-builds-for-elasticsearch-5-6/288665 "2021-11-08T22:58:49Z")

</div>

We are unfortunately stuck on Es5 for the foreseeable future... and I just got a new M1 MacBook. Neither of these commands work. docker run --rm --platform linux/amd64 elasticsearch:5.6.16 docker run --rm --platform li…

---

## [Group by latest Plus Aggregation for Analysis or Delete old records](https://discuss.elastic.co/t/group-by-latest-plus-aggregation-for-analysis-or-delete-old-records/288663)

<div class="topic-metadata">

**Author:** [@Ahmed\_Mousa](https://discuss.elastic.co/u/Ahmed_Mousa)\
**Replies:** 0\
**Last updated:** [November 8, 2021, 6:03pm UTC](https://discuss.elastic.co/t/group-by-latest-plus-aggregation-for-analysis-or-delete-old-records/288663 "2021-11-08T18:03:39Z")

</div>

Hello everyone, I am trying to get statistics from my elastic on some filters. I managed to get some using this: GET \<index\>/\_search { "query": { "bool": {"must":\[ {"terms":{"type.keyword":\[ "video", "tex…

---

## [Python Client : Receive illegal\_argument\_exception error when trying to create an index template](https://discuss.elastic.co/t/python-client-receive-illegal-argument-exception-error-when-trying-to-create-an-index-template/288457)

<div class="topic-metadata">

**Author:** [@MKH](https://discuss.elastic.co/u/MKH)\
**Replies:** 3\
**Last updated:** [November 8, 2021, 5:55pm UTC](https://discuss.elastic.co/t/python-client-receive-illegal-argument-exception-error-when-trying-to-create-an-index-template/288457 "2021-11-08T17:55:15Z")

</div>

Hi, I am trying to create an index template to use it for my data stream. I use this command to create the template: es = client.Elasticsearch(\['\_host\_name'\], http\_auth=('user', 'psw'), port=\_port, scheme='https', tim…

---

## [Elasticsearch cardinality aggregation not returning accurate numbers despite using precision\_threshold](https://discuss.elastic.co/t/elasticsearch-cardinality-aggregation-not-returning-accurate-numbers-despite-using-precision-threshold/288632)

<div class="topic-metadata">

**Author:** [@preetish\_P](https://discuss.elastic.co/u/preetish_P)\
**Replies:** 3\
**Last updated:** [November 8, 2021, 5:10pm UTC](https://discuss.elastic.co/t/elasticsearch-cardinality-aggregation-not-returning-accurate-numbers-despite-using-precision-threshold/288632 "2021-11-08T17:10:15Z")

</div>

Hi folks, I am trying to show unique count in a metric and observed that the numbers are wrong. Setup: I ​used enhanced table visualisation and did a "unique count" of keyword type field. in advanced setting I used {"…

---

## [Is it possible to ignore documents that exceeds index.mapping.nested\_objects.limit](https://discuss.elastic.co/t/is-it-possible-to-ignore-documents-that-exceeds-index-mapping-nested-objects-limit/288538)

<div class="topic-metadata">

**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 4:43pm UTC](https://discuss.elastic.co/t/is-it-possible-to-ignore-documents-that-exceeds-index-mapping-nested-objects-limit/288538 "2021-11-08T16:43:27Z")

</div>

Hi, we have a transform that writes into a destination index, that includes a nested field. the transform failed because of the index.mapping.nested\_objects.limit. is there a way to ignore/processing/writing/updating …

---

## [Transform and Aggregate Index with an Index Rate of 200k/s](https://discuss.elastic.co/t/transform-and-aggregate-index-with-an-index-rate-of-200k-s/288286)

<div class="topic-metadata">

**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 4:39pm UTC](https://discuss.elastic.co/t/transform-and-aggregate-index-with-an-index-rate-of-200k-s/288286 "2021-11-08T16:39:23Z")

</div>

We are thinking about gathering our DNS traffic via packetbeat and create statistics out of the collected data. Currently we have a query rate of about 200k/s and growing... Because of the tremendous amount of data, we w…

---

## [What are the "Elastic security features" that are referred to in the \_cat/indices doc page?](https://discuss.elastic.co/t/what-are-the-elastic-security-features-that-are-referred-to-in-the-cat-indices-doc-page/288578)

<div class="topic-metadata">

**Author:** [@astanton1978](https://discuss.elastic.co/u/astanton1978)\
**Replies:** 6\
**Last updated:** [November 8, 2021, 4:27pm UTC](https://discuss.elastic.co/t/what-are-the-elastic-security-features-that-are-referred-to-in-the-cat-indices-doc-page/288578 "2021-11-08T16:27:42Z")

</div>

cat indices API | Elasticsearch Guide \[8.11\] | Elastic says If the Elasticsearch security features are enabled, you must have the monitor or manage cluster privilege to use this API. ... but there is no link to what…

---

## [Waiting for a quote (Gold license Elastic Stack on Kubernetes)](https://discuss.elastic.co/t/waiting-for-a-quote-gold-license-elastic-stack-on-kubernetes/288631)

<div class="topic-metadata">

**Author:** [@WookWook](https://discuss.elastic.co/u/WookWook)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 3:59pm UTC](https://discuss.elastic.co/t/waiting-for-a-quote-gold-license-elastic-stack-on-kubernetes/288631 "2021-11-08T15:59:43Z")

</div>

Hello there, me and my company are waiting for a quote for many weeks now. We have a self managed Elastic Cloud on Kubernetes cluster running. Want to buy a gold license for a 3 node environment. I started here Offizie…

---

## [Text not stemmed after inserted in the index with language specific analyzer](https://discuss.elastic.co/t/text-not-stemmed-after-inserted-in-the-index-with-language-specific-analyzer/288645)

<div class="topic-metadata">

**Author:** [@makons](https://discuss.elastic.co/u/makons)\
**Replies:** 0\
**Last updated:** [November 8, 2021, 2:52pm UTC](https://discuss.elastic.co/t/text-not-stemmed-after-inserted-in-the-index-with-language-specific-analyzer/288645 "2021-11-08T14:52:12Z")

</div>

I have 2 fields in my index, one containing the standardly analyzed content, while the other one uses a german analyzer. However, when I insert documents, they don't seem to be stemmed at all, even though they should be …

---

## [Aggregate bucket values with SUM](https://discuss.elastic.co/t/aggregate-bucket-values-with-sum/288146)

<div class="topic-metadata">

**Author:** [@tds21](https://discuss.elastic.co/u/tds21)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 1:42pm UTC](https://discuss.elastic.co/t/aggregate-bucket-values-with-sum/288146 "2021-11-08T13:42:34Z")

</div>

HI :slight\_smile: I'm new to elastic, and based on a reqeust constructed by a visualization on Kibana along with few tips, built query aggregates a 'policy' key \> 'device' (or devices) it's on - and groups the values b…

---

## [Character filter analyzer not working](https://discuss.elastic.co/t/character-filter-analyzer-not-working/288531)

<div class="topic-metadata">

**Author:** [@Kevin\_Juliano](https://discuss.elastic.co/u/Kevin_Juliano)\
**Replies:** 1\
**Last updated:** [November 8, 2021, 1:28pm UTC](https://discuss.elastic.co/t/character-filter-analyzer-not-working/288531 "2021-11-08T13:28:52Z")

</div>

Hi! I have a special character analyzer, but for some reason, I am not getting the result I want. Here are my configurations: ANALYZER: { index: "my\_idx", body: { settings: { …

---

## [Defined ILM policy not working](https://discuss.elastic.co/t/defined-ilm-policy-not-working/288302)

<div class="topic-metadata">

**Author:** [@Psyhil](https://discuss.elastic.co/u/Psyhil)\
**Replies:** 4\
**Last updated:** [November 8, 2021, 12:20pm UTC](https://discuss.elastic.co/t/defined-ilm-policy-not-working/288302 "2021-11-08T12:20:45Z")

</div>

Hi All, I hope are doing well! We are running Elastic 7.15 version with a single node. Currently the data in our winlogbeat index is all dated from back February 2021 hence we defined an ILM policy as below though ple…

---

## [UseConcMarkSweepGC error - cannot start ElasticSearch](https://discuss.elastic.co/t/useconcmarksweepgc-error-cannot-start-elasticsearch/288616)

<div class="topic-metadata">

**Author:** [@TVRV8S](https://discuss.elastic.co/u/TVRV8S)\
**Replies:** 0\
**Last updated:** [November 8, 2021, 10:42am UTC](https://discuss.elastic.co/t/useconcmarksweepgc-error-cannot-start-elasticsearch/288616 "2021-11-08T10:42:00Z")

</div>

I posted a question on Stack Overflow but perhaps it's better here. https://stackoverflow.com/questions/69875937/elasticsearch-windows-2016-hosted-server-useconcmarksweepgc-error I downloaded the Elasticsearch ZIP and …

---

## [Webhook watcher action timeout](https://discuss.elastic.co/t/webhook-watcher-action-timeout/288613)

<div class="topic-metadata">

**Author:** [@gissavem](https://discuss.elastic.co/u/gissavem)\
**Replies:** 0\
**Last updated:** [November 8, 2021, 10:02am UTC](https://discuss.elastic.co/t/webhook-watcher-action-timeout/288613 "2021-11-08T10:02:49Z")

</div>

Hi! I am trying to set up a Watcher to create incidents when our applications throw errors. The watcher I've set up looks through our logs for errors and when we hit any I send a webhook request to BetterUptime to crea…

---

## [User with manage\_own\_api\_key - Best Practices (Security)](https://discuss.elastic.co/t/user-with-manage-own-api-key-best-practices-security/288559)

<div class="topic-metadata">

**Author:** [@inf](https://discuss.elastic.co/u/inf)\
**Replies:** 4\
**Last updated:** [November 8, 2021, 9:05am UTC](https://discuss.elastic.co/t/user-with-manage-own-api-key-best-practices-security/288559 "2021-11-08T09:05:09Z")

</div>

Hi, I have been using the default elastic user to create API keys. However, I do not think that this is a good security practice (please correct me if I'm wrong). Hence, I'm not sure how do others normally create API …

---

## [Dynamic field type in template](https://discuss.elastic.co/t/dynamic-field-type-in-template/288568)

<div class="topic-metadata">

**Author:** [@anna.kuranda](https://discuss.elastic.co/u/anna.kuranda)\
**Replies:** 3\
**Last updated:** [November 8, 2021, 6:17am UTC](https://discuss.elastic.co/t/dynamic-field-type-in-template/288568 "2021-11-08T06:17:04Z")

</div>

I use template and alias to manage my insert data The issue : I have field that have different types , so I failed on field type inconsistency the field can be of String type or Nested JSON Object For example : St…

---

## [Will Elasticsearch optimize dsl query?](https://discuss.elastic.co/t/will-elasticsearch-optimize-dsl-query/288588)

<div class="topic-metadata">

**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\
**Replies:** 0\
**Last updated:** [November 8, 2021, 6:07am UTC](https://discuss.elastic.co/t/will-elasticsearch-optimize-dsl-query/288588 "2021-11-08T06:07:06Z")

</div>

Hi there, I have a program to convert some text into Elasticsearch dsl query. For some reasons it generates complex bool query which somethimes is actually can be simplified, for example: { "query":{ "bool"…

---

## [Should I store user id or name in logging?](https://discuss.elastic.co/t/should-i-store-user-id-or-name-in-logging/288460)

<div class="topic-metadata">

**Author:** [@buaaytt](https://discuss.elastic.co/u/buaaytt)\
**Replies:** 2\
**Last updated:** [November 8, 2021, 12:23am UTC](https://discuss.elastic.co/t/should-i-store-user-id-or-name-in-logging/288460 "2021-11-08T00:23:10Z")

</div>

A common scenario in logging is the need to store the backend user performing the logging action. So using ES should I store the user id or its username in the document? After all, when retrieving logs, I need to return …

---

## [Logging into Elasticsearch](https://discuss.elastic.co/t/logging-into-elasticsearch/288535)

<div class="topic-metadata">

**Author:** [@SteveP](https://discuss.elastic.co/u/SteveP)\
**Replies:** 5\
**Last updated:** [November 7, 2021, 8:35pm UTC](https://discuss.elastic.co/t/logging-into-elasticsearch/288535 "2021-11-07T20:35:19Z")

</div>

Hello all, I have created a single node ES system, as a way to ingest security data from my firewall. As part of this I need to configure the security plugin on my firewall to login to ES and setup it’s data indices. I…

---

## [Is timestamp field also indexed while storing time siries data like logs into an index?](https://discuss.elastic.co/t/is-timestamp-field-also-indexed-while-storing-time-siries-data-like-logs-into-an-index/288438)

<div class="topic-metadata">

**Author:** [@shi](https://discuss.elastic.co/u/shi)\
**Replies:** 2\
**Last updated:** [November 6, 2021, 7:52pm UTC](https://discuss.elastic.co/t/is-timestamp-field-also-indexed-while-storing-time-siries-data-like-logs-into-an-index/288438 "2021-11-06T19:52:41Z")

</div>

Is timestamp field in a logentry of logfile also indexed (ie, made searchable by means of inverted index data structure) while storing time series data like logs into an index/data stream, provided we are not explicitly…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=544)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=546)
