# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=793 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 794 --- ## [Cannot configure Open ID Connect - cant store key in elastic keystore for persistent usage](https://discuss.elastic.co/t/cannot-configure-open-id-connect-cant-store-key-in-elastic-keystore-for-persistent-usage/250099)
**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\ **Replies:** 3\ **Last updated:** [October 6, 2020, 9:11am UTC](https://discuss.elastic.co/t/cannot-configure-open-id-connect-cant-store-key-in-elastic-keystore-for-persistent-usage/250099 "2020-10-06T09:11:52Z")
I am trying to configure OIDC according to documentation. According to instructions, I have to store xpack.security.authc.realms.oidc.oidc1.rp.client\_secret into keystore. bin/elasticsearch-keystore add xpack.security.… --- ## [Error occur after enable elasticsearch security feature](https://discuss.elastic.co/t/error-occur-after-enable-elasticsearch-security-feature/251089)
**Author:** [@P\_ng\_Chun\_Sein](https://discuss.elastic.co/u/P_ng_Chun_Sein)\ **Replies:** 0\ **Last updated:** [October 6, 2020, 9:04am UTC](https://discuss.elastic.co/t/error-occur-after-enable-elasticsearch-security-feature/251089 "2020-10-06T09:04:53Z")
Hi all, I follow the this link \[https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elastic-stack-on-centos-7\] to setup my elasticsearch in my RH linux server. Everything i… --- ## [Certificate Issue](https://discuss.elastic.co/t/certificate-issue/251053)
**Author:** [@Cassie\_Danaher](https://discuss.elastic.co/u/Cassie_Danaher)\ **Replies:** 2\ **Last updated:** [October 6, 2020, 8:10am UTC](https://discuss.elastic.co/t/certificate-issue/251053 "2020-10-06T08:10:49Z")
I am trying to update our certificate for elasticsearch. I was able to do so for Kibana with no problems. When I try to use any command for certutil I get the same error: certutil: function failed: SEC\_ERROR\_LEGAC… --- ## [How does elasticsearch store its data \[ multi node architecture \]](https://discuss.elastic.co/t/how-does-elasticsearch-store-its-data-multi-node-architecture/251056)
**Author:** [@Youssef\_Blaada](https://discuss.elastic.co/u/Youssef_Blaada)\ **Replies:** 2\ **Last updated:** [October 6, 2020, 7:58am UTC](https://discuss.elastic.co/t/how-does-elasticsearch-store-its-data-multi-node-architecture/251056 "2020-10-06T07:58:15Z")
Hi all, I'm a newbie in elasticsearch, and i have a question about how does elasticsearch store its data in a multi node architecture, what i know is each node store its data on the specified data path and if we choose … --- ## [Watch json error "Unknown key for a START\_OBJECT in \["](https://discuss.elastic.co/t/watch-json-error-unknown-key-for-a-start-object-in/250546)
**Author:** [@hubbardgd](https://discuss.elastic.co/u/hubbardgd)\ **Replies:** 5\ **Last updated:** [October 6, 2020, 7:36am UTC](https://discuss.elastic.co/t/watch-json-error-unknown-key-for-a-start-object-in/250546 "2020-10-06T07:36:55Z")
Trying to define a watch alert in ELK to trigger when a file system reaches more than 87% full. I need to aggregate on host, files system and percent full for the FS. With the script below, I'm getting the error "Unknown… --- ## [Filtering the response into the "Avg Bucket Aggregation"](https://discuss.elastic.co/t/filtering-the-response-into-the-avg-bucket-aggregation/250806)
**Author:** [@Famas](https://discuss.elastic.co/u/Famas)\ **Replies:** 2\ **Last updated:** [October 6, 2020, 6:44am UTC](https://discuss.elastic.co/t/filtering-the-response-into-the-avg-bucket-aggregation/250806 "2020-10-06T06:44:53Z")
Hi all. I'm trying to use "Avg Bucket Aggregation". This is the example given in the help page of Elasticsearch site. POST /\_search { "size": 0, "aggs": { "sales\_per\_month": { "da… --- ## [Elasticsearch 7.9.2 stuck at startip](https://discuss.elastic.co/t/elasticsearch-7-9-2-stuck-at-startip/250592)
**Author:** [@deepansh](https://discuss.elastic.co/u/deepansh)\ **Replies:** 8\ **Last updated:** [October 6, 2020, 5:40am UTC](https://discuss.elastic.co/t/elasticsearch-7-9-2-stuck-at-startip/250592 "2020-10-06T05:40:34Z")
I m trying to install elasticsearch 7.9.2 using cloudformation on AWS Ec2. When i run command "service elasticsearch start" in cloudformation cfn-init command it never completes even though elasticsearch has started. s… --- ## [ElasticSearch - How to display an additional field name in "Multi level" aggregation query?](https://discuss.elastic.co/t/elasticsearch-how-to-display-an-additional-field-name-in-multi-level-aggregation-query/251068)
**Author:** [@rifas\_ali\_pbi](https://discuss.elastic.co/u/rifas_ali_pbi)\ **Replies:** 0\ **Last updated:** [October 6, 2020, 5:28am UTC](https://discuss.elastic.co/t/elasticsearch-how-to-display-an-additional-field-name-in-multi-level-aggregation-query/251068 "2020-10-06T05:28:32Z")
--- ## [Nodes leaving Elastic Search cluster](https://discuss.elastic.co/t/nodes-leaving-elastic-search-cluster/251052)
**Author:** [@praveen4bv](https://discuss.elastic.co/u/praveen4bv)\ **Replies:** 0\ **Last updated:** [October 5, 2020, 9:35pm UTC](https://discuss.elastic.co/t/nodes-leaving-elastic-search-cluster/251052 "2020-10-05T21:35:15Z")
Hi, We have recently migrated to ES 7.6.2 from 6.5.2 and are seeing cluster instability since the upgrade. We see the below behavior from the Elastic Search cluster: Nodes in the cluster leave and join back after som… --- ## [Snapshot elasticsearch with rsync](https://discuss.elastic.co/t/snapshot-elasticsearch-with-rsync/251033)
**Author:** [@andrezenzen](https://discuss.elastic.co/u/andrezenzen)\ **Replies:** 3\ **Last updated:** [October 5, 2020, 9:06pm UTC](https://discuss.elastic.co/t/snapshot-elasticsearch-with-rsync/251033 "2020-10-05T21:06:59Z")
I have a backup routine set up, and would like to use rsync to make a copy to another server. My question is whether rsync will be able to move without breaking files with the routine enabled. --- ## [Document updates in ES rally scenarious](https://discuss.elastic.co/t/document-updates-in-es-rally-scenarious/250656)
**Author:** [@111391](https://discuss.elastic.co/u/111391)\ **Replies:** 1\ **Last updated:** [October 5, 2020, 8:15pm UTC](https://discuss.elastic.co/t/document-updates-in-es-rally-scenarious/250656 "2020-10-05T20:15:49Z")
Hello guys, I'm going to create load tests and I'd like to understand whether implementing my use case is possible via esrally. Basically what I'd like to emulate scenario where I create documents and then update them i… --- ## [Transform exclude nodes](https://discuss.elastic.co/t/transform-exclude-nodes/250899)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 2\ **Last updated:** [October 5, 2020, 7:39pm UTC](https://discuss.elastic.co/t/transform-exclude-nodes/250899 "2020-10-05T19:39:34Z")
I'm looking for a way to exclude nodes from transform searches: Cluster has a cold/warm architecture. The transform checks the last date of data for each client (terms by client\> max date), in order to alert for delays… --- ## [Last Valid Value of a Field in Scripted Fields](https://discuss.elastic.co/t/last-valid-value-of-a-field-in-scripted-fields/250918)
**Author:** [@Nastooh](https://discuss.elastic.co/u/Nastooh)\ **Replies:** 5\ **Last updated:** [October 5, 2020, 7:23pm UTC](https://discuss.elastic.co/t/last-valid-value-of-a-field-in-scripted-fields/250918 "2020-10-05T19:23:33Z")
Hi I need to perform math functions on fields with different timestamps. For example, current value of field x, qualified by its size and the last valid value of field y: if(doc\['x'\].size()\>0){ doc\['x'\].value+doc\['y'… --- ## [Elasticsearch 7.9.2 elasticsearch.keystore](https://discuss.elastic.co/t/elasticsearch-7-9-2-elasticsearch-keystore/251037)
**Author:** [@deepansh](https://discuss.elastic.co/u/deepansh)\ **Replies:** 0\ **Last updated:** [October 5, 2020, 6:24pm UTC](https://discuss.elastic.co/t/elasticsearch-7-9-2-elasticsearch-keystore/251037 "2020-10-05T18:24:16Z")
Is Elasticsearch 7.9.2 elasticsearch.keystore necessary and should have password? --- ## [Elastic Search Killed on start up!](https://discuss.elastic.co/t/elastic-search-killed-on-start-up/250737)
**Author:** [@aatif26](https://discuss.elastic.co/u/aatif26)\ **Replies:** 9\ **Last updated:** [October 5, 2020, 6:14pm UTC](https://discuss.elastic.co/t/elastic-search-killed-on-start-up/250737 "2020-10-05T18:14:55Z")
I just installed elasticsearch 7.9.2 in my centos 7.8.2003. Whenever I run ./bin/elasticsearch it just returns "killed" along with a bunch of warnings. I have referred this for installation. I have 2GB installed memor… --- ## [Dynamic mapping error - Unable to create dynamic object](https://discuss.elastic.co/t/dynamic-mapping-error-unable-to-create-dynamic-object/250755)
**Author:** [@elastic78](https://discuss.elastic.co/u/elastic78)\ **Replies:** 5\ **Last updated:** [October 5, 2020, 5:06pm UTC](https://discuss.elastic.co/t/dynamic-mapping-error-unable-to-create-dynamic-object/250755 "2020-10-05T17:06:30Z")
Hi, We are trying to migrate from 5.5.2. to 6.8.12 version.Below is the sample of my mapping. I have set my mapping to dynamic:strict and only one object I would want to introduce dynamically so setting it to true. Thi… --- ## [ML jobs](https://discuss.elastic.co/t/ml-jobs/225697)
**Author:** [@pinguin](https://discuss.elastic.co/u/pinguin)\ **Replies:** 9\ **Last updated:** [October 5, 2020, 4:25pm UTC](https://discuss.elastic.co/t/ml-jobs/225697 "2020-10-05T16:25:11Z")
hello, i have created the built-in machine learning jobs for windows and linux, for linux it s working as expected, for windows some of the jobs are showing 0 Processed data. one of the jobs is "windows\_anomalous\_proc… --- ## [Weighting HTML files to move them up search rankings](https://discuss.elastic.co/t/weighting-html-files-to-move-them-up-search-rankings/251025)
**Author:** [@oceanclub](https://discuss.elastic.co/u/oceanclub)\ **Replies:** 0\ **Last updated:** [October 5, 2020, 4:02pm UTC](https://discuss.elastic.co/t/weighting-html-files-to-move-them-up-search-rankings/251025 "2020-10-05T16:02:34Z")
Hi all, I'm working in tandem with a developer to create an online help site to which Madcap Flare HTML files are published. On top of the standard Flare search is an additional global search implemented using Elasticse… --- ## [User can access index not allowed in role (security is not working)](https://discuss.elastic.co/t/user-can-access-index-not-allowed-in-role-security-is-not-working/250993)
**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\ **Replies:** 4\ **Last updated:** [October 5, 2020, 3:13pm UTC](https://discuss.elastic.co/t/user-can-access-index-not-allowed-in-role-security-is-not-working/250993 "2020-10-05T15:13:16Z")
Hi community, I am asking for advice, if you could help with this security problem: ES version 7.92 (in docker ) created role with access the index bs\_hdm\_tr69\_\* created user this role but user can access all indice… --- ## [How much AWS EBS iops do I need?](https://discuss.elastic.co/t/how-much-aws-ebs-iops-do-i-need/250961)
**Author:** [@vamsikrishna\_medeti](https://discuss.elastic.co/u/vamsikrishna_medeti)\ **Replies:** 1\ **Last updated:** [October 5, 2020, 3:11pm UTC](https://discuss.elastic.co/t/how-much-aws-ebs-iops-do-i-need/250961 "2020-10-05T15:11:05Z")
Hi, I am provisioning the ELK stack on AWS kubernetes (EKS) with EBS storage. Can someone help me in configuring the IOPS? How much IOPS do I need to configure for EBS io2, for elastic stack? --- ## [Data synchronization time in elasticsearch](https://discuss.elastic.co/t/data-synchronization-time-in-elasticsearch/246748)
**Author:** [@akshatsharma](https://discuss.elastic.co/u/akshatsharma)\ **Replies:** 14\ **Last updated:** [October 5, 2020, 12:26pm UTC](https://discuss.elastic.co/t/data-synchronization-time-in-elasticsearch/246748 "2020-10-05T12:26:53Z")
Hi, This is a query regarding data synchronization in elasticsearch. We encountered a problem where we insert some data into elasticsearch at a regular interval. Now, immediately after data insertion, we run a search q… --- ## [Kafka-kerberos integartion with fiel beat verion 6.8.0](https://discuss.elastic.co/t/kafka-kerberos-integartion-with-fiel-beat-verion-6-8-0/250983)
**Author:** [@Vikas\_Bhardwaj](https://discuss.elastic.co/u/Vikas_Bhardwaj)\ **Replies:** 0\ **Last updated:** [October 5, 2020, 11:25am UTC](https://discuss.elastic.co/t/kafka-kerberos-integartion-with-fiel-beat-verion-6-8-0/250983 "2020-10-05T11:25:41Z")
Hi, I am trying to add kafka-kerbros to filebeat output but where I will give jaas config path my current config is this output.kafka: hosts: xxxx topic: xxxx required\_acks: 0 compression: none max\_message\_bytes: … --- ## [The number of shards on my nodes is no longer equal](https://discuss.elastic.co/t/the-number-of-shards-on-my-nodes-is-no-longer-equal/250934)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 4\ **Last updated:** [October 5, 2020, 11:17am UTC](https://discuss.elastic.co/t/the-number-of-shards-on-my-nodes-is-no-longer-equal/250934 "2020-10-05T11:17:11Z")
Hello, The number of shards on my nodes is no longer equal and I constantly see this kind of information in the logs of the main-2 node. What could be the reason for this? I am using Elasticsearch and Kibana version 7.… --- ## [Java library for Elastic Date Math](https://discuss.elastic.co/t/java-library-for-elastic-date-math/250790)
**Author:** [@Kevin\_Bourne](https://discuss.elastic.co/u/Kevin_Bourne)\ **Replies:** 2\ **Last updated:** [October 5, 2020, 11:07am UTC](https://discuss.elastic.co/t/java-library-for-elastic-date-math/250790 "2020-10-05T11:07:21Z")
Is there a Java library that converts Elastic accepted Date Math expressions ('now', 'now-1y/d') to a Java Date object? I have a case where we accept the Elastic Date Math as we pass this along to Elastic but there is an… --- ## [Is it possible to register multiple snapshot repositories for the same S3 bucket?](https://discuss.elastic.co/t/is-it-possible-to-register-multiple-snapshot-repositories-for-the-same-s3-bucket/250948)
**Author:** [@aliservetdonmez](https://discuss.elastic.co/u/aliservetdonmez)\ **Replies:** 4\ **Last updated:** [October 5, 2020, 10:54am UTC](https://discuss.elastic.co/t/is-it-possible-to-register-multiple-snapshot-repositories-for-the-same-s3-bucket/250948 "2020-10-05T10:54:44Z")
I'd like to create separate snapshot repositories for each major Elasticsearch version, however I don't necessarily want to create separate backing S3 buckets, for storage. Is it okay/possible using the same bucket for … --- ## [Elasticsearch integration with Vault](https://discuss.elastic.co/t/elasticsearch-integration-with-vault/250488)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 2\ **Last updated:** [October 5, 2020, 10:52am UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-vault/250488 "2020-10-05T10:52:19Z")
Is this possible to integrate Elasticsearch with Vault. If possible, Can anyone please give the reference how to approach that --- ## [Watcher not work perfect](https://discuss.elastic.co/t/watcher-not-work-perfect/250886)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 3\ **Last updated:** [October 5, 2020, 10:48am UTC](https://discuss.elastic.co/t/watcher-not-work-perfect/250886 "2020-10-05T10:48:01Z")
i have some aggs like this: "aggregations" : { "range\_by\_date" : { "buckets" : \[ { "key" : "2020-10-04T06:27:06.912Z-\*", "from" : 1.601792826912E12, "from\_as\_string"… --- ## [How to design ES fields for nested logical query](https://discuss.elastic.co/t/how-to-design-es-fields-for-nested-logical-query/250978)
**Author:** [@ybc\_c](https://discuss.elastic.co/u/ybc_c)\ **Replies:** 0\ **Last updated:** [October 5, 2020, 10:35am UTC](https://discuss.elastic.co/t/how-to-design-es-fields-for-nested-logical-query/250978 "2020-10-05T10:35:25Z")
I want to query ES to find docs meeting this pattern: A & (B | C) & (D | E). And A is the value of a field, both B and C are the values of the other field, and D and E are the values of another field. Here is a concrete… --- ## [Is it impossible to use multi-fields mapping without default type?](https://discuss.elastic.co/t/is-it-impossible-to-use-multi-fields-mapping-without-default-type/250953)
**Author:** [@taichi](https://discuss.elastic.co/u/taichi)\ **Replies:** 1\ **Last updated:** [October 5, 2020, 9:45am UTC](https://discuss.elastic.co/t/is-it-impossible-to-use-multi-fields-mapping-without-default-type/250953 "2020-10-05T09:45:25Z")
I want to use fields named foo.ngram & foo.kuromoji (kuromoji is Japanese morphological analyzer). Setting like below does not work, saying No type specified for field \[foo\]. { "mapping": { "properties": { … --- ## [Need help with Elasticsearch query on Kibana](https://discuss.elastic.co/t/need-help-with-elasticsearch-query-on-kibana/250764)
**Author:** [@Bahar\_Yilmaz](https://discuss.elastic.co/u/Bahar_Yilmaz)\ **Replies:** 1\ **Last updated:** [October 5, 2020, 9:36am UTC](https://discuss.elastic.co/t/need-help-with-elasticsearch-query-on-kibana/250764 "2020-10-05T09:36:26Z")
Hi , I need help with the Elasticsearch query. My query is like this below. GET record/\_search { "\_source": "Climate.Product.ProductCategory.ProductSubcategory.ProductModel.UnitMeasure.ProductModelIllustration.Produ… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=792) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=794)