# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1194 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1195 --- ## [Permissions of logstash\_write user](https://discuss.elastic.co/t/permissions-of-logstash-write-user/194812)
**Author:** [@jimmyvalmer19](https://discuss.elastic.co/u/jimmyvalmer19)\ **Replies:** 0\ **Last updated:** [August 12, 2019, 8:21am UTC](https://discuss.elastic.co/t/permissions-of-logstash-write-user/194812 "2019-08-12T08:21:22Z")
Hello. I have user called logstash and role called logstash\_write. User logstash has a role logstash\_write and the role is configured as follows: Cluster privileges: all Indices privileges: all (for all indices i crea… --- ## [Term query on nested field returns empty result, why?](https://discuss.elastic.co/t/term-query-on-nested-field-returns-empty-result-why/194642)
**Author:** [@andreas-gruenwald](https://discuss.elastic.co/u/andreas-gruenwald)\ **Replies:** 1\ **Last updated:** [August 12, 2019, 8:13am UTC](https://discuss.elastic.co/t/term-query-on-nested-field-returns-empty-result-why/194642 "2019-08-12T08:13:32Z")
GET /at\_de\_elastic/\_search { "\_source": \[ "attributes.articleName", "attributes.remoteId", "attributes.comparisonListMetadataSearch" \], "query": { "term": { "attributes.remoteId": … --- ## [Can we create snapshots of immutable indices?](https://discuss.elastic.co/t/can-we-create-snapshots-of-immutable-indices/194687)
**Author:** [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Replies:** 1\ **Last updated:** [August 12, 2019, 8:05am UTC](https://discuss.elastic.co/t/can-we-create-snapshots-of-immutable-indices/194687 "2019-08-12T08:05:42Z")
Suppose I have made an index to be immutable . Is it possible to make a snapshot of it?. Also if no, what is the best practices when dealing with the backing up and restoration operations of immutable indices ? --- ## [How many months of log data do we retain in Elasticsearch?](https://discuss.elastic.co/t/how-many-months-of-log-data-do-we-retain-in-elasticsearch/194104)
**Author:** [@Bjen\_Shah](https://discuss.elastic.co/u/Bjen_Shah)\ **Replies:** 6\ **Last updated:** [August 12, 2019, 8:01am UTC](https://discuss.elastic.co/t/how-many-months-of-log-data-do-we-retain-in-elasticsearch/194104 "2019-08-12T08:01:44Z")
How many months of log data does organization should store in Elasticsearch? Do we store the log data anywhere aside from Elasticsearch (e.g. flat files?) How do we archive old log data that is required for regulatory c… --- ## [After upgrading to 7.3.0 search queries return null\_pointer\_exception](https://discuss.elastic.co/t/after-upgrading-to-7-3-0-search-queries-return-null-pointer-exception/193629)
**Author:** [@nkoothrappahli](https://discuss.elastic.co/u/nkoothrappahli)\ **Replies:** 3\ **Last updated:** [August 12, 2019, 7:56am UTC](https://discuss.elastic.co/t/after-upgrading-to-7-3-0-search-queries-return-null-pointer-exception/193629 "2019-08-12T07:56:30Z")
Search queries (which worked before upgrading) now return { "took":16, "timed\_out":false, "\_shards":{ "total":5, "successful":4, "skipped":0, "failed":1, "failures":\[ { … --- ## [How to check if a field value of a tag is present in the field value of other tags](https://discuss.elastic.co/t/how-to-check-if-a-field-value-of-a-tag-is-present-in-the-field-value-of-other-tags/194393)
**Author:** [@madhan8](https://discuss.elastic.co/u/madhan8)\ **Replies:** 5\ **Last updated:** [August 12, 2019, 7:51am UTC](https://discuss.elastic.co/t/how-to-check-if-a-field-value-of-a-tag-is-present-in-the-field-value-of-other-tags/194393 "2019-08-12T07:51:47Z")
Hi, I want to identify if an IP address(field A) is present in the list of IP addresses(field B). How will I be able to do this check? How should I convert the IP addresses present in a field B into a list first? Onc… --- ## [How to limit the list of fields that can be written to a specific index?](https://discuss.elastic.co/t/how-to-limit-the-list-of-fields-that-can-be-written-to-a-specific-index/194401)
**Author:** [@Melok](https://discuss.elastic.co/u/Melok)\ **Replies:** 6\ **Last updated:** [August 12, 2019, 7:46am UTC](https://discuss.elastic.co/t/how-to-limit-the-list-of-fields-that-can-be-written-to-a-specific-index/194401 "2019-08-12T07:46:52Z")
I want my document index to contain only fields ('a', 'b', 'c' for example). How can I do this? --- ## [Master node fail when unexpected error while indexing document](https://discuss.elastic.co/t/master-node-fail-when-unexpected-error-while-indexing-document/194788)
**Author:** [@Jehutywong](https://discuss.elastic.co/u/Jehutywong)\ **Replies:** 5\ **Last updated:** [August 12, 2019, 7:25am UTC](https://discuss.elastic.co/t/master-node-fail-when-unexpected-error-while-indexing-document/194788 "2019-08-12T07:25:45Z")
Elasticsearch version: 7.0.1 Master nodes: 3 Datanodes: 31 When one of my index fail to initiate primary shard (in my case its the .monitoring-es-7-2019.08.12 index). The leader master will fail in some minutes. The … --- ## [Dots in index and searching](https://discuss.elastic.co/t/dots-in-index-and-searching/194737)
**Author:** [@codecandy](https://discuss.elastic.co/u/codecandy)\ **Replies:** 1\ **Last updated:** [August 12, 2019, 7:03am UTC](https://discuss.elastic.co/t/dots-in-index-and-searching/194737 "2019-08-12T07:03:44Z")
Hi, I am pretty new to ES: I have to create an index which is dot seperated something like, // minions.dev.contents/minion02.retro/noise:2019-08-01T19:42:45.000Z and the contents is // { "noise" : "25", "temperatu… --- ## [Action \[indices:data/read/search\] is unauthorized for user](https://discuss.elastic.co/t/action-indices-data-read-search-is-unauthorized-for-user/194789)
**Author:** [@jhonko](https://discuss.elastic.co/u/jhonko)\ **Replies:** 0\ **Last updated:** [August 12, 2019, 5:49am UTC](https://discuss.elastic.co/t/action-indices-data-read-search-is-unauthorized-for-user/194789 "2019-08-12T05:49:50Z")
Hello! I'm currently evaluating Elastic Stack and I have problems related to REST API authorization. I'm not sure if I'm doing something wrong or if there's a bug is Elasticsearch. I have setup OIDC SSO successfully (u… --- ## [Terminology Clarification](https://discuss.elastic.co/t/terminology-clarification/194758)
**Author:** [@stanly](https://discuss.elastic.co/u/stanly)\ **Replies:** 1\ **Last updated:** [August 12, 2019, 5:24am UTC](https://discuss.elastic.co/t/terminology-clarification/194758 "2019-08-12T05:24:22Z")
I was reading this ticket, and it seems like a really exciting change: https://github.com/apache/lucene-solr/pull/715 One constraint mentioned here: The segments must have at most one field value per document (otherwi… --- ## [It takes up to 10 minutes to join new master](https://discuss.elastic.co/t/it-takes-up-to-10-minutes-to-join-new-master/194522)
**Author:** [@Jehutywong](https://discuss.elastic.co/u/Jehutywong)\ **Replies:** 4\ **Last updated:** [August 12, 2019, 5:08am UTC](https://discuss.elastic.co/t/it-takes-up-to-10-minutes-to-join-new-master/194522 "2019-08-12T05:08:47Z")
When the leader master node fail, it takes about a minute to elect a new leader. But the follower master node takes minutes to switch to the new leader. It's this expected? or any configuration can optimize this? After … --- ## [How to read elasticsearch snapshots stored in hdfs](https://discuss.elastic.co/t/how-to-read-elasticsearch-snapshots-stored-in-hdfs/194757)
**Author:** [@Atul\_Srivastava](https://discuss.elastic.co/u/Atul_Srivastava)\ **Replies:** 1\ **Last updated:** [August 11, 2019, 6:52pm UTC](https://discuss.elastic.co/t/how-to-read-elasticsearch-snapshots-stored-in-hdfs/194757 "2019-08-11T18:52:12Z")
Hi, I am currently backing up my elasticsearch data to hdfs using curator and the repository-hdfs plugin. Is there a way I can query the snapshots stored in hdfs using hive? --- ## [Authentication SAML - Authentication to realm saml1 failed - SAML Attribute \[nameid:persistent\] not found in saml attributes](https://discuss.elastic.co/t/authentication-saml-authentication-to-realm-saml1-failed-saml-attribute-nameid-persistent-not-found-in-saml-attributes/193349)
**Author:** [@giorgiogale](https://discuss.elastic.co/u/giorgiogale)\ **Replies:** 3\ **Last updated:** [August 11, 2019, 1:30pm UTC](https://discuss.elastic.co/t/authentication-saml-authentication-to-realm-saml1-failed-saml-attribute-nameid-persistent-not-found-in-saml-attributes/193349 "2019-08-11T13:30:34Z")
Hi, I'm trying to authenticate to Kibana using an IDP and SAML. The version of Elasticsearch used is 7.2.0. Starting from an application I try to authenticate myself on Kibana. The problem is that I haven't found much… --- ## [ELastic search cluster with logstash](https://discuss.elastic.co/t/elastic-search-cluster-with-logstash/194746)
**Author:** [@Yuvraj\_S](https://discuss.elastic.co/u/Yuvraj_S)\ **Replies:** 0\ **Last updated:** [August 11, 2019, 12:00pm UTC](https://discuss.elastic.co/t/elastic-search-cluster-with-logstash/194746 "2019-08-11T12:00:45Z")
Hi ALl, I have setup the below as my elasticsearch cluster. HA proxy -- proxy1.test.com:9000 this HA proxy redirects my request to the below elastic nodes, es1.test.com:9200 es2.test.com:9200 es3.test.com:9200 whi… --- ## [Best way to manage missing data of date type while using bulk to inject data into elasticsearch](https://discuss.elastic.co/t/best-way-to-manage-missing-data-of-date-type-while-using-bulk-to-inject-data-into-elasticsearch/194398)
**Author:** [@Saurabh\_Sharma\_IIT](https://discuss.elastic.co/u/Saurabh_Sharma_IIT)\ **Replies:** 3\ **Last updated:** [August 11, 2019, 8:09am UTC](https://discuss.elastic.co/t/best-way-to-manage-missing-data-of-date-type-while-using-bulk-to-inject-data-into-elasticsearch/194398 "2019-08-11T08:09:59Z")
Hi, I am trying to inject csv file into elasticsearch. I have a row named "starttime". In this columns some rows are missing. I have converted this to datetime format using pandas to\_datetime. Now when I inject this data… --- ## [Hello, may I ask you a question](https://discuss.elastic.co/t/hello-may-i-ask-you-a-question/194705)
**Author:** [@kakano.1](https://discuss.elastic.co/u/kakano.1)\ **Replies:** 4\ **Last updated:** [August 11, 2019, 8:05am UTC](https://discuss.elastic.co/t/hello-may-i-ask-you-a-question/194705 "2019-08-11T08:05:14Z")
es : v7.2 logstash: v7.2 kibana : v7.2 --- ## [Cross Cluster Search param search.remote.initial\_connect\_timeout does not work](https://discuss.elastic.co/t/cross-cluster-search-param-search-remote-initial-connect-timeout-does-not-work/193671)
**Author:** [@michal1](https://discuss.elastic.co/u/michal1)\ **Replies:** 2\ **Last updated:** [August 11, 2019, 6:23am UTC](https://discuss.elastic.co/t/cross-cluster-search-param-search-remote-initial-connect-timeout-does-not-work/193671 "2019-08-11T06:23:07Z")
Hi, I am running with cross cluster search in elastic. I want to raise the search.remote.initial\_connect\_timeout from the default 30sec to a larger number, but i see this has no impact on anything. I would expect it t… --- ## [How to query terms which are neighbour of provided terms?](https://discuss.elastic.co/t/how-to-query-terms-which-are-neighbour-of-provided-terms/194710)
**Author:** [@elasticpatrick](https://discuss.elastic.co/u/elasticpatrick)\ **Replies:** 0\ **Last updated:** [August 10, 2019, 12:09pm UTC](https://discuss.elastic.co/t/how-to-query-terms-which-are-neighbour-of-provided-terms/194710 "2019-08-10T12:09:04Z")
Hello, I used to go market every day and take pictures of different products which contain brand names. A product can have zero brand names or multiple brand names. I do analysis on the products photos and retrieve brand… --- ## [Elastic-search SSL certification error, unable to open kibana](https://discuss.elastic.co/t/elastic-search-ssl-certification-error-unable-to-open-kibana/194340)
**Author:** [@asad\_ali](https://discuss.elastic.co/u/asad_ali)\ **Replies:** 9\ **Last updated:** [August 10, 2019, 11:03am UTC](https://discuss.elastic.co/t/elastic-search-ssl-certification-error-unable-to-open-kibana/194340 "2019-08-10T11:03:36Z")
I'm unable to open kibana as elastic-search is irresponsive as I made changes to elasticsearch.yml for SSL authentication. On dashboard on webpage i get "Cannot connect to the Elasticsearch cluster". My elasticsearch.y… --- ## [K8S Install Fails on version \< 7.2](https://discuss.elastic.co/t/k8s-install-fails-on-version-7-2/194476)
**Author:** [@engineertdog](https://discuss.elastic.co/u/engineertdog)\ **Replies:** 4\ **Last updated:** [August 10, 2019, 7:17am UTC](https://discuss.elastic.co/t/k8s-install-fails-on-version-7-2/194476 "2019-08-10T07:17:28Z")
I am able to install v7.2 with the statefulset config that is listed below, but for a service I'm running, it hasn't been updated to support v7 yet. Currently, the service only supports v6.3. The following is the error I… --- ## [Active Directory configuration issue](https://discuss.elastic.co/t/active-directory-configuration-issue/192028)
**Author:** [@Ashok\_Sharma](https://discuss.elastic.co/u/Ashok_Sharma)\ **Replies:** 1\ **Last updated:** [August 9, 2019, 11:28pm UTC](https://discuss.elastic.co/t/active-directory-configuration-issue/192028 "2019-08-09T23:28:30Z")
I am using trying to configure active directory from ES 6.8 and getting error. Below is the snippet from active directory configuration from elasticsearch.yml file xpack: security: authc: realms: my\_ad: type: acti… --- ## [Scripted update to select minimum value in list](https://discuss.elastic.co/t/scripted-update-to-select-minimum-value-in-list/192116)
**Author:** [@neesha](https://discuss.elastic.co/u/neesha)\ **Replies:** 3\ **Last updated:** [August 9, 2019, 10:21pm UTC](https://discuss.elastic.co/t/scripted-update-to-select-minimum-value-in-list/192116 "2019-08-09T22:21:00Z")
I have series of documents that currently have a field that is a list of integers (date timestamps, but this doesn't really matter). Some have a single value, some have many (possibly hundreds). For example: "date" : \[… --- ## [Rollover max\_size precision](https://discuss.elastic.co/t/rollover-max-size-precision/194326)
**Author:** [@jimyoo](https://discuss.elastic.co/u/jimyoo)\ **Replies:** 1\ **Last updated:** [August 9, 2019, 9:37pm UTC](https://discuss.elastic.co/t/rollover-max-size-precision/194326 "2019-08-09T21:37:26Z")
I am seeing an interesting behavior on Rollover Index. When "max\_size" is given with little bit smaller than the current index size, sometimes (or some indices) the rollover succeeds sometime it fails. For example, the… --- ## [Get Hierarchical Data...Pls Helppp!](https://discuss.elastic.co/t/get-hierarchical-data-pls-helppp/193419)
**Author:** [@Bidzina\_Goginashvili](https://discuss.elastic.co/u/Bidzina_Goginashvili)\ **Replies:** 0\ **Last updated:** [August 1, 2019, 10:37pm UTC](https://discuss.elastic.co/t/get-hierarchical-data-pls-helppp/193419 "2019-08-01T22:37:23Z")
I have a little problem with Elasticsearch... I have products table.which looks something like this ID NAME MODELNAME IsParentModel 1 IPhone 7 16 gb IPhone 7 1 2 IPhone 7 32 gb IPhone 7 0 3 IPhone 7 64 gb IPhone 7 0 … --- ## [Doc2vec for more relevant search](https://discuss.elastic.co/t/doc2vec-for-more-relevant-search/194670)
**Author:** [@alexpython](https://discuss.elastic.co/u/alexpython)\ **Replies:** 0\ **Last updated:** [August 9, 2019, 7:06pm UTC](https://discuss.elastic.co/t/doc2vec-for-more-relevant-search/194670 "2019-08-09T19:06:08Z")
Hi there! Did someone have expirience with doc2vec dictinary intergration in elastic search for more relevant search? We faced problem with double meaning of words and didn't find any other solution than ML model. Any he… --- ## [All shards failed exception during reindexing kibana index](https://discuss.elastic.co/t/all-shards-failed-exception-during-reindexing-kibana-index/194669)
**Author:** [@shivani\_aggarwal](https://discuss.elastic.co/u/shivani_aggarwal)\ **Replies:** 0\ **Last updated:** [August 9, 2019, 6:50pm UTC](https://discuss.elastic.co/t/all-shards-failed-exception-during-reindexing-kibana-index/194669 "2019-08-09T18:50:33Z")
Hi, I am running ELK 7.0.1 cluster in kubernetes environment. I had few visualizations stored in .kibana\_1 index. I have taken the snapshot of this. Later, .kibana\_1 index was deleted & it got recreated when kibana wa… --- ## [Ccs\_minimize\_roundtrips error when using 7.X high level REST API to access 6.x index](https://discuss.elastic.co/t/ccs-minimize-roundtrips-error-when-using-7-x-high-level-rest-api-to-access-6-x-index/194095)
**Author:** [@iti](https://discuss.elastic.co/u/iti)\ **Replies:** 2\ **Last updated:** [August 9, 2019, 6:18pm UTC](https://discuss.elastic.co/t/ccs-minimize-roundtrips-error-when-using-7-x-high-level-rest-api-to-access-6-x-index/194095 "2019-08-09T18:18:50Z")
I am using Elastic Search High Level REST API 7.x and try to access ES 6.7 index and go the following error: ElasticsearchStatusException\[Elasticsearch exception \[type=illegal\_argument\_exception, reason=request \[xxxxxxx… --- ## [Elasticsearch - Java insufficient memory](https://discuss.elastic.co/t/elasticsearch-java-insufficient-memory/194655)
**Author:** [@David04](https://discuss.elastic.co/u/David04)\ **Replies:** 2\ **Last updated:** [August 9, 2019, 4:55pm UTC](https://discuss.elastic.co/t/elasticsearch-java-insufficient-memory/194655 "2019-08-09T16:55:28Z")
Hello, When I run "/usr/share/elasticsearch/bin/elasticsearch --version" I get the following Java error: Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit\_memory(0x0000000614cc0000, 7167279104, 0) failed; er… --- ## [Error:(44, 45) java: cannot find symbol symbol: method settingsBuilder() location: class org.elasticsearch.common.settings.Settings](https://discuss.elastic.co/t/error-44-45-java-cannot-find-symbol-symbol-method-settingsbuilder-location-class-org-elasticsearch-common-settings-settings/193364)
**Author:** [@patri](https://discuss.elastic.co/u/patri)\ **Replies:** 1\ **Last updated:** [August 9, 2019, 4:48pm UTC](https://discuss.elastic.co/t/error-44-45-java-cannot-find-symbol-symbol-method-settingsbuilder-location-class-org-elasticsearch-common-settings-settings/193364 "2019-08-09T16:48:45Z")
\< public boolean initEStransportClinet() { try { // Build the settings for our client. String clusterId = "cd494a44d4d946ae9d84ee858cfb6cae"; // Your cluster ID here String region = "us-east-1"; // Your region here … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1193) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1195)