# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=936

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 937

---

## [Issue with elasticsearch edge\_ngram query](https://discuss.elastic.co/t/issue-with-elasticsearch-edge-ngram-query/230699)

<div class="topic-metadata">

**Author:** [@sai\_saran](https://discuss.elastic.co/u/sai_saran)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 10:54am UTC](https://discuss.elastic.co/t/issue-with-elasticsearch-edge-ngram-query/230699 "2020-05-01T10:54:43Z")

</div>

I am using edge-gram to search in Elasticsearch. This is the analyse I used { "settings": { "analysis": { "analyzer": { "my\_analyzer": { "tokenizer": "my\_tokenizer"…

---

## [Plugin \[my-plugin\] was built for Elasticsearch version 7.6.0 but version 7.6.2 is running](https://discuss.elastic.co/t/plugin-my-plugin-was-built-for-elasticsearch-version-7-6-0-but-version-7-6-2-is-running/230708)

<div class="topic-metadata">

**Author:** [@p4charu](https://discuss.elastic.co/u/p4charu)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 12:05pm UTC](https://discuss.elastic.co/t/plugin-my-plugin-was-built-for-elasticsearch-version-7-6-0-but-version-7-6-2-is-running/230708 "2020-05-01T12:05:09Z")

</div>

Hello, We are facing a problem here with elastic search not installing our custom plugin. We built a filter plugin with ElasticSearch 7.6.0 using org.elasticsearch.gradle:build-tools:7.6.0 But can't use it with Elasti…

---

## [Help with data structure (small project)](https://discuss.elastic.co/t/help-with-data-structure-small-project/230684)

<div class="topic-metadata">

**Author:** [@freddedotme](https://discuss.elastic.co/u/freddedotme)\
**Replies:** 8\
**Last updated:** [May 1, 2020, 12:04pm UTC](https://discuss.elastic.co/t/help-with-data-structure-small-project/230684 "2020-05-01T12:04:19Z")

</div>

Hi there! I'm quite new to ES and would need some guidance from you, if possible. The scenario is the following: I have approximately 20 unique people, all identified by a separate UUID. Each person has around 2000 u…

---

## [Snapshot restore fails on Ensuring snapshot repository exists](https://discuss.elastic.co/t/snapshot-restore-fails-on-ensuring-snapshot-repository-exists/230697)

<div class="topic-metadata">

**Author:** [@Joren\_Inghelbrecht](https://discuss.elastic.co/u/Joren_Inghelbrecht)\
**Replies:** 4\
**Last updated:** [May 1, 2020, 11:25am UTC](https://discuss.elastic.co/t/snapshot-restore-fails-on-ensuring-snapshot-repository-exists/230697 "2020-05-01T11:25:04Z")

</div>

I want to switch from a CPU optimized deployment (elastic cloud v7.6.1) to a new IO optimized deployment. I tried the following methods: create a new deployment based on a snapshot create a new deployment and then re…

---

## [Elasticsearch in different zone](https://discuss.elastic.co/t/elasticsearch-in-different-zone/230540)

<div class="topic-metadata">

**Author:** [@amanjain](https://discuss.elastic.co/u/amanjain)\
**Replies:** 3\
**Last updated:** [May 1, 2020, 9:39am UTC](https://discuss.elastic.co/t/elasticsearch-in-different-zone/230540 "2020-05-01T09:39:27Z")

</div>

Hello, I want to confirm about the performance of Elasticsearch if data is separated among different zone but same region. I have tried to install in different zone but the performance (latency) was very bad. Data sha…

---

## [Recovering from missing state .si file](https://discuss.elastic.co/t/recovering-from-missing-state-si-file/229744)

<div class="topic-metadata">

**Author:** [@samuel](https://discuss.elastic.co/u/samuel)\
**Replies:** 7\
**Last updated:** [May 1, 2020, 8:53am UTC](https://discuss.elastic.co/t/recovering-from-missing-state-si-file/229744 "2020-05-01T08:53:12Z")

</div>

Elasticsearch service has been terminated and fails to restart. The error returned is Job for elasticsearch.service failed because the control process exited with error code. See "systemctl status elasticsearch.service"…

---

## [Handle null values in date range](https://discuss.elastic.co/t/handle-null-values-in-date-range/230678)

<div class="topic-metadata">

**Author:** [@maryam\_abdullah](https://discuss.elastic.co/u/maryam_abdullah)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 8:43am UTC](https://discuss.elastic.co/t/handle-null-values-in-date-range/230678 "2020-05-01T08:43:06Z")

</div>

Hello, I'm using elasticseach .net, I was wondering is it possible to handle null values in date range? .Query(q =\> q .FunctionScore(fs =\> fs.Query(qy =\> qy .Bool(b =\>…

---

## [An error in calculating the scoring ball?](https://discuss.elastic.co/t/an-error-in-calculating-the-scoring-ball/230673)

<div class="topic-metadata">

**Author:** [@iva3682](https://discuss.elastic.co/u/iva3682)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 7:37am UTC](https://discuss.elastic.co/t/an-error-in-calculating-the-scoring-ball/230673 "2020-05-01T07:37:49Z")

</div>

Good afternoon! I can’t understand why this is happening? The example in the attachment. Expect item with \["CategoryName": "Бытовая техника / Встраиваемая техника / Микроволновые печи", "FullCategoryName": ""\] will b…

---

## [Getting max\_open\_scroll\_context issue](https://discuss.elastic.co/t/getting-max-open-scroll-context-issue/230667)

<div class="topic-metadata">

**Author:** [@prashanthkumar](https://discuss.elastic.co/u/prashanthkumar)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 6:14am UTC](https://discuss.elastic.co/t/getting-max-open-scroll-context-issue/230667 "2020-05-01T06:14:07Z")

</div>

Hi All, We are using elastic search 7.4.2 and create API of ESActionFactory, I have increased max\_open\_scroll\_context up to 10,000, But still we getting issue create too many scroll contexts issue in our application, P…

---

## [How can i add new index pattern?](https://discuss.elastic.co/t/how-can-i-add-new-index-pattern/230557)

<div class="topic-metadata">

**Author:** [@janmichae.reyes4](https://discuss.elastic.co/u/janmichae.reyes4)\
**Replies:** 2\
**Last updated:** [May 1, 2020, 6:01am UTC](https://discuss.elastic.co/t/how-can-i-add-new-index-pattern/230557 "2020-05-01T06:01:56Z")

</div>

how can i add new index pattern while i already have an existing index pattern? Thank you,

---

## [Skip the document using a script processor](https://discuss.elastic.co/t/skip-the-document-using-a-script-processor/230608)

<div class="topic-metadata">

**Author:** [@bindu](https://discuss.elastic.co/u/bindu)\
**Replies:** 2\
**Last updated:** [May 1, 2020, 2:51am UTC](https://discuss.elastic.co/t/skip-the-document-using-a-script-processor/230608 "2020-05-01T02:51:37Z")

</div>

My use-case : Before the document is indexed, I would like to Skip the documents with conditions using a script processor (defined in a pipeline). When I try to create a index using the pipeline with the script processor…

---

## [SSO / Azure AD setup](https://discuss.elastic.co/t/sso-azure-ad-setup/230639)

<div class="topic-metadata">

**Author:** [@isaac.antebi](https://discuss.elastic.co/u/isaac.antebi)\
**Replies:** 2\
**Last updated:** [May 1, 2020, 12:49am UTC](https://discuss.elastic.co/t/sso-azure-ad-setup/230639 "2020-05-01T00:49:02Z")

</div>

Having issues getting SAML based SSO setup for Azure AD. Not sure where to get the Identifier / Entity ID, Reply URL etc.. from

---

## [Remove pre-filter phase in search](https://discuss.elastic.co/t/remove-pre-filter-phase-in-search/230580)

<div class="topic-metadata">

**Author:** [@zhangchao](https://discuss.elastic.co/u/zhangchao)\
**Replies:** 2\
**Last updated:** [April 30, 2020, 11:26pm UTC](https://discuss.elastic.co/t/remove-pre-filter-phase-in-search/230580 "2020-04-30T23:26:34Z")

</div>

from this issue Thanks for @jimczi ,Please correct me if there is any mistake.i think it only reduce the search thread pool usage doesn't seem very helpful，Coordinate node will limit maximum number of concurrent shard…

---

## [Autocomplete for ecommerce](https://discuss.elastic.co/t/autocomplete-for-ecommerce/230641)

<div class="topic-metadata">

**Author:** [@logipad\_Info\_Solutio](https://discuss.elastic.co/u/logipad_Info_Solutio)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 9:45pm UTC](https://discuss.elastic.co/t/autocomplete-for-ecommerce/230641 "2020-04-30T21:45:51Z")

</div>

hi, I am trying implement autosuggest for an ecomm website using elastic. I believe, alongwith returning product links(document matches), the autocomplete must also return most occuring phrases/shingles. Example, if we …

---

## [Nested Aggregation with Filter](https://discuss.elastic.co/t/nested-aggregation-with-filter/230636)

<div class="topic-metadata">

**Author:** [@relwell](https://discuss.elastic.co/u/relwell)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 9:22pm UTC](https://discuss.elastic.co/t/nested-aggregation-with-filter/230636 "2020-04-30T21:22:44Z")

</div>

I'm trying to get the counts for a given aggregation filtered against a different query. Here's an example document: { "\_index": "studies\_development\_20200403181856384", "\_type": "study", "\_id":…

---

## [Unable to start Elasticsearch 7.6.2 as a service \[RHEL 7.5\]](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-6-2-as-a-service-rhel-7-5/230633)

<div class="topic-metadata">

**Author:** [@rafaelgomesdm](https://discuss.elastic.co/u/rafaelgomesdm)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 9:16pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-6-2-as-a-service-rhel-7-5/230633 "2020-04-30T21:16:40Z")

</div>

Hello fellas I dowloaded and installed the RPM version - and GPG-Key - manually, following the steps given by elastic.co... installation file: "elasticsearch-7.6.2-x86\_64.rpm" The server that I'm working on have stric…

---

## [Received ban for the parent (Ban messages and searches failing)](https://discuss.elastic.co/t/received-ban-for-the-parent-ban-messages-and-searches-failing/230632)

<div class="topic-metadata">

**Author:** [@rpialum](https://discuss.elastic.co/u/rpialum)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 9:05pm UTC](https://discuss.elastic.co/t/received-ban-for-the-parent-ban-messages-and-searches-failing/230632 "2020-04-30T21:05:59Z")

</div>

We're experiencing the following DEBUG & WARN log messages and experiencing an issue where sporadically our searches appear to not be returning when these messages are seen. They all seem to begin with the "Received ban…

---

## [Only few hit content files are showing the correct results - custom analyzer](https://discuss.elastic.co/t/only-few-hit-content-files-are-showing-the-correct-results-custom-analyzer/229330)

<div class="topic-metadata">

**Author:** [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Replies:** 8\
**Last updated:** [April 30, 2020, 8:58pm UTC](https://discuss.elastic.co/t/only-few-hit-content-files-are-showing-the-correct-results-custom-analyzer/229330 "2020-04-30T20:58:10Z")

</div>

Hi, I have created a custom analyzer to recognize special characters in my files such as @,-, /, etc Here is my custom analyzer when i am creating the index: PUT /s3/ { "settings": { "index": { "number\_…

---

## [Files index being cleared](https://discuss.elastic.co/t/files-index-being-cleared/230625)

<div class="topic-metadata">

**Author:** [@StrifeX](https://discuss.elastic.co/u/StrifeX)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 8:23pm UTC](https://discuss.elastic.co/t/files-index-being-cleared/230625 "2020-04-30T20:23:32Z")

</div>

I'm not sure if this is the appropriate place to ask this question, but any assistance would be greatly appreciated. Our stack has is running fine (aside from a storage issue every so often). The issue I'm running into i…

---

## [Troubleshooting Elastalerts](https://discuss.elastic.co/t/troubleshooting-elastalerts/230628)

<div class="topic-metadata">

**Author:** [@mitchell.dyer](https://discuss.elastic.co/u/mitchell.dyer)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 7:49pm UTC](https://discuss.elastic.co/t/troubleshooting-elastalerts/230628 "2020-04-30T19:49:36Z")

</div>

I am trying to create an alert that shows as invalid in Elastalerts. Need help seeing why it is failing. Here is the query for the rule. doc\_type: doc filter: - query\_string: query: | node\_app: \[hidden\] …

---

## [How exactly do I shutdown, then restart the cluster?](https://discuss.elastic.co/t/how-exactly-do-i-shutdown-then-restart-the-cluster/230622)

<div class="topic-metadata">

**Author:** [@rgelb](https://discuss.elastic.co/u/rgelb)\
**Replies:** 8\
**Last updated:** [April 30, 2020, 7:48pm UTC](https://discuss.elastic.co/t/how-exactly-do-i-shutdown-then-restart-the-cluster/230622 "2020-04-30T19:48:14Z")

</div>

I have a cluster of 3 nodes. I need to change a setting in elasticsearch.yml and then restart the cluster. I am a bit confused on the procedure. Here is what I have so far. Is this correct? Make changes to /etc/elast…

---

## [Emerging standards for ECS customization](https://discuss.elastic.co/t/emerging-standards-for-ecs-customization/229969)

<div class="topic-metadata">

**Author:** [@jgregmac](https://discuss.elastic.co/u/jgregmac)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 6:28pm UTC](https://discuss.elastic.co/t/emerging-standards-for-ecs-customization/229969 "2020-04-30T18:28:21Z")

</div>

I am curious if there are any emerging patterns / practices / standards relating to the development of ECS custom extensions that can be shared with the community. We are experiencing difficulties in making logically co…

---

## [Getting started with managing users and how to control what data they can see](https://discuss.elastic.co/t/getting-started-with-managing-users-and-how-to-control-what-data-they-can-see/230607)

<div class="topic-metadata">

**Author:** [@ilovedonuts](https://discuss.elastic.co/u/ilovedonuts)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 6:23pm UTC](https://discuss.elastic.co/t/getting-started-with-managing-users-and-how-to-control-what-data-they-can-see/230607 "2020-04-30T18:23:18Z")

</div>

Our team has the following requirements that I need to look into... Create and manage users when they access Kibana from their workspace Control what these users see in Kibana I need guidance on where to start with th…

---

## [Query latest 10 parent documents and corresponding child document if exists](https://discuss.elastic.co/t/query-latest-10-parent-documents-and-corresponding-child-document-if-exists/230334)

<div class="topic-metadata">

**Author:** [@shashanka\_arnady](https://discuss.elastic.co/u/shashanka_arnady)\
**Replies:** 5\
**Last updated:** [April 30, 2020, 6:18pm UTC](https://discuss.elastic.co/t/query-latest-10-parent-documents-and-corresponding-child-document-if-exists/230334 "2020-04-30T18:18:47Z")

</div>

Hello, Lets say i want to store Songs data in elasticsearch where users can write comments for any of the songs. I am looking at option where i can get 10 latest songs (based on say cretedTime field) and corresponding …

---

## [Moving data files on windows](https://discuss.elastic.co/t/moving-data-files-on-windows/230605)

<div class="topic-metadata">

**Author:** [@giorgio](https://discuss.elastic.co/u/giorgio)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 5:54pm UTC](https://discuss.elastic.co/t/moving-data-files-on-windows/230605 "2020-04-30T17:54:12Z")

</div>

Hi I have little bit of situation where I have to strip down RAID 0 where I have elasticsearch + its data config and logs. Will there be a problem if I just copy elasticsearch data config and log files to backup drive th…

---

## [How to sort number stored as string (keyword)](https://discuss.elastic.co/t/how-to-sort-number-stored-as-string-keyword/230551)

<div class="topic-metadata">

**Author:** [@AffanShahab](https://discuss.elastic.co/u/AffanShahab)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 4:58pm UTC](https://discuss.elastic.co/t/how-to-sort-number-stored-as-string-keyword/230551 "2020-04-30T16:58:40Z")

</div>

Some numerical attribute in my data is mapped as keyword and stored as string. I want to sort it as 1, 2, 10, 15 or when descending. 15, 10, 2, 1. I have tried multiple solutions available online but nothing works. Data …

---

## [Integrate ldap with kibana](https://discuss.elastic.co/t/integrate-ldap-with-kibana/230131)

<div class="topic-metadata">

**Author:** [@kasim123](https://discuss.elastic.co/u/kasim123)\
**Replies:** 6\
**Last updated:** [April 30, 2020, 4:48pm UTC](https://discuss.elastic.co/t/integrate-ldap-with-kibana/230131 "2020-04-30T16:48:35Z")

</div>

Hi Team, Recently, I have configured ELK stack with x-pack security enabled. it is working fine now, now I wanted to extend security by integrating kibana with ldap. Could you help us how to integrate ldap with kibana…

---

## [Bulk indexing 1.6 billion rows with ~400 columns using es-hadoop hive](https://discuss.elastic.co/t/bulk-indexing-1-6-billion-rows-with-400-columns-using-es-hadoop-hive/230475)

<div class="topic-metadata">

**Author:** [@gsahu25](https://discuss.elastic.co/u/gsahu25)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 4:46pm UTC](https://discuss.elastic.co/t/bulk-indexing-1-6-billion-rows-with-400-columns-using-es-hadoop-hive/230475 "2020-04-30T16:46:01Z")

</div>

Hi All, I am trying to load a table in Hive using ES-Hadoop Hive (1.6 billion rows with 380 columns) into two indices with 16 shards. Refresh interval is set to 60s Replication is set to 0 Indices buffer size 30% Bat…

---

## [Detected a corrupted repository , index\<name\> references an unknown snapshot uuid](https://discuss.elastic.co/t/detected-a-corrupted-repository-index-name-references-an-unknown-snapshot-uuid/230371)

<div class="topic-metadata">

**Author:** [@spreet](https://discuss.elastic.co/u/spreet)\
**Replies:** 5\
**Last updated:** [April 30, 2020, 3:42pm UTC](https://discuss.elastic.co/t/detected-a-corrupted-repository-index-name-references-an-unknown-snapshot-uuid/230371 "2020-04-30T15:42:47Z")

</div>

Hi, All, We are trying to migrate a self-managed elastic search cluster (version 5.3) to a different Elasticsearch cluster with version 7.1. Below steps works for the first time but fails when I try to restore another s…

---

## [Accessing fields in watcher with transform actions](https://discuss.elastic.co/t/accessing-fields-in-watcher-with-transform-actions/230581)

<div class="topic-metadata">

**Author:** [@sholzhauer](https://discuss.elastic.co/u/sholzhauer)\
**Replies:** 0\
**Last updated:** [April 30, 2020, 3:14pm UTC](https://discuss.elastic.co/t/accessing-fields-in-watcher-with-transform-actions/230581 "2020-04-30T15:14:46Z")

</div>

Hi there, I am trying to implement a watcher for when a client is sending "excessive" amounts of requests. When a client passes the threshold I would like to trigger an action foreach client which exceeds the threshold…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=935)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=937)
