# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1790

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1791

---

## [LDAP user, local group?](https://discuss.elastic.co/t/ldap-user-local-group/119337)

<div class="topic-metadata">

**Author:** [@Turbo\_Fredriksson](https://discuss.elastic.co/u/Turbo_Fredriksson)\
**Replies:** 4\
**Last updated:** [February 13, 2018, 7:25pm UTC](https://discuss.elastic.co/t/ldap-user-local-group/119337 "2018-02-13T19:25:08Z")

</div>

I have a user in LDAP (can authenticate fine), but this is a "simple" user ("person" and "uidObject" object classes only). How can I add this user to a local ('file') group? Is there any LDAP schema that I can use to ad…

---

## [Overhead overspend issues](https://discuss.elastic.co/t/overhead-overspend-issues/119513)

<div class="topic-metadata">

**Author:** [@Callahan](https://discuss.elastic.co/u/Callahan)\
**Replies:** 7\
**Last updated:** [February 13, 2018, 7:14pm UTC](https://discuss.elastic.co/t/overhead-overspend-issues/119513 "2018-02-13T19:14:50Z")

</div>

I'm having huge problems getting my 3 node ES setup to stay up for more than an hour. Nothing has changed leading up to this although I was seeing issues about JVM running out of heap space. I've upgraded successfully fr…

---

## [Fetch 200M documents with slice and scroll](https://discuss.elastic.co/t/fetch-200m-documents-with-slice-and-scroll/119692)

<div class="topic-metadata">

**Author:** [@harshil](https://discuss.elastic.co/u/harshil)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 6:51pm UTC](https://discuss.elastic.co/t/fetch-200m-documents-with-slice-and-scroll/119692 "2018-02-13T18:51:11Z")

</div>

Hi, We have a requirement to fetch ~200M documents. To make this work in parallel, I am using slice and scroll API, and fetching 10,000 documents per page. I know scroll API will run a query and takes a snapshot of th…

---

## [Aggregation count unique values](https://discuss.elastic.co/t/aggregation-count-unique-values/119567)

<div class="topic-metadata">

**Author:** [@Manuel\_Islas](https://discuss.elastic.co/u/Manuel_Islas)\
**Replies:** 4\
**Last updated:** [February 13, 2018, 6:15pm UTC](https://discuss.elastic.co/t/aggregation-count-unique-values/119567 "2018-02-13T18:15:16Z")

</div>

Hello, I have a requirement in which I need to aggregate over multiple indexes, each being independent from the others and each containing potentially millions of documents. Each index has its own Ids but contains a has…

---

## [Scroll API taking long time and using a lot of memory](https://discuss.elastic.co/t/scroll-api-taking-long-time-and-using-a-lot-of-memory/119687)

<div class="topic-metadata">

**Author:** [@Raj\_Kiran](https://discuss.elastic.co/u/Raj_Kiran)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 6:12pm UTC](https://discuss.elastic.co/t/scroll-api-taking-long-time-and-using-a-lot-of-memory/119687 "2018-02-13T18:12:53Z")

</div>

Hi, I have a single machine with following configs RAM: 32 GB (allocated 12 gb to ES) HDD I have indexed 17 million rows x 3000 columns (200 gb) data with 5 shards and no replicas I want to retrieve a subset of data…

---

## [Unexpected pri.store.size discrepancy for files indexed in ES2x and ES5x](https://discuss.elastic.co/t/unexpected-pri-store-size-discrepancy-for-files-indexed-in-es2x-and-es5x/119514)

<div class="topic-metadata">

**Author:** [@dimalini](https://discuss.elastic.co/u/dimalini)\
**Replies:** 1\
**Last updated:** [February 13, 2018, 5:32pm UTC](https://discuss.elastic.co/t/unexpected-pri-store-size-discrepancy-for-files-indexed-in-es2x-and-es5x/119514 "2018-02-13T17:32:49Z")

</div>

Hi, We are seeing some noticeable store size discrepancy for documents we indexed in 2 ES versions In ES version 2.4.1, we indexed docs with type "Mapping1". It has just field1 and \_source is ON { \_ "Mapping1": {\_ …

---

## [Able to call Open ID login portal using SAML](https://discuss.elastic.co/t/able-to-call-open-id-login-portal-using-saml/119522)

<div class="topic-metadata">

**Author:** [@kasi](https://discuss.elastic.co/u/kasi)\
**Replies:** 2\
**Last updated:** [February 13, 2018, 4:50pm UTC](https://discuss.elastic.co/t/able-to-call-open-id-login-portal-using-saml/119522 "2018-02-13T16:50:31Z")

</div>

Hi, Is there any possibility of calling a Open ID login page from SAML ? Thanks, Kasi

---

## [How to query string for (contains this, also contains that, but shouldnt include these words)](https://discuss.elastic.co/t/how-to-query-string-for-contains-this-also-contains-that-but-shouldnt-include-these-words/119677)

<div class="topic-metadata">

**Author:** [@dprophet](https://discuss.elastic.co/u/dprophet)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 4:42pm UTC](https://discuss.elastic.co/t/how-to-query-string-for-contains-this-also-contains-that-but-shouldnt-include-these-words/119677 "2018-02-13T16:42:50Z")

</div>

I have a string in elastic search. It looks like this GET "/user/685934468/api/v1/tables/funds\_raised\_map\_by\_region\_1" String is an HTTP RESTFul data endpoint with a breakdown like so GET /user/"numerical user ID"/api…

---

## [Iterate Over all Documents for a specific index and type](https://discuss.elastic.co/t/iterate-over-all-documents-for-a-specific-index-and-type/119335)

<div class="topic-metadata">

**Author:** [@Tameem\_Ahmed](https://discuss.elastic.co/u/Tameem_Ahmed)\
**Replies:** 1\
**Last updated:** [February 13, 2018, 4:15pm UTC](https://discuss.elastic.co/t/iterate-over-all-documents-for-a-specific-index-and-type/119335 "2018-02-13T16:15:02Z")

</div>

I am newbie and this is my first attempt. I have few documents with this json { "\_index": "msm", "\_type": "bat", "\_id": "AWBP0tthO9VGNRQOwYSB", "\_version": 1, "\_score": 1, "\_source": { "testMethodsSummary": { "…

---

## [Paging bug with bucket sort aggregation](https://discuss.elastic.co/t/paging-bug-with-bucket-sort-aggregation/119670)

<div class="topic-metadata">

**Author:** [@Matthew\_Field](https://discuss.elastic.co/u/Matthew_Field)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 4:06pm UTC](https://discuss.elastic.co/t/paging-bug-with-bucket-sort-aggregation/119670 "2018-02-13T16:06:34Z")

</div>

I am trying to page the results of a terms aggregation using a bucket sort aggregation. I am using the query below to sort the buckets by the sum of the scores in order to list the categories by order of relevance. I t…

---

## [Creating template : Validation Failed: 1: template is missing;](https://discuss.elastic.co/t/creating-template-validation-failed-1-template-is-missing/119663)

<div class="topic-metadata">

**Author:** [@yoavsradware](https://discuss.elastic.co/u/yoavsradware)\
**Replies:** 2\
**Last updated:** [February 13, 2018, 3:43pm UTC](https://discuss.elastic.co/t/creating-template-validation-failed-1-template-is-missing/119663 "2018-02-13T15:43:00Z")

</div>

Hi all I am new to ES , I am trying to create a basic template so when I am creating and indx start with the prefix ff\* it will have my mapping for example ff-first-index ff1-second-index will have the same index I d…

---

## [Scripting access other documents fields of result](https://discuss.elastic.co/t/scripting-access-other-documents-fields-of-result/119662)

<div class="topic-metadata">

**Author:** [@mstkk](https://discuss.elastic.co/u/mstkk)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 3:04pm UTC](https://discuss.elastic.co/t/scripting-access-other-documents-fields-of-result/119662 "2018-02-13T15:04:29Z")

</div>

GET /\_search { "\_source": "classified\_id", "query": { "bool": { "filter": { "term": { "town.areaId.keyword": "134" } } } }, "script\_fields": { "test2": { …

---

## [How to apply x pack ML job on filtered data and group by field](https://discuss.elastic.co/t/how-to-apply-x-pack-ml-job-on-filtered-data-and-group-by-field/119574)

<div class="topic-metadata">

**Author:** [@sarvendra.singh](https://discuss.elastic.co/u/sarvendra.singh)\
**Replies:** 1\
**Last updated:** [February 13, 2018, 1:45pm UTC](https://discuss.elastic.co/t/how-to-apply-x-pack-ml-job-on-filtered-data-and-group-by-field/119574 "2018-02-13T13:45:34Z")

</div>

Hi Team, how to apply filter in x pack ML job.. for example we don't apply to mean(number\_of\_records) on all records only for some values(for example location="US")..also please let us know how we can apply group by so…

---

## [Multi-Index search (autocomplete)](https://discuss.elastic.co/t/multi-index-search-autocomplete/119645)

<div class="topic-metadata">

**Author:** [@Alireza\_Bashiri](https://discuss.elastic.co/u/Alireza_Bashiri)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 1:21pm UTC](https://discuss.elastic.co/t/multi-index-search-autocomplete/119645 "2018-02-13T13:21:42Z")

</div>

Hey, I have four indicis (I couldn't create multi-type with single index using JDBC input in Logstash just to mention) called, cities, regions, countries and hotels they have a in common filed called name I want to searc…

---

## [Can't add properties to a new type](https://discuss.elastic.co/t/cant-add-properties-to-a-new-type/119637)

<div class="topic-metadata">

**Author:** [@alqamasudofy](https://discuss.elastic.co/u/alqamasudofy)\
**Replies:** 3\
**Last updated:** [February 13, 2018, 1:17pm UTC](https://discuss.elastic.co/t/cant-add-properties-to-a-new-type/119637 "2018-02-13T13:17:12Z")

</div>

PUT /customers/\_mapping/instore { "properties":{ "name":{ "type":"text", "analyzer":"standard" } } } ERROR: { "error": { "root\_cause": \[ { "type": "illegal\_argument\_excep…

---

## [ElasticSearch max and min score](https://discuss.elastic.co/t/elasticsearch-max-and-min-score/119641)

<div class="topic-metadata">

**Author:** [@yatishraaz](https://discuss.elastic.co/u/yatishraaz)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 1:15pm UTC](https://discuss.elastic.co/t/elasticsearch-max-and-min-score/119641 "2018-02-13T13:15:31Z")

</div>

I want to search the fields and apply a function to the doc score that includes the max and min score of the search result. I can use the script score but how I get the max and min scores in script?

---

## [Group by and sum operation for fields](https://discuss.elastic.co/t/group-by-and-sum-operation-for-fields/119181)

<div class="topic-metadata">

**Author:** [@cekeriya](https://discuss.elastic.co/u/cekeriya)\
**Replies:** 10\
**Last updated:** [February 13, 2018, 12:48pm UTC](https://discuss.elastic.co/t/group-by-and-sum-operation-for-fields/119181 "2018-02-13T12:48:59Z")

</div>

First of all I want to tell you that I am new at ElasticSearch I have a JSON in following format. I want to group by "CallTo" field and sum of "Count" value for each "CallTo" I will use this values for visulation in Kib…

---

## [Regexp support in source filtering](https://discuss.elastic.co/t/regexp-support-in-source-filtering/117808)

<div class="topic-metadata">

**Author:** [@fchicharro](https://discuss.elastic.co/u/fchicharro)\
**Replies:** 1\
**Last updated:** [February 13, 2018, 12:54pm UTC](https://discuss.elastic.co/t/regexp-support-in-source-filtering/117808 "2018-02-13T12:54:53Z")

</div>

Hi All, I have a question about the capabilities of source filtering. I have documents which represents products. Each document contains a set product properties and a set of product prices, one price for each country.…

---

## [Output recurring events multiple times in a range query](https://discuss.elastic.co/t/output-recurring-events-multiple-times-in-a-range-query/119631)

<div class="topic-metadata">

**Author:** [@Wullschi](https://discuss.elastic.co/u/Wullschi)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 12:30pm UTC](https://discuss.elastic.co/t/output-recurring-events-multiple-times-in-a-range-query/119631 "2018-02-13T12:30:04Z")

</div>

Hi, my indexed documents should represent events with a certain starting date. Some of those events can be reccuring. Every event has a nested date property which indicates the starting date of the event. If it is a rec…

---

## [Min doc frequency for the whole phrase suggestion?](https://discuss.elastic.co/t/min-doc-frequency-for-the-whole-phrase-suggestion/119619)

<div class="topic-metadata">

**Author:** [@aclowkey](https://discuss.elastic.co/u/aclowkey)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 11:26am UTC](https://discuss.elastic.co/t/min-doc-frequency-for-the-whole-phrase-suggestion/119619 "2018-02-13T11:26:06Z")

</div>

Say I'm using the phrase suggestion, and I want to get suggestion only when the whole phrase has results. For example: User types: "Dog hous" - since there is no document which matches "Dog house" the suggestion "Dog ho…

---

## [Elasticsearch - JSON date payload being converted to type long, cannot use for range queries](https://discuss.elastic.co/t/elasticsearch-json-date-payload-being-converted-to-type-long-cannot-use-for-range-queries/119552)

<div class="topic-metadata">

**Author:** [@BruceLeroy](https://discuss.elastic.co/u/BruceLeroy)\
**Replies:** 6\
**Last updated:** [February 13, 2018, 11:33am UTC](https://discuss.elastic.co/t/elasticsearch-json-date-payload-being-converted-to-type-long-cannot-use-for-range-queries/119552 "2018-02-13T11:33:28Z")

</div>

Hi! I create a mapping like: \> { "test3" : { "mappings" : { "doc" : { "properties" : { "alerttype" : { "type" : "text" }, "devicename" : { …

---

## [ElasticSearch Nested Aggregation with Cardinality on another field](https://discuss.elastic.co/t/elasticsearch-nested-aggregation-with-cardinality-on-another-field/119398)

<div class="topic-metadata">

**Author:** [@Tu5har](https://discuss.elastic.co/u/Tu5har)\
**Replies:** 1\
**Last updated:** [February 13, 2018, 11:21am UTC](https://discuss.elastic.co/t/elasticsearch-nested-aggregation-with-cardinality-on-another-field/119398 "2018-02-13T11:21:21Z")

</div>

Hi All, I need some help on below problem. Let me know how can I form my query to get expected output. Details posted in the stack overflow page. Thanks

---

## [Sort in both parent and child objects](https://discuss.elastic.co/t/sort-in-both-parent-and-child-objects/119614)

<div class="topic-metadata">

**Author:** [@muthucse123](https://discuss.elastic.co/u/muthucse123)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 10:40am UTC](https://discuss.elastic.co/t/sort-in-both-parent-and-child-objects/119614 "2018-02-13T10:40:19Z")

</div>

i have parent child mapping to store the media content. I need to sort using both parent and child fields when querying. Is it possible to sort in both parent and child ? I tried and there is no option to sort both. Whe…

---

## [How to filter nested objects on a should query?](https://discuss.elastic.co/t/how-to-filter-nested-objects-on-a-should-query/119612)

<div class="topic-metadata">

**Author:** [@batmaci](https://discuss.elastic.co/u/batmaci)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 10:21am UTC](https://discuss.elastic.co/t/how-to-filter-nested-objects-on-a-should-query/119612 "2018-02-13T10:21:20Z")

</div>

I have my mappings as below and I am doing a bool should query on name and other properties as shown below but what I need is that I want to filter CustomerPrices by CustomerId on response. Each products have same Custo…

---

## [Indices recovery speed is strange](https://discuss.elastic.co/t/indices-recovery-speed-is-strange/119590)

<div class="topic-metadata">

**Author:** [@junkainiu](https://discuss.elastic.co/u/junkainiu)\
**Replies:** 2\
**Last updated:** [February 13, 2018, 8:44am UTC](https://discuss.elastic.co/t/indices-recovery-speed-is-strange/119590 "2018-02-13T08:44:37Z")

</div>

Hi, this situation happens when I am testing the elatsicsearch recovery speed. I use elasticsearch 5.3.0 as a one node cluster and a heap size of 3G. Indices are like this: green open fulleth\_smartprobe2\_nic0\_4h\_201…

---

## [X-Pack Free license - change password](https://discuss.elastic.co/t/x-pack-free-license-change-password/119433)

<div class="topic-metadata">

**Author:** [@Mojster](https://discuss.elastic.co/u/Mojster)\
**Replies:** 8\
**Last updated:** [February 13, 2018, 8:28am UTC](https://discuss.elastic.co/t/x-pack-free-license-change-password/119433 "2018-02-13T08:28:46Z")

</div>

I'm using X-Pack 6.2 over Elastic stack 6.2. I've used auto-generated passwords during installation steps. As in the tutorial I've used U/P(elastic/generatedPass) to log into Kibana. Now to share the login, I want to …

---

## [Telnet on 9200 doesn't work elasticsearch](https://discuss.elastic.co/t/telnet-on-9200-doesnt-work-elasticsearch/119588)

<div class="topic-metadata">

**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\
**Replies:** 4\
**Last updated:** [February 13, 2018, 8:27am UTC](https://discuss.elastic.co/t/telnet-on-9200-doesnt-work-elasticsearch/119588 "2018-02-13T08:27:46Z")

</div>

Hi , I am not able to telnet on the machine having elasticsearch is running using the hostname/ipaddr, while the telnet through localhost is working fine. telnet localhost 9200 Trying 127.0.0.1... Connected to localh…

---

## [Help on ELK Cluster Setup](https://discuss.elastic.co/t/help-on-elk-cluster-setup/119594)

<div class="topic-metadata">

**Author:** [@inhinyera16](https://discuss.elastic.co/u/inhinyera16)\
**Replies:** 0\
**Last updated:** [February 13, 2018, 8:15am UTC](https://discuss.elastic.co/t/help-on-elk-cluster-setup/119594 "2018-02-13T08:15:19Z")

</div>

We have this small setup of ELK Cluster in Production. ES Nodes : 4 - 3 Master/Data Eligible nodes - 1 Coordinating node Logstash : 3 - Each running on 3 Master/Data Eligible nodes - LoadBalancer Enabled - Perform…

---

## [X-pack plugin version hell \[feature request?\]](https://discuss.elastic.co/t/x-pack-plugin-version-hell-feature-request/118238)

<div class="topic-metadata">

**Author:** [@Guy\_Wicks](https://discuss.elastic.co/u/Guy_Wicks)\
**Replies:** 2\
**Last updated:** [February 13, 2018, 8:06am UTC](https://discuss.elastic.co/t/x-pack-plugin-version-hell-feature-request/118238 "2018-02-13T08:06:49Z")

</div>

Something that STOPS me from using the otherwise very useful x-pack on my cluster is that I have to exactly match the ES and x-pack version numbers. I've been in situations where my ES server has patched, upgraded and th…

---

## [How System Index like .monitoring-es-6-2018.02.06 are being deleted automatically](https://discuss.elastic.co/t/how-system-index-like-monitoring-es-6-2018-02-06-are-being-deleted-automatically/119578)

<div class="topic-metadata">

**Author:** [@Hanish\_Bansal](https://discuss.elastic.co/u/Hanish_Bansal)\
**Replies:** 3\
**Last updated:** [February 13, 2018, 7:28am UTC](https://discuss.elastic.co/t/how-system-index-like-monitoring-es-6-2018-02-06-are-being-deleted-automatically/119578 "2018-02-13T07:28:23Z")

</div>

We are using basic license of X-PACK. All system indexes like .monitoring-es-6-2018.02.06, .monitoring-kibana-6-2018.02.06 are being deleted after 7 days automatically. I am curious to know how these are being deleted? …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1789)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1791)
