# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1094

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1095

---

## [Analytics for elasticsearch](https://discuss.elastic.co/t/analytics-for-elasticsearch/207936)

<div class="topic-metadata">

**Author:** [@imranazad](https://discuss.elastic.co/u/imranazad)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 4:35pm UTC](https://discuss.elastic.co/t/analytics-for-elasticsearch/207936 "2019-11-14T16:35:43Z")

</div>

This post is to get some ideas and advice on what analytics can be done on elasticsearch. We want to measure our search performance. In particular we are interested in getting data around Number of results returned for…

---

## [Aggregation Per document](https://discuss.elastic.co/t/aggregation-per-document/207934)

<div class="topic-metadata">

**Author:** [@Calvin-J-Scott](https://discuss.elastic.co/u/Calvin-J-Scott)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 4:34pm UTC](https://discuss.elastic.co/t/aggregation-per-document/207934 "2019-11-14T16:34:40Z")

</div>

Hi am trying to create a query that will return aggregations for each hit returned from a query rather that aggregation for the full search response. for example if i had two documents { "Name":"Jon", "Cars":\[ …

---

## [Cluster stats flat settings](https://discuss.elastic.co/t/cluster-stats-flat-settings/207933)

<div class="topic-metadata">

**Author:** [@stevesimpson](https://discuss.elastic.co/u/stevesimpson)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 4:31pm UTC](https://discuss.elastic.co/t/cluster-stats-flat-settings/207933 "2019-11-14T16:31:03Z")

</div>

I'm trying to get cluster stats using the flat\_settings query parameter. However when I run: GET \_cluster/stats?flat\_settings=true I get back the following response: { "error": { "root\_cause": \[ { …

---

## [Point in time recovery from a snapshot](https://discuss.elastic.co/t/point-in-time-recovery-from-a-snapshot/207795)

<div class="topic-metadata">

**Author:** [@AxialTilt](https://discuss.elastic.co/u/AxialTilt)\
**Replies:** 1\
**Last updated:** [November 14, 2019, 4:41am UTC](https://discuss.elastic.co/t/point-in-time-recovery-from-a-snapshot/207795 "2019-11-14T04:41:01Z")

</div>

Hello I am trying out ElasticSearch administration for the first time after having administered relational DBMS for many years. Trying to understand if point in time recovery is possible with ElasticSearch snapshots. Fr…

---

## [Issues with installation in IPv6 environment](https://discuss.elastic.co/t/issues-with-installation-in-ipv6-environment/207000)

<div class="topic-metadata">

**Author:** [@shivani\_aggarwal](https://discuss.elastic.co/u/shivani_aggarwal)\
**Replies:** 4\
**Last updated:** [November 14, 2019, 3:45pm UTC](https://discuss.elastic.co/t/issues-with-installation-in-ipv6-environment/207000 "2019-11-14T15:45:23Z")

</div>

Hi, I am installing elasticsearch in a kubernetes environment with IPv6 network. Using helm charts from https://github.com/elastic/helm-charts/tree/master/elasticsearch. I configured network.host as \["::"\], but with t…

---

## [Error in installing elasticsearch 6.7 and above](https://discuss.elastic.co/t/error-in-installing-elasticsearch-6-7-and-above/180980)

<div class="topic-metadata">

**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Replies:** 2\
**Last updated:** [November 14, 2019, 3:11pm UTC](https://discuss.elastic.co/t/error-in-installing-elasticsearch-6-7-and-above/180980 "2019-11-14T15:11:06Z")

</div>

While installing elaticsearch 6.7 and above I am getting this error: sudo systemctl start elasticsearch.service could not find java in JAVA\_HOME or bundled at /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.212.b04-0.el7\_6.x86\_6…

---

## [Scroll search | Caused by: java.io.IOException: entity content is too long \[226508429\] for the configured buffer limit \[1029760\]](https://discuss.elastic.co/t/scroll-search-caused-by-java-io-ioexception-entity-content-is-too-long-226508429-for-the-configured-buffer-limit-1029760/207202)

<div class="topic-metadata">

**Author:** [@vijaykriishna](https://discuss.elastic.co/u/vijaykriishna)\
**Replies:** 0\
**Last updated:** [November 9, 2019, 5:39am UTC](https://discuss.elastic.co/t/scroll-search-caused-by-java-io-ioexception-entity-content-is-too-long-226508429-for-the-configured-buffer-limit-1029760/207202 "2019-11-09T05:39:25Z")

</div>

Hi All, I've implemented scroll search on an index with 348,004 documents in it. Code: SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder().fetchSource(includes, null) .size(20000); searchSour…

---

## [Aggregation on long type is wrong](https://discuss.elastic.co/t/aggregation-on-long-type-is-wrong/207798)

<div class="topic-metadata">

**Author:** [@yuri9163](https://discuss.elastic.co/u/yuri9163)\
**Replies:** 3\
**Last updated:** [November 14, 2019, 1:57pm UTC](https://discuss.elastic.co/t/aggregation-on-long-type-is-wrong/207798 "2019-11-14T13:57:00Z")

</div>

Can any one explain me what is going on? I would like to aggregate and get the max value of duration by global\_fdid. I'm expecting to get max duration will be 6860 but it returns 7214.0 GET //\_mapping Result { …

---

## [Can Elasticsearch get logs from Logstash/Fluentd by itself?](https://discuss.elastic.co/t/can-elasticsearch-get-logs-from-logstash-fluentd-by-itself/207901)

<div class="topic-metadata">

**Author:** [@Eugene2](https://discuss.elastic.co/u/Eugene2)\
**Replies:** 3\
**Last updated:** [November 14, 2019, 1:55pm UTC](https://discuss.elastic.co/t/can-elasticsearch-get-logs-from-logstash-fluentd-by-itself/207901 "2019-11-14T13:55:08Z")

</div>

Hello I have Elasticsearch and instances with Fluentd/Logstach in different environments. Access to the env with Elastic is limited that's why Fluentd/Logstash can't push logs to the elasticsearch. But Elasticsearch has…

---

## [Spark string to elasticsearch geo\_point](https://discuss.elastic.co/t/spark-string-to-elasticsearch-geo-point/207902)

<div class="topic-metadata">

**Author:** [@ParthM](https://discuss.elastic.co/u/ParthM)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 1:28pm UTC](https://discuss.elastic.co/t/spark-string-to-elasticsearch-geo-point/207902 "2019-11-14T13:28:41Z")

</div>

Hello, I am new to ES so I don't know much about it. I have a spark streaming DataFrame which has a field "location" and it has the latitude and longitude of a place and I want to show the data into kibana Map. The issu…

---

## [Add Elastic Search functionalities to the Topcoder Resources API](https://discuss.elastic.co/t/add-elastic-search-functionalities-to-the-topcoder-resources-api/207899)

<div class="topic-metadata">

**Author:** [@Rajendra\_Prasad](https://discuss.elastic.co/u/Rajendra_Prasad)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 1:02pm UTC](https://discuss.elastic.co/t/add-elastic-search-functionalities-to-the-topcoder-resources-api/207899 "2019-11-14T13:02:49Z")

</div>

Add Elastic Search functionalities to Resources API I have one resource api and wants to add Elastic Search functionalities please let me know how to do it?

---

## [Spark to elasticsearch data](https://discuss.elastic.co/t/spark-to-elasticsearch-data/207896)

<div class="topic-metadata">

**Author:** [@ParthM](https://discuss.elastic.co/u/ParthM)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 12:54pm UTC](https://discuss.elastic.co/t/spark-to-elasticsearch-data/207896 "2019-11-14T12:54:54Z")

</div>

Can elasticsearch store map coordinates which are in string to geo\_point directly. I have created index with a field having geo\_point datatype but it show error and I am new to ES

---

## [How can i update all the values in specific field using update\_by\_query?](https://discuss.elastic.co/t/how-can-i-update-all-the-values-in-specific-field-using-update-by-query/207875)

<div class="topic-metadata">

**Author:** [@lakmina\_chathurya](https://discuss.elastic.co/u/lakmina_chathurya)\
**Replies:** 2\
**Last updated:** [November 14, 2019, 12:19pm UTC](https://discuss.elastic.co/t/how-can-i-update-all-the-values-in-specific-field-using-update-by-query/207875 "2019-11-14T12:19:19Z")

</div>

POST /my\_metric/\_update\_by\_query { "query": { "bool": { "must": \[ { "term": {"timestamp": "1324987657365"} } …

---

## [Problems with creating a custom query builder which uses "percolate" or "has\_child" query inside](https://discuss.elastic.co/t/problems-with-creating-a-custom-query-builder-which-uses-percolate-or-has-child-query-inside/207884)

<div class="topic-metadata">

**Author:** [@mdyuldina](https://discuss.elastic.co/u/mdyuldina)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 12:18pm UTC](https://discuss.elastic.co/t/problems-with-creating-a-custom-query-builder-which-uses-percolate-or-has-child-query-inside/207884 "2019-11-14T12:18:08Z")

</div>

Hi, I am trying to create a custom query parser. I have created a simple plugin implementing SearchPlugin: public class CustomPlugin extends Plugin implements SearchPlugin { public List\<QuerySpec\<?\>\> getQueries() …

---

## [Cost of storing duplicate fields, but not indexing the duplicated field via \_dynamic=false](https://discuss.elastic.co/t/cost-of-storing-duplicate-fields-but-not-indexing-the-duplicated-field-via-dynamic-false/207880)

<div class="topic-metadata">

**Author:** [@harsimranb](https://discuss.elastic.co/u/harsimranb)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 12:05pm UTC](https://discuss.elastic.co/t/cost-of-storing-duplicate-fields-but-not-indexing-the-duplicated-field-via-dynamic-false/207880 "2019-11-14T12:05:09Z")

</div>

Hi, I am storing duplicate fields in my document (solution to an interesting use case). Using, \_dynamic=false, I am only indexing the one set of fields, not the duplicate ones. This helps keep my index small, but our \_…

---

## [Reindex data without compromising on data loss & search](https://discuss.elastic.co/t/reindex-data-without-compromising-on-data-loss-search/207879)

<div class="topic-metadata">

**Author:** [@Tapan](https://discuss.elastic.co/u/Tapan)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 11:55am UTC](https://discuss.elastic.co/t/reindex-data-without-compromising-on-data-loss-search/207879 "2019-11-14T11:55:52Z")

</div>

Problem statement: I would like to import data from one index to another index without compromising on data loss and impacting search from web. Approach taken I have an index development\_users\_en\_gb and would like to i…

---

## [SAML Group Attributes with more than one group](https://discuss.elastic.co/t/saml-group-attributes-with-more-than-one-group/205295)

<div class="topic-metadata">

**Author:** [@ramss](https://discuss.elastic.co/u/ramss)\
**Replies:** 22\
**Last updated:** [November 14, 2019, 11:40am UTC](https://discuss.elastic.co/t/saml-group-attributes-with-more-than-one-group/205295 "2019-11-14T11:40:38Z")

</div>

Hi All, I am trying to integrate Kibana running on Kuberenetes with on-prem ADFS with the below mapping. SAML Config SAML Config saml: saml1: order: 1 ssl.verification\_mode: none idp.metadata.path: adfs.xml idp.…

---

## [SSL certificate | Let's Encrypt or self-signed](https://discuss.elastic.co/t/ssl-certificate-lets-encrypt-or-self-signed/207819)

<div class="topic-metadata">

**Author:** [@Danelicious](https://discuss.elastic.co/u/Danelicious)\
**Replies:** 8\
**Last updated:** [November 14, 2019, 11:36am UTC](https://discuss.elastic.co/t/ssl-certificate-lets-encrypt-or-self-signed/207819 "2019-11-14T11:36:02Z")

</div>

Hi there! I am trying to enrypt communication on my elastic server. I followed several tutorials. However, I always fail to succeed, so I am seeking for advise here. Elasticsearch is running fine after a fresh installati…

---

## [Elastic not working cold nodes with S3 (minio)](https://discuss.elastic.co/t/elastic-not-working-cold-nodes-with-s3-minio/207856)

<div class="topic-metadata">

**Author:** [@levatigra](https://discuss.elastic.co/u/levatigra)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 10:15am UTC](https://discuss.elastic.co/t/elastic-not-working-cold-nodes-with-s3-minio/207856 "2019-11-14T10:15:11Z")

</div>

Hello! My problem is that I'm trying to put a date on S3 (mini). The directory is mounted locally. The path is specified in the config file. But when you try to run a node, it produces the following error. \> \[2019-11-1…

---

## [Define custom analyzer for highlight](https://discuss.elastic.co/t/define-custom-analyzer-for-highlight/207853)

<div class="topic-metadata">

**Author:** [@avivlevizky](https://discuss.elastic.co/u/avivlevizky)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 10:03am UTC](https://discuss.elastic.co/t/define-custom-analyzer-for-highlight/207853 "2019-11-14T10:03:13Z")

</div>

After some study on the Lucene highlight that elastic search based on. I have an unanswered question. I want to use the standard tokenizer on the index/search stages (to utilize properly the token filters) and also to …

---

## [Elasticsearch innerhits difference between docvalue\_fields and include and exclude](https://discuss.elastic.co/t/elasticsearch-innerhits-difference-between-docvalue-fields-and-include-and-exclude/207849)

<div class="topic-metadata">

**Author:** [@sanju\_yadav](https://discuss.elastic.co/u/sanju_yadav)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 9:30am UTC](https://discuss.elastic.co/t/elasticsearch-innerhits-difference-between-docvalue-fields-and-include-and-exclude/207849 "2019-11-14T09:30:34Z")

</div>

I have multiple nested fields in an index, while querying I need to find which documents match for which I was using inner\_hits with include in source fields which was having a performance hit, but as I moved to use docv…

---

## [No results for search in kibana](https://discuss.elastic.co/t/no-results-for-search-in-kibana/207739)

<div class="topic-metadata">

**Author:** [@Amos\_Shahar](https://discuss.elastic.co/u/Amos_Shahar)\
**Replies:** 1\
**Last updated:** [November 14, 2019, 9:07am UTC](https://discuss.elastic.co/t/no-results-for-search-in-kibana/207739 "2019-11-14T09:07:28Z")

</div>

hi, I am getting no results for my search term "collectionaccount" in the field "tableId\_lc" in Kibana. seems that for other docs all is working properly. not sure what am I missing: "analysis" : { "filter" : { "auto…

---

## [Delete index from logstash](https://discuss.elastic.co/t/delete-index-from-logstash/206555)

<div class="topic-metadata">

**Author:** [@DILIP\_SHARMA](https://discuss.elastic.co/u/DILIP_SHARMA)\
**Replies:** 8\
**Last updated:** [November 14, 2019, 8:49am UTC](https://discuss.elastic.co/t/delete-index-from-logstash/206555 "2019-11-14T08:49:13Z")

</div>

hi i have 1 summary index , which get refresh once in day . i want to delete all the data from index every day when logstash run i want to delete data from index or index itself . here i cant use id column to update …

---

## [Intersection between documents by specific property](https://discuss.elastic.co/t/intersection-between-documents-by-specific-property/207347)

<div class="topic-metadata">

**Author:** [@Stancheva](https://discuss.elastic.co/u/Stancheva)\
**Replies:** 4\
**Last updated:** [November 14, 2019, 8:30am UTC](https://discuss.elastic.co/t/intersection-between-documents-by-specific-property/207347 "2019-11-14T08:30:46Z")

</div>

I've got index with the following mapping: "properties": { "group\_id": { "type": "long" }, "user\_id": { "type": "long" } } Document id has the following structure {group\_id}-{user\_id}. …

---

## [Elastic SQL is not working with time bound data](https://discuss.elastic.co/t/elastic-sql-is-not-working-with-time-bound-data/207742)

<div class="topic-metadata">

**Author:** [@farrukh\_aziz](https://discuss.elastic.co/u/farrukh_aziz)\
**Replies:** 1\
**Last updated:** [November 14, 2019, 8:20am UTC](https://discuss.elastic.co/t/elastic-sql-is-not-working-with-time-bound-data/207742 "2019-11-14T08:20:47Z")

</div>

this search is working without time field how i can make it work with time bound. POST \_sql?format=txt { "query":"SELECT network,usage.total from clients where usage.total \<= 1000 AND '@timestamp' \< now() - INTERVAL 7…

---

## [Wildcard query on complex text/json column](https://discuss.elastic.co/t/wildcard-query-on-complex-text-json-column/207815)

<div class="topic-metadata">

**Author:** [@salihklc](https://discuss.elastic.co/u/salihklc)\
**Replies:** 4\
**Last updated:** [November 14, 2019, 8:09am UTC](https://discuss.elastic.co/t/wildcard-query-on-complex-text-json-column/207815 "2019-11-14T08:09:47Z")

</div>

Hello everyone, I'm trying to search a text in the Request,ResponseJSon column with wildcard method ,but It's look like search on only first 10 chars. All the other fields works like as excepted but I really dont get th…

---

## [Do i need to close client everytime I finish querying?](https://discuss.elastic.co/t/do-i-need-to-close-client-everytime-i-finish-querying/207832)

<div class="topic-metadata">

**Author:** [@cjsjyh](https://discuss.elastic.co/u/cjsjyh)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 7:59am UTC](https://discuss.elastic.co/t/do-i-need-to-close-client-everytime-i-finish-querying/207832 "2019-11-14T07:59:31Z")

</div>

Do I need to close connection that I made with const elasticClient = new Client(parameters)? or does elasticsearch handle by itself?

---

## [Bulk request is throwing rejected execution exception](https://discuss.elastic.co/t/bulk-request-is-throwing-rejected-execution-exception/207821)

<div class="topic-metadata">

**Author:** [@Balu\_P](https://discuss.elastic.co/u/Balu_P)\
**Replies:** 1\
**Last updated:** [November 14, 2019, 6:53am UTC](https://discuss.elastic.co/t/bulk-request-is-throwing-rejected-execution-exception/207821 "2019-11-14T06:53:31Z")

</div>

{"reason":"rejected execution of processing of \[6013644\]\[indices:data/write/bulk\[s\]\[p\]\]: request: BulkShardRequest \[\[index-test24\]\[3\]\] containing \[52\] requests, target allocation id: HwDviwdxRRexbw-sT7B8WQ, primary term:…

---

## [Is there any best way to update existing index without re-indexing and creating alias of index?](https://discuss.elastic.co/t/is-there-any-best-way-to-update-existing-index-without-re-indexing-and-creating-alias-of-index/207622)

<div class="topic-metadata">

**Author:** [@Devang\_Prajapati](https://discuss.elastic.co/u/Devang_Prajapati)\
**Replies:** 10\
**Last updated:** [November 14, 2019, 6:17am UTC](https://discuss.elastic.co/t/is-there-any-best-way-to-update-existing-index-without-re-indexing-and-creating-alias-of-index/207622 "2019-11-14T06:17:59Z")

</div>

I've to re-index the data if there is little change in the existing index. I've already done reindexing with creating an alias of the index but in that , I've to wait while reindexing the data from one index to another.…

---

## [LDAP Integration with Elastic Search](https://discuss.elastic.co/t/ldap-integration-with-elastic-search/207322)

<div class="topic-metadata">

**Author:** [@ksarkar](https://discuss.elastic.co/u/ksarkar)\
**Replies:** 4\
**Last updated:** [November 13, 2019, 2:03pm UTC](https://discuss.elastic.co/t/ldap-integration-with-elastic-search/207322 "2019-11-13T14:03:26Z")

</div>

I am using a trial x-pack license and configured a openLDAP in centOS env. While trying to validate a user through Kibana its just showing, \<\>{"statusCode":403,"error":"Forbidden","message":"Forbidden"}\</\> My elasticse…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1093)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1095)
