# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1882

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1883

---

## [How to generate custom score and explanation](https://discuss.elastic.co/t/how-to-generate-custom-score-and-explanation/108412)

<div class="topic-metadata">

**Author:** [@smay](https://discuss.elastic.co/u/smay)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 5:33pm UTC](https://discuss.elastic.co/t/how-to-generate-custom-score-and-explanation/108412 "2017-11-20T17:33:45Z")

</div>

Hi, i am looking for a way to generate new fields/scores on each search result and am lost whether this is possible at all: Given a document and a query i want to (re)score the documents based on parameters (for exampl…

---

## [Remove unwanted Fields From an Index Pattern](https://discuss.elastic.co/t/remove-unwanted-fields-from-an-index-pattern/108437)

<div class="topic-metadata">

**Author:** [@jamesspi](https://discuss.elastic.co/u/jamesspi)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 5:28pm UTC](https://discuss.elastic.co/t/remove-unwanted-fields-from-an-index-pattern/108437 "2017-11-20T17:28:31Z")

</div>

Hi, I am trying to remove several unwanted fields from an index pattern, as the index pattern has reaches 975 fields, most of which are garbage. I've tried deleting the pattern and recreating it, but they just appear o…

---

## [Getting error for term\_vector query](https://discuss.elastic.co/t/getting-error-for-term-vector-query/108436)

<div class="topic-metadata">

**Author:** [@jay224](https://discuss.elastic.co/u/jay224)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 5:28pm UTC](https://discuss.elastic.co/t/getting-error-for-term-vector-query/108436 "2017-11-20T17:28:04Z")

</div>

When trying to run term\_vectors query for certain document I am getting "max\_bytes\_length\_exceeded\_exception:" error. The log file is spitting following information, it is not helping with what is causing that error. Won…

---

## [Can't shrink index using Curator](https://discuss.elastic.co/t/cant-shrink-index-using-curator/106860)

<div class="topic-metadata">

**Author:** [@Alberto\_Martinez](https://discuss.elastic.co/u/Alberto_Martinez)\
**Replies:** 4\
**Last updated:** [November 20, 2017, 4:27pm UTC](https://discuss.elastic.co/t/cant-shrink-index-using-curator/106860 "2017-11-20T16:27:58Z")

</div>

Hi there, I'm trying to use Curator to remove old data from the main (ingest) data nodes to a "cold" one. I believe that the Curator Shrink action should be able help me with this. The error I'm seeing is: 2017-11-0…

---

## [Date Format : java.lang.IllegalArgumentException: Mapper exception](https://discuss.elastic.co/t/date-format-java-lang-illegalargumentexception-mapper-exception/108423)

<div class="topic-metadata">

**Author:** [@mahesh.maney](https://discuss.elastic.co/u/mahesh.maney)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 4:11pm UTC](https://discuss.elastic.co/t/date-format-java-lang-illegalargumentexception-mapper-exception/108423 "2017-11-20T16:11:10Z")

</div>

Hi, We have a date mapping as follows "createdOn": { "type": "date", "fields": { "sortable": { "type": "keyword" } }, "ignore\_malformed": true, "format": "yyyy-MM-dd HH:mm:ss||strict\_date\_optional\_time||epoch\_m…

---

## [ES Upgrade, Terms Lookup Cache Keys](https://discuss.elastic.co/t/es-upgrade-terms-lookup-cache-keys/108262)

<div class="topic-metadata">

**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 4:07pm UTC](https://discuss.elastic.co/t/es-upgrade-terms-lookup-cache-keys/108262 "2017-11-20T16:07:37Z")

</div>

C#, NEST I'm in the process of upgrading from ES 1.7.5 to ES 6.0. In my terms lookup queries I set the \_cache\_key so that I'm able to clear it when that cache is impacted by an update. I vaguely remember seeing somewh…

---

## [Custom Aggregation \[Plugin\] for Elasticsearch 5.x](https://discuss.elastic.co/t/custom-aggregation-plugin-for-elasticsearch-5-x/106567)

<div class="topic-metadata">

**Author:** [@varundbest](https://discuss.elastic.co/u/varundbest)\
**Replies:** 3\
**Last updated:** [November 20, 2017, 3:53pm UTC](https://discuss.elastic.co/t/custom-aggregation-plugin-for-elasticsearch-5-x/106567 "2017-11-20T15:53:06Z")

</div>

I'm trying to implement Weighted Avg Agg and It would be great if I could do it as a plugin, Is there any way to do so in ES 5.x? I can't seem to find any Plugins implementing Custom Aggregation logic.

---

## [Joining on Parent Child relations in Elasticsearch 6.0](https://discuss.elastic.co/t/joining-on-parent-child-relations-in-elasticsearch-6-0/108417)

<div class="topic-metadata">

**Author:** [@Aravindh\_S](https://discuss.elastic.co/u/Aravindh_S)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 3:45pm UTC](https://discuss.elastic.co/t/joining-on-parent-child-relations-in-elasticsearch-6-0/108417 "2017-11-20T15:45:48Z")

</div>

Hi, I have a question regarding how to model some data so that I can join two documents of different structure (Inside the same index differentiated by type field). My data structure is as follows: SessionCreatedEvent …

---

## [Aggregations within aggregations](https://discuss.elastic.co/t/aggregations-within-aggregations/108399)

<div class="topic-metadata">

**Author:** [@Karolinebryn](https://discuss.elastic.co/u/Karolinebryn)\
**Replies:** 9\
**Last updated:** [November 20, 2017, 2:55pm UTC](https://discuss.elastic.co/t/aggregations-within-aggregations/108399 "2017-11-20T14:55:19Z")

</div>

I have an index that contains documents about movies and the movies are tagged with their genre and main actors. Like this: { "title": "The fast and the furious", "tags": \[ { "groupName": "Genre", "tags": \[ "A…

---

## [Different count in Elastic search](https://discuss.elastic.co/t/different-count-in-elastic-search/107072)

<div class="topic-metadata">

**Author:** [@afonso.ribeiro](https://discuss.elastic.co/u/afonso.ribeiro)\
**Replies:** 2\
**Last updated:** [November 20, 2017, 2:39pm UTC](https://discuss.elastic.co/t/different-count-in-elastic-search/107072 "2017-11-20T14:39:28Z")

</div>

Hi guys, I'm counting the number of records in elasticsearch. First I count in dev tools and the result is 5303: \[image\] Then I do a cumulative sum of count aggregation in a graph (in visualize tab) and the result is…

---

## [String size limit in painless / keyword field?](https://discuss.elastic.co/t/string-size-limit-in-painless-keyword-field/108366)

<div class="topic-metadata">

**Author:** [@fhdz](https://discuss.elastic.co/u/fhdz)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 2:13pm UTC](https://discuss.elastic.co/t/string-size-limit-in-painless-keyword-field/108366 "2017-11-20T14:13:19Z")

</div>

Hi there, I am trying to perform some deduplication and sorting using "aggs" and "sort" queries. My documents contain some strings of different lengths and some of those strings are supposed to be part of the key for th…

---

## [\[ES 5.2.0\] Error: \[illegal\_argument\_exception\] Fractional absolute document frequencies are not allowed](https://discuss.elastic.co/t/es-5-2-0-error-illegal-argument-exception-fractional-absolute-document-frequencies-are-not-allowed/108397)

<div class="topic-metadata">

**Author:** [@mguillau42](https://discuss.elastic.co/u/mguillau42)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 1:51pm UTC](https://discuss.elastic.co/t/es-5-2-0-error-illegal-argument-exception-fractional-absolute-document-frequencies-are-not-allowed/108397 "2017-11-20T13:51:43Z")

</div>

Hi, We are experiencing a weird issue which prevents us and our users from using the suggest feature from elasticsearch. When I try to obtain suggestions for the text "obligation de" using the following query { "i…

---

## [NullPointerException Build.java:48](https://discuss.elastic.co/t/nullpointerexception-build-java-48/107830)

<div class="topic-metadata">

**Author:** [@dougbeasley](https://discuss.elastic.co/u/dougbeasley)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 1:48pm UTC](https://discuss.elastic.co/t/nullpointerexception-build-java-48/107830 "2017-11-20T13:48:06Z")

</div>

I'm having an issue with using the RestHighLevelClient with the maven-jetty-plugin. This NPE only manifests when running locally with mvn jetty:run I don't have this issue when packaging as a war and deploying to a con…

---

## [Xpack SSL configuartion of organization-specific certificate authority](https://discuss.elastic.co/t/xpack-ssl-configuartion-of-organization-specific-certificate-authority/106004)

<div class="topic-metadata">

**Author:** [@GabayAvi](https://discuss.elastic.co/u/GabayAvi)\
**Replies:** 6\
**Last updated:** [November 20, 2017, 1:18pm UTC](https://discuss.elastic.co/t/xpack-ssl-configuartion-of-organization-specific-certificate-authority/106004 "2017-11-20T13:18:44Z")

</div>

i created a a CSR flle with certgen --csr send the file to our organization certificate authority got ther cer file but i don't know how to configure it corrent to work in secure mode. which trusted certificated i nee…

---

## [Combining indices with same name but different content](https://discuss.elastic.co/t/combining-indices-with-same-name-but-different-content/107757)

<div class="topic-metadata">

**Author:** [@alessandro](https://discuss.elastic.co/u/alessandro)\
**Replies:** 2\
**Last updated:** [November 20, 2017, 9:54am UTC](https://discuss.elastic.co/t/combining-indices-with-same-name-but-different-content/107757 "2017-11-20T09:54:30Z")

</div>

Good afternoon, I would like to ask a question regarding a situation that we will face soon in our production environment. We are moving our Elastic Stack from one server to another and, for some reasons we need to hav…

---

## [Min, max aggregations on date type fields](https://discuss.elastic.co/t/min-max-aggregations-on-date-type-fields/108380)

<div class="topic-metadata">

**Author:** [@nugusbayevkk](https://discuss.elastic.co/u/nugusbayevkk)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 12:37pm UTC](https://discuss.elastic.co/t/min-max-aggregations-on-date-type-fields/108380 "2017-11-20T12:37:07Z")

</div>

hello guys, i notice that in current version don't work min, max aggregations on "date" type fields. i try to execute var params = { body: { size: 0, query: { bool: { must: \[ { range: { 'event\_date': qrange …

---

## [Modelling data with Joins in Elasticsearch](https://discuss.elastic.co/t/modelling-data-with-joins-in-elasticsearch/108378)

<div class="topic-metadata">

**Author:** [@kartik\_jain](https://discuss.elastic.co/u/kartik_jain)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 12:25pm UTC](https://discuss.elastic.co/t/modelling-data-with-joins-in-elasticsearch/108378 "2017-11-20T12:25:19Z")

</div>

I indent to transfer data from a RDBMS source to elasticsearch and perform various aggregation queries on it. For this purpose, I need to perform some joins on the data. I was looking into parent-child relationships. I …

---

## [How to index my eCommerce website](https://discuss.elastic.co/t/how-to-index-my-ecommerce-website/107948)

<div class="topic-metadata">

**Author:** [@saurabhbhatt](https://discuss.elastic.co/u/saurabhbhatt)\
**Replies:** 3\
**Last updated:** [November 20, 2017, 11:25am UTC](https://discuss.elastic.co/t/how-to-index-my-ecommerce-website/107948 "2017-11-20T11:25:33Z")

</div>

My Requirement: I am using .NET C# for coding preference using Visual Studio 2017 and working to integrate Elasticsearch with my eCommerce website so that my website users can easily search my website. My Current Unders…

---

## [Setting Up a Cluster](https://discuss.elastic.co/t/setting-up-a-cluster/108362)

<div class="topic-metadata">

**Author:** [@devil\_srj7](https://discuss.elastic.co/u/devil_srj7)\
**Replies:** 3\
**Last updated:** [November 20, 2017, 11:03am UTC](https://discuss.elastic.co/t/setting-up-a-cluster/108362 "2017-11-20T11:03:31Z")

</div>

Could anyone help in setting up a cluster in ES.

---

## [Issue with ElasticStack 6.0.0 and Certs](https://discuss.elastic.co/t/issue-with-elasticstack-6-0-0-and-certs/107981)

<div class="topic-metadata">

**Author:** [@ggonzalo](https://discuss.elastic.co/u/ggonzalo)\
**Replies:** 0\
**Last updated:** [November 16, 2017, 4:14pm UTC](https://discuss.elastic.co/t/issue-with-elasticstack-6-0-0-and-certs/107981 "2017-11-16T16:14:20Z")

</div>

Hi there! SOLVED

---

## [ElasticSearch - Java Connectivity](https://discuss.elastic.co/t/elasticsearch-java-connectivity/107907)

<div class="topic-metadata">

**Author:** [@devil\_srj7](https://discuss.elastic.co/u/devil_srj7)\
**Replies:** 13\
**Last updated:** [November 20, 2017, 10:28am UTC](https://discuss.elastic.co/t/elasticsearch-java-connectivity/107907 "2017-11-20T10:28:22Z")

</div>

Could anyone help us establish elasticsearch-java connectivity through REST api. It would be of great help if you provide a tutorial from basic.

---

## [What is the best (and easiest) way to insert Elasticsearch into a website?](https://discuss.elastic.co/t/what-is-the-best-and-easiest-way-to-insert-elasticsearch-into-a-website/108329)

<div class="topic-metadata">

**Author:** [@Liron1379](https://discuss.elastic.co/u/Liron1379)\
**Replies:** 3\
**Last updated:** [November 20, 2017, 10:25am UTC](https://discuss.elastic.co/t/what-is-the-best-and-easiest-way-to-insert-elasticsearch-into-a-website/108329 "2017-11-20T10:25:26Z")

</div>

Hi there! I'm writing a website in HTML and C#, in an offline environment (no global internet, on a private network). I'm struggling with inserting and using Elasticsearch from the website code. I've searched for tuto…

---

## [Bucket script fails when some docs are missing](https://discuss.elastic.co/t/bucket-script-fails-when-some-docs-are-missing/107592)

<div class="topic-metadata">

**Author:** [@shaharmor](https://discuss.elastic.co/u/shaharmor)\
**Replies:** 9\
**Last updated:** [November 20, 2017, 10:09am UTC](https://discuss.elastic.co/t/bucket-script-fails-when-some-docs-are-missing/107592 "2017-11-20T10:09:59Z")

</div>

Elasticsearch version (bin/elasticsearch --version): 6.0.0-rc1 JVM version (java -version): java version "1.8.0\_151" Java(TM) SE Runtime Environment (build 1.8.0\_151-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.1…

---

## [Upgrade directly from 5.1.2 to 6.0.0?](https://discuss.elastic.co/t/upgrade-directly-from-5-1-2-to-6-0-0/108353)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 2\
**Last updated:** [November 20, 2017, 9:58am UTC](https://discuss.elastic.co/t/upgrade-directly-from-5-1-2-to-6-0-0/108353 "2017-11-20T09:58:28Z")

</div>

Hi, We are currently running a single instance of version 5.1.2 of elastic stack (ES, LS, Kibana, filebeat, metricbeat). Is it save to upgrade directly 5.1.2 to 6.0.0? Or do I need to go via 5.latest? Migrating kibana…

---

## [X-Pack Audit Trail logs cannot further specified](https://discuss.elastic.co/t/x-pack-audit-trail-logs-cannot-further-specified/108351)

<div class="topic-metadata">

**Author:** [@fluency03](https://discuss.elastic.co/u/fluency03)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 9:23am UTC](https://discuss.elastic.co/t/x-pack-audit-trail-logs-cannot-further-specified/108351 "2017-11-20T09:23:05Z")

</div>

Describe the feature: When we enable X-Pack's Audit Trail as following: xpack.security.audit: enabled: true outputs: \[index, logfile\] What we would like to monitor are mainly two things; the login actions the ac…

---

## [Modelling Social search to work at scale](https://discuss.elastic.co/t/modelling-social-search-to-work-at-scale/108239)

<div class="topic-metadata">

**Author:** [@jalaj](https://discuss.elastic.co/u/jalaj)\
**Replies:** 1\
**Last updated:** [November 20, 2017, 9:22am UTC](https://discuss.elastic.co/t/modelling-social-search-to-work-at-scale/108239 "2017-11-20T09:22:23Z")

</div>

The question is more inclined towards how to model my data to satisfy all kind of queries at scale. I am trying to model search with Social factor to be in consideration . Example use-case:- 1 - A user can post a stat…

---

## [How should I manage x-pack users with Java?](https://discuss.elastic.co/t/how-should-i-manage-x-pack-users-with-java/108347)

<div class="topic-metadata">

**Author:** [@Sai\_Zin](https://discuss.elastic.co/u/Sai_Zin)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 9:17am UTC](https://discuss.elastic.co/t/how-should-i-manage-x-pack-users-with-java/108347 "2017-11-20T09:17:22Z")

</div>

I would like to manage CRUD for x-pack user. That's why which will be suitable to use. TransportClient or SecurityClient ? I would like to know the writing way and detail implementation way for it. Is anyone have a re…

---

## [Elastic runs into erratic JVM heap use](https://discuss.elastic.co/t/elastic-runs-into-erratic-jvm-heap-use/108345)

<div class="topic-metadata">

**Author:** [@raldo](https://discuss.elastic.co/u/raldo)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 9:06am UTC](https://discuss.elastic.co/t/elastic-runs-into-erratic-jvm-heap-use/108345 "2017-11-20T09:06:17Z")

</div>

We are using Elastic 5.6.3, 3 nodes with 64gb mem (2 physical and one VM on CentOS) and .net core services which query and write to index. Our platform is a classifieds site with many search facets; we are using Datadog…

---

## [ES 6.0.0GA is listed as a DOWNGRADE to 6.0.0-preGA](https://discuss.elastic.co/t/es-6-0-0ga-is-listed-as-a-downgrade-to-6-0-0-prega/108334)

<div class="topic-metadata">

**Author:** [@shaharmor](https://discuss.elastic.co/u/shaharmor)\
**Replies:** 0\
**Last updated:** [November 20, 2017, 8:01am UTC](https://discuss.elastic.co/t/es-6-0-0ga-is-listed-as-a-downgrade-to-6-0-0-prega/108334 "2017-11-20T08:01:52Z")

</div>

Hi, In the apt-get repositories of ES, if you had a pre-GA version installed and you want to upgrade, adding the 6.x GA repository and running apt-get update && apt-get dist-upgrade will not work because 6.0.0 will be …

---

## [Issue with NEST SniffingConnectionPool + TLS](https://discuss.elastic.co/t/issue-with-nest-sniffingconnectionpool-tls/106444)

<div class="topic-metadata">

**Author:** [@Illidan](https://discuss.elastic.co/u/Illidan)\
**Replies:** 5\
**Last updated:** [November 20, 2017, 7:01am UTC](https://discuss.elastic.co/t/issue-with-nest-sniffingconnectionpool-tls/106444 "2017-11-20T07:01:41Z")

</div>

Trying to establish connection to my ES cluster over TLS. When I using SniffingConnectionPool, I getting the following exception: "The handshake failed due to an unexpected packet format." Trying to connect without it …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1881)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1883)
