# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1706

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1707

---

## [Accessing number of matching document inside a script](https://discuss.elastic.co/t/accessing-number-of-matching-document-inside-a-script/129238)

<div class="topic-metadata">

**Author:** [@vincent.arnaud90](https://discuss.elastic.co/u/vincent.arnaud90)\
**Replies:** 1\
**Last updated:** [April 27, 2018, 9:39am UTC](https://discuss.elastic.co/t/accessing-number-of-matching-document-inside-a-script/129238 "2018-04-27T09:39:58Z")

</div>

Hi, I developped a custom plugin to modify the scores, according to some internal criteria, of documents matching a user query. My problem is : the function that modifies the score is very expensive and I do not want t…

---

## [Inaccurate sum aggregation results](https://discuss.elastic.co/t/inaccurate-sum-aggregation-results/128997)

<div class="topic-metadata">

**Author:** [@shushu](https://discuss.elastic.co/u/shushu)\
**Replies:** 1\
**Last updated:** [April 27, 2018, 9:37am UTC](https://discuss.elastic.co/t/inaccurate-sum-aggregation-results/128997 "2018-04-27T09:37:25Z")

</div>

Hi all, I index lots of documents in batch mode, indexing ~50M docs. Since it took too long (200K/hour) while running on a 5 data nodes cluster, I enlarged the cluster with 2 more data nodes. I was watching while the d…

---

## [ElasticSearch Service Failure status=78/n/a](https://discuss.elastic.co/t/elasticsearch-service-failure-status-78-n-a/129461)

<div class="topic-metadata">

**Author:** [@thompsonlau](https://discuss.elastic.co/u/thompsonlau)\
**Replies:** 17\
**Last updated:** [April 27, 2018, 8:37am UTC](https://discuss.elastic.co/t/elasticsearch-service-failure-status-78-n-a/129461 "2018-04-27T08:37:03Z")

</div>

I have installed ElasticSearch v6.2.4 on CentOS 7.0 I have done all necessary configurations. When I run it, I got the following messages in system. Apr 25 18:24:18 QVELKSRH01 systemd\[1\]: elasticsearch.service: main pr…

---

## [Three ES nodes in one VM with docker (works)](https://discuss.elastic.co/t/three-es-nodes-in-one-vm-with-docker-works/129665)

<div class="topic-metadata">

**Author:** [@TheAnonymousModeIT](https://discuss.elastic.co/u/TheAnonymousModeIT)\
**Replies:** 2\
**Last updated:** [April 27, 2018, 8:12am UTC](https://discuss.elastic.co/t/three-es-nodes-in-one-vm-with-docker-works/129665 "2018-04-27T08:12:00Z")

</div>

Hello, I would like to setup a development and learn environment. One Virtual machine with linux and docker: elastic search instance 1 elastic search instance 2 elastic search instance 3 EDIT: I had a typo in my ini…

---

## [Array intersection metric](https://discuss.elastic.co/t/array-intersection-metric/127117)

<div class="topic-metadata">

**Author:** [@alepuccetti](https://discuss.elastic.co/u/alepuccetti)\
**Replies:** 5\
**Last updated:** [April 27, 2018, 7:57am UTC](https://discuss.elastic.co/t/array-intersection-metric/127117 "2018-04-27T07:57:32Z")

</div>

Hi everyone, I use a filter query to select document only match certain ids in a lit. I would like to get back as metric the number of ids that matched that document but if I use cardinality aggregation I get the cardin…

---

## [Stopwords in kibana](https://discuss.elastic.co/t/stopwords-in-kibana/129620)

<div class="topic-metadata">

**Author:** [@aarthinim](https://discuss.elastic.co/u/aarthinim)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 9:06am UTC](https://discuss.elastic.co/t/stopwords-in-kibana/129620 "2018-04-26T09:06:19Z")

</div>

In kibana stopwords is not working . PUT /samp1/\_settings { "analysis": { "analyzer": { "custname": { "type": "stop", "stopwords": \[ "and", "the","." ,"on","dog"\] } } } } This is my s…

---

## [Sort results by "is item in array"](https://discuss.elastic.co/t/sort-results-by-is-item-in-array/129278)

<div class="topic-metadata">

**Author:** [@mattfletcher](https://discuss.elastic.co/u/mattfletcher)\
**Replies:** 0\
**Last updated:** [April 24, 2018, 9:52am UTC](https://discuss.elastic.co/t/sort-results-by-is-item-in-array/129278 "2018-04-24T09:52:17Z")

</div>

I have a data set which includes within each document an array of user IDs that have marked the document as a "preferred" one. I want to be able to sort my documents such that these preferred documents are shown first, b…

---

## [Bug report X-Pack: Watcher email action uses the same \`Message-ID\` if multiple mail actions are used](https://discuss.elastic.co/t/bug-report-x-pack-watcher-email-action-uses-the-same-message-id-if-multiple-mail-actions-are-used/128399)

<div class="topic-metadata">

**Author:** [@ypid-geberit](https://discuss.elastic.co/u/ypid-geberit)\
**Replies:** 2\
**Last updated:** [April 27, 2018, 7:10am UTC](https://discuss.elastic.co/t/bug-report-x-pack-watcher-email-action-uses-the-same-message-id-if-multiple-mail-actions-are-used/128399 "2018-04-27T07:10:24Z")

</div>

Elasticsearch version (bin/elasticsearch --version): Version: 5.5.1, Build: 19c13d0/2017-07-18T20:44:24.823Z, JVM: 1.8.0\_151 Plugins installed: repository-azure, x-pack JVM version (java -version): openjdk version "1.…

---

## [Elasticsearch Rest Client throws java.lang.ArrayStoreException](https://discuss.elastic.co/t/elasticsearch-rest-client-throws-java-lang-arraystoreexception/128371)

<div class="topic-metadata">

**Author:** [@arony](https://discuss.elastic.co/u/arony)\
**Replies:** 10\
**Last updated:** [April 27, 2018, 7:04am UTC](https://discuss.elastic.co/t/elasticsearch-rest-client-throws-java-lang-arraystoreexception/128371 "2018-04-27T07:04:41Z")

</div>

Hello I am using Elasticsearch Rest Client v5.5.3 and it throws java.lang.ArrayStoreException after a while application start. The application which uses Elasticsearch rest client executes queries intensively. Would it …

---

## [\[Elasticsearch NEST\] Unable to define language for collate queries](https://discuss.elastic.co/t/elasticsearch-nest-unable-to-define-language-for-collate-queries/129773)

<div class="topic-metadata">

**Author:** [@ishim](https://discuss.elastic.co/u/ishim)\
**Replies:** 0\
**Last updated:** [April 27, 2018, 6:43am UTC](https://discuss.elastic.co/t/elasticsearch-nest-unable-to-define-language-for-collate-queries/129773 "2018-04-27T06:43:09Z")

</div>

I'm using NEST/ElasticSearch 5.4 and I am trying to write a NEST object which uses collate. Basically i want to have json something like this: "collate": { "query": { "lang" : "my\_own\_language", …

---

## [Question for completion suggester score](https://discuss.elastic.co/t/question-for-completion-suggester-score/129772)

<div class="topic-metadata">

**Author:** [@Andy\_Zhou](https://discuss.elastic.co/u/Andy_Zhou)\
**Replies:** 0\
**Last updated:** [April 27, 2018, 6:36am UTC](https://discuss.elastic.co/t/question-for-completion-suggester-score/129772 "2018-04-27T06:36:31Z")

</div>

I am trying to understand how the score works for completion suggester. When I tested with the prefix search, the score always returns 1.0. Below is my testing: 1): Create one index with suggest field: PUT testidx { …

---

## [Nested Mapping - Array of objects](https://discuss.elastic.co/t/nested-mapping-array-of-objects/129650)

<div class="topic-metadata">

**Author:** [@satkumvnr](https://discuss.elastic.co/u/satkumvnr)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 11:36am UTC](https://discuss.elastic.co/t/nested-mapping-array-of-objects/129650 "2018-04-26T11:36:09Z")

</div>

HI, I am have sample document provided below. Pls assist, how to perform nested mapping, { "Token": null, "LoginStamp": "4/18/2018 5:34:55 AM", "Uri": null, "Events": \[{ "Source": "Microsoft1", "EventType": "A…

---

## [Repository-s3 bucket sub-folder for snapshots](https://discuss.elastic.co/t/repository-s3-bucket-sub-folder-for-snapshots/129754)

<div class="topic-metadata">

**Author:** [@the.tyler.farr](https://discuss.elastic.co/u/the.tyler.farr)\
**Replies:** 2\
**Last updated:** [April 27, 2018, 3:06am UTC](https://discuss.elastic.co/t/repository-s3-bucket-sub-folder-for-snapshots/129754 "2018-04-27T03:06:22Z")

</div>

Is it possible to tell Elasticsearch to snapshot an index into a sub-folder of an s3 bucket? Or, is the only way to logically separate different indices to create separate s3 buckets for each grouping/type of index?

---

## [Docker image tags removed without notice](https://discuss.elastic.co/t/docker-image-tags-removed-without-notice/129177)

<div class="topic-metadata">

**Author:** [@thernstig](https://discuss.elastic.co/u/thernstig)\
**Replies:** 0\
**Last updated:** [April 23, 2018, 8:17pm UTC](https://discuss.elastic.co/t/docker-image-tags-removed-without-notice/129177 "2018-04-23T20:17:57Z")

</div>

I was happily coding away last week, using the official docker images from https://www.docker.elastic.co/ I was using docker.elastic.co/elasticsearch/elasticsearch:6.2.3 but when I went back this week, it was gone! Only…

---

## [SSL Communication](https://discuss.elastic.co/t/ssl-communication/129440)

<div class="topic-metadata">

**Author:** [@Rahul\_Pm](https://discuss.elastic.co/u/Rahul_Pm)\
**Replies:** 1\
**Last updated:** [April 26, 2018, 8:45pm UTC](https://discuss.elastic.co/t/ssl-communication/129440 "2018-04-26T20:45:17Z")

</div>

Hi, I'm trying to secure communication between Logstash and Filebeat using SSL (windows). After installing X-pack there is no data flowing in. Also there is no logs in the filebeat folder despite manually creating File…

---

## [RestFilter, RestFilterChain, RestController changes after 5.1.2](https://discuss.elastic.co/t/restfilter-restfilterchain-restcontroller-changes-after-5-1-2/129706)

<div class="topic-metadata">

**Author:** [@arul\_since1975](https://discuss.elastic.co/u/arul_since1975)\
**Replies:** 1\
**Last updated:** [April 26, 2018, 7:56pm UTC](https://discuss.elastic.co/t/restfilter-restfilterchain-restcontroller-changes-after-5-1-2/129706 "2018-04-26T19:56:10Z")

</div>

Hi, I am in the process upgrading my plugin to ElasticSearch 5.6.8 from ElasticSearch 5.1.2. From ES 5.2 onwards, The classes RestFilter and RestFilterChain has been removed from ElasticSearch API. My Current code goe…

---

## [Slow writing to Elasticsearch](https://discuss.elastic.co/t/slow-writing-to-elasticsearch/129707)

<div class="topic-metadata">

**Author:** [@mikhail\_mironov](https://discuss.elastic.co/u/mikhail_mironov)\
**Replies:** 1\
**Last updated:** [April 26, 2018, 7:44pm UTC](https://discuss.elastic.co/t/slow-writing-to-elasticsearch/129707 "2018-04-26T19:44:58Z")

</div>

Dear community, I have a problem with slow writing to Elasticsearch from Logstash. I need to write 100K rows per second, but I get ~25K rows per second maximum. Please help me to find a bottleneck. Servers. I have two…

---

## [Upsert nested fields with Spark](https://discuss.elastic.co/t/upsert-nested-fields-with-spark/128813)

<div class="topic-metadata">

**Author:** [@cluengo](https://discuss.elastic.co/u/cluengo)\
**Replies:** 6\
**Last updated:** [April 26, 2018, 7:27pm UTC](https://discuss.elastic.co/t/upsert-nested-fields-with-spark/128813 "2018-04-26T19:27:51Z")

</div>

I'm trying to update a nested field using Spark and a scripted update. The code I'm using is: update\_params = "new\_samples: samples" update\_script = "ctx.\_source.samples += new\_samples" es\_conf = { "es.mapping.id": "…

---

## [Analyzers not started in a cluster environment after re-indexing all documents?](https://discuss.elastic.co/t/analyzers-not-started-in-a-cluster-environment-after-re-indexing-all-documents/129733)

<div class="topic-metadata">

**Author:** [@Vishnu\_S\_Kumar](https://discuss.elastic.co/u/Vishnu_S_Kumar)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 6:33pm UTC](https://discuss.elastic.co/t/analyzers-not-started-in-a-cluster-environment-after-re-indexing-all-documents/129733 "2018-04-26T18:33:42Z")

</div>

We added new analyzers and done a full re-index on the local machine and it started. But when we deployed it in a clustered environment it didn't start after re-indexing. It only started once we delete the index and re-c…

---

## [ES 5.6.8 is consuming huge amount of RAM](https://discuss.elastic.co/t/es-5-6-8-is-consuming-huge-amount-of-ram/129729)

<div class="topic-metadata">

**Author:** [@andrescampos](https://discuss.elastic.co/u/andrescampos)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 5:43pm UTC](https://discuss.elastic.co/t/es-5-6-8-is-consuming-huge-amount-of-ram/129729 "2018-04-26T17:43:36Z")

</div>

Hi, we are implementing ES in Magento 2.2.2 and we are facing an infrastructure issue. What we are seeing is that ES 5.6.8 uses more memory than ES 2.4.6 (a huge more than 2.4.6). Basically 5.6.8 takes 2.5gb RAM just f…

---

## [What is this nesting in my mapping and what is its purpose?](https://discuss.elastic.co/t/what-is-this-nesting-in-my-mapping-and-what-is-its-purpose/129565)

<div class="topic-metadata">

**Author:** [@David9](https://discuss.elastic.co/u/David9)\
**Replies:** 3\
**Last updated:** [April 26, 2018, 4:50pm UTC](https://discuss.elastic.co/t/what-is-this-nesting-in-my-mapping-and-what-is-its-purpose/129565 "2018-04-26T16:50:25Z")

</div>

Looking at my mappings I'm often seeing something like this. I expect to see a flat country\_iso\_code having type text, but what is the keyword field? I don't see this in the raw data, I just see a country code value. …

---

## [Type Mapping Changed from geo\_point to floats](https://discuss.elastic.co/t/type-mapping-changed-from-geo-point-to-floats/129570)

<div class="topic-metadata">

**Author:** [@riebo](https://discuss.elastic.co/u/riebo)\
**Replies:** 3\
**Last updated:** [April 26, 2018, 4:41pm UTC](https://discuss.elastic.co/t/type-mapping-changed-from-geo-point-to-floats/129570 "2018-04-26T16:41:04Z")

</div>

Somehow a type mapping for my index automatically changed from geo\_point to float properties representing lat, lon. Using ES 6. No reindex operation was performed, but the type somehow got changed. Is there any way to…

---

## [HTTP Request and Find a way in JAVA SCRIPT to get CONTENT from Kibana](https://discuss.elastic.co/t/http-request-and-find-a-way-in-java-script-to-get-content-from-kibana/129717)

<div class="topic-metadata">

**Author:** [@Mas](https://discuss.elastic.co/u/Mas)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 3:41pm UTC](https://discuss.elastic.co/t/http-request-and-find-a-way-in-java-script-to-get-content-from-kibana/129717 "2018-04-26T15:41:37Z")

</div>

I need to use an HTTP Request and Find a way in JAVA SCRIPTt to get CONTENT from Kibana I need and want almost this similar thing: var my\_content\_from\_file = file\_content(ext + file\_name) out(my\_content\_from\_file) //I…

---

## [Json import error on elasticsearch with curl command](https://discuss.elastic.co/t/json-import-error-on-elasticsearch-with-curl-command/129668)

<div class="topic-metadata">

**Author:** [@Enonimous8](https://discuss.elastic.co/u/Enonimous8)\
**Replies:** 7\
**Last updated:** [April 26, 2018, 3:42pm UTC](https://discuss.elastic.co/t/json-import-error-on-elasticsearch-with-curl-command/129668 "2018-04-26T15:42:49Z")

</div>

Hi, I have a problem when load a json file on elasticsearch with curl command. The json file is this: https://drive.google.com/file/d/13nCXdIY1n096SSWcL36TEtqkGTVhn28o/view?usp=sharing When I launch this command: cur…

---

## [Combine bool with nested query](https://discuss.elastic.co/t/combine-bool-with-nested-query/129445)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 2\
**Last updated:** [April 26, 2018, 3:14pm UTC](https://discuss.elastic.co/t/combine-bool-with-nested-query/129445 "2018-04-26T15:14:52Z")

</div>

I am sending the following request: { "query": { "bool": { "must": \[{ "terms": { "name": \["test"\] } }, { "terms": { "tags": \["java", "php"\] } }, { "nested ": { "path": "fi…

---

## [Doc that explicitly exists in the Index comes second when searched](https://discuss.elastic.co/t/doc-that-explicitly-exists-in-the-index-comes-second-when-searched/129708)

<div class="topic-metadata">

**Author:** [@agertsovich](https://discuss.elastic.co/u/agertsovich)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 3:14pm UTC](https://discuss.elastic.co/t/doc-that-explicitly-exists-in-the-index-comes-second-when-searched/129708 "2018-04-26T15:14:03Z")

</div>

Hi team. Im new to ES. My index has 19K documents spread over 2 fields: 'banner' and 'id'. And what sometimes happens is that when i search for a banner that explicitly exists (as-in-search) in the index it only comes in…

---

## [.monitoring\* indices do not exist](https://discuss.elastic.co/t/monitoring-indices-do-not-exist/129656)

<div class="topic-metadata">

**Author:** [@bobby259](https://discuss.elastic.co/u/bobby259)\
**Replies:** 2\
**Last updated:** [April 26, 2018, 2:08pm UTC](https://discuss.elastic.co/t/monitoring-indices-do-not-exist/129656 "2018-04-26T14:08:11Z")

</div>

On our new 6.2 cluster, I configured x-pack and in monitoring (on kibana) I see "No Monitoring Data Found". When I look back into the indices, GET /\_cat/indices?v health status index uuid …

---

## [Access processor information (name/fields)](https://discuss.elastic.co/t/access-processor-information-name-fields/129692)

<div class="topic-metadata">

**Author:** [@sdeck51](https://discuss.elastic.co/u/sdeck51)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 2:02pm UTC](https://discuss.elastic.co/t/access-processor-information-name-fields/129692 "2018-04-26T14:02:06Z")

</div>

I'm trying to figure out if there's a way to get information on the available processors in an ingest node. I know I can give the following command to get a list of processor names... GET /\_nodes/ingest but I'm interes…

---

## [Not able to create index logstash-\* in elasticsearch 6.2.2](https://discuss.elastic.co/t/not-able-to-create-index-logstash-in-elasticsearch-6-2-2/129627)

<div class="topic-metadata">

**Author:** [@Rajshree\_Shome](https://discuss.elastic.co/u/Rajshree_Shome)\
**Replies:** 19\
**Last updated:** [April 26, 2018, 1:54pm UTC](https://discuss.elastic.co/t/not-able-to-create-index-logstash-in-elasticsearch-6-2-2/129627 "2018-04-26T13:54:01Z")

</div>

I have re insatlled elasticsearch 6.2.2 and now i am not able to create index for logstash-\*. GET \_cluster/health { "cluster\_name": "Development", "status": "red", "timed\_out": false, "number\_of\_nodes": 3, "number…

---

## [Elastic Cluster on aws](https://discuss.elastic.co/t/elastic-cluster-on-aws/129683)

<div class="topic-metadata">

**Author:** [@astrobounce](https://discuss.elastic.co/u/astrobounce)\
**Replies:** 0\
**Last updated:** [April 26, 2018, 1:28pm UTC](https://discuss.elastic.co/t/elastic-cluster-on-aws/129683 "2018-04-26T13:28:09Z")

</div>

Hello team , I had been running Elastic cluster on traditional VM's with following architecture . 3 master Nodes 3 Client Nodes 5 Hot Data Nodes and 3 Warm Data nodes ( Implemented Hot warm architecture from elasti…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1705)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1707)
