# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1562

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1563

---

## [ES unable to allocate Primary and corresponding Secondary shards after node re-joins cluster](https://discuss.elastic.co/t/es-unable-to-allocate-primary-and-corresponding-secondary-shards-after-node-re-joins-cluster/146913)

<div class="topic-metadata">

**Author:** [@UDixit](https://discuss.elastic.co/u/UDixit)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 8:07pm UTC](https://discuss.elastic.co/t/es-unable-to-allocate-primary-and-corresponding-secondary-shards-after-node-re-joins-cluster/146913 "2018-08-31T20:07:09Z")

</div>

Following was the sequence of Events: node cluster(node= N-1) ( node itself was master)5 indexes : 12 shard each (total 60 shards) Scale up the cluster and add 2 replicas(N-2 and N-3)Replicas have initialized but the #…

---

## [ES Unassigned shards number of allocated shards found \< required number](https://discuss.elastic.co/t/es-unassigned-shards-number-of-allocated-shards-found-required-number/146912)

<div class="topic-metadata">

**Author:** [@UDixit](https://discuss.elastic.co/u/UDixit)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 8:06pm UTC](https://discuss.elastic.co/t/es-unassigned-shards-number-of-allocated-shards-found-required-number/146912 "2018-08-31T20:06:15Z")

</div>

In a 3 node cluster (all nodes being master eligible), the master left the cluster and then rejoined after an hour. Soon, all primary and secondary shards(shard 9) became unassigned for an index. I am also seeing the fo…

---

## [\[ERROR\] timed out when collecting data](https://discuss.elastic.co/t/error-timed-out-when-collecting-data/146908)

<div class="topic-metadata">

**Author:** [@msina](https://discuss.elastic.co/u/msina)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 7:06pm UTC](https://discuss.elastic.co/t/error-timed-out-when-collecting-data/146908 "2018-08-31T19:06:55Z")

</div>

Hi , version: 6.3.0 We have installed trial version of ELK and it was working fine but recently we observed below error in ELK nodes and no data is showing in kibana dashboard. In elk-master-node we are getting below …

---

## [Elasticsearch 6.3: X-Pack and remote connection doesn't work](https://discuss.elastic.co/t/elasticsearch-6-3-x-pack-and-remote-connection-doesnt-work/136618)

<div class="topic-metadata">

**Author:** [@cmenendez](https://discuss.elastic.co/u/cmenendez)\
**Replies:** 17\
**Last updated:** [August 14, 2018, 5:22pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-x-pack-and-remote-connection-doesnt-work/136618 "2018-08-14T17:22:56Z")

</div>

Hi, I'm trying to install Elasticsearch 6.3 in my PC. The first problem I find is when I want to set an user and a password. I follow the documentation and use bin/elasticsearch-setup-passwords interactive but the r…

---

## [Xpack defaults, beats\_system authentication error](https://discuss.elastic.co/t/xpack-defaults-beats-system-authentication-error/146870)

<div class="topic-metadata">

**Author:** [@Ryan\_Downey](https://discuss.elastic.co/u/Ryan_Downey)\
**Replies:** 3\
**Last updated:** [August 31, 2018, 6:54pm UTC](https://discuss.elastic.co/t/xpack-defaults-beats-system-authentication-error/146870 "2018-08-31T18:54:01Z")

</div>

We are running Elasticsearch 6.3.2 on our system and xpack.security.enabled is set to true on only the elastic nodes within our system. I have also ran the bin/elasticsearch-setup-passwords interactive setup on all thre…

---

## [High Level Rest Snapshot Creation Error](https://discuss.elastic.co/t/high-level-rest-snapshot-creation-error/146902)

<div class="topic-metadata">

**Author:** [@questar](https://discuss.elastic.co/u/questar)\
**Replies:** 1\
**Last updated:** [August 31, 2018, 6:27pm UTC](https://discuss.elastic.co/t/high-level-rest-snapshot-creation-error/146902 "2018-08-31T18:27:57Z")

</div>

CreateSnapshotRequest request = new CreateSnapshotRequest(); request.repository(repositoryName); request.snapshot(snapshotName); request.partial(false); request.waitForCompletion(true); CreateSnapshotResponse respon…

---

## [Context Suggestion query, but allow middle-text searching?](https://discuss.elastic.co/t/context-suggestion-query-but-allow-middle-text-searching/146773)

<div class="topic-metadata">

**Author:** [@RedactedProfile](https://discuss.elastic.co/u/RedactedProfile)\
**Replies:** 1\
**Last updated:** [August 31, 2018, 5:28pm UTC](https://discuss.elastic.co/t/context-suggestion-query-but-allow-middle-text-searching/146773 "2018-08-31T17:28:16Z")

</div>

Hi there, I'm trying to implement an auto-complete type-ahead search feature onto a documentation style website. I love the speed of the suggestions, and this is definitely the feature I want to use, but, the problem i…

---

## [Custom score on the basis of a field value(colon separated) and boosting factor in ES 6.2.4](https://discuss.elastic.co/t/custom-score-on-the-basis-of-a-field-value-colon-separated-and-boosting-factor-in-es-6-2-4/144888)

<div class="topic-metadata">

**Author:** [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Replies:** 1\
**Last updated:** [August 31, 2018, 4:05pm UTC](https://discuss.elastic.co/t/custom-score-on-the-basis-of-a-field-value-colon-separated-and-boosting-factor-in-es-6-2-4/144888 "2018-08-31T16:05:37Z")

</div>

custom score on the basis of a field value(colon separated) and booting factor e.g I have a indexed a field as scorevector : "Lucene:1.3 Hadoop:4.3 Elastic:6.8 Lucene:7.2" I would like to search the index as my\_inde…

---

## [How to register Custom Query Parser Plugin in ES 6.2.4](https://discuss.elastic.co/t/how-to-register-custom-query-parser-plugin-in-es-6-2-4/143361)

<div class="topic-metadata">

**Author:** [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Replies:** 2\
**Last updated:** [August 31, 2018, 3:29pm UTC](https://discuss.elastic.co/t/how-to-register-custom-query-parser-plugin-in-es-6-2-4/143361 "2018-08-31T15:29:17Z")

</div>

Hello, I am using Elasticsearch 6.2.4. I am trying to create the Custom Query Parser Plugin. I saw the mesage under https://discuss.elastic.co/t/custom-query-parser-possible from May, 2011. I have created my custom q…

---

## [Different alerts for different hosts](https://discuss.elastic.co/t/different-alerts-for-different-hosts/146869)

<div class="topic-metadata">

**Author:** [@annk](https://discuss.elastic.co/u/annk)\
**Replies:** 2\
**Last updated:** [August 31, 2018, 2:43pm UTC](https://discuss.elastic.co/t/different-alerts-for-different-hosts/146869 "2018-08-31T14:43:39Z")

</div>

Hi, I am using watcher to raise alerts to an alerting system. I am wondering if it is possible to have the Action block execute multiple times ? I want to be able to generate the individual alerts (webhook action) for t…

---

## [X-pack chain input with condition](https://discuss.elastic.co/t/x-pack-chain-input-with-condition/146871)

<div class="topic-metadata">

**Author:** [@krishna\_chaitanya](https://discuss.elastic.co/u/krishna_chaitanya)\
**Replies:** 2\
**Last updated:** [August 31, 2018, 2:26pm UTC](https://discuss.elastic.co/t/x-pack-chain-input-with-condition/146871 "2018-08-31T14:26:31Z")

</div>

I have chained input like this: "input": { "chain" : { "inputs" : \[{ "input\_http" : { "http" : { "request" : { "url" : "http://localhost:8080/list" }…

---

## [Elastic Cluster planning - hardware](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857)

<div class="topic-metadata">

**Author:** [@varunarathinam](https://discuss.elastic.co/u/varunarathinam)\
**Replies:** 3\
**Last updated:** [August 31, 2018, 12:54pm UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857 "2018-08-31T12:54:28Z")

</div>

Hi, Here we plan to create cluster of elk. Our current sceranio is; Daily data size would be 500 GB; Monthly around 15TB Data are generated and pushed to index. we need cluster of nodes and hardware requirements for…

---

## [Elasticsearch Error Exception](https://discuss.elastic.co/t/elasticsearch-error-exception/146825)

<div class="topic-metadata">

**Author:** [@Ghulam\_Akbar](https://discuss.elastic.co/u/Ghulam_Akbar)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 8:00am UTC](https://discuss.elastic.co/t/elasticsearch-error-exception/146825 "2018-08-31T08:00:12Z")

</div>

Hi, These are the version of ElasticSearch & Logstash we are using: Elasticsearch 2.3.1 Logstash 2.3.4 We got the following error in our application: Message: script\_exception: failed to compile groovy script File:…

---

## [How to use multiple fields in exists query in Java API in Elasticsearch 2.4.4](https://discuss.elastic.co/t/how-to-use-multiple-fields-in-exists-query-in-java-api-in-elasticsearch-2-4-4/146858)

<div class="topic-metadata">

**Author:** [@Yashasvi\_Raj\_Pant](https://discuss.elastic.co/u/Yashasvi_Raj_Pant)\
**Replies:** 4\
**Last updated:** [August 31, 2018, 11:43am UTC](https://discuss.elastic.co/t/how-to-use-multiple-fields-in-exists-query-in-java-api-in-elasticsearch-2-4-4/146858 "2018-08-31T11:43:37Z")

</div>

From the REST API of the elasticsearch(version 2.4.4), we can use multiple fields in exists query as: { "query": { "exists": { "field": \[ "field1", "field2", "field3" \] } …

---

## [Substring in watcher action](https://discuss.elastic.co/t/substring-in-watcher-action/146550)

<div class="topic-metadata">

**Author:** [@TheCodingKnight](https://discuss.elastic.co/u/TheCodingKnight)\
**Replies:** 2\
**Last updated:** [August 31, 2018, 11:07am UTC](https://discuss.elastic.co/t/substring-in-watcher-action/146550 "2018-08-31T11:07:32Z")

</div>

Hi, I've created a watcher which monitors for the keywords "result address" and returns the following line. Is there a way to extract the "doorno" part out of this line to display in an email through the watcher action? …

---

## ["failed to execute pipeline", but client error had not found. What happen to ES?](https://discuss.elastic.co/t/failed-to-execute-pipeline-but-client-error-had-not-found-what-happen-to-es/145858)

<div class="topic-metadata">

**Author:** [@nyamada2](https://discuss.elastic.co/u/nyamada2)\
**Replies:** 1\
**Last updated:** [August 31, 2018, 10:49am UTC](https://discuss.elastic.co/t/failed-to-execute-pipeline-but-client-error-had-not-found-what-happen-to-es/145858 "2018-08-31T10:49:57Z")

</div>

Hi, I'm using Elasticsearch 6.3.2. I set the Lambda function in AWS and put Elastic Load Balancer logs from s3 to Elasticsearch on EC2. I'm using ingest node with this templating. { "elblog": { "processors": \[ …

---

## [Understanding recovery: primary vs replica performance difference](https://discuss.elastic.co/t/understanding-recovery-primary-vs-replica-performance-difference/146702)

<div class="topic-metadata">

**Author:** [@cdekker](https://discuss.elastic.co/u/cdekker)\
**Replies:** 3\
**Last updated:** [August 31, 2018, 8:27am UTC](https://discuss.elastic.co/t/understanding-recovery-primary-vs-replica-performance-difference/146702 "2018-08-31T08:27:07Z")

</div>

I have a fairly simple cluster running 6.2.4 with 3 master nodes, 3 data nodes, 70 indices \* 20 shards \* 3 replicas. The cluster is near empty at the moment with about 3GB of data total. In short, every shard is replicat…

---

## [Way to retrieve the nested data using java](https://discuss.elastic.co/t/way-to-retrieve-the-nested-data-using-java/146543)

<div class="topic-metadata">

**Author:** [@vivekranjan](https://discuss.elastic.co/u/vivekranjan)\
**Replies:** 0\
**Last updated:** [August 29, 2018, 2:15pm UTC](https://discuss.elastic.co/t/way-to-retrieve-the-nested-data-using-java/146543 "2018-08-29T14:15:18Z")

</div>

Hi all, I have a nested data in elasticsearch and i need to retrieve it. Can some one tell me the way to do the same. I have tried all the possible way and either I am getting null in the Postman and tried googling as w…

---

## [Elasticsearch multi threading problems and How to improve elasticsearch performance](https://discuss.elastic.co/t/elasticsearch-multi-threading-problems-and-how-to-improve-elasticsearch-performance/146243)

<div class="topic-metadata">

**Author:** [@gogua](https://discuss.elastic.co/u/gogua)\
**Replies:** 14\
**Last updated:** [August 31, 2018, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-multi-threading-problems-and-how-to-improve-elasticsearch-performance/146243 "2018-08-31T07:52:10Z")

</div>

Hello eveyone, I have 15.1 Million documents and I have such a problem with elasticsearch multi threading, I'm trying to search 46 aggregations(count, cardinality, date\_histogram) together and it takes about 20-45 sec. T…

---

## [How can I check index storage type by CURL?](https://discuss.elastic.co/t/how-can-i-check-index-storage-type-by-curl/146818)

<div class="topic-metadata">

**Author:** [@horazen](https://discuss.elastic.co/u/horazen)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 7:11am UTC](https://discuss.elastic.co/t/how-can-i-check-index-storage-type-by-curl/146818 "2018-08-31T07:11:16Z")

</div>

My system had some issues with the index storage type. Couldn't find which type it was, but by changing the setting index.store.type at the elasticsearch.yml it seemed to be mmapfs. (Actually we had a big problem of usi…

---

## [Xpack/sql Does not appear to be able to handle "IN"](https://discuss.elastic.co/t/xpack-sql-does-not-appear-to-be-able-to-handle-in/146772)

<div class="topic-metadata">

**Author:** [@lzukel](https://discuss.elastic.co/u/lzukel)\
**Replies:** 4\
**Last updated:** [August 31, 2018, 6:45am UTC](https://discuss.elastic.co/t/xpack-sql-does-not-appear-to-be-able-to-handle-in/146772 "2018-08-31T06:45:01Z")

</div>

Example SQL -\> SELECT visit.app.appVersion FROM index WHERE visit.app.appName IN ('appA', 'appB') returns { "error": { "root\_cause": \[ { "type": "sql\_illegal\_argument\_exception", "reason…

---

## [\[1\]: max number of threads \[2048\] for user \[elasticsearch\] is too low, increase to at least \[4096\]](https://discuss.elastic.co/t/1-max-number-of-threads-2048-for-user-elasticsearch-is-too-low-increase-to-at-least-4096/146809)

<div class="topic-metadata">

**Author:** [@yuzhongzhu](https://discuss.elastic.co/u/yuzhongzhu)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 6:27am UTC](https://discuss.elastic.co/t/1-max-number-of-threads-2048-for-user-elasticsearch-is-too-low-increase-to-at-least-4096/146809 "2018-08-31T06:27:18Z")

</div>

Hi,I install elasticsearch6.4 in ubuntu on docker, and I have set nproc to 4096, but I still get the error message "\[1\]: max number of threads \[2048\] for user \[elasticsearch\] is too low, increase to at least \[4096\]", Can…

---

## [Set data type for object in template](https://discuss.elastic.co/t/set-data-type-for-object-in-template/146461)

<div class="topic-metadata">

**Author:** [@insomniac](https://discuss.elastic.co/u/insomniac)\
**Replies:** 0\
**Last updated:** [August 29, 2018, 4:35am UTC](https://discuss.elastic.co/t/set-data-type-for-object-in-template/146461 "2018-08-29T04:35:25Z")

</div>

I have a template created so that one of the fields is recognised as an integer/long type instead of a string, however it doesn't take effect. Here's the template I have set up: "templatename": { "mappings": { "d…

---

## [Retrieving data only from data node?](https://discuss.elastic.co/t/retrieving-data-only-from-data-node/146799)

<div class="topic-metadata">

**Author:** [@nikhil.k](https://discuss.elastic.co/u/nikhil.k)\
**Replies:** 0\
**Last updated:** [August 31, 2018, 4:48am UTC](https://discuss.elastic.co/t/retrieving-data-only-from-data-node/146799 "2018-08-31T04:48:26Z")

</div>

Elasticsearch version -5.4.3 I have a two nodes cluster. Roles of the nodes are as follows: Node1: Master & Data Node2: Data Created an index with replica enabled and inserted few documents in it(means data is availa…

---

## [ES 5.6.10 - Thread WAITING on java client log](https://discuss.elastic.co/t/es-5-6-10-thread-waiting-on-java-client-log/146786)

<div class="topic-metadata">

**Author:** [@eramitsinha](https://discuss.elastic.co/u/eramitsinha)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 10:44pm UTC](https://discuss.elastic.co/t/es-5-6-10-thread-waiting-on-java-client-log/146786 "2018-08-30T22:44:12Z")

</div>

Hi, I am using Elastic Search 5.6.10 and Jdk 1.8.102, I was doing load testing this got failed and during Load testing(Only Search operation on Index) I am seeing lots of Thread wait on client logs/dum…

---

## [Where is my elasticsearch data?](https://discuss.elastic.co/t/where-is-my-elasticsearch-data/144277)

<div class="topic-metadata">

**Author:** [@sheryl](https://discuss.elastic.co/u/sheryl)\
**Replies:** 3\
**Last updated:** [August 30, 2018, 9:06pm UTC](https://discuss.elastic.co/t/where-is-my-elasticsearch-data/144277 "2018-08-30T21:06:54Z")

</div>

i have csv file and using logstash i ingest this file to elasticsearch and viewing the count process on kibana . two things i want to know where is the csv file i just ingested in elasticsearch in windows. i have chec…

---

## [Elasticsearch ClusterException](https://discuss.elastic.co/t/elasticsearch-clusterexception/146553)

<div class="topic-metadata">

**Author:** [@Silen\_logs](https://discuss.elastic.co/u/Silen_logs)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 8:57pm UTC](https://discuss.elastic.co/t/elasticsearch-clusterexception/146553 "2018-08-30T20:57:09Z")

</div>

Hi all, I have a 3 node cluster and another server running logstash. Sometimes the collect stops and the follow error appears in logstash log.The elasticsearch servers don't show this type of communication failure. Afte…

---

## [Any way to initialize a large set once in painless script for repeat use?](https://discuss.elastic.co/t/any-way-to-initialize-a-large-set-once-in-painless-script-for-repeat-use/146577)

<div class="topic-metadata">

**Author:** [@paulbc](https://discuss.elastic.co/u/paulbc)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 7:31pm UTC](https://discuss.elastic.co/t/any-way-to-initialize-a-large-set-once-in-painless-script-for-repeat-use/146577 "2018-08-30T19:31:48Z")

</div>

We want to implement filters using painless scripts that work by checking if a string is a member of some potentially large set (hundreds or thousands of members) determined ahead of time. E.g., suppose the set contains …

---

## [GeometryCollection search all elements](https://discuss.elastic.co/t/geometrycollection-search-all-elements/146770)

<div class="topic-metadata">

**Author:** [@Artem\_Sh](https://discuss.elastic.co/u/Artem_Sh)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 7:30pm UTC](https://discuss.elastic.co/t/geometrycollection-search-all-elements/146770 "2018-08-30T19:30:43Z")

</div>

Hello. I have city GeometryCollection coordinates. And I have elements with point coordinates. How can I search for all the elements whose coordinates are in the GeometryCollection?

---

## [Elasticsearch user creation](https://discuss.elastic.co/t/elasticsearch-user-creation/145609)

<div class="topic-metadata">

**Author:** [@rijinmp](https://discuss.elastic.co/u/rijinmp)\
**Replies:** 6\
**Last updated:** [August 30, 2018, 7:10pm UTC](https://discuss.elastic.co/t/elasticsearch-user-creation/145609 "2018-08-30T19:10:10Z")

</div>

Before the elasticsearch installation , is there any need for creating a user named "elasticsearch " ( in Linux) ? I know elasticsearch installation time elasticsearch will automatically creating the "elastisearch" u…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1561)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1563)
