# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1307

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1308

---

## [Image recognition in kibana and ES](https://discuss.elastic.co/t/image-recognition-in-kibana-and-es/180070)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 3\
**Last updated:** [May 8, 2019, 12:24pm UTC](https://discuss.elastic.co/t/image-recognition-in-kibana-and-es/180070 "2019-05-08T12:24:55Z")

</div>

hi dears, i want to do image recognition , i have many images and now i want to compare images with each other for example i want to see if a person appears in an image. is it possible to do that and what tool can be use…

---

## [Elasticsearch won't accept logs using standard syslog date format](https://discuss.elastic.co/t/elasticsearch-wont-accept-logs-using-standard-syslog-date-format/179962)

<div class="topic-metadata">

**Author:** [@elasticSmash](https://discuss.elastic.co/u/elasticSmash)\
**Replies:** 3\
**Last updated:** [May 8, 2019, 11:39am UTC](https://discuss.elastic.co/t/elasticsearch-wont-accept-logs-using-standard-syslog-date-format/179962 "2019-05-08T11:39:36Z")

</div>

On the logstash forum, they said that my question had more to do with elasticsearch, so here I am. So far I've added hosts to my logstash input that have used ISO8601 time format in their syslog config. Those have impo…

---

## [Getting only 10 search results though I am getting more than 20000 hits](https://discuss.elastic.co/t/getting-only-10-search-results-though-i-am-getting-more-than-20000-hits/180164)

<div class="topic-metadata">

**Author:** [@mandar.raj](https://discuss.elastic.co/u/mandar.raj)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 11:36am UTC](https://discuss.elastic.co/t/getting-only-10-search-results-though-i-am-getting-more-than-20000-hits/180164 "2019-05-08T11:36:24Z")

</div>

Getting only 10 search results though I am getting more than 20000 hits. I used size parameter in query but its limit is up to 10000, is there any way we can do pagination?

---

## [Siginification of the score field in fscrawler](https://discuss.elastic.co/t/siginification-of-the-score-field-in-fscrawler/180077)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 11:25am UTC](https://discuss.elastic.co/t/siginification-of-the-score-field-in-fscrawler/180077 "2019-05-08T11:25:44Z")

</div>

i am using kibana dev toools and fscrawler to index files, i want to know what do the filed score, "hits" : { "total" : 12, "max\_score" : 1.0, "hits" : \[ { "\_index" : "bigdata", "\_type" : "\_doc", "\_id" : "d7f60c6…

---

## [Unable to setup PagerDuty or Slack notification on ES7.x](https://discuss.elastic.co/t/unable-to-setup-pagerduty-or-slack-notification-on-es7-x/179967)

<div class="topic-metadata">

**Author:** [@innovia](https://discuss.elastic.co/u/innovia)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 11:17am UTC](https://discuss.elastic.co/t/unable-to-setup-pagerduty-or-slack-notification-on-es7-x/179967 "2019-05-08T11:17:44Z")

</div>

Hi The documentation for setting up notifications for Slack or PagerDuty are outdated and wrong Im running on elastic cloud with standard subscriptions can anyone please help with setting this up correctly on version …

---

## [Java security apparent bug with repository-gcs](https://discuss.elastic.co/t/java-security-apparent-bug-with-repository-gcs/180144)

<div class="topic-metadata">

**Author:** [@MichaelSGrant](https://discuss.elastic.co/u/MichaelSGrant)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 11:08am UTC](https://discuss.elastic.co/t/java-security-apparent-bug-with-repository-gcs/180144 "2019-05-08T11:08:08Z")

</div>

I have a Elasticsearch cluster which I have just migrated from 5.6.4 to 6.5.1. (This version was selected because it is the highest version currently supported by the elastic4s library used by our code.) Unfortunately,…

---

## [Good practice for index templates in ES](https://discuss.elastic.co/t/good-practice-for-index-templates-in-es/180116)

<div class="topic-metadata">

**Author:** [@Praneet\_Khandelwal](https://discuss.elastic.co/u/Praneet_Khandelwal)\
**Replies:** 8\
**Last updated:** [May 8, 2019, 10:40am UTC](https://discuss.elastic.co/t/good-practice-for-index-templates-in-es/180116 "2019-05-08T10:40:21Z")

</div>

Let's say I have documents coming into my ES from different sources. Source A(index name = "abde") has the following mapping: { "field1": { "type": "text" }, …

---

## [Freeze indecies](https://discuss.elastic.co/t/freeze-indecies/179676)

<div class="topic-metadata">

**Author:** [@roiwexler](https://discuss.elastic.co/u/roiwexler)\
**Replies:** 5\
**Last updated:** [May 8, 2019, 10:06am UTC](https://discuss.elastic.co/t/freeze-indecies/179676 "2019-05-08T10:06:47Z")

</div>

we have an application that create a lot of indices (about 400,000 a week). there for we're trying to find a solution for the high memory usage this indices requiter. we are looking at two option ES gives freeze indi…

---

## [Error while connecting to elasticSearch from HTTPHIghLeavelClient](https://discuss.elastic.co/t/error-while-connecting-to-elasticsearch-from-httphighleavelclient/178160)

<div class="topic-metadata">

**Author:** [@jaya](https://discuss.elastic.co/u/jaya)\
**Replies:** 4\
**Last updated:** [May 8, 2019, 9:21am UTC](https://discuss.elastic.co/t/error-while-connecting-to-elasticsearch-from-httphighleavelclient/178160 "2019-05-08T09:21:42Z")

</div>

Hi, I am getting error while connecting to elasticSearch using HighLeavelClient. My elastic Search instance is Running on localhost with bind and publish address 127.0.0.1:9200 and is working fine with Postman (I have…

---

## [Merge 2 indexes in one with same id](https://discuss.elastic.co/t/merge-2-indexes-in-one-with-same-id/179526)

<div class="topic-metadata">

**Author:** [@olpru](https://discuss.elastic.co/u/olpru)\
**Replies:** 3\
**Last updated:** [May 8, 2019, 9:06am UTC](https://discuss.elastic.co/t/merge-2-indexes-in-one-with-same-id/179526 "2019-05-08T09:06:56Z")

</div>

Hello, I try to merge 2 indexes into one. The first index (index\_1) looks like this: { "\_index" : "index\_1", "\_id" : "1", "\_source" : { "a":"1" } }, { "\_index"…

---

## [Unknown setting \[thread\_pool.bulk.queue\_size\]](https://discuss.elastic.co/t/unknown-setting-thread-pool-bulk-queue-size/180120)

<div class="topic-metadata">

**Author:** [@cmcdowell03](https://discuss.elastic.co/u/cmcdowell03)\
**Replies:** 5\
**Last updated:** [May 8, 2019, 9:01am UTC](https://discuss.elastic.co/t/unknown-setting-thread-pool-bulk-queue-size/180120 "2019-05-08T09:01:33Z")

</div>

java.lang.IllegalArgumentException: unknown setting \[thread\_pool.bulk.queue\_size\] did you mean any of \[thread\_pool.get.queue\_size, thread\_pool.write.queue\_size, thread\_pool.analyze.queue\_size, thread\_pool.search.queue\_si…

---

## [Nested field total at document level](https://discuss.elastic.co/t/nested-field-total-at-document-level/180134)

<div class="topic-metadata">

**Author:** [@Vinutha](https://discuss.elastic.co/u/Vinutha)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 8:51am UTC](https://discuss.elastic.co/t/nested-field-total-at-document-level/180134 "2019-05-08T08:51:35Z")

</div>

We are facing issue with below requirement, it would be great if you could suggest us with a solution. We have nested data in a document . Below is the part of document JSON structure { "contents": { "type": "nested"…

---

## [Grok processor: Expected output to be decimal, but output was string](https://discuss.elastic.co/t/grok-processor-expected-output-to-be-decimal-but-output-was-string/180123)

<div class="topic-metadata">

**Author:** [@Miao](https://discuss.elastic.co/u/Miao)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 8:22am UTC](https://discuss.elastic.co/t/grok-processor-expected-output-to-be-decimal-but-output-was-string/180123 "2019-05-08T08:22:48Z")

</div>

I created a pipeline called parse\_duration: { "description" : "ParseDuration", "processors": \[ { "grok": { "field": "Duration", "patterns": \["%{NUMBER:DrillDuration}"\] } } \] } I…

---

## [Logstash output to ES cluster - sharding?](https://discuss.elastic.co/t/logstash-output-to-es-cluster-sharding/180102)

<div class="topic-metadata">

**Author:** [@Anish\_Sujanani](https://discuss.elastic.co/u/Anish_Sujanani)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 8:19am UTC](https://discuss.elastic.co/t/logstash-output-to-es-cluster-sharding/180102 "2019-05-08T08:19:15Z")

</div>

Hi all, My cluster currently involves: Machine 1 : ES - co-ordinating node + Kibana Machine 2 : ES - master + data + Logstash Machine 3 : ES - master + data + Logstash Machine 4 : ES - master + data + Logstash Shar…

---

## [Select and Update](https://discuss.elastic.co/t/select-and-update/179870)

<div class="topic-metadata">

**Author:** [@han1](https://discuss.elastic.co/u/han1)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 8:16am UTC](https://discuss.elastic.co/t/select-and-update/179870 "2019-05-08T08:16:39Z")

</div>

Hi. We are trying to do the following and any help would be appreciated. Say you make a search and 100,000 documents match. We would like to increment a counter in each document that matched. Then at the same time sel…

---

## [Writing nested aggregation query in NEST](https://discuss.elastic.co/t/writing-nested-aggregation-query-in-nest/179547)

<div class="topic-metadata">

**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 8:03am UTC](https://discuss.elastic.co/t/writing-nested-aggregation-query-in-nest/179547 "2019-05-08T08:03:05Z")

</div>

How can I convert the following query to NEST? "aggs": { "UnitAggregationBucket": { "terms": { "field": "unitId", "size": 10, "order": { "max\_score": "desc" } }…

---

## [Take snapshot in a kubernetes cluster with storage not supporting ReadWriteMany accessMethod](https://discuss.elastic.co/t/take-snapshot-in-a-kubernetes-cluster-with-storage-not-supporting-readwritemany-accessmethod/180012)

<div class="topic-metadata">

**Author:** [@Sunil\_Chadha](https://discuss.elastic.co/u/Sunil_Chadha)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 7:58am UTC](https://discuss.elastic.co/t/take-snapshot-in-a-kubernetes-cluster-with-storage-not-supporting-readwritemany-accessmethod/180012 "2019-05-08T07:58:53Z")

</div>

Does Elasticsearch support repository configuration for taking snapshot on kubernetes cluster with storage like - AWSElasticBlockStore, AzureDisk, Cinder etc which does not support ReadWriteMany? Is it possible to take …

---

## [Can not reindex to another host](https://discuss.elastic.co/t/can-not-reindex-to-another-host/178633)

<div class="topic-metadata">

**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\
**Replies:** 4\
**Last updated:** [May 8, 2019, 7:45am UTC](https://discuss.elastic.co/t/can-not-reindex-to-another-host/178633 "2019-05-08T07:45:10Z")

</div>

Hi community, I try to reindex from remote elasticsearch but i got err response. Here is what I run in kibana dev tool, POST \_reindex { "source": { "remote": { "host": "https://anotherhost:443", "socket\_timeout…

---

## [River puts too much load on only one node](https://discuss.elastic.co/t/river-puts-too-much-load-on-only-one-node/180053)

<div class="topic-metadata">

**Author:** [@KashiPashoria\_Tonny](https://discuss.elastic.co/u/KashiPashoria_Tonny)\
**Replies:** 13\
**Last updated:** [May 8, 2019, 7:42am UTC](https://discuss.elastic.co/t/river-puts-too-much-load-on-only-one-node/180053 "2019-05-08T07:42:40Z")

</div>

I'm using Elasticsearch 1.5. It uses rivers to ingest data. I've 3 nodes in my cluster. The river that ingest large amount of data puts too much load on a specific node. I want to divert this utilization to another node.…

---

## [Client nodes killed by kernel OOM killer](https://discuss.elastic.co/t/client-nodes-killed-by-kernel-oom-killer/177884)

<div class="topic-metadata">

**Author:** [@nishantagarwal1990](https://discuss.elastic.co/u/nishantagarwal1990)\
**Replies:** 15\
**Last updated:** [May 8, 2019, 7:22am UTC](https://discuss.elastic.co/t/client-nodes-killed-by-kernel-oom-killer/177884 "2019-05-08T07:22:54Z")

</div>

For a couple of months I have been using ES 6.4.2 and my client nodes get reaped/oom-killed by the linux kernel, due to which I do not get a heap dump. On taking a force heap dump I get the below dominator tree. The h…

---

## [Elasticsearch query to return all records](https://discuss.elastic.co/t/elasticsearch-query-to-return-all-records/180099)

<div class="topic-metadata">

**Author:** [@Lauren69](https://discuss.elastic.co/u/Lauren69)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-query-to-return-all-records/180099 "2019-05-08T07:19:44Z")

</div>

I have a small database in Elasticsearch and for testing purposes would like to pull all records back. I am attempting to use a URL of the form... http://localhost:9200/foo/\_search?pretty=true&q={'matchAll':{''}} Can s…

---

## [New fields added in mapping do not appear in index pattern](https://discuss.elastic.co/t/new-fields-added-in-mapping-do-not-appear-in-index-pattern/180113)

<div class="topic-metadata">

**Author:** [@Praneet\_Khandelwal](https://discuss.elastic.co/u/Praneet_Khandelwal)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 7:11am UTC](https://discuss.elastic.co/t/new-fields-added-in-mapping-do-not-appear-in-index-pattern/180113 "2019-05-08T07:11:15Z")

</div>

I currently have daily indices (lets say logstash-\*). I want to add new fields to the index mapping. After pushing the new template, the newly added fields do not become searchable for the entire index pattern. I guess t…

---

## [3 node Elastic Search installation using docker](https://discuss.elastic.co/t/3-node-elastic-search-installation-using-docker/180109)

<div class="topic-metadata">

**Author:** [@syedsfayaz](https://discuss.elastic.co/u/syedsfayaz)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 7:00am UTC](https://discuss.elastic.co/t/3-node-elastic-search-installation-using-docker/180109 "2019-05-08T07:00:18Z")

</div>

Hi I am trying to figure out ways to install Elastic Stack for our staging environment using Docker. I have installed Elastic stack with out docker on linux vm and its working fine. I want to setup a 3 node ES cluster…

---

## [How to set field\_multi\_value\_leniency parameter in elasticsearch-sql-cli command line?](https://discuss.elastic.co/t/how-to-set-field-multi-value-leniency-parameter-in-elasticsearch-sql-cli-command-line/179990)

<div class="topic-metadata">

**Author:** [@byronhe](https://discuss.elastic.co/u/byronhe)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 5:11am UTC](https://discuss.elastic.co/t/how-to-set-field-multi-value-leniency-parameter-in-elasticsearch-sql-cli-command-line/179990 "2019-05-08T05:11:46Z")

</div>

how to set field\_multi\_value\_leniency parameter in elasticsearch-sql-cli command line ? https://www.elastic.co/guide/en/elasticsearch/reference/current/sql-rest.html#sql-rest-fields

---

## [How to output  \`\_id\`  field in elasticsearch-sql-cli command line?](https://discuss.elastic.co/t/how-to-output-id-field-in-elasticsearch-sql-cli-command-line/179988)

<div class="topic-metadata">

**Author:** [@byronhe](https://discuss.elastic.co/u/byronhe)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 4:57am UTC](https://discuss.elastic.co/t/how-to-output-id-field-in-elasticsearch-sql-cli-command-line/179988 "2019-05-08T04:57:21Z")

</div>

how to output \_id field in elasticsearch-sql-cli command line ? https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-id-field.html

---

## [How to co-relate multiple csv file and push into single index?](https://discuss.elastic.co/t/how-to-co-relate-multiple-csv-file-and-push-into-single-index/180000)

<div class="topic-metadata">

**Author:** [@Manoharan\_Prince](https://discuss.elastic.co/u/Manoharan_Prince)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 4:37am UTC](https://discuss.elastic.co/t/how-to-co-relate-multiple-csv-file-and-push-into-single-index/180000 "2019-05-08T04:37:46Z")

</div>

Hi all, I am looking for plugins or features where i can simulate and co-relate multiple csv files. Scenario: CSV contains syslog information of ciena network devices, which doesn't contains hostname and port details…

---

## [Dynamic code evaluation using Script](https://discuss.elastic.co/t/dynamic-code-evaluation-using-script/179479)

<div class="topic-metadata">

**Author:** [@sgoel](https://discuss.elastic.co/u/sgoel)\
**Replies:** 4\
**Last updated:** [May 8, 2019, 4:30am UTC](https://discuss.elastic.co/t/dynamic-code-evaluation-using-script/179479 "2019-05-08T04:30:35Z")

</div>

I have a field in Elastic search of type 'keyword' with value = "Quantity \<= 10". "hits": \[ { "\_index": "rules1", "\_type": "\_doc", "\_id": "zvMleGoBkFxQI52IVKGV", "\_score": 1, "\_source": { "id": "1", "criteria1":…

---

## [Does anyone know how to see audit events in elastic cloud?](https://discuss.elastic.co/t/does-anyone-know-how-to-see-audit-events-in-elastic-cloud/180055)

<div class="topic-metadata">

**Author:** [@aml\_iv](https://discuss.elastic.co/u/aml_iv)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 3:02am UTC](https://discuss.elastic.co/t/does-anyone-know-how-to-see-audit-events-in-elastic-cloud/180055 "2019-05-08T03:02:32Z")

</div>

Hi, We have a elasticsearch cloudservice with platinum services and would like to trace user activity and search queries send through the search api and from within Kibana. Is that possible? Br aml

---

## [Slow child query: Elasticsearch parent child query profile analysis showing using time for unrealetd children I was not quering](https://discuss.elastic.co/t/slow-child-query-elasticsearch-parent-child-query-profile-analysis-showing-using-time-for-unrealetd-children-i-was-not-quering/180066)

<div class="topic-metadata">

**Author:** [@jasonzhang](https://discuss.elastic.co/u/jasonzhang)\
**Replies:** 0\
**Last updated:** [May 7, 2019, 9:15pm UTC](https://discuss.elastic.co/t/slow-child-query-elasticsearch-parent-child-query-profile-analysis-showing-using-time-for-unrealetd-children-i-was-not-quering/180066 "2019-05-07T21:15:25Z")

</div>

I have join type field mapping, { "properties": { "data\_type": { "type": "join", "eager\_global\_ordinals": true, "relations": { "contact": \[ "user\_published\_contact", "crm\_lead\_email", "crm…

---

## [ILM policy not applied to all indices](https://discuss.elastic.co/t/ilm-policy-not-applied-to-all-indices/180050)

<div class="topic-metadata">

**Author:** [@trondhindenes](https://discuss.elastic.co/u/trondhindenes)\
**Replies:** 0\
**Last updated:** [May 7, 2019, 7:41pm UTC](https://discuss.elastic.co/t/ilm-policy-not-applied-to-all-indices/180050 "2019-05-07T19:41:18Z")

</div>

Hi, I've created an ILM policy on our 6.7 cluster, and applied it "manually" to a number of indices by setting the index\_settings.index.lifecycle.name Now several hours later, only one of the indices seems to have "act…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1306)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1308)
