# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1422

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1423

---

## [Query filtering based on one element in an array of nested elements](https://discuss.elastic.co/t/query-filtering-based-on-one-element-in-an-array-of-nested-elements/161533)

<div class="topic-metadata">

**Author:** [@codobbit](https://discuss.elastic.co/u/codobbit)\
**Replies:** 4\
**Last updated:** [January 18, 2019, 10:53am UTC](https://discuss.elastic.co/t/query-filtering-based-on-one-element-in-an-array-of-nested-elements/161533 "2019-01-18T10:53:21Z")

</div>

Hello everyone! Been grappling this issue for a couple of days now and cannot find a way out of it. I'm using C# and NEST but the issue is in my filtration. I have a product with nested prices array for each different …

---

## [Watcher email attachment](https://discuss.elastic.co/t/watcher-email-attachment/164448)

<div class="topic-metadata">

**Author:** [@pjanzen](https://discuss.elastic.co/u/pjanzen)\
**Replies:** 1\
**Last updated:** [January 18, 2019, 10:42am UTC](https://discuss.elastic.co/t/watcher-email-attachment/164448 "2019-01-18T10:42:33Z")

</div>

Hi All, I have created a watcher where the action is to send an email. A request came to me asking: Is it possible to use a date in the filename? The receiver would like to see attachment-20190111.pdf Can I use mustac…

---

## [Several times of large gc, then will be disconnected, this is why?](https://discuss.elastic.co/t/several-times-of-large-gc-then-will-be-disconnected-this-is-why/164735)

<div class="topic-metadata">

**Author:** [@Leeeo](https://discuss.elastic.co/u/Leeeo)\
**Replies:** 0\
**Last updated:** [January 18, 2019, 6:12am UTC](https://discuss.elastic.co/t/several-times-of-large-gc-then-will-be-disconnected-this-is-why/164735 "2019-01-18T06:12:53Z")

</div>

logs as follows: \[2019-01-17T23:08:19,097\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[node-142\] \[gc\]\[101523\] overhead, spent \[322ms\] collecting in the last \[1s\] \[2019-01-17T23:08:26,107\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[…

---

## [Ingest pipeline : Getting lookup values from another index](https://discuss.elastic.co/t/ingest-pipeline-getting-lookup-values-from-another-index/164731)

<div class="topic-metadata">

**Author:** [@hammadarif](https://discuss.elastic.co/u/hammadarif)\
**Replies:** 1\
**Last updated:** [January 18, 2019, 6:16am UTC](https://discuss.elastic.co/t/ingest-pipeline-getting-lookup-values-from-another-index/164731 "2019-01-18T06:16:57Z")

</div>

Main main index (say, countries) has a field CountryId, At the time of indexing I would to grab details about this country from another index (say, population-data) and store in the main index. So if i PUT countries/\_…

---

## [Quick advice for an ES newbie - ES and natural language](https://discuss.elastic.co/t/quick-advice-for-an-es-newbie-es-and-natural-language/164699)

<div class="topic-metadata">

**Author:** [@GenXJason](https://discuss.elastic.co/u/GenXJason)\
**Replies:** 1\
**Last updated:** [January 18, 2019, 4:49am UTC](https://discuss.elastic.co/t/quick-advice-for-an-es-newbie-es-and-natural-language/164699 "2019-01-18T04:49:50Z")

</div>

Trying to (extremely) simplify my requirements. Given a document structure similar to this: { "id": 1. " vendor\_type": "electrician", "location": "new york", "price\_level": "cheap" } { "id": 2. " v…

---

## [How set default values with fields in Aggregation results' empty buckets?](https://discuss.elastic.co/t/how-set-default-values-with-fields-in-aggregation-results-empty-buckets/164597)

<div class="topic-metadata">

**Author:** [@teemoGod](https://discuss.elastic.co/u/teemoGod)\
**Replies:** 2\
**Last updated:** [January 18, 2019, 4:32am UTC](https://discuss.elastic.co/t/how-set-default-values-with-fields-in-aggregation-results-empty-buckets/164597 "2019-01-18T04:32:46Z")

</div>

Hi. Im using Elasticseach 6.4 following is my request. "aggs": { "times": { "date\_histogram": { "field": "ccr.key", "interval": "…

---

## [Old data shown after re-creating an index](https://discuss.elastic.co/t/old-data-shown-after-re-creating-an-index/164714)

<div class="topic-metadata">

**Author:** [@razortt](https://discuss.elastic.co/u/razortt)\
**Replies:** 5\
**Last updated:** [January 18, 2019, 2:21am UTC](https://discuss.elastic.co/t/old-data-shown-after-re-creating-an-index/164714 "2019-01-18T02:21:45Z")

</div>

Hi Apologies if this has been asked before. I'm new with ES (6.3) and i'm working through the process of how I want to index all my documents. What I have found is after I delete the index, tweak the mappings and re-i…

---

## [Unique count \> Count in kibana](https://discuss.elastic.co/t/unique-count-count-in-kibana/164565)

<div class="topic-metadata">

**Author:** [@MrZhangisGood](https://discuss.elastic.co/u/MrZhangisGood)\
**Replies:** 2\
**Last updated:** [January 18, 2019, 2:05am UTC](https://discuss.elastic.co/t/unique-count-count-in-kibana/164565 "2019-01-18T02:05:59Z")

</div>

Hi , I am using elasticsearch 5.4.2 and kibana also 5.4.2 . I want to check distinct counts for a string value field in elasticsearch . Unique count greater than Count Count Unique count

---

## [ElasticSearch HTTP CORS config variables are not being honored](https://discuss.elastic.co/t/elasticsearch-http-cors-config-variables-are-not-being-honored/164709)

<div class="topic-metadata">

**Author:** [@MantasVidutis](https://discuss.elastic.co/u/MantasVidutis)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 10:28pm UTC](https://discuss.elastic.co/t/elasticsearch-http-cors-config-variables-are-not-being-honored/164709 "2019-01-17T22:28:15Z")

</div>

I have an ElasticSearch node that is coming up in a docker-compose cluster locally. This is the dockerfile: FROM docker.elastic.co/elasticsearch/elasticsearch:6.5.4 ADD elasticsearch.yml config/elasticsearch.yml And …

---

## [Not able to setup elasticsearch using docker](https://discuss.elastic.co/t/not-able-to-setup-elasticsearch-using-docker/164196)

<div class="topic-metadata">

**Author:** [@kartik\_pandey](https://discuss.elastic.co/u/kartik_pandey)\
**Replies:** 8\
**Last updated:** [January 17, 2019, 10:22pm UTC](https://discuss.elastic.co/t/not-able-to-setup-elasticsearch-using-docker/164196 "2019-01-17T22:22:54Z")

</div>

I am following this to setup elastic search. But it is not working. Console output when I visit localhost:9200 it say's site cant be reached. I am on windows 10

---

## [Upgrading to Elasticsearch 6.5.4 got Java AccessControlException: access denied for Elasticsearch.yml](https://discuss.elastic.co/t/upgrading-to-elasticsearch-6-5-4-got-java-accesscontrolexception-access-denied-for-elasticsearch-yml/164552)

<div class="topic-metadata">

**Author:** [@jqiu97](https://discuss.elastic.co/u/jqiu97)\
**Replies:** 2\
**Last updated:** [January 17, 2019, 9:36pm UTC](https://discuss.elastic.co/t/upgrading-to-elasticsearch-6-5-4-got-java-accesscontrolexception-access-denied-for-elasticsearch-yml/164552 "2019-01-17T21:36:33Z")

</div>

We are using Elasticsearch 6.1.2 now and are trying to upgrade to latest version Elasticsearch 6.5.4. When I start the new version of Elasticsearch on the same machine that we ran 6.1.2 before, I got Caused by: java.se…

---

## [Indices size and # of shard](https://discuss.elastic.co/t/indices-size-and-of-shard/163278)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 9\
**Last updated:** [January 17, 2019, 9:35pm UTC](https://discuss.elastic.co/t/indices-size-and-of-shard/163278 "2019-01-17T21:35:23Z")

</div>

After lot of testing I am going to move to production. Is it ok to have default 5 shard and large indices size 50gig with 150Million documents? cluster I have setup is pretty big 8 node with three master and all 8 node…

---

## [Terrible Performance On Query against Empty Field Check](https://discuss.elastic.co/t/terrible-performance-on-query-against-empty-field-check/164702)

<div class="topic-metadata">

**Author:** [@PuttPuttGo](https://discuss.elastic.co/u/PuttPuttGo)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 8:45pm UTC](https://discuss.elastic.co/t/terrible-performance-on-query-against-empty-field-check/164702 "2019-01-17T20:45:06Z")

</div>

situation explained here Can anyone help me out? I've put together a NEST query that is experiencing terrible performance when trying to search on a Empty Field. I explain everything in the on stackoverflow. i can ad…

---

## [How to do a self-join type of query](https://discuss.elastic.co/t/how-to-do-a-self-join-type-of-query/164391)

<div class="topic-metadata">

**Author:** [@tchung](https://discuss.elastic.co/u/tchung)\
**Replies:** 4\
**Last updated:** [January 17, 2019, 6:56pm UTC](https://discuss.elastic.co/t/how-to-do-a-self-join-type-of-query/164391 "2019-01-17T18:56:31Z")

</div>

This is kinda a followup question to this. I'm now indexing individual events and each event has a user field. Say I have these three docs: { "user":"abc", "event":"foo" } { "user":"abc", "event":"bar" } { "user":"d…

---

## [Index json files in bulk](https://discuss.elastic.co/t/index-json-files-in-bulk/164629)

<div class="topic-metadata">

**Author:** [@itsron143](https://discuss.elastic.co/u/itsron143)\
**Replies:** 4\
**Last updated:** [January 17, 2019, 5:44pm UTC](https://discuss.elastic.co/t/index-json-files-in-bulk/164629 "2019-01-17T17:44:36Z")

</div>

I have a folder with around 590,035 json files. Each file is a document that has to be indexed. If I index each document using python then it is taking more than 30 hours. How do I index these documents quickly? Note …

---

## [Query only location snapshots](https://discuss.elastic.co/t/query-only-location-snapshots/164513)

<div class="topic-metadata">

**Author:** [@ssolanoballester](https://discuss.elastic.co/u/ssolanoballester)\
**Replies:** 1\
**Last updated:** [January 17, 2019, 5:30pm UTC](https://discuss.elastic.co/t/query-only-location-snapshots/164513 "2019-01-17T17:30:17Z")

</div>

How can I list only the location of all snapshots? I tried: curl -q -XPOST -H "Content-Type: application/json" -u elastic:mypassword "https://10.0.0.1:9200/\_snapshot/\_all" -d '{ "\_source": \["location"\], "query" : { …

---

## [Force filebeat index to use specific/correct type](https://discuss.elastic.co/t/force-filebeat-index-to-use-specific-correct-type/164653)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 2:41pm UTC](https://discuss.elastic.co/t/force-filebeat-index-to-use-specific-correct-type/164653 "2019-01-17T14:41:46Z")

</div>

Im pulling in some stdout/stderr from kubernetes via filebeat. When the indexes are created both the numeric and string values are showing up in kibana with '?' for type. Looking at the index via GET /filebeat-\<date\> I …

---

## [Support for hadoop 3.0](https://discuss.elastic.co/t/support-for-hadoop-3-0/164661)

<div class="topic-metadata">

**Author:** [@Saul\_Tawil](https://discuss.elastic.co/u/Saul_Tawil)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 3:06pm UTC](https://discuss.elastic.co/t/support-for-hadoop-3-0/164661 "2019-01-17T15:06:44Z")

</div>

When can we expect support for hadoop 3.0

---

## [Using English analyzer filtered out some words](https://discuss.elastic.co/t/using-english-analyzer-filtered-out-some-words/164643)

<div class="topic-metadata">

**Author:** [@denk](https://discuss.elastic.co/u/denk)\
**Replies:** 1\
**Last updated:** [January 17, 2019, 3:04pm UTC](https://discuss.elastic.co/t/using-english-analyzer-filtered-out-some-words/164643 "2019-01-17T15:04:35Z")

</div>

Hey guys! Learning Elastic at the moment and have a question about stopwords and analyzers. I'm using Java API and want to use English analyzer to filter out some articles and other redundant words from the search. Se…

---

## [How to upload platinum licence on an existing cluster elk stack](https://discuss.elastic.co/t/how-to-upload-platinum-licence-on-an-existing-cluster-elk-stack/164646)

<div class="topic-metadata">

**Author:** [@elastic5](https://discuss.elastic.co/u/elastic5)\
**Replies:** 2\
**Last updated:** [January 17, 2019, 2:30pm UTC](https://discuss.elastic.co/t/how-to-upload-platinum-licence-on-an-existing-cluster-elk-stack/164646 "2019-01-17T14:30:33Z")

</div>

Hi, I am new to elk stack and I need to upload a new platinum licence as trial licence is expired. It is a clustered elk stack (6.3). I found these links but not sure if i am on the right path: https://www.elastic.co/…

---

## [CURL returns immediately whereas RestClient timesout](https://discuss.elastic.co/t/curl-returns-immediately-whereas-restclient-timesout/161802)

<div class="topic-metadata">

**Author:** [@madhan3396](https://discuss.elastic.co/u/madhan3396)\
**Replies:** 17\
**Last updated:** [January 17, 2019, 2:06pm UTC](https://discuss.elastic.co/t/curl-returns-immediately-whereas-restclient-timesout/161802 "2019-01-17T14:06:32Z")

</div>

Hi, I'm using elasticsearch version 6.4. An index pri.store.size is 25GB and it contains 47 Million documents. My query includes a termsquery and cardinality. When i execute the query using CURL i got the response …

---

## [Recommended way of testing locally with 6.5](https://discuss.elastic.co/t/recommended-way-of-testing-locally-with-6-5/164618)

<div class="topic-metadata">

**Author:** [@regiskuckaertz](https://discuss.elastic.co/u/regiskuckaertz)\
**Replies:** 3\
**Last updated:** [January 17, 2019, 1:53pm UTC](https://discuss.elastic.co/t/recommended-way-of-testing-locally-with-6-5/164618 "2019-01-17T13:53:29Z")

</div>

Hello. We're planning a 5.6 -\> 6.5 upgrade here and I noticed that the local transport type has been removed in the latest version. We only use it once: for integration tests, we spin up a local ES node with transport.ty…

---

## [Using Cutoff Frequency in a Multi-Match Query Causes Irrelevant Results](https://discuss.elastic.co/t/using-cutoff-frequency-in-a-multi-match-query-causes-irrelevant-results/164638)

<div class="topic-metadata">

**Author:** [@maryam\_abdullah](https://discuss.elastic.co/u/maryam_abdullah)\
**Replies:** 1\
**Last updated:** [January 17, 2019, 1:37pm UTC](https://discuss.elastic.co/t/using-cutoff-frequency-in-a-multi-match-query-causes-irrelevant-results/164638 "2019-01-17T13:37:42Z")

</div>

Hey, I read that Common Terms technique is supposed to enhance search results, however, when I added it to my code, the opposite happened. Here's my code: var response = elasticClient.Search\<Document\>(s =\> s …

---

## [Curator: During Shrink, replicas assigned to ignored nodes](https://discuss.elastic.co/t/curator-during-shrink-replicas-assigned-to-ignored-nodes/164630)

<div class="topic-metadata">

**Author:** [@StephenThorpe](https://discuss.elastic.co/u/StephenThorpe)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 12:16pm UTC](https://discuss.elastic.co/t/curator-during-shrink-replicas-assigned-to-ignored-nodes/164630 "2019-01-17T12:16:31Z")

</div>

Hi All, ElasticSearch 6.5.4 and Curator 5.6 I'm testing out curator and have it successfully moving shards from 'hot' nodes to 'warm' nodes. I'm now looking at shrinking the shards down to 3 (3 warm nodes). This is w…

---

## [Can't able register aws ES snapshot repository to filesystem](https://discuss.elastic.co/t/cant-able-register-aws-es-snapshot-repository-to-filesystem/164611)

<div class="topic-metadata">

**Author:** [@arun5635](https://discuss.elastic.co/u/arun5635)\
**Replies:** 1\
**Last updated:** [January 17, 2019, 12:13pm UTC](https://discuss.elastic.co/t/cant-able-register-aws-es-snapshot-repository-to-filesystem/164611 "2019-01-17T12:13:34Z")

</div>

Hi I am trying to register aws ES snapshot repository to local filesystem. Can anyone please help me in registering the repository. input curl -XPUT http://search-ecs-alblogs-@@@@@.us-west-2.es.amazonaws.com/\_snapshot/…

---

## [Getting exception on elasticSearch client program](https://discuss.elastic.co/t/getting-exception-on-elasticsearch-client-program/164623)

<div class="topic-metadata">

**Author:** [@Nandita\_Rane](https://discuss.elastic.co/u/Nandita_Rane)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 12:01pm UTC](https://discuss.elastic.co/t/getting-exception-on-elasticsearch-client-program/164623 "2019-01-17T12:01:20Z")

</div>

I am beginner to ELK technology stack and does not understand the error, your guideance will be extremely helpful. I tried application to convert csv file to json file using ELK server.I have setup kibana-5.6.1-windows-…

---

## [Strings that can be interpreted as Date cause trouble even if mapped as text](https://discuss.elastic.co/t/strings-that-can-be-interpreted-as-date-cause-trouble-even-if-mapped-as-text/163881)

<div class="topic-metadata">

**Author:** [@Sauter\_Vector](https://discuss.elastic.co/u/Sauter_Vector)\
**Replies:** 1\
**Last updated:** [January 17, 2019, 11:53am UTC](https://discuss.elastic.co/t/strings-that-can-be-interpreted-as-date-cause-trouble-even-if-mapped-as-text/163881 "2019-01-17T11:53:37Z")

</div>

Hello there, we have an application which allows our customer to upload and index almost any data. We seem to have an issue, if we have a property whose type is "Text", but the input data can be interpreted as a datetim…

---

## [Exception caught on transport layer (es6.4.2)](https://discuss.elastic.co/t/exception-caught-on-transport-layer-es6-4-2/163924)

<div class="topic-metadata">

**Author:** [@aparent](https://discuss.elastic.co/u/aparent)\
**Replies:** 45\
**Last updated:** [January 17, 2019, 10:59am UTC](https://discuss.elastic.co/t/exception-caught-on-transport-layer-es6-4-2/163924 "2019-01-17T10:59:33Z")

</div>

Hi ! I'm trying to reach a cluster (ES6.4.2) with SSl enabled. I'm using the java low-level API and the TransportClient. I can read/write on the cluster when SSL is disabled, but not when it is on. I don't know which…

---

## [How to get data in chunks | need for pagination](https://discuss.elastic.co/t/how-to-get-data-in-chunks-need-for-pagination/164594)

<div class="topic-metadata">

**Author:** [@Ashish.Singh](https://discuss.elastic.co/u/Ashish.Singh)\
**Replies:** 3\
**Last updated:** [January 17, 2019, 10:54am UTC](https://discuss.elastic.co/t/how-to-get-data-in-chunks-need-for-pagination/164594 "2019-01-17T10:54:09Z")

</div>

I am trying to implement pagination in my React Grid . In the base I am using SQL query to get data from ElasticSearch. I need something like , SELECT\* FROM bank ORDER BY account\_number OFFSET 5 \* (1 - 1) ROWS FETCH NE…

---

## [What should be the elastic query for the below data scenario?](https://discuss.elastic.co/t/what-should-be-the-elastic-query-for-the-below-data-scenario/164605)

<div class="topic-metadata">

**Author:** [@karan.j.shah](https://discuss.elastic.co/u/karan.j.shah)\
**Replies:** 0\
**Last updated:** [January 17, 2019, 10:19am UTC](https://discuss.elastic.co/t/what-should-be-the-elastic-query-for-the-below-data-scenario/164605 "2019-01-17T10:19:31Z")

</div>

Hello Everyone, I would like to discuss one scenario for retrieving millions of records from Elasticsearch. I am indexing Author Model as shown below in Elasticsearch and I am using NEST Client with a .net application. …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1421)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1423)
