# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1085

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1086

---

## [Must\_Not aggregation double counting items](https://discuss.elastic.co/t/must-not-aggregation-double-counting-items/209198)

<div class="topic-metadata">

**Author:** [@ad\_rip](https://discuss.elastic.co/u/ad_rip)\
**Replies:** 0\
**Last updated:** [November 24, 2019, 7:41pm UTC](https://discuss.elastic.co/t/must-not-aggregation-double-counting-items/209198 "2019-11-24T19:41:45Z")

</div>

I'm hoping this is the right place to ask this. I've been trying to use a must\_not filter to get a count of all the items that don't contain a contain a specific field, but unfortunately the count is much higher than t…

---

## [Histogram in reverse nested](https://discuss.elastic.co/t/histogram-in-reverse-nested/209048)

<div class="topic-metadata">

**Author:** [@Yamuna\_Mallikarjun](https://discuss.elastic.co/u/Yamuna_Mallikarjun)\
**Replies:** 1\
**Last updated:** [November 24, 2019, 12:25pm UTC](https://discuss.elastic.co/t/histogram-in-reverse-nested/209048 "2019-11-24T12:25:18Z")

</div>

Data format: Basically i want to do the aggregation with histogram for 4 minutes. The pattern was: 1st min send 2 requests from each port 2nd min send 3 requests from each port 3rd min send 4 requests from each por…

---

## [Upgrading from 5.6.8 to 6.8](https://discuss.elastic.co/t/upgrading-from-5-6-8-to-6-8/209177)

<div class="topic-metadata">

**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\
**Replies:** 0\
**Last updated:** [November 24, 2019, 12:14pm UTC](https://discuss.elastic.co/t/upgrading-from-5-6-8-to-6-8/209177 "2019-11-24T12:14:07Z")

</div>

Hi, I'm having some trouble upgrading elasticsearch. Following : https://www.elastic.co/guide/en/elasticsearch/reference/6.8/rolling-upgrades.html And: https://www.elastic.co/guide/en/elasticsearch/reference/6.8/deb.ht…

---

## [More like this query](https://discuss.elastic.co/t/more-like-this-query/208553)

<div class="topic-metadata">

**Author:** [@Giannis](https://discuss.elastic.co/u/Giannis)\
**Replies:** 2\
**Last updated:** [November 23, 2019, 9:55pm UTC](https://discuss.elastic.co/t/more-like-this-query/208553 "2019-11-23T21:55:51Z")

</div>

GET articles/\_search { "query": { "more\_like\_this" : { "fields" : \["title"\], "like" : " Creating the model Apache", "min\_term\_freq" : 1, "max\_query\_terms" : 12 } } } In articles it exists the exact title " Cre…

---

## [Search query does'nt find the token](https://discuss.elastic.co/t/search-query-doesnt-find-the-token/208543)

<div class="topic-metadata">

**Author:** [@Giannis](https://discuss.elastic.co/u/Giannis)\
**Replies:** 4\
**Last updated:** [November 23, 2019, 9:54pm UTC](https://discuss.elastic.co/t/search-query-doesnt-find-the-token/208543 "2019-11-23T21:54:03Z")

</div>

I have the sentence "Is with any job to take courses" in title field. If i query with token "cours" doesnt match anything. I must query with token "courses" and then is ok! I use the english analyser https://www.elastic.…

---

## [Why does some fields names in Elasticsearch's API output have \`\_\` in them](https://discuss.elastic.co/t/why-does-some-fields-names-in-elasticsearchs-api-output-have-in-them/209157)

<div class="topic-metadata">

**Author:** [@viveksinghggits](https://discuss.elastic.co/u/viveksinghggits)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 4:44pm UTC](https://discuss.elastic.co/t/why-does-some-fields-names-in-elasticsearchs-api-output-have-in-them/209157 "2019-11-23T16:44:02Z")

</div>

If we take a look into the output of some of the APIs especially of search and run below command for a particular index let's say twitter curl \<host-ip\>:9200/twitter/\_search/pretty below is response that we get { "t…

---

## [Managing traffic with multiple Nics](https://discuss.elastic.co/t/managing-traffic-with-multiple-nics/209153)

<div class="topic-metadata">

**Author:** [@120GBSSD](https://discuss.elastic.co/u/120GBSSD)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 3:16pm UTC](https://discuss.elastic.co/t/managing-traffic-with-multiple-nics/209153 "2019-11-23T15:16:08Z")

</div>

Hi, I'm in an environment where all nodes run multiple NIC's, If users access the servers on NIC 1, I would like to make all elasticsearch and \*beats traffic run across NIC 2 is it possible to configure this as i haven…

---

## [COUNT(DISTINCT field\_name) is returning null](https://discuss.elastic.co/t/count-distinct-field-name-is-returning-null/209148)

<div class="topic-metadata">

**Author:** [@Eswari\_Kallakuri](https://discuss.elastic.co/u/Eswari_Kallakuri)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 10:08am UTC](https://discuss.elastic.co/t/count-distinct-field-name-is-returning-null/209148 "2019-11-23T10:08:27Z")

</div>

In ElasticSearch 7.4.2 version, COUNT(DISTINCT field\_name) is returning null instead of 0. Canvas is showing below error In ElasticSearch 7.3 version, COUNT(DISTINCT field\_name) is returning 0

---

## [Submit the Query with Role defined using Document Level Security](https://discuss.elastic.co/t/submit-the-query-with-role-defined-using-document-level-security/209128)

<div class="topic-metadata">

**Author:** [@shri\_palchuri](https://discuss.elastic.co/u/shri_palchuri)\
**Replies:** 1\
**Last updated:** [November 23, 2019, 6:40am UTC](https://discuss.elastic.co/t/submit-the-query-with-role-defined-using-document-level-security/209128 "2019-11-23T06:40:58Z")

</div>

Our system has around 100,000 users and each user has different permission on the data. I am planning to use elastic search roles concept to support permission/authorization. I will be defining one role on elasticsea…

---

## [How to reindex from an frozen index?](https://discuss.elastic.co/t/how-to-reindex-from-an-frozen-index/208801)

<div class="topic-metadata">

**Author:** [@stone\_xy](https://discuss.elastic.co/u/stone_xy)\
**Replies:** 2\
**Last updated:** [November 23, 2019, 6:04am UTC](https://discuss.elastic.co/t/how-to-reindex-from-an-frozen-index/208801 "2019-11-23T06:04:08Z")

</div>

ES Version: 7.4.2 Steps: create index and post some data: PUT logs { "settings": { "number\_of\_shards": 2, "number\_of\_replicas": 1 } } POST logs/\_doc { "msg": "hello there" } POST logs/\_doc { "msg": "hel…

---

## [Secure cURL connections and HTTP connections](https://discuss.elastic.co/t/secure-curl-connections-and-http-connections/209134)

<div class="topic-metadata">

**Author:** [@louisdeveloper](https://discuss.elastic.co/u/louisdeveloper)\
**Replies:** 3\
**Last updated:** [November 23, 2019, 5:44am UTC](https://discuss.elastic.co/t/secure-curl-connections-and-http-connections/209134 "2019-11-23T05:44:44Z")

</div>

I currently use ElasticSearch 6. \* installed on my server. In it I make cURL connections and access via HTTP directly, without having to enter username and password, just sending the request with HTTP to create and sear…

---

## [Elasticsearch 5.4.1 service stuck in windows](https://discuss.elastic.co/t/elasticsearch-5-4-1-service-stuck-in-windows/209139)

<div class="topic-metadata">

**Author:** [@Greg\_Kh](https://discuss.elastic.co/u/Greg_Kh)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 4:26am UTC](https://discuss.elastic.co/t/elasticsearch-5-4-1-service-stuck-in-windows/209139 "2019-11-23T04:26:52Z")

</div>

Elasticsearch 5.4.1 was remove from Windows 2016 server as part of the removing MS DevOps Server 2019... While it was removed, somehow it is still listed in the local services on the server, attempt to start it fails as …

---

## [Is allow partial indices a valid option snapshot option?](https://discuss.elastic.co/t/is-allow-partial-indices-a-valid-option-snapshot-option/209132)

<div class="topic-metadata">

**Author:** [@kyles](https://discuss.elastic.co/u/kyles)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 1:32am UTC](https://discuss.elastic.co/t/is-allow-partial-indices-a-valid-option-snapshot-option/209132 "2019-11-23T01:32:44Z")

</div>

In 7.4.2 I noticed that SLM has a snapshot policy option of "Allow partial indices". I noticed in the snapshot and restore documentation this option is not mentioned anywhere (link to docs) Although if I add it to a sta…

---

## [Issue with ES 6.8 supporting \_all field within index created in ES 5.6](https://discuss.elastic.co/t/issue-with-es-6-8-supporting-all-field-within-index-created-in-es-5-6/209130)

<div class="topic-metadata">

**Author:** [@blindwitness](https://discuss.elastic.co/u/blindwitness)\
**Replies:** 0\
**Last updated:** [November 23, 2019, 1:00am UTC](https://discuss.elastic.co/t/issue-with-es-6-8-supporting-all-field-within-index-created-in-es-5-6/209130 "2019-11-23T01:00:53Z")

</div>

Hello, In production, we use Elasticsearch to index our data for search related purposes. To interact with our current ES 5.6 cluster, we use the Java transport client. We are in the process of preparing for an upgrade …

---

## [Issue with nGram Analyzer on ECE](https://discuss.elastic.co/t/issue-with-ngram-analyzer-on-ece/208967)

<div class="topic-metadata">

**Author:** [@Francisco\_Noguera](https://discuss.elastic.co/u/Francisco_Noguera)\
**Replies:** 5\
**Last updated:** [November 22, 2019, 6:37pm UTC](https://discuss.elastic.co/t/issue-with-ngram-analyzer-on-ece/208967 "2019-11-22T18:37:39Z")

</div>

Hi, I'm creating a index on ECE with a nGram analyzer but never works the query. This is my index: { "settings": { "analysis": { "analyzer": { "ailabs\_analyzer": { "type": "stop", "stopwords": \["a", …

---

## [Retrieve metadata of document in response to queries](https://discuss.elastic.co/t/retrieve-metadata-of-document-in-response-to-queries/208939)

<div class="topic-metadata">

**Author:** [@chari](https://discuss.elastic.co/u/chari)\
**Replies:** 11\
**Last updated:** [November 22, 2019, 6:39pm UTC](https://discuss.elastic.co/t/retrieve-metadata-of-document-in-response-to-queries/208939 "2019-11-22T18:39:15Z")

</div>

I am indexing the text content of a file by using res = es.index(index=myIndex,body=jsonDict), where jsonDict is just the text of a pdf file in a json dictionary. I am able to query the content and retrieve the relevan…

---

## [Can we make basic authentication part of Open Source ES?](https://discuss.elastic.co/t/can-we-make-basic-authentication-part-of-open-source-es/209104)

<div class="topic-metadata">

**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\
**Replies:** 2\
**Last updated:** [November 22, 2019, 6:39pm UTC](https://discuss.elastic.co/t/can-we-make-basic-authentication-part-of-open-source-es/209104 "2019-11-22T18:39:03Z")

</div>

Hey all, This could be a sensitive topic, so I hope I'm able to address it tactfully. Can we please get basic authentication integrated into the open source version of Elasticsearch? And it should be turned on by defau…

---

## [ILM and alias confusion](https://discuss.elastic.co/t/ilm-and-alias-confusion/208753)

<div class="topic-metadata">

**Author:** [@Callahan](https://discuss.elastic.co/u/Callahan)\
**Replies:** 8\
**Last updated:** [November 22, 2019, 4:22pm UTC](https://discuss.elastic.co/t/ilm-and-alias-confusion/208753 "2019-11-22T16:22:15Z")

</div>

Hi, I have a 5 node cluster. 3 ingestion nodes, 1 coordinator node and a cold node. All ingestion goes via my Logstash server and the output of each index is dated as so: elasticsearch { index =\> "firewall-traffic-…

---

## [Significant terms aggregation custom score with more than one background](https://discuss.elastic.co/t/significant-terms-aggregation-custom-score-with-more-than-one-background/208910)

<div class="topic-metadata">

**Author:** [@dbuijs](https://discuss.elastic.co/u/dbuijs)\
**Replies:** 13\
**Last updated:** [November 22, 2019, 4:06pm UTC](https://discuss.elastic.co/t/significant-terms-aggregation-custom-score-with-more-than-one-background/208910 "2019-11-22T16:06:57Z")

</div>

I'm trying to implement different types of disproportionality metrics for pharmacovigilance reports in Elasticsearch. These are basically different flavours of significant terms aggregations, and I'm pretty sure I can us…

---

## [The Elasticsearch class is not starting on an exisiting project, but working fine on a vanilla site?](https://discuss.elastic.co/t/the-elasticsearch-class-is-not-starting-on-an-exisiting-project-but-working-fine-on-a-vanilla-site/209069)

<div class="topic-metadata">

**Author:** [@truls1502](https://discuss.elastic.co/u/truls1502)\
**Replies:** 2\
**Last updated:** [November 22, 2019, 3:37pm UTC](https://discuss.elastic.co/t/the-elasticsearch-class-is-not-starting-on-an-exisiting-project-but-working-fine-on-a-vanilla-site/209069 "2019-11-22T15:37:38Z")

</div>

I am trying to use DDEV, a Local Development environment, and use elasticsearch 6.8 with Drupal 8 site. I started to use the example recipe. But since it is not working and missing some parameters, so I want to get it w…

---

## [How import json file using filbeat to kibana](https://discuss.elastic.co/t/how-import-json-file-using-filbeat-to-kibana/209079)

<div class="topic-metadata">

**Author:** [@pmal](https://discuss.elastic.co/u/pmal)\
**Replies:** 0\
**Last updated:** [November 22, 2019, 2:59pm UTC](https://discuss.elastic.co/t/how-import-json-file-using-filbeat-to-kibana/209079 "2019-11-22T14:59:37Z")

</div>

I am sending tshark packets in JSON format to kibana, using filebeat. I am a newbie with kibana and filebeat. I am not getting any data. Not sure what is wrong, either importing template or creating an index. I can no…

---

## [Elasticsearch in nodejs: get suggest's simple\_phrase query values](https://discuss.elastic.co/t/elasticsearch-in-nodejs-get-suggests-simple-phrase-query-values/209070)

<div class="topic-metadata">

**Author:** [@akhut13](https://discuss.elastic.co/u/akhut13)\
**Replies:** 0\
**Last updated:** [November 22, 2019, 1:55pm UTC](https://discuss.elastic.co/t/elasticsearch-in-nodejs-get-suggests-simple-phrase-query-values/209070 "2019-11-22T13:55:24Z")

</div>

I have such kind of index test PUT test { "settings": { "index": { "number\_of\_shards": 1, "analysis": { "analyzer": { "trigram": { "type": "custom", "tokenizer…

---

## [Getting disk space error when rolling upgrades](https://discuss.elastic.co/t/getting-disk-space-error-when-rolling-upgrades/208977)

<div class="topic-metadata">

**Author:** [@araujonelson](https://discuss.elastic.co/u/araujonelson)\
**Replies:** 5\
**Last updated:** [November 22, 2019, 1:51pm UTC](https://discuss.elastic.co/t/getting-disk-space-error-when-rolling-upgrades/208977 "2019-11-22T13:51:29Z")

</div>

Hello, I'm currently performing a rolling upgrade from ES 5.6.8 to 6.8.4 following the steps told here Everything is fine but I'm having troubles with certain nodes and disk space. I'll describe the scenario I'm having…

---

## [Elasticsearch reindexing data](https://discuss.elastic.co/t/elasticsearch-reindexing-data/209029)

<div class="topic-metadata">

**Author:** [@zmira\_meriem](https://discuss.elastic.co/u/zmira_meriem)\
**Replies:** 6\
**Last updated:** [November 22, 2019, 1:45pm UTC](https://discuss.elastic.co/t/elasticsearch-reindexing-data/209029 "2019-11-22T13:45:47Z")

</div>

Hi!! i want to reindex data to elasticsearch for weekly or monthly indices,because i have problem with java space (memory) ps : i have one node how can i do that plz ????

---

## [How to increase the default size limit from 10000 to 1000000 in ElasticSearch](https://discuss.elastic.co/t/how-to-increase-the-default-size-limit-from-10000-to-1000000-in-elasticsearch/208807)

<div class="topic-metadata">

**Author:** [@chandu506](https://discuss.elastic.co/u/chandu506)\
**Replies:** 5\
**Last updated:** [November 22, 2019, 1:25pm UTC](https://discuss.elastic.co/t/how-to-increase-the-default-size-limit-from-10000-to-1000000-in-elasticsearch/208807 "2019-11-22T13:25:22Z")

</div>

How to increase the default size limit from 10000 to 1000000 in ElasticSearch

---

## [\_id needs to be unique only in index?](https://discuss.elastic.co/t/id-needs-to-be-unique-only-in-index/209039)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 2\
**Last updated:** [November 22, 2019, 11:29am UTC](https://discuss.elastic.co/t/id-needs-to-be-unique-only-in-index/209039 "2019-11-22T11:29:41Z")

</div>

Hi, If I set the \_id field on my own in logstash, where does it needs to be unique? Only within the same index or in all indices? Thanks, Andreas

---

## [Conditional Filter in pipeline](https://discuss.elastic.co/t/conditional-filter-in-pipeline/208482)

<div class="topic-metadata">

**Author:** [@graimato](https://discuss.elastic.co/u/graimato)\
**Replies:** 5\
**Last updated:** [November 22, 2019, 11:03am UTC](https://discuss.elastic.co/t/conditional-filter-in-pipeline/208482 "2019-11-22T11:03:16Z")

</div>

Dear All, I'm new in Eleastic environment. I need an help if it is possible. I create a pipeline to process the data from filebeat system, my pipeline works correctly I'm processing various parameters, one of them is an…

---

## [Ckp file missing](https://discuss.elastic.co/t/ckp-file-missing/209047)

<div class="topic-metadata">

**Author:** [@Beda\_Bogdan](https://discuss.elastic.co/u/Beda_Bogdan)\
**Replies:** 0\
**Last updated:** [November 22, 2019, 10:54am UTC](https://discuss.elastic.co/t/ckp-file-missing/209047 "2019-11-22T10:54:59Z")

</div>

Hi, We are running Elastic Search 2.3.3 and after a Node restart whilst the Disk Space was very very low, we are getting an error while recovering a shard as it cannot find a cpk file. There is a .tlog file with same na…

---

## [Max\_expansions performance concerns](https://discuss.elastic.co/t/max-expansions-performance-concerns/209045)

<div class="topic-metadata">

**Author:** [@sachmuchsachin](https://discuss.elastic.co/u/sachmuchsachin)\
**Replies:** 0\
**Last updated:** [November 22, 2019, 10:39am UTC](https://discuss.elastic.co/t/max-expansions-performance-concerns/209045 "2019-11-22T10:39:11Z")

</div>

Is there a serious concern if I set max\_expansions to a very large value say 5000? I have ~100 millions documents and I search on phone number prefixes (stored as sequence of digits). As data has grown, search accuracy …

---

## [Elasticsearch, docker and failover](https://discuss.elastic.co/t/elasticsearch-docker-and-failover/208314)

<div class="topic-metadata">

**Author:** [@vincent2mots](https://discuss.elastic.co/u/vincent2mots)\
**Replies:** 9\
**Last updated:** [November 22, 2019, 9:42am UTC](https://discuss.elastic.co/t/elasticsearch-docker-and-failover/208314 "2019-11-22T09:42:23Z")

</div>

Hi there, I'm struggling with my docker-compose configuration in order to test failover. I create 3 nodes (es01, es02 and es03) and I want to test a failover situation if I kill the master (es01). Here's my docker-comp…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1084)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1086)
