# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1874

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1875

---

## [Query DSL: How to use must in should condition?](https://discuss.elastic.co/t/query-dsl-how-to-use-must-in-should-condition/108989)

<div class="topic-metadata">

**Author:** [@imqishi](https://discuss.elastic.co/u/imqishi)\
**Replies:** 3\
**Last updated:** [November 28, 2017, 11:36am UTC](https://discuss.elastic.co/t/query-dsl-how-to-use-must-in-should-condition/108989 "2017-11-28T11:36:05Z")

</div>

I need to do a time period-period match like this: Data has 2 time field such as d\_from and d\_to. Now given param p\_from and param p\_to. I need to get records which SHOULD satisfy following conditions: p\_from gte d\_…

---

## [Cluster setup on 2 virtual machines (Using vmware)](https://discuss.elastic.co/t/cluster-setup-on-2-virtual-machines-using-vmware/109371)

<div class="topic-metadata">

**Author:** [@nim1](https://discuss.elastic.co/u/nim1)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 11:12am UTC](https://discuss.elastic.co/t/cluster-setup-on-2-virtual-machines-using-vmware/109371 "2017-11-28T11:12:45Z")

</div>

Hello! I have 2 seperate elasticsearch nodes on 2 virtual machines (in the same network) and I would like to set them up as one cluster. I use VMWare for my virtual machines. I would like to know how to configure elas…

---

## [Is ES smart enough to only check documents that are used?](https://discuss.elastic.co/t/is-es-smart-enough-to-only-check-documents-that-are-used/109370)

<div class="topic-metadata">

**Author:** [@shaharmor](https://discuss.elastic.co/u/shaharmor)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 11:09am UTC](https://discuss.elastic.co/t/is-es-smart-enough-to-only-check-documents-that-are-used/109370 "2017-11-28T11:09:59Z")

</div>

Hi, Not sure if the title is good enough. I was wondering if ES is smart enough to filter documents by the fields that are used in aggregations or not. For example, given this query: { "aggs": { "bytes": { …

---

## [Search using result of previous search as parameter](https://discuss.elastic.co/t/search-using-result-of-previous-search-as-parameter/109203)

<div class="topic-metadata">

**Author:** [@ckhalilo](https://discuss.elastic.co/u/ckhalilo)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 10:40am UTC](https://discuss.elastic.co/t/search-using-result-of-previous-search-as-parameter/109203 "2017-11-28T10:40:09Z")

</div>

Hi, I need a help please, I have searched many topics and didn't find the answer. I need to pass result of search as parameters like in SQL : SELECT \* FROM Table Where Field\_1 = (SELECT Field\_1 FROM Table WHERE Field\_2…

---

## [How to rewrite an SQL Complex query](https://discuss.elastic.co/t/how-to-rewrite-an-sql-complex-query/109360)

<div class="topic-metadata">

**Author:** [@bilpor](https://discuss.elastic.co/u/bilpor)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 10:21am UTC](https://discuss.elastic.co/t/how-to-rewrite-an-sql-complex-query/109360 "2017-11-28T10:21:30Z")

</div>

HI All, I have created an index via logstash using the jdbc driver for sql and the index has been made using the following query: SELECT iDisID, iTopID, iPID, tblDiscussions.iUID, sSubject, dCreated, iViews, sQuestion,…

---

## [Please reconsider hosting docker image on Docker Hub](https://discuss.elastic.co/t/please-reconsider-hosting-docker-image-on-docker-hub/92679)

<div class="topic-metadata">

**Author:** [@twang2218](https://discuss.elastic.co/u/twang2218)\
**Replies:** 9\
**Last updated:** [November 28, 2017, 10:11am UTC](https://discuss.elastic.co/t/please-reconsider-hosting-docker-image-on-docker-hub/92679 "2017-11-28T10:11:54Z")

</div>

Just found out the original elasticsearch, logstash and kibana images on Docker Hub are marked as deprecated, and all the images will be hosted on elastic.co repository, and there will be no update for the Docker Hub rep…

---

## [Elasticsearch 5.6.3 upgrade to 6.0 Node will not start "failed to read local state"](https://discuss.elastic.co/t/elasticsearch-5-6-3-upgrade-to-6-0-node-will-not-start-failed-to-read-local-state/108252)

<div class="topic-metadata">

**Author:** [@kwslavens](https://discuss.elastic.co/u/kwslavens)\
**Replies:** 33\
**Last updated:** [November 28, 2017, 9:44am UTC](https://discuss.elastic.co/t/elasticsearch-5-6-3-upgrade-to-6-0-node-will-not-start-failed-to-read-local-state/108252 "2017-11-28T09:44:12Z")

</div>

We've updated our Dev system and our monitoring stack to 6.0 with minimal issues. When we attempt to update production node they refuse to start. Attempted the upgrade on two nodes now. Both nodes result in the same erro…

---

## [Collector timeouts and high CPU utilization after installing X-Pack](https://discuss.elastic.co/t/collector-timeouts-and-high-cpu-utilization-after-installing-x-pack/108678)

<div class="topic-metadata">

**Author:** [@mbsj](https://discuss.elastic.co/u/mbsj)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 9:28am UTC](https://discuss.elastic.co/t/collector-timeouts-and-high-cpu-utilization-after-installing-x-pack/108678 "2017-11-28T09:28:56Z")

</div>

I have installed X-Pack to Kibana, LogStash and Elasticsearch and generally it working fine (all version 6.0). However, i do have some issues in elasticseach. When looking in the logs i get a lot of these errors: \[2017…

---

## [NEST error handling for multiple types in the same index on ES6 is, erm, poor](https://discuss.elastic.co/t/nest-error-handling-for-multiple-types-in-the-same-index-on-es6-is-erm-poor/109345)

<div class="topic-metadata">

**Author:** [@WebReaper](https://discuss.elastic.co/u/WebReaper)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 9:05am UTC](https://discuss.elastic.co/t/nest-error-handling-for-multiple-types-in-the-same-index-on-es6-is-erm-poor/109345 "2017-11-28T09:05:09Z")

</div>

I've just upgraded my cluster from 5.5.2 to 6.0, and found that some code I was using to bulk index documents just failed. After some digging about, it turns out that I was doing two bulk index operations - each one stor…

---

## [Unable to use msearch using Curl or any Rest client](https://discuss.elastic.co/t/unable-to-use-msearch-using-curl-or-any-rest-client/109320)

<div class="topic-metadata">

**Author:** [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)\
**Replies:** 5\
**Last updated:** [November 28, 2017, 8:21am UTC](https://discuss.elastic.co/t/unable-to-use-msearch-using-curl-or-any-rest-client/109320 "2017-11-28T08:21:51Z")

</div>

Hi, I got the my complex \_msearch query from chrome developer tools. I took the payload the the request URL and pasted that in the dev tools and it worked fine and gave me the same result i was looking for as kibana UI.…

---

## [Is there a limit to scrolling or have i misunderstood size?](https://discuss.elastic.co/t/is-there-a-limit-to-scrolling-or-have-i-misunderstood-size/107945)

<div class="topic-metadata">

**Author:** [@bilpor](https://discuss.elastic.co/u/bilpor)\
**Replies:** 2\
**Last updated:** [November 28, 2017, 8:17am UTC](https://discuss.elastic.co/t/is-there-a-limit-to-scrolling-or-have-i-misunderstood-size/107945 "2017-11-28T08:17:32Z")

</div>

HI All, I've written some code in Classic asp that uses scrolling. On a particular search I know that I should be obtaining 1033 records. When I set my page size to 40 and perform my initial search then loop calling th…

---

## [To take snapshot in cluster without NFS?](https://discuss.elastic.co/t/to-take-snapshot-in-cluster-without-nfs/109324)

<div class="topic-metadata">

**Author:** [@MuthuRamalingam](https://discuss.elastic.co/u/MuthuRamalingam)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 8:07am UTC](https://discuss.elastic.co/t/to-take-snapshot-in-cluster-without-nfs/109324 "2017-11-28T08:07:47Z")

</div>

I have a multinode setup in my local. I need to take snapshot without nfs.

---

## [Elasticsearch Logfiles](https://discuss.elastic.co/t/elasticsearch-logfiles/109318)

<div class="topic-metadata">

**Author:** [@McElroy](https://discuss.elastic.co/u/McElroy)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 8:06am UTC](https://discuss.elastic.co/t/elasticsearch-logfiles/109318 "2017-11-28T08:06:48Z")

</div>

Hi, I ran into troubles with my elasticsearch log files. There were 21GB of logs one of my machines. After trying to reconfigure the log4j2.properties, elasticsearch didn't start anymore. Here is the documentation I'v…

---

## [GET log from access\_log's apache to send email](https://discuss.elastic.co/t/get-log-from-access-logs-apache-to-send-email/109325)

<div class="topic-metadata">

**Author:** [@tran\_canh\_khanh](https://discuss.elastic.co/u/tran_canh_khanh)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 7:56am UTC](https://discuss.elastic.co/t/get-log-from-access-logs-apache-to-send-email/109325 "2017-11-28T07:56:36Z")

</div>

Hi guys. I'm using x-pack to alert when my website is attacked with access file "/etc/password". I created 1 watcher with bellow content { "trigger": { "schedule": { "interval": "5m" } }, "input": { "search": { …

---

## [How to make words combination](https://discuss.elastic.co/t/how-to-make-words-combination/109326)

<div class="topic-metadata">

**Author:** [@Shekhar\_Pandey](https://discuss.elastic.co/u/Shekhar_Pandey)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 7:55am UTC](https://discuss.elastic.co/t/how-to-make-words-combination/109326 "2017-11-28T07:55:02Z")

</div>

Hi.. My query is can I make words combinations like I have suggest\["Hammer", "Red", "fortis"\] So if i used suggest query like below POST music/\_search?pretty { "suggest": { "song-suggest" : { "prefix" : "hamm", …

---

## [Problem with aggregation in Watcher](https://discuss.elastic.co/t/problem-with-aggregation-in-watcher/108908)

<div class="topic-metadata">

**Author:** [@g\_ani](https://discuss.elastic.co/u/g_ani)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 7:39am UTC](https://discuss.elastic.co/t/problem-with-aggregation-in-watcher/108908 "2017-11-28T07:39:37Z")

</div>

Hi I am currently facing some problems when trying to create an alert. My use case is that I want to calculate a ratio for each country (field on my index) and get notified for each country that this ratio is less than 9…

---

## [Add field by reindexing](https://discuss.elastic.co/t/add-field-by-reindexing/108466)

<div class="topic-metadata">

**Author:** [@prophoto](https://discuss.elastic.co/u/prophoto)\
**Replies:** 7\
**Last updated:** [November 28, 2017, 7:37am UTC](https://discuss.elastic.co/t/add-field-by-reindexing/108466 "2017-11-28T07:37:57Z")

</div>

How do I add a field to my index? I wanted a day of week field for my dashboard in Kibana. I was able to add it in Logstash, but need to reindex to add it to past documents? I've read over the documentation but it doesn'…

---

## [Resource limitation for each query](https://discuss.elastic.co/t/resource-limitation-for-each-query/109295)

<div class="topic-metadata">

**Author:** [@Edberg.s](https://discuss.elastic.co/u/Edberg.s)\
**Replies:** 3\
**Last updated:** [November 28, 2017, 7:31am UTC](https://discuss.elastic.co/t/resource-limitation-for-each-query/109295 "2017-11-28T07:31:34Z")

</div>

I think it is not an error but I need to solve it. Sometimes, huge query is carried-on over the elastic cluster like query with lots of 'or' and wide range of time (1 year or so...) At that time, this query takes most o…

---

## [PHP Client: Custom Query Parameters are Whitelisted](https://discuss.elastic.co/t/php-client-custom-query-parameters-are-whitelisted/109321)

<div class="topic-metadata">

**Author:** [@moy2010](https://discuss.elastic.co/u/moy2010)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 7:30am UTC](https://discuss.elastic.co/t/php-client-custom-query-parameters-are-whitelisted/109321 "2017-11-28T07:30:24Z")

</div>

Hi, ES community. I'm trying to get some custom query parameters in the PHP client as mentioned in the documentation, but when I log the request in Nginx I cannot see them, as if they were being whitelisted. The index a…

---

## [Unknown mimetype unable to deserialize](https://discuss.elastic.co/t/unknown-mimetype-unable-to-deserialize/108820)

<div class="topic-metadata">

**Author:** [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 7:12am UTC](https://discuss.elastic.co/t/unknown-mimetype-unable-to-deserialize/108820 "2017-11-28T07:12:16Z")

</div>

Hi , I am just playing around with python elasticsearch module. But seems like i am unable to make it work. Right now i am just setting up the connection so no complex coding yet. Below is what i see: Traceback (most r…

---

## [What would cause refresh=wait\_for to regularly take 2-5 seconds?](https://discuss.elastic.co/t/what-would-cause-refresh-wait-for-to-regularly-take-2-5-seconds/106369)

<div class="topic-metadata">

**Author:** [@Rod\_Howarth](https://discuss.elastic.co/u/Rod_Howarth)\
**Replies:** 8\
**Last updated:** [November 28, 2017, 6:53am UTC](https://discuss.elastic.co/t/what-would-cause-refresh-wait-for-to-regularly-take-2-5-seconds/106369 "2017-11-28T06:53:25Z")

</div>

Hi, I am facing a bit of trouble with something we're trying to do in our system and was hoping someone could give me some advice! We've been using elastic search quite heavily in our architecture, for text search but …

---

## [Reindex ES with aliases](https://discuss.elastic.co/t/reindex-es-with-aliases/109245)

<div class="topic-metadata">

**Author:** [@Natalia\_Kuleniuk](https://discuss.elastic.co/u/Natalia_Kuleniuk)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 6:34am UTC](https://discuss.elastic.co/t/reindex-es-with-aliases/109245 "2017-11-28T06:34:35Z")

</div>

Question about alises: I have ES index with 10 min documents. I need to add new fields and values for each document. I am going to use Scroll Search API to get documents and Bulk API to copy documents into new index \[ad…

---

## [ELK Stack and CI/CD](https://discuss.elastic.co/t/elk-stack-and-ci-cd/109254)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 5\
**Last updated:** [November 28, 2017, 5:30am UTC](https://discuss.elastic.co/t/elk-stack-and-ci-cd/109254 "2017-11-28T05:30:45Z")

</div>

Can you please share your views on ELK stack with CI and CD. Any standard procedures/process have been set to accomplish this process as part of Dev Ops activity?

---

## [Error comes in elastic search](https://discuss.elastic.co/t/error-comes-in-elastic-search/109240)

<div class="topic-metadata">

**Author:** [@sachin\_pradhan](https://discuss.elastic.co/u/sachin_pradhan)\
**Replies:** 2\
**Last updated:** [November 28, 2017, 5:17am UTC](https://discuss.elastic.co/t/error-comes-in-elastic-search/109240 "2017-11-28T05:17:30Z")

</div>

.es(index:kibanass, timefield='@TimeStamp').title('CPU usage over time').label('current hour is')

---

## [New Type not getting created in Elasticsearch](https://discuss.elastic.co/t/new-type-not-getting-created-in-elasticsearch/109306)

<div class="topic-metadata">

**Author:** [@vidyapati](https://discuss.elastic.co/u/vidyapati)\
**Replies:** 4\
**Last updated:** [November 28, 2017, 5:16am UTC](https://discuss.elastic.co/t/new-type-not-getting-created-in-elasticsearch/109306 "2017-11-28T05:16:07Z")

</div>

I am trying to create 3 elasticsearch type from code in an Index. One type is created successfully. Add data come in ES. But second type is not getting created. I am using spring elasticsearch data to create the data in …

---

## [Multiple node cluster worse than single node](https://discuss.elastic.co/t/multiple-node-cluster-worse-than-single-node/109308)

<div class="topic-metadata">

**Author:** [@Zhengcong\_Yin](https://discuss.elastic.co/u/Zhengcong_Yin)\
**Replies:** 0\
**Last updated:** [November 28, 2017, 5:13am UTC](https://discuss.elastic.co/t/multiple-node-cluster-worse-than-single-node/109308 "2017-11-28T05:13:29Z")

</div>

I had 43G data to do the match query. When I set up a single node (no dedicated role), it works very well. After I set up a cluster, 3 master node, 2 data node and 1 client node. The time took for each query seems like t…

---

## [Ported from old transport API to high rest API](https://discuss.elastic.co/t/ported-from-old-transport-api-to-high-rest-api/109294)

<div class="topic-metadata">

**Author:** [@blair](https://discuss.elastic.co/u/blair)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 2:55am UTC](https://discuss.elastic.co/t/ported-from-old-transport-api-to-high-rest-api/109294 "2017-11-28T02:55:26Z")

</div>

It went pretty smoothly. You will end up rewriting code around every single query, but it isn't too bad. The thread pools in the bulk loader is nice. There are a couple of bugs around Terms Aggregation, I get Invalid t…

---

## [ES Version and Shards Advice](https://discuss.elastic.co/t/es-version-and-shards-advice/109296)

<div class="topic-metadata">

**Author:** [@rwat090](https://discuss.elastic.co/u/rwat090)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 2:46am UTC](https://discuss.elastic.co/t/es-version-and-shards-advice/109296 "2017-11-28T02:46:37Z")

</div>

Hi Everyone, Im a newbie with ES and I just have some general questions (I’m just looking for advice) Current Installed ES version Version: 5.2.2 lucene\_version: 6.4.1 Version Question Im looking at upgrading ES…

---

## [Elasticsearch failed to delete unreferenced translog files due to unexpected Python and OpenSSL upgrade. If the issue is related to upgrade it should be infrastructure independent](https://discuss.elastic.co/t/elasticsearch-failed-to-delete-unreferenced-translog-files-due-to-unexpected-python-and-openssl-upgrade-if-the-issue-is-related-to-upgrade-it-should-be-infrastructure-independent/109168)

<div class="topic-metadata">

**Author:** [@david\_loh](https://discuss.elastic.co/u/david_loh)\
**Replies:** 1\
**Last updated:** [November 28, 2017, 2:26am UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-delete-unreferenced-translog-files-due-to-unexpected-python-and-openssl-upgrade-if-the-issue-is-related-to-upgrade-it-should-be-infrastructure-independent/109168 "2017-11-28T02:26:51Z")

</div>

Hi all, I got a production Elasticsearch cluster running on Azure. On 9th Nov, Azure agent started a yum update on OpenSSL and Python libraries. This action crashes one of the index. Have anyone with Elasticsearch on …

---

## [Webhook https , ignoring verification of certificate](https://discuss.elastic.co/t/webhook-https-ignoring-verification-of-certificate/25874)

<div class="topic-metadata">

**Author:** [@micjaesc](https://discuss.elastic.co/u/micjaesc)\
**Replies:** 6\
**Last updated:** [November 27, 2017, 11:27pm UTC](https://discuss.elastic.co/t/webhook-https-ignoring-verification-of-certificate/25874 "2017-11-27T23:27:25Z")

</div>

Hi, Is there any way to skip SSL validation when sending notification? Presently I have "actions": \[ { "id": "SLACK\_notify", "type": "webhook", …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1873)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1875)
