# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=848

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 849

---

## [Out of the box Refiners](https://discuss.elastic.co/t/out-of-the-box-refiners/242716)

<div class="topic-metadata">

**Author:** [@aakhiezer](https://discuss.elastic.co/u/aakhiezer)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 8:48am UTC](https://discuss.elastic.co/t/out-of-the-box-refiners/242716 "2020-07-30T08:48:56Z")

</div>

I'm pretty new at elastic and I'm wondering is there out of the box feature of Refiners, like in SharePoint search? Thanks a lot!

---

## [Pairing nested properties in nested filter](https://discuss.elastic.co/t/pairing-nested-properties-in-nested-filter/243185)

<div class="topic-metadata">

**Author:** [@Yonatan\_Omer](https://discuss.elastic.co/u/Yonatan_Omer)\
**Replies:** 0\
**Last updated:** [July 30, 2020, 8:37am UTC](https://discuss.elastic.co/t/pairing-nested-properties-in-nested-filter/243185 "2020-07-30T08:37:51Z")

</div>

Hi Our documents have a nested array tasks. We need to filter documents having task.cpu \> X for tasks entries having tasks.id = 'foo' { "tasks" : { "type" : "nested", "properties" : { "cpu" : { "type" : "floa…

---

## [Only one node in cluster(6 nodes) slow query and high read I/O when querying](https://discuss.elastic.co/t/only-one-node-in-cluster-6-nodes-slow-query-and-high-read-i-o-when-querying/243158)

<div class="topic-metadata">

**Author:** [@Sunghoon\_Jo](https://discuss.elastic.co/u/Sunghoon_Jo)\
**Replies:** 6\
**Last updated:** [July 30, 2020, 8:17am UTC](https://discuss.elastic.co/t/only-one-node-in-cluster-6-nodes-slow-query-and-high-read-i-o-when-querying/243158 "2020-07-30T08:17:23Z")

</div>

Hi All, I have some problem when querying. My cluster have 6 data nodes. When I query, only one node has unusual symptoms. my query is very simple. I'm doing stress tests, only one node shows high Read I/O(3000/s) , L…

---

## [All index missing every 1-2 days. What is happening?](https://discuss.elastic.co/t/all-index-missing-every-1-2-days-what-is-happening/243152)

<div class="topic-metadata">

**Author:** [@Oh\_Chee\_Peng](https://discuss.elastic.co/u/Oh_Chee_Peng)\
**Replies:** 4\
**Last updated:** [July 30, 2020, 7:50am UTC](https://discuss.elastic.co/t/all-index-missing-every-1-2-days-what-is-happening/243152 "2020-07-30T07:50:13Z")

</div>

I created an instance on Google Cloud, using Elasticsearch Certified by Bitnami. There is no issue with creating index, but every 1 or 2 days, all index will be mysteriously missing, and I am having hard time troublesho…

---

## [Time-range search query help](https://discuss.elastic.co/t/time-range-search-query-help/243161)

<div class="topic-metadata">

**Author:** [@sandeepgdba](https://discuss.elastic.co/u/sandeepgdba)\
**Replies:** 1\
**Last updated:** [July 30, 2020, 7:47am UTC](https://discuss.elastic.co/t/time-range-search-query-help/243161 "2020-07-30T07:47:18Z")

</div>

Hi, I need help in time-range search aggregations, I am trying to figure out aggregated visits for every 2 hours below is the query which doesn't work. help needed on this POST index\_name/\_search { "size": 0, "quer…

---

## [Unable to authenticate elastic user when DR node is isolated from the elastic cluster](https://discuss.elastic.co/t/unable-to-authenticate-elastic-user-when-dr-node-is-isolated-from-the-elastic-cluster/243174)

<div class="topic-metadata">

**Author:** [@hiruni.insyncit.net](https://discuss.elastic.co/u/hiruni.insyncit.net)\
**Replies:** 1\
**Last updated:** [July 30, 2020, 7:44am UTC](https://discuss.elastic.co/t/unable-to-authenticate-elastic-user-when-dr-node-is-isolated-from-the-elastic-cluster/243174 "2020-07-30T07:44:32Z")

</div>

The elastic cluster consists of 5 primary nodes and 1 DR node. I was unable to authenticate the elastic cluster using elastic user(basic authentication). Also, I tried to curl -XGET -u elastic:password http://localhost…

---

## [Is there connector or plugin to pull or push nagios monitoring data to ELK?](https://discuss.elastic.co/t/is-there-connector-or-plugin-to-pull-or-push-nagios-monitoring-data-to-elk/243163)

<div class="topic-metadata">

**Author:** [@Jaya\_Nehru\_Kumar](https://discuss.elastic.co/u/Jaya_Nehru_Kumar)\
**Replies:** 0\
**Last updated:** [July 30, 2020, 6:46am UTC](https://discuss.elastic.co/t/is-there-connector-or-plugin-to-pull-or-push-nagios-monitoring-data-to-elk/243163 "2020-07-30T06:46:32Z")

</div>

is there connector or plugin to pull or push nagios monitoring data to ELK?

---

## [Multiple/Join query on same index](https://discuss.elastic.co/t/multiple-join-query-on-same-index/243160)

<div class="topic-metadata">

**Author:** [@mohitbharti](https://discuss.elastic.co/u/mohitbharti)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 6:05am UTC](https://discuss.elastic.co/t/multiple-join-query-on-same-index/243160 "2020-07-30T06:05:53Z")

</div>

I want to know the Elastic search query for select \* from (Select sum(income) from users where users.name like '%abc%' group by users.address) aResult, (select count(\*), phone number from users where users.name like '%…

---

## [Bug in bulk requests with mix of requests with and without pipelines](https://discuss.elastic.co/t/bug-in-bulk-requests-with-mix-of-requests-with-and-without-pipelines/242973)

<div class="topic-metadata">

**Author:** [@sihtam23](https://discuss.elastic.co/u/sihtam23)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 5:53am UTC](https://discuss.elastic.co/t/bug-in-bulk-requests-with-mix-of-requests-with-and-without-pipelines/242973 "2020-07-30T05:53:11Z")

</div>

I'm new here but not new to using the Elastic stack; I apologise if I get reporting this bug wrong. This bug exists in Elasticsearch 7.8. I know it doesn't exist in 6.8 but I haven't looked at all the in-between version…

---

## [Rollover Automation with ILM](https://discuss.elastic.co/t/rollover-automation-with-ilm/243112)

<div class="topic-metadata">

**Author:** [@hemanth49841](https://discuss.elastic.co/u/hemanth49841)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 5:51am UTC](https://discuss.elastic.co/t/rollover-automation-with-ilm/243112 "2020-07-30T05:51:41Z")

</div>

Hi All, I have face a issue with indices rollover automation with ILM. Created ILM policy with rollover Max index size is 1GB. But rollover is happening at 1.2 GB. almost 0.2 GB lag is there. Also, changed the Cluster…

---

## [Ansible Elasticsearch Hangs on TASK \[elastic.elasticsearch : Wait for elasticsearch to startup\]](https://discuss.elastic.co/t/ansible-elasticsearch-hangs-on-task-elastic-elasticsearch-wait-for-elasticsearch-to-startup/241734)

<div class="topic-metadata">

**Author:** [@M\_M](https://discuss.elastic.co/u/M_M)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 5:04am UTC](https://discuss.elastic.co/t/ansible-elasticsearch-hangs-on-task-elastic-elasticsearch-wait-for-elasticsearch-to-startup/241734 "2020-07-30T05:04:06Z")

</div>

The elasticsearch initiates successfully on the nodes but somehow ansible is stuck at TASK \[elastic.elasticsearch : Wait for elasticsearch to startup\] My nodes are EC2 Amazon linux 2 and ansible is run from my desktop…

---

## [Table Visual with Top Hit and filtering](https://discuss.elastic.co/t/table-visual-with-top-hit-and-filtering/243155)

<div class="topic-metadata">

**Author:** [@analog\_memories](https://discuss.elastic.co/u/analog_memories)\
**Replies:** 0\
**Last updated:** [July 30, 2020, 4:32am UTC](https://discuss.elastic.co/t/table-visual-with-top-hit-and-filtering/243155 "2020-07-30T04:32:36Z")

</div>

Hello there. I have a table visual that I have 2 Top Hits aggs. This is for Metricbeat filesystem used, trying to see when a host breaks a threshold. The Top Hits are for when the host is first seen in the query resul…

---

## [Elastic Search REST api version dependency](https://discuss.elastic.co/t/elastic-search-rest-api-version-dependency/243134)

<div class="topic-metadata">

**Author:** [@Musfiqur\_Siddique](https://discuss.elastic.co/u/Musfiqur_Siddique)\
**Replies:** 1\
**Last updated:** [July 30, 2020, 2:42am UTC](https://discuss.elastic.co/t/elastic-search-rest-api-version-dependency/243134 "2020-07-30T02:42:26Z")

</div>

I see that there is a lot of similarities among different ES Highlevel REST versions in terms the api signature and data models https://www.elastic.co/guide/en/elasticsearch/client/java-rest/current/java-rest-high.html.…

---

## [Automatically created templates break beats dashboards](https://discuss.elastic.co/t/automatically-created-templates-break-beats-dashboards/242831)

<div class="topic-metadata">

**Author:** [@jclemons7](https://discuss.elastic.co/u/jclemons7)\
**Replies:** 2\
**Last updated:** [July 30, 2020, 12:54am UTC](https://discuss.elastic.co/t/automatically-created-templates-break-beats-dashboards/242831 "2020-07-30T00:54:52Z")

</div>

Hello, I'm hoping someone can help me get this straight in my head. I've setup elastic stack all on one server and everything works well as it is. I've been messing with the beats in my lab (Winlogbeat, Packetbeat, Me…

---

## [We want to automatically delete some document with different expiration dates](https://discuss.elastic.co/t/we-want-to-automatically-delete-some-document-with-different-expiration-dates/243000)

<div class="topic-metadata">

**Author:** [@devin.teki](https://discuss.elastic.co/u/devin.teki)\
**Replies:** 7\
**Last updated:** [July 30, 2020, 12:54am UTC](https://discuss.elastic.co/t/we-want-to-automatically-delete-some-document-with-different-expiration-dates/243000 "2020-07-30T00:54:32Z")

</div>

How to let elasticsearch5.5.2 automatic delete document by some datetime field. The \_ttl mappings have been removed from 5.x. because effifient problem. Is there any other way I can delete expired files automatically…

---

## [Elasticsearch using too much memory](https://discuss.elastic.co/t/elasticsearch-using-too-much-memory/242808)

<div class="topic-metadata">

**Author:** [@SteveHodges](https://discuss.elastic.co/u/SteveHodges)\
**Replies:** 9\
**Last updated:** [July 29, 2020, 11:08pm UTC](https://discuss.elastic.co/t/elasticsearch-using-too-much-memory/242808 "2020-07-29T23:08:12Z")

</div>

Hello, Originally the ELK stack was working great but after several months of collecting logs, Kibana reports are failing to run properly and it appears due to Elasticsearch memory issues. At least for the past week th…

---

## [Does in refresh interval data of the entire shards get changed](https://discuss.elastic.co/t/does-in-refresh-interval-data-of-the-entire-shards-get-changed/242886)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 9:39pm UTC](https://discuss.elastic.co/t/does-in-refresh-interval-data-of-the-entire-shards-get-changed/242886 "2020-07-29T21:39:46Z")

</div>

Does in refresh interval data of the entire shards get changed or only the data which has been changed. Suppose refresh interval is 1s. And in if index.requests.cache.enable = true then filter query results will be c…

---

## [Enable Index after disabling it](https://discuss.elastic.co/t/enable-index-after-disabling-it/242803)

<div class="topic-metadata">

**Author:** [@animageofmine](https://discuss.elastic.co/u/animageofmine)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 9:29pm UTC](https://discuss.elastic.co/t/enable-index-after-disabling-it/242803 "2020-07-29T21:29:43Z")

</div>

Index attribute enables / disables indexing on elasticsearch. I am wondering if I can do the following: Disable indexing (set index to false) on a field. At some point in future, enable indexing on that field. This is…

---

## [Elasticsearch-hadoop Connector](https://discuss.elastic.co/t/elasticsearch-hadoop-connector/243090)

<div class="topic-metadata">

**Author:** [@bastienharmand](https://discuss.elastic.co/u/bastienharmand)\
**Replies:** 0\
**Last updated:** [July 29, 2020, 3:44pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-connector/243090 "2020-07-29T15:44:04Z")

</div>

Hello, I want to connect to an Elasticsearch \[7.5\] cluster with elasticsearch-hadoop using the SSL protocol. By providing the user and password with curl : curl -XPUT -k -u "user:pass" https://xxxxxxxxxxx:9200/prefix-t…

---

## [How to recover unassigned shards and replica for a index](https://discuss.elastic.co/t/how-to-recover-unassigned-shards-and-replica-for-a-index/242917)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 5:46pm UTC](https://discuss.elastic.co/t/how-to-recover-unassigned-shards-and-replica-for-a-index/242917 "2020-07-29T17:46:54Z")

</div>

HI team, I want to know how to recover the red state into Green and when it try to find the reason and im getting below data, xx-logstash-2020.07 0 p INITIALIZING INDEX\_REOPENED xx-logstash-2020.07 0 …

---

## [How to fix this date range](https://discuss.elastic.co/t/how-to-fix-this-date-range/243065)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 3\
**Last updated:** [July 29, 2020, 3:42pm UTC](https://discuss.elastic.co/t/how-to-fix-this-date-range/243065 "2020-07-29T15:42:58Z")

</div>

Hi, Here is sample code from the documentation: GET /\_search { "query": { "range": { "timestamp": { "gte": "now-1d/d", "lt": "now/d" } } } } I want to change it so that now only…

---

## [By Date Indexes when using Elastic Ingest](https://discuss.elastic.co/t/by-date-indexes-when-using-elastic-ingest/242994)

<div class="topic-metadata">

**Author:** [@tbernhardson](https://discuss.elastic.co/u/tbernhardson)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 3:29pm UTC](https://discuss.elastic.co/t/by-date-indexes-when-using-elastic-ingest/242994 "2020-07-29T15:29:21Z")

</div>

When using Logstash it's easy to tell the system to create indices by day (also then making it easy to delete old data). I've tried to figure out how to do the same thing when sending the beats data directly to Elastics…

---

## [Conditional watcher alert](https://discuss.elastic.co/t/conditional-watcher-alert/240210)

<div class="topic-metadata">

**Author:** [@velu](https://discuss.elastic.co/u/velu)\
**Replies:** 4\
**Last updated:** [July 29, 2020, 2:18pm UTC](https://discuss.elastic.co/t/conditional-watcher-alert/240210 "2020-07-29T14:18:17Z")

</div>

Hi, Is it possible to set the alert triggering condition like ...the alert should trigger after 10 mins after it reaches threshold value . Note: we have to wait for 10 mins to check whether the value is getting draine…

---

## [Elastic machine learning code source](https://discuss.elastic.co/t/elastic-machine-learning-code-source/242847)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 14\
**Last updated:** [July 29, 2020, 1:50pm UTC](https://discuss.elastic.co/t/elastic-machine-learning-code-source/242847 "2020-07-29T13:50:00Z")

</div>

Hello everybody, I started using elastic and kibana from code source, could someone please tell me how can I integrate machine learning "https://github.com/elastic/ml-cpp" with elasticsearch "https://github.com/elastic/…

---

## [Adding new node to cluster](https://discuss.elastic.co/t/adding-new-node-to-cluster/242223)

<div class="topic-metadata">

**Author:** [@hariskhalique](https://discuss.elastic.co/u/hariskhalique)\
**Replies:** 11\
**Last updated:** [July 29, 2020, 1:21pm UTC](https://discuss.elastic.co/t/adding-new-node-to-cluster/242223 "2020-07-29T13:21:53Z")

</div>

Hi, I want to add new node to running cluster. I have two servers on which elastic search 7.8 is setup. Server # 1 IP address x.x.x.x port 9200 hostname: es1.example.com Server # 2 IP Address x.x.x.x port 9200 hostna…

---

## [Shall we add more than 50 nested fields in single index?](https://discuss.elastic.co/t/shall-we-add-more-than-50-nested-fields-in-single-index/241901)

<div class="topic-metadata">

**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\
**Replies:** 7\
**Last updated:** [July 29, 2020, 12:32pm UTC](https://discuss.elastic.co/t/shall-we-add-more-than-50-nested-fields-in-single-index/241901 "2020-07-29T12:32:41Z")

</div>

Hi Team, Greetings..! Hope you are doing good. My requirement is to add 55 nested fields in a single index. but elastic recommendation is 50, If i add more than 50 nested fields means will it affect my performance? Ki…

---

## [Updating documents when using auto-generated IDs](https://discuss.elastic.co/t/updating-documents-when-using-auto-generated-ids/242828)

<div class="topic-metadata">

**Author:** [@jerrymj](https://discuss.elastic.co/u/jerrymj)\
**Replies:** 6\
**Last updated:** [July 29, 2020, 9:52am UTC](https://discuss.elastic.co/t/updating-documents-when-using-auto-generated-ids/242828 "2020-07-29T09:52:07Z")

</div>

Hi, I have an index running on 6.3. It is about 11MM documents, and since the documents are nested, they are much larger in count. These documents represent information stored in multiple databases relating to a specifi…

---

## [Cannot delete index template](https://discuss.elastic.co/t/cannot-delete-index-template/243009)

<div class="topic-metadata">

**Author:** [@Karel\_Cech](https://discuss.elastic.co/u/Karel_Cech)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 9:58am UTC](https://discuss.elastic.co/t/cannot-delete-index-template/243009 "2020-07-29T09:58:18Z")

</div>

Hi, I accidentally created 2 templates with the same name and same pattern. Unfortunately, I don't remember how this happened, because the API does not allow to create templates of same priority and same pattern. But I…

---

## [All Shards failed to assign](https://discuss.elastic.co/t/all-shards-failed-to-assign/242075)

<div class="topic-metadata">

**Author:** [@Pradeep\_K\_S](https://discuss.elastic.co/u/Pradeep_K_S)\
**Replies:** 18\
**Last updated:** [July 29, 2020, 9:01am UTC](https://discuss.elastic.co/t/all-shards-failed-to-assign/242075 "2020-07-29T09:01:55Z")

</div>

Hi, I tried restoring EBS of Elastic search nodes from one cluster to another but after restoring the EBS nodes are running in EC2 but cluster health shows red. GET http://hostname/\_cluster/health?pretty { "cluster\_n…

---

## [Slow Elasticsearch Ingestion](https://discuss.elastic.co/t/slow-elasticsearch-ingestion/243006)

<div class="topic-metadata">

**Author:** [@evacch](https://discuss.elastic.co/u/evacch)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 8:20am UTC](https://discuss.elastic.co/t/slow-elasticsearch-ingestion/243006 "2020-07-29T08:20:50Z")

</div>

I am new to ELK stack and I am currently testing on the performance of the Elasticsearch with 3 different configurations as follows: One source file: 1GB One source file: 3GB 3 source files: 1GB+1GB+1GB It took me 3 t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=847)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=849)
