# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1082

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1083

---

## [Aggregation on previous aggregation's result](https://discuss.elastic.co/t/aggregation-on-previous-aggregations-result/207414)

<div class="topic-metadata">

**Author:** [@hi\_there](https://discuss.elastic.co/u/hi_there)\
**Replies:** 6\
**Last updated:** [November 27, 2019, 3:54pm UTC](https://discuss.elastic.co/t/aggregation-on-previous-aggregations-result/207414 "2019-11-27T15:54:45Z")

</div>

Hi first time poster, probably won't be last =D. I think Elasticsearch is cool, but I am stuck in trying to translate SQL to DSL and I was wondering if I could get some help. Nutshell is the following (using random sch…

---

## [Field\_name values from ml result resource](https://discuss.elastic.co/t/field-name-values-from-ml-result-resource/209589)

<div class="topic-metadata">

**Author:** [@Inammathe\_Inna](https://discuss.elastic.co/u/Inammathe_Inna)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 3:28pm UTC](https://discuss.elastic.co/t/field-name-values-from-ml-result-resource/209589 "2019-11-27T15:28:39Z")

</div>

Hey guys, I have a ML job that is doing a distinct count of a field over another e.g. "detector\_description": "distinct\_count(reply\_CustomerId) over request\_IPAddress", "function": "distinct\_count", "field\_name": "repl…

---

## [Issue while installing elastic search with azure web portal](https://discuss.elastic.co/t/issue-while-installing-elastic-search-with-azure-web-portal/209710)

<div class="topic-metadata">

**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\
**Replies:** 0\
**Last updated:** [November 27, 2019, 2:58pm UTC](https://discuss.elastic.co/t/issue-while-installing-elastic-search-with-azure-web-portal/209710 "2019-11-27T14:58:24Z")

</div>

Hey All. i having installation issue while adding elasticsearch with azure portal . any one is here who know or used elasticsearch with Azure web portal. please guide me about installation of Elasticsearch ;- what is…

---

## [Problem with cluster.max\_shards\_per\_node](https://discuss.elastic.co/t/problem-with-cluster-max-shards-per-node/209656)

<div class="topic-metadata">

**Author:** [@111228](https://discuss.elastic.co/u/111228)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 1:37pm UTC](https://discuss.elastic.co/t/problem-with-cluster-max-shards-per-node/209656 "2019-11-27T13:37:19Z")

</div>

Good day I have a problem :\_type=\>"\_doc", :routing=\>nil}, #LogStash::Event:0x23cacf18\], :response=\>{"index"=\>{"\_index"=\>"logstash-nginx-domain", "\_type"=\>"\_doc", "\_id"=\>nil, "status"=\>400, "error"=\>{"type"=\>"validation…

---

## [Unable to join ES server on port 9200](https://discuss.elastic.co/t/unable-to-join-es-server-on-port-9200/209529)

<div class="topic-metadata">

**Author:** [@Nabil777](https://discuss.elastic.co/u/Nabil777)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 12:41pm UTC](https://discuss.elastic.co/t/unable-to-join-es-server-on-port-9200/209529 "2019-11-27T12:41:32Z")

</div>

Hello, I am running elasticsearch and logstash on two different machines, the port 9200 and 9300 are "open" on the server running ES but it seems that the server running logstash doesn't have the rights to send data to t…

---

## [Java 8 supports till which elasticsearch version?](https://discuss.elastic.co/t/java-8-supports-till-which-elasticsearch-version/209614)

<div class="topic-metadata">

**Author:** [@Renuka](https://discuss.elastic.co/u/Renuka)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 12:28pm UTC](https://discuss.elastic.co/t/java-8-supports-till-which-elasticsearch-version/209614 "2019-11-27T12:28:16Z")

</div>

Java 8 supports till which elasticsearch version? We are currently using Java 8 and no plans to upgrade our application to java 11 in near future. We are planning to upgrade our elasticsearch from 5.6.0 to 7.4 (first t…

---

## [Elk-on-aws-EKS-Helm](https://discuss.elastic.co/t/elk-on-aws-eks-helm/209678)

<div class="topic-metadata">

**Author:** [@sree421](https://discuss.elastic.co/u/sree421)\
**Replies:** 0\
**Last updated:** [November 27, 2019, 12:20pm UTC](https://discuss.elastic.co/t/elk-on-aws-eks-helm/209678 "2019-11-27T12:20:14Z")

</div>

Hi , i was planing to do a production Elk stack on Aws EKS using Helm . But it seems like very difficult to find a good documentation on googling . If anyone here have a good documentation or some production grade best …

---

## [How to collapse individual indices into fewer?](https://discuss.elastic.co/t/how-to-collapse-individual-indices-into-fewer/209619)

<div class="topic-metadata">

**Author:** [@babarsiddique](https://discuss.elastic.co/u/babarsiddique)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 11:50am UTC](https://discuss.elastic.co/t/how-to-collapse-individual-indices-into-fewer/209619 "2019-11-27T11:50:58Z")

</div>

Error: Bad Gateway at respond (http://xxx.xxx.xxx:5000/bundles/kibana.bundle.js?v=15543:13:2730) ........ Opening kibana's dashboard stopped the elasticsearch master and elasticsearch health goes from gr…

---

## [How can I properly create an index in Elasticsearch using Ruby?](https://discuss.elastic.co/t/how-can-i-properly-create-an-index-in-elasticsearch-using-ruby/209620)

<div class="topic-metadata">

**Author:** [@yashwant](https://discuss.elastic.co/u/yashwant)\
**Replies:** 0\
**Last updated:** [November 27, 2019, 7:06am UTC](https://discuss.elastic.co/t/how-can-i-properly-create-an-index-in-elasticsearch-using-ruby/209620 "2019-11-27T07:06:33Z")

</div>

Hello, I have been trying to create an index using the ruby integrations of Elasticsearch. The code that I have as of now is as follows. build\_id = ENV\['BUILD\_NUM'\] elastic\_ip = ENV\['ELASTIC\_IP'\] project\_name = params…

---

## [Deploying multinode elastic cluster on Google Kubernetes Engine(GKE)](https://discuss.elastic.co/t/deploying-multinode-elastic-cluster-on-google-kubernetes-engine-gke/209420)

<div class="topic-metadata">

**Author:** [@SukeshGupta](https://discuss.elastic.co/u/SukeshGupta)\
**Replies:** 6\
**Last updated:** [November 27, 2019, 11:06am UTC](https://discuss.elastic.co/t/deploying-multinode-elastic-cluster-on-google-kubernetes-engine-gke/209420 "2019-11-27T11:06:48Z")

</div>

Hi, I have deployed elasticsearch on GKE with cluster size : 3 under Asia region. Is it possible to add a new cluster under US region in GKE and join this one to the above cluster ( which is located in asia region). If…

---

## [Elasticsearch helm chart, are privileged containers necessary?](https://discuss.elastic.co/t/elasticsearch-helm-chart-are-privileged-containers-necessary/206205)

<div class="topic-metadata">

**Author:** [@nfickas](https://discuss.elastic.co/u/nfickas)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 11:01am UTC](https://discuss.elastic.co/t/elasticsearch-helm-chart-are-privileged-containers-necessary/206205 "2019-11-27T11:01:54Z")

</div>

Hello, I am trying to deploy the elasticsearch helm chart onto a PKS cluster. I keep running into issues since the PodSecurityPolicy that is in effect does not allow for privileged containers. Is there a way to run the…

---

## [Elastic search with XPack on Azure K8S](https://discuss.elastic.co/t/elastic-search-with-xpack-on-azure-k8s/208628)

<div class="topic-metadata">

**Author:** [@siddheshb](https://discuss.elastic.co/u/siddheshb)\
**Replies:** 5\
**Last updated:** [November 27, 2019, 10:44am UTC](https://discuss.elastic.co/t/elastic-search-with-xpack-on-azure-k8s/208628 "2019-11-27T10:44:39Z")

</div>

I have few queries regarding setting up ES on kubernetes as we are currently facing issues while enabling basic security in our 3 master, 2 data and 2 client node configuration Is the helm chart stable/elasticsearch su…

---

## [Elastic Search not update config (elasticsearch.yml)](https://discuss.elastic.co/t/elastic-search-not-update-config-elasticsearch-yml/208208)

<div class="topic-metadata">

**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\
**Replies:** 12\
**Last updated:** [November 27, 2019, 9:34am UTC](https://discuss.elastic.co/t/elastic-search-not-update-config-elasticsearch-yml/208208 "2019-11-27T09:34:43Z")

</div>

I changed the configuration to elasticsearch.yml Current part of the configuration: xpack.security.enabled: true xpack.security.transport.ssl.enabled: true xpack.security.transport.ssl.verification\_mode: certificate …

---

## [Aggregation only query returns hits with no aggregations](https://discuss.elastic.co/t/aggregation-only-query-returns-hits-with-no-aggregations/209520)

<div class="topic-metadata">

**Author:** [@KamyarGhajar](https://discuss.elastic.co/u/KamyarGhajar)\
**Replies:** 0\
**Last updated:** [November 26, 2019, 1:16pm UTC](https://discuss.elastic.co/t/aggregation-only-query-returns-hits-with-no-aggregations/209520 "2019-11-26T13:16:46Z")

</div>

I have a query that works properly sometimes. This query is simple bool query with nested composite(on terms) aggregations with hits size of zero because I only need the terms agg results so I can group the results by a …

---

## [How to store objects which are shared for another objects?](https://discuss.elastic.co/t/how-to-store-objects-which-are-shared-for-another-objects/209326)

<div class="topic-metadata">

**Author:** [@SeminDM](https://discuss.elastic.co/u/SeminDM)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 9:25am UTC](https://discuss.elastic.co/t/how-to-store-objects-which-are-shared-for-another-objects/209326 "2019-11-27T09:25:44Z")

</div>

Hello! I have object of 'A' which have references to rarely changed object of 'RarelyChanged' (for example, user context) and frequently changed object of 'FrequentlyChanged'. "Rarely changed" means the many 'A' objec…

---

## [Have a single ip for the cluster](https://discuss.elastic.co/t/have-a-single-ip-for-the-cluster/209626)

<div class="topic-metadata">

**Author:** [@Medidou](https://discuss.elastic.co/u/Medidou)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 8:39am UTC](https://discuss.elastic.co/t/have-a-single-ip-for-the-cluster/209626 "2019-11-27T08:39:38Z")

</div>

Hello, I wanted to know how I can configure a single ip for my cluster that contains 3 nodes because currently my applications in config files just the ip of the master, but if it comes to fall my applications will not…

---

## [Error during elasticsearch upgrade 6.8 to 7.4.2 unassigned shards IllegalArgumentException failed to parse date field](https://discuss.elastic.co/t/error-during-elasticsearch-upgrade-6-8-to-7-4-2-unassigned-shards-illegalargumentexception-failed-to-parse-date-field/209452)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 7:59am UTC](https://discuss.elastic.co/t/error-during-elasticsearch-upgrade-6-8-to-7-4-2-unassigned-shards-illegalargumentexception-failed-to-parse-date-field/209452 "2019-11-27T07:59:42Z")

</div>

ERROR: (IllegalArgumentException\[failed to parse date field \[1574755226.3741724\] with format \[strict\_date\_optional\_time||epoch\_millis\]\]) During upgrade after I upgraded one node and reenabled shard allocation PUT \_clu…

---

## [Failed to obtain node locks, tried \[\[/datadisks/disk1/elasticsearch/data\]\] with lock id \[0\]; maybe these locations are not writable or multiple nodes were started without increasing \[node.max\_local\_storage\_nodes\] (was \[1\])?](https://discuss.elastic.co/t/failed-to-obtain-node-locks-tried-datadisks-disk1-elasticsearch-data-with-lock-id-0-maybe-these-locations-are-not-writable-or-multiple-nodes-were-started-without-increasing-node-max-local-storage-nodes-was-1/209624)

<div class="topic-metadata">

**Author:** [@Gokulnath](https://discuss.elastic.co/u/Gokulnath)\
**Replies:** 0\
**Last updated:** [November 27, 2019, 7:35am UTC](https://discuss.elastic.co/t/failed-to-obtain-node-locks-tried-datadisks-disk1-elasticsearch-data-with-lock-id-0-maybe-these-locations-are-not-writable-or-multiple-nodes-were-started-without-increasing-node-max-local-storage-nodes-was-1/209624 "2019-11-27T07:35:48Z")

</div>

In Kibana Nodes are in online, But when i checked the status in each node it shows it is failed. Thanks in Advance.

---

## [Kibana iframe with Token (Authentication purpose)](https://discuss.elastic.co/t/kibana-iframe-with-token-authentication-purpose/207744)

<div class="topic-metadata">

**Author:** [@vishal\_M](https://discuss.elastic.co/u/vishal_M)\
**Replies:** 8\
**Last updated:** [November 27, 2019, 7:19am UTC](https://discuss.elastic.co/t/kibana-iframe-with-token-authentication-purpose/207744 "2019-11-27T07:19:45Z")

</div>

Hello Team, I have integrated the Kibana dashboard "iframe" with my react application. But, each time I have to log-in to see the Kibana dashboard. (FYI: My Kibana version 7.4.0) So, I have followed a few paths to bypa…

---

## [Elasticsearch cluster is in Red state. How to recover it?](https://discuss.elastic.co/t/elasticsearch-cluster-is-in-red-state-how-to-recover-it/207444)

<div class="topic-metadata">

**Author:** [@chaitra\_hegde](https://discuss.elastic.co/u/chaitra_hegde)\
**Replies:** 13\
**Last updated:** [November 27, 2019, 6:58am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-in-red-state-how-to-recover-it/207444 "2019-11-27T06:58:36Z")

</div>

Hi, I am using Elasticsearch 6.6.1 in k8s environment. My cluster was in green state before. But now my cluster is in red state due to UNASSIGNED shards. I see many shards are in PRIMARY\_FAILED state. You can find the …

---

## [Error on elasticsearch](https://discuss.elastic.co/t/error-on-elasticsearch/208659)

<div class="topic-metadata">

**Author:** [@elktester](https://discuss.elastic.co/u/elktester)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 6:27am UTC](https://discuss.elastic.co/t/error-on-elasticsearch/208659 "2019-11-27T06:27:37Z")

</div>

Hello! I can not import the data (csv file) as I did before Whenever I try to import the files the following error is displayed: \[2019-11-20T09:58:52,897\]\[DEBUG\]\[org.logstash.execution.PeriodicFlush\]\[main\] Pushing flu…

---

## [How to log users trying to preform actions they arent allowed to preform](https://discuss.elastic.co/t/how-to-log-users-trying-to-preform-actions-they-arent-allowed-to-preform/206692)

<div class="topic-metadata">

**Author:** [@kyles](https://discuss.elastic.co/u/kyles)\
**Replies:** 2\
**Last updated:** [November 27, 2019, 6:23am UTC](https://discuss.elastic.co/t/how-to-log-users-trying-to-preform-actions-they-arent-allowed-to-preform/206692 "2019-11-27T06:23:40Z")

</div>

I have configured a 7.3.2 single node cluster with RBAC, the user testeruser only has permissions to read indices. If testuser tries to preform an action via an API call to check the cluster health it returns a 403 but I…

---

## [Pickup Updates from ElasticSearch Index and send to Kafka](https://discuss.elastic.co/t/pickup-updates-from-elasticsearch-index-and-send-to-kafka/209519)

<div class="topic-metadata">

**Author:** [@giridhar\_varma](https://discuss.elastic.co/u/giridhar_varma)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 6:05am UTC](https://discuss.elastic.co/t/pickup-updates-from-elasticsearch-index-and-send-to-kafka/209519 "2019-11-27T06:05:41Z")

</div>

Hello Team, Need your guidance for my problem Requirement:- we push the updates into our ES Index from our source, and we want to pick up those updates and further send to Kafka topic using kafka output plugin Questi…

---

## [Does ES Rally have OpenSSL to enable it](https://discuss.elastic.co/t/does-es-rally-have-openssl-to-enable-it/209612)

<div class="topic-metadata">

**Author:** [@suvarna](https://discuss.elastic.co/u/suvarna)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 5:59am UTC](https://discuss.elastic.co/t/does-es-rally-have-openssl-to-enable-it/209612 "2019-11-27T05:59:46Z")

</div>

Can you please let me know whether we can enable openSSL at esrally side.

---

## [Highlighting Using Nest](https://discuss.elastic.co/t/highlighting-using-nest/208180)

<div class="topic-metadata">

**Author:** [@han1](https://discuss.elastic.co/u/han1)\
**Replies:** 7\
**Last updated:** [November 27, 2019, 5:15am UTC](https://discuss.elastic.co/t/highlighting-using-nest/208180 "2019-11-27T05:15:37Z")

</div>

We are trying to use the Highlighting feature , but we just want to update each document that has the relevant highlights. For example: var hits = searchResponse.Hits.Where(h =\> h.Highlight.Count \> 0).Select(p =\> { p.S…

---

## [What are the different kind of OutOfMemory in ElasticSearch?](https://discuss.elastic.co/t/what-are-the-different-kind-of-outofmemory-in-elasticsearch/209590)

<div class="topic-metadata">

**Author:** [@kgpersonal](https://discuss.elastic.co/u/kgpersonal)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 3:16am UTC](https://discuss.elastic.co/t/what-are-the-different-kind-of-outofmemory-in-elasticsearch/209590 "2019-11-27T03:16:23Z")

</div>

Hi Team, What are the different cases where OutOfMemory might occur? I want to test my ES cluster with OutOfMemory exceptions. I would like to explore the options to obtain the same. What settings would help me create…

---

## [Interpreting Advanced Monitoring Stats](https://discuss.elastic.co/t/interpreting-advanced-monitoring-stats/209596)

<div class="topic-metadata">

**Author:** [@jmartori](https://discuss.elastic.co/u/jmartori)\
**Replies:** 0\
**Last updated:** [November 27, 2019, 1:52am UTC](https://discuss.elastic.co/t/interpreting-advanced-monitoring-stats/209596 "2019-11-27T01:52:54Z")

</div>

Hi there, I've been trying to find information about how to interpret the advanced monitoring section in kibana. However I haven't been able to find in it ES doc. How do you know a "normal" GC Count or GC Duration. We …

---

## [Elastic search start service is failing](https://discuss.elastic.co/t/elastic-search-start-service-is-failing/206388)

<div class="topic-metadata">

**Author:** [@Shradha\_Bharti](https://discuss.elastic.co/u/Shradha_Bharti)\
**Replies:** 1\
**Last updated:** [November 27, 2019, 12:13am UTC](https://discuss.elastic.co/t/elastic-search-start-service-is-failing/206388 "2019-11-27T00:13:02Z")

</div>

Hi I am trying to install the elastic search 7.3.0 version in my centos server when i m checking the status with systemctl status elasticsearch -l command I am getting the below error elasticsearch.service - Elasti…

---

## [How to do group by multiple fields and sort on a different field, in elasticsearch](https://discuss.elastic.co/t/how-to-do-group-by-multiple-fields-and-sort-on-a-different-field-in-elasticsearch/207963)

<div class="topic-metadata">

**Author:** [@Seetha93](https://discuss.elastic.co/u/Seetha93)\
**Replies:** 4\
**Last updated:** [November 26, 2019, 7:21pm UTC](https://discuss.elastic.co/t/how-to-do-group-by-multiple-fields-and-sort-on-a-different-field-in-elasticsearch/207963 "2019-11-26T19:21:22Z")

</div>

Lets say I have a query like Select \* from table Group By field\_1, field\_2, field\_3 Order By filed\_7; How to achieve the same functionality in elasticsearch. I use Composite Aggregations to do Group by multiple fields.…

---

## [Is it possible to run Rally against an Elastic Cloud Elasticsearch deployment?](https://discuss.elastic.co/t/is-it-possible-to-run-rally-against-an-elastic-cloud-elasticsearch-deployment/209358)

<div class="topic-metadata">

**Author:** [@Ian\_Billett](https://discuss.elastic.co/u/Ian_Billett)\
**Replies:** 1\
**Last updated:** [November 26, 2019, 6:30pm UTC](https://discuss.elastic.co/t/is-it-possible-to-run-rally-against-an-elastic-cloud-elasticsearch-deployment/209358 "2019-11-26T18:30:06Z")

</div>

Hello :wave: Is it possible to run Rally benchmarks against my existing Elastic Cloud Elasticsearch 7.3 deployment? If so, please can you point me towards documentation? I couldn't see anything obvious on https://esral…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1081)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1083)
