# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1146

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1147

---

## [Composite Aggregation pagination size](https://discuss.elastic.co/t/composite-aggregation-pagination-size/200802)

<div class="topic-metadata">

**Author:** [@mmeng](https://discuss.elastic.co/u/mmeng)\
**Replies:** 0\
**Last updated:** [September 24, 2019, 7:01am UTC](https://discuss.elastic.co/t/composite-aggregation-pagination-size/200802 "2019-09-24T07:01:55Z")

</div>

I remember some document mentioned the number of buckets returned from a composite aggregation query has a soft limit of 10000. I wonder if that 10000 includes the sub aggregation buckets. Thanks for anyone's help of an…

---

## [Elasticsearch Java REST high level client and Timeout values](https://discuss.elastic.co/t/elasticsearch-java-rest-high-level-client-and-timeout-values/200800)

<div class="topic-metadata">

**Author:** [@pequt](https://discuss.elastic.co/u/pequt)\
**Replies:** 0\
**Last updated:** [September 24, 2019, 6:56am UTC](https://discuss.elastic.co/t/elasticsearch-java-rest-high-level-client-and-timeout-values/200800 "2019-09-24T06:56:33Z")

</div>

Hello all. Version using: Elasticsearch server / Java REST high level client, 7.2.0 I was trying to confirm a timeout behavior, so made a RestHighLevelClient like below - RestClientBuilder.RequestConfigCallback reque…

---

## [Upgrade ELK 6.4.0 to ELK 7.3.2](https://discuss.elastic.co/t/upgrade-elk-6-4-0-to-elk-7-3-2/199590)

<div class="topic-metadata">

**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\
**Replies:** 6\
**Last updated:** [September 24, 2019, 5:48am UTC](https://discuss.elastic.co/t/upgrade-elk-6-4-0-to-elk-7-3-2/199590 "2019-09-24T05:48:42Z")

</div>

Hello Team, Currently we are using ELK 6.4.0 but we want to upgrade to ELK 7.3.2. Earlier we installed our ELK manually using the .deb file. We want to upgrade to use the SIEM feature which is available in ELK 7.2 or h…

---

## [Assigning index names dynamically (at run time) in spring boot](https://discuss.elastic.co/t/assigning-index-names-dynamically-at-run-time-in-spring-boot/200781)

<div class="topic-metadata">

**Author:** [@5460cacf2efb6201e5f8](https://discuss.elastic.co/u/5460cacf2efb6201e5f8)\
**Replies:** 0\
**Last updated:** [September 24, 2019, 5:02am UTC](https://discuss.elastic.co/t/assigning-index-names-dynamically-at-run-time-in-spring-boot/200781 "2019-09-24T05:02:15Z")

</div>

Hi, i have following bean @Document(indexName = "{dna-nbi-performancemanagement}", type = "\_doc") public class PerformanceResource { private String granularity; @Id private String retrievalTime; private Map\<String,…

---

## [Elasticsearch occur NoNodeAvailableException](https://discuss.elastic.co/t/elasticsearch-occur-nonodeavailableexception/200777)

<div class="topic-metadata">

**Author:** [@lurongjiang](https://discuss.elastic.co/u/lurongjiang)\
**Replies:** 0\
**Last updated:** [September 24, 2019, 3:57am UTC](https://discuss.elastic.co/t/elasticsearch-occur-nonodeavailableexception/200777 "2019-09-24T03:57:58Z")

</div>

above all: the version of elasticsearch: 5.6.1 cluster nodes: six when the six nodes were well,everything is ok after kill the 3 data nodes , nothing happened; but the second day,I found the error log for my applica…

---

## [Elasticsearch custom realm, support for wildcard properties](https://discuss.elastic.co/t/elasticsearch-custom-realm-support-for-wildcard-properties/200649)

<div class="topic-metadata">

**Author:** [@patrikjetzer](https://discuss.elastic.co/u/patrikjetzer)\
**Replies:** 1\
**Last updated:** [September 24, 2019, 3:25am UTC](https://discuss.elastic.co/t/elasticsearch-custom-realm-support-for-wildcard-properties/200649 "2019-09-24T03:25:46Z")

</div>

I have implemented a custom real plugin based on the \_x-pack\_qa\_security-example-spi-extension project. The problem i'm facing is reading custom plugin properties provided in the elasticsearch.yml file. i would need to …

---

## [Logstash shuts down within seconds after successfully starting Logstash API endpoint](https://discuss.elastic.co/t/logstash-shuts-down-within-seconds-after-successfully-starting-logstash-api-endpoint/200733)

<div class="topic-metadata">

**Author:** [@Mehak\_Bhargava](https://discuss.elastic.co/u/Mehak_Bhargava)\
**Replies:** 5\
**Last updated:** [September 24, 2019, 1:59am UTC](https://discuss.elastic.co/t/logstash-shuts-down-within-seconds-after-successfully-starting-logstash-api-endpoint/200733 "2019-09-24T01:59:47Z")

</div>

Hi there, I am trying to config and run logstash for which I ran this command - sudo bin/logstash -e 'input { stdin {} } output { elasticsearch { hosts =\> \[192.168.0.12:9200"\] }}' It ran and gave me this output. Threa…

---

## [Update document to remove a field / overwrite](https://discuss.elastic.co/t/update-document-to-remove-a-field-overwrite/200755)

<div class="topic-metadata">

**Author:** [@dlaprade](https://discuss.elastic.co/u/dlaprade)\
**Replies:** 3\
**Last updated:** [September 24, 2019, 1:49am UTC](https://discuss.elastic.co/t/update-document-to-remove-a-field-overwrite/200755 "2019-09-24T01:49:06Z")

</div>

ES: 6.8 I have a document like: { "title": "mytitle", "description": "my description", "randomfield" : "random value" } My index fields is title. I would like to be able to update this document to rem…

---

## [How to create buckets for number of occurances](https://discuss.elastic.co/t/how-to-create-buckets-for-number-of-occurances/200763)

<div class="topic-metadata">

**Author:** [@rwhaley](https://discuss.elastic.co/u/rwhaley)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 9:47pm UTC](https://discuss.elastic.co/t/how-to-create-buckets-for-number-of-occurances/200763 "2019-09-23T21:47:05Z")

</div>

I am needing to create a query that will show users that have uploaded 'x' number of receipts. I would like to have the receipt counts as defined 'buckets' which would range from, '0' to '10+'. I have tried to utilize th…

---

## [Count how many values of field appears N times?](https://discuss.elastic.co/t/count-how-many-values-of-field-appears-n-times/199886)

<div class="topic-metadata">

**Author:** [@jcaballero](https://discuss.elastic.co/u/jcaballero)\
**Replies:** 3\
**Last updated:** [September 23, 2019, 9:44pm UTC](https://discuss.elastic.co/t/count-how-many-values-of-field-appears-n-times/199886 "2019-09-23T21:44:40Z")

</div>

Hi, Elasticsearch 5.6 I see in the documentation how to count how many times each value of a field appears. But that is not exactly what I need. My documents have a field myfield, of type keyword. I need to know how …

---

## [Improving Speed to Query Millions of Small Documents](https://discuss.elastic.co/t/improving-speed-to-query-millions-of-small-documents/199731)

<div class="topic-metadata">

**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\
**Replies:** 5\
**Last updated:** [September 23, 2019, 9:20pm UTC](https://discuss.elastic.co/t/improving-speed-to-query-millions-of-small-documents/199731 "2019-09-23T21:20:05Z")

</div>

ES, Kibana Version 7.3.1 I'm hitting the two-minute timeout on Elasticsearch when trying to query just the past 12 hours of data. I'm curious on what I can do to increase query speed. I have basically unlimited hardware…

---

## [Exactly-once guarantee for Spark Structured Streaming](https://discuss.elastic.co/t/exactly-once-guarantee-for-spark-structured-streaming/200746)

<div class="topic-metadata">

**Author:** [@danielyahn](https://discuss.elastic.co/u/danielyahn)\
**Replies:** 2\
**Last updated:** [September 23, 2019, 9:07pm UTC](https://discuss.elastic.co/t/exactly-once-guarantee-for-spark-structured-streaming/200746 "2019-09-23T21:07:49Z")

</div>

The following blog that @james.baiera wrote says, Users of ES-Hadoop can specify one of their fields to be used as the document’s ID, and Elasticsearch manages ID based writes consistently. We can’t know ahead of time …

---

## [Where does Elasticsearch store logs?](https://discuss.elastic.co/t/where-does-elasticsearch-store-logs/200466)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 6\
**Last updated:** [September 23, 2019, 8:56pm UTC](https://discuss.elastic.co/t/where-does-elasticsearch-store-logs/200466 "2019-09-23T20:56:01Z")

</div>

Hi I am using a VM to explore the X-pack. I want to send some logs from the production servers (Elasticsearch and Splunk) to that VM. Where are the logs stored in Elasticsearch? Is there a path (ex: /var/log/)? I woul…

---

## [Connecting Logstash to Elastic Master or Elastic Data](https://discuss.elastic.co/t/connecting-logstash-to-elastic-master-or-elastic-data/199259)

<div class="topic-metadata">

**Author:** [@edster](https://discuss.elastic.co/u/edster)\
**Replies:** 2\
**Last updated:** [September 23, 2019, 8:10pm UTC](https://discuss.elastic.co/t/connecting-logstash-to-elastic-master-or-elastic-data/199259 "2019-09-23T20:10:42Z")

</div>

Hello, When having a Elastic Master servers and Elastic Data servers, should the Logstash consumer point to the Elastic Data for the output or the Elastic Master? What is the difference between the two connections/outpu…

---

## [NOTICE: Elasticsearch Service changes to handling of CORS requests, on September 22, 2019](https://discuss.elastic.co/t/notice-elasticsearch-service-changes-to-handling-of-cors-requests-on-september-22-2019/199403)

<div class="topic-metadata">

**Author:** [@Nicholas\_Thompson](https://discuss.elastic.co/u/Nicholas_Thompson)\
**Replies:** 1\
**Last updated:** [September 23, 2019, 8:01pm UTC](https://discuss.elastic.co/t/notice-elasticsearch-service-changes-to-handling-of-cors-requests-on-september-22-2019/199403 "2019-09-23T20:01:09Z")

</div>

Hi, We've been trying for a few weeks to address this notice that Elastic send out. All Elasticsearch Service clusters will default to http.cors settings after September 22 2019. Elasticsearch Service clusters provis…

---

## [Shard failure notification](https://discuss.elastic.co/t/shard-failure-notification/200735)

<div class="topic-metadata">

**Author:** [@justinw](https://discuss.elastic.co/u/justinw)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 6:47pm UTC](https://discuss.elastic.co/t/shard-failure-notification/200735 "2019-09-23T18:47:53Z")

</div>

Hi, I'd like to get notified when there is a query with a shard failure. What is the best way to go about setting this up? Best, Justin

---

## [Elasticsearch service on windows not starting when using path.repo](https://discuss.elastic.co/t/elasticsearch-service-on-windows-not-starting-when-using-path-repo/200730)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-service-on-windows-not-starting-when-using-path-repo/200730 "2019-09-23T17:41:59Z")

</div>

Hello, Playing around with elasticsearch on Windows, I ran into issues when trying to add path.repo configuration in elasticsearch.yml Configuration: path.repo: C:\\Users\\myuser\\Google Drive\\Backups\\Elastic\\FIREBASE E…

---

## [Unauthenticated HTTP GET request for load balancing](https://discuss.elastic.co/t/unauthenticated-http-get-request-for-load-balancing/199487)

<div class="topic-metadata">

**Author:** [@DaveyDevOps](https://discuss.elastic.co/u/DaveyDevOps)\
**Replies:** 3\
**Last updated:** [September 23, 2019, 5:17pm UTC](https://discuss.elastic.co/t/unauthenticated-http-get-request-for-load-balancing/199487 "2019-09-23T17:17:05Z")

</div>

We have Elasticsearch behind a load balancer that only supports HTTP GET health checks. Security is enabled Are there any existing (7.3.0+) API/paths that will respond to an unauthenticated HTTP GET request (while secu…

---

## [Elasticsearch cluster , one node failing](https://discuss.elastic.co/t/elasticsearch-cluster-one-node-failing/200726)

<div class="topic-metadata">

**Author:** [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 4:13pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-one-node-failing/200726 "2019-09-23T16:13:05Z")

</div>

My one of the pod (es ) in the cluster is failing and its not coming its. It's helm chart . Please find the attached cluster status and node status json file.

---

## [How does elasticsearch route reads?](https://discuss.elastic.co/t/how-does-elasticsearch-route-reads/200700)

<div class="topic-metadata">

**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\
**Replies:** 3\
**Last updated:** [September 23, 2019, 4:09pm UTC](https://discuss.elastic.co/t/how-does-elasticsearch-route-reads/200700 "2019-09-23T16:09:30Z")

</div>

I have an index in which I am using auto expand replicas to 0-all. This means every node has every replica So when a search request comes to ES, will it be processed by only one node? I am using 7.2 and the search reque…

---

## [Group Values with Aggregation](https://discuss.elastic.co/t/group-values-with-aggregation/200255)

<div class="topic-metadata">

**Author:** [@code\_blue](https://discuss.elastic.co/u/code_blue)\
**Replies:** 7\
**Last updated:** [September 23, 2019, 3:48pm UTC](https://discuss.elastic.co/t/group-values-with-aggregation/200255 "2019-09-23T15:48:00Z")

</div>

I am trying to write an aggregation query but not sure what I am missing here. I have the following structure across multiple documents. Some of the field names may not be present in documents. { "CaptureData": \[{ …

---

## [With a Basic license, is it possible to do GeoIP and use the SIEM?](https://discuss.elastic.co/t/with-a-basic-license-is-it-possible-to-do-geoip-and-use-the-siem/200258)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 3\
**Last updated:** [September 23, 2019, 2:29pm UTC](https://discuss.elastic.co/t/with-a-basic-license-is-it-possible-to-do-geoip-and-use-the-siem/200258 "2019-09-23T14:29:14Z")

</div>

Hi With a Basic license, is it possible to do GeoIP and test the SIEM? In the web page says YES to SIEM! But I do not see the "lock" . in Capture|251x500 Thank you

---

## [How to handle only one same document in multiple indices (indices are based on everyday)](https://discuss.elastic.co/t/how-to-handle-only-one-same-document-in-multiple-indices-indices-are-based-on-everyday/200694)

<div class="topic-metadata">

**Author:** [@milankamboya](https://discuss.elastic.co/u/milankamboya)\
**Replies:** 1\
**Last updated:** [September 23, 2019, 2:20pm UTC](https://discuss.elastic.co/t/how-to-handle-only-one-same-document-in-multiple-indices-indices-are-based-on-everyday/200694 "2019-09-23T14:20:09Z")

</div>

In my project, I am fetching records from database and keeping document id as primary key id. I have created indices based on date. So everyday new index has been created. like, test-2019.09.23, test-2019.09.22 This …

---

## [How can i setup tie breaker in aws ec2 instance](https://discuss.elastic.co/t/how-can-i-setup-tie-breaker-in-aws-ec2-instance/200146)

<div class="topic-metadata">

**Author:** [@naveena.lm](https://discuss.elastic.co/u/naveena.lm)\
**Replies:** 0\
**Last updated:** [September 19, 2019, 8:08am UTC](https://discuss.elastic.co/t/how-can-i-setup-tie-breaker-in-aws-ec2-instance/200146 "2019-09-19T08:08:04Z")

</div>

Configure tie breaker in aws ec2 instance

---

## [Dead queue log files](https://discuss.elastic.co/t/dead-queue-log-files/199969)

<div class="topic-metadata">

**Author:** [@yestoprince](https://discuss.elastic.co/u/yestoprince)\
**Replies:** 4\
**Last updated:** [September 23, 2019, 1:46pm UTC](https://discuss.elastic.co/t/dead-queue-log-files/199969 "2019-09-23T13:46:02Z")

</div>

Hi, ELK Community please help me to resolve this issue related to delete log files in dead queue. I reindex the documents logged in dead queue logs, but still the size of log files is still the same? what should i do of…

---

## [Searching like using grep -A5](https://discuss.elastic.co/t/searching-like-using-grep-a5/200698)

<div class="topic-metadata">

**Author:** [@vasek](https://discuss.elastic.co/u/vasek)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 1:27pm UTC](https://discuss.elastic.co/t/searching-like-using-grep-a5/200698 "2019-09-23T13:27:24Z")

</div>

Hi Elasticians, a developer looking for feature like this: grep -A5 "ERROR" /var/log/error.log Developer can find necessary error lines from some log and after that he need to find logs which was generated before thes…

---

## [Elasticsearch::Transport::Transport::Errors::ServiceUnavailable: \[503\] {"ok":false,"message":"The requested deployment is currently unavailable."}](https://discuss.elastic.co/t/elasticsearch-503-ok-false-message-the-requested-deployment-is-currently-unavailable/200583)

<div class="topic-metadata">

**Author:** [@atul2685](https://discuss.elastic.co/u/atul2685)\
**Replies:** 2\
**Last updated:** [September 23, 2019, 12:52pm UTC](https://discuss.elastic.co/t/elasticsearch-503-ok-false-message-the-requested-deployment-is-currently-unavailable/200583 "2019-09-23T12:52:25Z")

</div>

Hi, I don't know why I am getting the above error continuously. Error count has been reached to 1,00,000.

---

## [Elasticsearch doesn't update pid file (and kibana does)](https://discuss.elastic.co/t/elasticsearch-doesnt-update-pid-file-and-kibana-does/200681)

<div class="topic-metadata">

**Author:** [@yishain11](https://discuss.elastic.co/u/yishain11)\
**Replies:** 6\
**Last updated:** [September 23, 2019, 12:24pm UTC](https://discuss.elastic.co/t/elasticsearch-doesnt-update-pid-file-and-kibana-does/200681 "2019-09-23T12:24:43Z")

</div>

Hi everyone! I have a setup of the elk stack (I don't use any beats or other members of the elastic stack) that start and stop not via deamon or system ctl, rather directly from the respective bin and scripts. When I s…

---

## [Multiple elasticsearch node with docker on differents Hosts](https://discuss.elastic.co/t/multiple-elasticsearch-node-with-docker-on-differents-hosts/200686)

<div class="topic-metadata">

**Author:** [@rafalitox2](https://discuss.elastic.co/u/rafalitox2)\
**Replies:** 0\
**Last updated:** [September 23, 2019, 11:57am UTC](https://discuss.elastic.co/t/multiple-elasticsearch-node-with-docker-on-differents-hosts/200686 "2019-09-23T11:57:39Z")

</div>

Hi, i just want to run different elasticsearch nodes in 3/4 hosts, all the hosts have a docker-compose like: version: '3' services: elk: image: sebp/elk:730 ports: - 5601:5601 - 9200:9200 - 9…

---

## [Index selection based on date range](https://discuss.elastic.co/t/index-selection-based-on-date-range/199292)

<div class="topic-metadata">

**Author:** [@Bob94](https://discuss.elastic.co/u/Bob94)\
**Replies:** 1\
**Last updated:** [September 23, 2019, 11:52am UTC](https://discuss.elastic.co/t/index-selection-based-on-date-range/199292 "2019-09-23T11:52:21Z")

</div>

Hi all, I have below listed index in kibana Index-2019-09-09 Index-2019-09-10 Index-2019-09-11 Index-2019-09-12 Index-2019-09-13 Index-2019-09-14 Index-2019-09-15 My question is how or is there any api that i ca…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1145)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1147)
