# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1192

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1193

---

## [Trigger an action on index rollover?](https://discuss.elastic.co/t/trigger-an-action-on-index-rollover/195066)

<div class="topic-metadata">

**Author:** [@ddearing](https://discuss.elastic.co/u/ddearing)\
**Replies:** 1\
**Last updated:** [August 13, 2019, 8:36pm UTC](https://discuss.elastic.co/t/trigger-an-action-on-index-rollover/195066 "2019-08-13T20:36:44Z")

</div>

I'm trying to figure out if there is a way to trigger some external action (e.g. a Webhook) when an index rolls over. I thought this might be possible using some kind of HTTP Input with a Watcher, but am not sure what t…

---

## [Rollover alias with date](https://discuss.elastic.co/t/rollover-alias-with-date/192308)

<div class="topic-metadata">

**Author:** [@abaullosa](https://discuss.elastic.co/u/abaullosa)\
**Replies:** 2\
**Last updated:** [August 13, 2019, 8:10pm UTC](https://discuss.elastic.co/t/rollover-alias-with-date/192308 "2019-08-13T20:10:56Z")

</div>

Hi. I need some help with the Rollover API. I need to have a new index every day with the name + datetime (index-YYYYMMDD) This is what I have now so far.. My app is sending the data to an an alias called alias\_1 t…

---

## [ImmutableSettings not. amember of ES](https://discuss.elastic.co/t/immutablesettings-not-amember-of-es/195093)

<div class="topic-metadata">

**Author:** [@andreaperez](https://discuss.elastic.co/u/andreaperez)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 7:58pm UTC](https://discuss.elastic.co/t/immutablesettings-not-amember-of-es/195093 "2019-08-13T19:58:09Z")

</div>

Hi! I'm using elasticsearch to import data from S3 to be visualized in kibana, to do this I'm using spark scala running in an EMR instance. The ES service is being started with the following command \< /usr/lib/spark/…

---

## [Bool filter performance and its alternatives](https://discuss.elastic.co/t/bool-filter-performance-and-its-alternatives/195062)

<div class="topic-metadata">

**Author:** [@amreshakim](https://discuss.elastic.co/u/amreshakim)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 4:29pm UTC](https://discuss.elastic.co/t/bool-filter-performance-and-its-alternatives/195062 "2019-08-13T16:29:41Z")

</div>

Hi everyone, I have been profiling a query that is noticeably slow in our ES setup. Setup: AWS, ES 7.3, 11 data nodes, 1 index, 22 shards total, total # of docs: ~350M We store documents like this (~20 fields and mos…

---

## [Cannot get date math to work properly in Elasticsearch](https://discuss.elastic.co/t/cannot-get-date-math-to-work-properly-in-elasticsearch/193655)

<div class="topic-metadata">

**Author:** [@jgorlin](https://discuss.elastic.co/u/jgorlin)\
**Replies:** 10\
**Last updated:** [August 13, 2019, 3:53pm UTC](https://discuss.elastic.co/t/cannot-get-date-math-to-work-properly-in-elasticsearch/193655 "2019-08-13T15:53:43Z")

</div>

Hi Team, I've bene struggling for hours on what seems to me should be a very basic search. I'm trying to find all documents that have a date within the last 7 days: GET date\_test/\_search { "query": { "range": { …

---

## [\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsearch](https://discuss.elastic.co/t/warn-logstash-outputs-elasticsearch-could-not-index-event-to-elasticsearch/194883)

<div class="topic-metadata">

**Author:** [@SCL\_ADMIN](https://discuss.elastic.co/u/SCL_ADMIN)\
**Replies:** 5\
**Last updated:** [August 13, 2019, 3:15pm UTC](https://discuss.elastic.co/t/warn-logstash-outputs-elasticsearch-could-not-index-event-to-elasticsearch/194883 "2019-08-13T15:15:57Z")

</div>

I had a really large logstash.log file which filled up the hdd I deleted the file and restarted the service now I I get this Aug 12 16:54:13 SCL-SIEM-01 logstash\[3096\]: \[2019-08-12T16:54:13,127\]\[WARN \]\[logstash.outputs…

---

## [Why are these rollup documents missing an ID?](https://discuss.elastic.co/t/why-are-these-rollup-documents-missing-an-id/194536)

<div class="topic-metadata">

**Author:** [@EricJohnson](https://discuss.elastic.co/u/EricJohnson)\
**Replies:** 10\
**Last updated:** [August 13, 2019, 3:15pm UTC](https://discuss.elastic.co/t/why-are-these-rollup-documents-missing-an-id/194536 "2019-08-13T15:15:29Z")

</div>

Hello - I've run into a major problem and would really appreciate an explanation. Thank you for your input. We are using rollups to process metricbeat data for analysis. We have three servers, say A, B and C. Having …

---

## [Mocking nodejs client with nock broken after new es client migration](https://discuss.elastic.co/t/mocking-nodejs-client-with-nock-broken-after-new-es-client-migration/195041)

<div class="topic-metadata">

**Author:** [@vbontempi](https://discuss.elastic.co/u/vbontempi)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 2:12pm UTC](https://discuss.elastic.co/t/mocking-nodejs-client-with-nock-broken-after-new-es-client-migration/195041 "2019-08-13T14:12:34Z")

</div>

Hello, we are using nock to mock the ES requests towards our ES cluster on nodejs We migrated recently our application running on nodejs from old legacy ES Client to the new one https://github.com/elastic/elasticsearch…

---

## [Use 'y' for year-of-era. Prefix your date format with '8' to use the new specifier](https://discuss.elastic.co/t/use-y-for-year-of-era-prefix-your-date-format-with-8-to-use-the-new-specifier/191078)

<div class="topic-metadata">

**Author:** [@mattsdevop](https://discuss.elastic.co/u/mattsdevop)\
**Replies:** 25\
**Last updated:** [August 13, 2019, 1:46pm UTC](https://discuss.elastic.co/t/use-y-for-year-of-era-prefix-your-date-format-with-8-to-use-the-new-specifier/191078 "2019-08-13T13:46:46Z")

</div>

Need a little help with this one. Tried doing as the deprecation log states, but logstash crashes on restart. The full deprecation log message is: 'y' year should be replaced with 'u'. Use 'y' for year-of-era. Prefix y…

---

## [Setup Elasticsearch in Docker for production](https://discuss.elastic.co/t/setup-elasticsearch-in-docker-for-production/195026)

<div class="topic-metadata">

**Author:** [@tomsk](https://discuss.elastic.co/u/tomsk)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 12:44pm UTC](https://discuss.elastic.co/t/setup-elasticsearch-in-docker-for-production/195026 "2019-08-13T12:44:50Z")

</div>

Hello, l use Elasticsearch using docker-compose.yml: version: '2' services: elasticsearch: image: docker.elastic.co/elasticsearch/elasticsearch:5.6.16 container\_name: elasticsearch restart: unless-stopped …

---

## [Testing refresh.interval / explanation](https://discuss.elastic.co/t/testing-refresh-interval-explanation/194970)

<div class="topic-metadata">

**Author:** [@Jean-Marc\_Autexier](https://discuss.elastic.co/u/Jean-Marc_Autexier)\
**Replies:** 4\
**Last updated:** [August 13, 2019, 12:08pm UTC](https://discuss.elastic.co/t/testing-refresh-interval-explanation/194970 "2019-08-13T12:08:53Z")

</div>

Hi, I'm testing the refresh.interval \[2\]of my ES cluster (6 nodes, ES 6.5.0). I'm doing sync upserts into an index with refresh.interval=30s. In a differnt app, I'm executing queries. However I set index.interval, my…

---

## [Elasticsearch container resources not recognized](https://discuss.elastic.co/t/elasticsearch-container-resources-not-recognized/195015)

<div class="topic-metadata">

**Author:** [@mohamamd](https://discuss.elastic.co/u/mohamamd)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 11:41am UTC](https://discuss.elastic.co/t/elasticsearch-container-resources-not-recognized/195015 "2019-08-13T11:41:17Z")

</div>

I have deployed the operator according to the following document and it is running fine. Then I created the following elastic search but the pods for elastic search is not getting created. https://www.elastic.co/guide/…

---

## [Snapshot deletion fails with remote\_transport\_exception and number\_format\_exception](https://discuss.elastic.co/t/snapshot-deletion-fails-with-remote-transport-exception-and-number-format-exception/195008)

<div class="topic-metadata">

**Author:** [@shevah](https://discuss.elastic.co/u/shevah)\
**Replies:** 2\
**Last updated:** [August 13, 2019, 11:07am UTC](https://discuss.elastic.co/t/snapshot-deletion-fails-with-remote-transport-exception-and-number-format-exception/195008 "2019-08-13T11:07:40Z")

</div>

Hey, Upon deleting a snapshot (stored in S3) using the DELETE API we get the following error: { "error": { "root\_cause": \[ { "type": "remote\_transport\_exception", "reason": "\[PROD-master-elastic1\]\[x…

---

## [Elastic search won't start with java 11 on ubuntu 18.04](https://discuss.elastic.co/t/elastic-search-wont-start-with-java-11-on-ubuntu-18-04/195003)

<div class="topic-metadata">

**Author:** [@Shiva\_Shahu](https://discuss.elastic.co/u/Shiva_Shahu)\
**Replies:** 1\
**Last updated:** [August 13, 2019, 10:37am UTC](https://discuss.elastic.co/t/elastic-search-wont-start-with-java-11-on-ubuntu-18-04/195003 "2019-08-13T10:37:31Z")

</div>

When I start the elasticsearch service i got below error that are attached - I have ElasticSearch 7.2 and JDK 11. Please help me to solve this issue.

---

## [Integrating ECS with ELK Stack](https://discuss.elastic.co/t/integrating-ecs-with-elk-stack/195007)

<div class="topic-metadata">

**Author:** [@gomathiganesan995](https://discuss.elastic.co/u/gomathiganesan995)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 10:32am UTC](https://discuss.elastic.co/t/integrating-ecs-with-elk-stack/195007 "2019-08-13T10:32:13Z")

</div>

Hi, I need to monitor the AWS logs using ELK stack. What is the configuration required .

---

## [What is there in my JVM Heap](https://discuss.elastic.co/t/what-is-there-in-my-jvm-heap/194998)

<div class="topic-metadata">

**Author:** [@Rakesh4](https://discuss.elastic.co/u/Rakesh4)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 9:38am UTC](https://discuss.elastic.co/t/what-is-there-in-my-jvm-heap/194998 "2019-08-13T09:38:33Z")

</div>

Hi, My analysis says, elastic search holds memory for segments ( cache memory no in heap) , fields mappings ( in Heap) and some shard structure. Can you please suggest is there any way to know what is there in my He…

---

## [CMS Old Gen GC consuming too much memory and never cleaned up](https://discuss.elastic.co/t/cms-old-gen-gc-consuming-too-much-memory-and-never-cleaned-up/194997)

<div class="topic-metadata">

**Author:** [@Rakesh4](https://discuss.elastic.co/u/Rakesh4)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 9:35am UTC](https://discuss.elastic.co/t/cms-old-gen-gc-consuming-too-much-memory-and-never-cleaned-up/194997 "2019-08-13T09:35:10Z")

</div>

Hi, my heap dump says , CMS old Gen GC is consuming too much memory and its never get cleaned up. Is it GC problem or its like Elastic search holds some object in heap for long last ? Any suggestion ?

---

## [Unable to calculate duration by 2 dates fields](https://discuss.elastic.co/t/unable-to-calculate-duration-by-2-dates-fields/194833)

<div class="topic-metadata">

**Author:** [@Rudolf\_Reddy\_Macejka](https://discuss.elastic.co/u/Rudolf_Reddy_Macejka)\
**Replies:** 3\
**Last updated:** [August 13, 2019, 8:21am UTC](https://discuss.elastic.co/t/unable-to-calculate-duration-by-2-dates-fields/194833 "2019-08-13T08:21:48Z")

</div>

Hello, I am trying to crated new field in indices by recalculate duration based on response and request timestamps. I have this document: { "request" : { "time" : "2019-08-04T20:02:15.459Z" }, "respo…

---

## [URL Remote access for Elasticsearch and Kibana](https://discuss.elastic.co/t/url-remote-access-for-elasticsearch-and-kibana/194974)

<div class="topic-metadata">

**Author:** [@Rahul\_Chauhan](https://discuss.elastic.co/u/Rahul_Chauhan)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 7:50am UTC](https://discuss.elastic.co/t/url-remote-access-for-elasticsearch-and-kibana/194974 "2019-08-13T07:50:41Z")

</div>

I want my elasticsearch indexes and Kibana to be available to remote users. I have changed my elasticsearch.yml files to have these- transport.host: localhost transport.tcp.port: 9300 http.port: 9200 network.host: 0.…

---

## [Receiving java.lang.IllegalArgumentException: Failed to derive xcontent while using @Query annotiation](https://discuss.elastic.co/t/receiving-java-lang-illegalargumentexception-failed-to-derive-xcontent-while-using-query-annotiation/194965)

<div class="topic-metadata">

**Author:** [@kbsivacse](https://discuss.elastic.co/u/kbsivacse)\
**Replies:** 1\
**Last updated:** [August 13, 2019, 7:12am UTC](https://discuss.elastic.co/t/receiving-java-lang-illegalargumentexception-failed-to-derive-xcontent-while-using-query-annotiation/194965 "2019-08-13T07:12:00Z")

</div>

I'm using below library for my spring-boot app and I'm getting below error while running the query in my Spring repository, @Query(""\_source": {"includes": \["Id","appOwner","empId","status","salary","indicator","created…

---

## [Simple HTTPS connection to ES](https://discuss.elastic.co/t/simple-https-connection-to-es/194827)

<div class="topic-metadata">

**Author:** [@Lincoln\_dev](https://discuss.elastic.co/u/Lincoln_dev)\
**Replies:** 3\
**Last updated:** [August 13, 2019, 6:50am UTC](https://discuss.elastic.co/t/simple-https-connection-to-es/194827 "2019-08-13T06:50:55Z")

</div>

Hello ! It's my first time here, so I hope I have done things well. I am currently working on a project using ES. I have the following setup : One serveur where ES is running in HTTP : ES\_SERVER One Website in HTTP …

---

## [Would like to know which type of AWS EC2 instance is suitable for elasticsearch data nodes](https://discuss.elastic.co/t/would-like-to-know-which-type-of-aws-ec2-instance-is-suitable-for-elasticsearch-data-nodes/194962)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 6:26am UTC](https://discuss.elastic.co/t/would-like-to-know-which-type-of-aws-ec2-instance-is-suitable-for-elasticsearch-data-nodes/194962 "2019-08-13T06:26:04Z")

</div>

Would like to know which type of AWS EC2 instance is suitable for installing the elasticsearch data node. I know that i3 instances are suitable as they support high IOPS with instance storage (SSD), in our case data volu…

---

## [Elasticsearch duplicates increase disk size](https://discuss.elastic.co/t/elasticsearch-duplicates-increase-disk-size/194842)

<div class="topic-metadata">

**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\
**Replies:** 2\
**Last updated:** [August 13, 2019, 6:16am UTC](https://discuss.elastic.co/t/elasticsearch-duplicates-increase-disk-size/194842 "2019-08-13T06:16:41Z")

</div>

Hello. I have indexed to the elasticsearch 7 milion + documents using the collisions handling by updating the \_version value. What I have expected was that the "\_version" will be incremented every time the document wit…

---

## [How to implement elastic search within two micro service](https://discuss.elastic.co/t/how-to-implement-elastic-search-within-two-micro-service/194959)

<div class="topic-metadata">

**Author:** [@kaja\_kana](https://discuss.elastic.co/u/kaja_kana)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 6:13am UTC](https://discuss.elastic.co/t/how-to-implement-elastic-search-within-two-micro-service/194959 "2019-08-13T06:13:44Z")

</div>

I am implementing reporting service in my micro-service project . i am using asp.net core web API and docker to compile all service. i need to connect to individual service to generate the report. and the data should be …

---

## [Elaticsearch script, is it possible to pass in field names as paramter?](https://discuss.elastic.co/t/elaticsearch-script-is-it-possible-to-pass-in-field-names-as-paramter/194922)

<div class="topic-metadata">

**Author:** [@qiang\_gui](https://discuss.elastic.co/u/qiang_gui)\
**Replies:** 1\
**Last updated:** [August 13, 2019, 3:19am UTC](https://discuss.elastic.co/t/elaticsearch-script-is-it-possible-to-pass-in-field-names-as-paramter/194922 "2019-08-13T03:19:19Z")

</div>

Hi, We had requirement that based on doc field and doc value, we want to hide/show return field for other column. for example, doc 1 name: mac, category : hardware, active=true, manager=Sam doc 2: name: windows, ca…

---

## [List installed plugins from within plugin](https://discuss.elastic.co/t/list-installed-plugins-from-within-plugin/194933)

<div class="topic-metadata">

**Author:** [@jiboxiv](https://discuss.elastic.co/u/jiboxiv)\
**Replies:** 1\
**Last updated:** [August 13, 2019, 3:06am UTC](https://discuss.elastic.co/t/list-installed-plugins-from-within-plugin/194933 "2019-08-13T03:06:15Z")

</div>

Hi all, I am currently creating a plugin, but need to know if there is another plugin installed before indexing some documents. I know there is the \_cat/plugins API, but is there any way to get the list of currently in…

---

## [Find consecutive field values in sorted collection of documents](https://discuss.elastic.co/t/find-consecutive-field-values-in-sorted-collection-of-documents/194943)

<div class="topic-metadata">

**Author:** [@zqd](https://discuss.elastic.co/u/zqd)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 2:54am UTC](https://discuss.elastic.co/t/find-consecutive-field-values-in-sorted-collection-of-documents/194943 "2019-08-13T02:54:59Z")

</div>

I have documents such as the following that I can sorted by id (sequence number) or dateRecorded. Was sold is boolean. Using elasticsearch aggregations, how do I compute the longest consecutive wasSold = true or wasSold…

---

## [Running elasticsearch in Eclipse](https://discuss.elastic.co/t/running-elasticsearch-in-eclipse/194942)

<div class="topic-metadata">

**Author:** [@keithag](https://discuss.elastic.co/u/keithag)\
**Replies:** 0\
**Last updated:** [August 13, 2019, 2:36am UTC](https://discuss.elastic.co/t/running-elasticsearch-in-eclipse/194942 "2019-08-13T02:36:50Z")

</div>

Hello, I'm trying to build Elasticsearch and get it to run in Eclipse. I'm following the directions in the CONFIGURATION.MD file. This is my setup: macOS Mojave java 12.0.2 OpenJDK Eclipse Photon 4.9.0 Elasticsearch …

---

## [Use api to get and set the minimum number of masters](https://discuss.elastic.co/t/use-api-to-get-and-set-the-minimum-number-of-masters/194927)

<div class="topic-metadata">

**Author:** [@lwwalker](https://discuss.elastic.co/u/lwwalker)\
**Replies:** 0\
**Last updated:** [August 12, 2019, 10:40pm UTC](https://discuss.elastic.co/t/use-api-to-get-and-set-the-minimum-number-of-masters/194927 "2019-08-12T22:40:14Z")

</div>

discovery.zen.minimum\_master\_nodes is the config file setting, but I can't find how to get the current value, or set a new value via the API.

---

## [Unable to connect to hosted elastic cloud aws endpoint for 1-2 hours yesterday](https://discuss.elastic.co/t/unable-to-connect-to-hosted-elastic-cloud-aws-endpoint-for-1-2-hours-yesterday/194914)

<div class="topic-metadata">

**Author:** [@jfall](https://discuss.elastic.co/u/jfall)\
**Replies:** 1\
**Last updated:** [August 12, 2019, 10:34pm UTC](https://discuss.elastic.co/t/unable-to-connect-to-hosted-elastic-cloud-aws-endpoint-for-1-2-hours-yesterday/194914 "2019-08-12T22:34:23Z")

</div>

I have a hosted elastic cloud AWS deployment setup using the aws.data.highio.i3 tier with 2-zone fault tolerance in aws us east. My end point is https://xxxxxxxxxxx.us-east-1.aws.found.io:9243 Our web servers reverse p…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1191)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1193)
