# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=976

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 977

---

## [Adding custom key and value to bucket aggregation response](https://discuss.elastic.co/t/adding-custom-key-and-value-to-bucket-aggregation-response/225093)

<div class="topic-metadata">

**Author:** [@Michael\_Jackson1](https://discuss.elastic.co/u/Michael_Jackson1)\
**Replies:** 0\
**Last updated:** [March 26, 2020, 1:18am UTC](https://discuss.elastic.co/t/adding-custom-key-and-value-to-bucket-aggregation-response/225093 "2020-03-26T01:18:22Z")

</div>

Is there a way to add a custom key and value to bucket response like the one below: { "took" : 7685, "timed\_out" : false, "\_shards" : { "total" : 1, "successful" : 1, "skipped" : 0, "failed" : 0 …

---

## [\[5.6.5\] terminate\_after and the Scroll API](https://discuss.elastic.co/t/5-6-5-terminate-after-and-the-scroll-api/225083)

<div class="topic-metadata">

**Author:** [@darin](https://discuss.elastic.co/u/darin)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 11:43pm UTC](https://discuss.elastic.co/t/5-6-5-terminate-after-and-the-scroll-api/225083 "2020-03-25T23:43:47Z")

</div>

All, I'm seeing some peculiar behavior when using terminate\_after in scrolls. For local testing, I have a 1 node 5.6.5 cluster with indices configured with 1 shard: {:26e1f492-59ca-459a-ab3f-5ed34ee125aa-0 {:settings…

---

## [AWS IAM Role with self hosted ELK](https://discuss.elastic.co/t/aws-iam-role-with-self-hosted-elk/225065)

<div class="topic-metadata">

**Author:** [@Kevin\_f](https://discuss.elastic.co/u/Kevin_f)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 8:46pm UTC](https://discuss.elastic.co/t/aws-iam-role-with-self-hosted-elk/225065 "2020-03-25T20:46:00Z")

</div>

Hello, I am trying to figure out if anyone has managed to get to use AWS IAM roles for their self hosted ELK stack rather than using IAM users (Access Key and Secret keys). Scenario is: -\> Mulitple AWS accounts contai…

---

## [How to calculate Search requests per seconds](https://discuss.elastic.co/t/how-to-calculate-search-requests-per-seconds/225021)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 3\
**Last updated:** [March 25, 2020, 10:17pm UTC](https://discuss.elastic.co/t/how-to-calculate-search-requests-per-seconds/225021 "2020-03-25T22:17:26Z")

</div>

Hi, is there a way to calculate the whole value of Search requests per seconds? I would like to get it referred to the entire cluster and not only for a specific index. the same question is also for response time. th…

---

## [Where are my instances from elastic cloud GCP creation?](https://discuss.elastic.co/t/where-are-my-instances-from-elastic-cloud-gcp-creation/225070)

<div class="topic-metadata">

**Author:** [@Dean\_Hiller](https://discuss.elastic.co/u/Dean_Hiller)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 9:25pm UTC](https://discuss.elastic.co/t/where-are-my-instances-from-elastic-cloud-gcp-creation/225070 "2020-03-25T21:25:50Z")

</div>

The startup of Elastic Search was pretty slick once I found out to use the 'Elastic Search Service'. before that was some complicated create setup but that complicated setup resulted in nodes I can see in GCP at least. …

---

## [Elastic Search RequestOptions race condition(Is this a bug)?](https://discuss.elastic.co/t/elastic-search-requestoptions-race-condition-is-this-a-bug/225063)

<div class="topic-metadata">

**Author:** [@Dean\_Hiller](https://discuss.elastic.co/u/Dean_Hiller)\
**Replies:** 1\
**Last updated:** [March 25, 2020, 9:14pm UTC](https://discuss.elastic.co/t/elastic-search-requestoptions-race-condition-is-this-a-bug/225063 "2020-03-25T21:14:24Z")

</div>

Notice the RequestOptions object has this line public static final RequestOptions DEFAULT = new Builder( Collections.emptyList(), HeapBufferedResponseConsumerFactory.DEFAULT, null).build(); everything is privat…

---

## [Using Curator](https://discuss.elastic.co/t/using-curator/225032)

<div class="topic-metadata">

**Author:** [@Bruceclegg](https://discuss.elastic.co/u/Bruceclegg)\
**Replies:** 5\
**Last updated:** [March 25, 2020, 8:56pm UTC](https://discuss.elastic.co/t/using-curator/225032 "2020-03-25T20:56:21Z")

</div>

I've been tasked with setting up Curator to delete data more than 40 days old on our existing ELK 6.8.6 server. I did not set up elk and am pretty much unfamiliar with how it is configured. I set up the yum repository,…

---

## [Index lifecycle error illegal\_argument\_exception: index.lifecycle.rollover\_alias \[\] does not point to index \[\]](https://discuss.elastic.co/t/index-lifecycle-error-illegal-argument-exception-index-lifecycle-rollover-alias-does-not-point-to-index/221068)

<div class="topic-metadata">

**Author:** [@Erich\_King](https://discuss.elastic.co/u/Erich_King)\
**Replies:** 2\
**Last updated:** [March 25, 2020, 8:45pm UTC](https://discuss.elastic.co/t/index-lifecycle-error-illegal-argument-exception-index-lifecycle-rollover-alias-does-not-point-to-index/221068 "2020-03-25T20:45:56Z")

</div>

Hi there. I am getting this error when trying to implement ILM on my indexes. Here is my ILM config PUT \_ilm/policy/rollover\_policy { "policy": { "phases": { "hot": { "actions…

---

## [Date histogram aggregation on an open date range field](https://discuss.elastic.co/t/date-histogram-aggregation-on-an-open-date-range-field/225060)

<div class="topic-metadata">

**Author:** [@krlm](https://discuss.elastic.co/u/krlm)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 8:07pm UTC](https://discuss.elastic.co/t/date-histogram-aggregation-on-an-open-date-range-field/225060 "2020-03-25T20:07:52Z")

</div>

Hi I'm trying to execute an date\_histogram aggregation on a index with date\_range field where some of documents can have open end (no value for lt or lte of that date\_rage). here's my setup: index: PUT /events { "ma…

---

## [Elasticsearch boost nested field score relevance query](https://discuss.elastic.co/t/elasticsearch-boost-nested-field-score-relevance-query/225059)

<div class="topic-metadata">

**Author:** [@kamboh](https://discuss.elastic.co/u/kamboh)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 8:07pm UTC](https://discuss.elastic.co/t/elasticsearch-boost-nested-field-score-relevance-query/225059 "2020-03-25T20:07:43Z")

</div>

I have an elasticsearch index (students) with following mapping: { "name": { "type": "text" }, "age": { "type": "integer" }, "tests": { "type": "nested", "properties":…

---

## [Get index and shard specific metrics](https://discuss.elastic.co/t/get-index-and-shard-specific-metrics/225040)

<div class="topic-metadata">

**Author:** [@surilshah](https://discuss.elastic.co/u/surilshah)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 6:21pm UTC](https://discuss.elastic.co/t/get-index-and-shard-specific-metrics/225040 "2020-03-25T18:21:19Z")

</div>

We are using ES 7.5.0 and use telegraf to collect and write metrics. We use the elasticsearch plugin in telegraf which mainly makes use of Node Stats which gives node level metrics. We would like to get index and shard …

---

## [Field mapping conflict on shrink index](https://discuss.elastic.co/t/field-mapping-conflict-on-shrink-index/225039)

<div class="topic-metadata">

**Author:** [@alexolivan](https://discuss.elastic.co/u/alexolivan)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 6:20pm UTC](https://discuss.elastic.co/t/field-mapping-conflict-on-shrink-index/225039 "2020-03-25T18:20:58Z")

</div>

Hi forum. I'm experiencing a problem that has caught me by surprise... all of the sudden, kibana starts complaining I've got a conflicting field on my indexes. The field is a classic bytes field, wich is suposed (and a…

---

## [List plugins from java high level rest client](https://discuss.elastic.co/t/list-plugins-from-java-high-level-rest-client/224987)

<div class="topic-metadata">

**Author:** [@p4paul](https://discuss.elastic.co/u/p4paul)\
**Replies:** 2\
**Last updated:** [March 25, 2020, 5:47pm UTC](https://discuss.elastic.co/t/list-plugins-from-java-high-level-rest-client/224987 "2020-03-25T17:47:51Z")

</div>

Is there a way to list all the installed plugins from the Java High Level Rest Client similar to the Rest API: GET /\_cat/plugins Documented here: https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-plu…

---

## [Client-node separated from cluster](https://discuss.elastic.co/t/client-node-separated-from-cluster/225026)

<div class="topic-metadata">

**Author:** [@kluvi](https://discuss.elastic.co/u/kluvi)\
**Replies:** 1\
**Last updated:** [March 25, 2020, 5:30pm UTC](https://discuss.elastic.co/t/client-node-separated-from-cluster/225026 "2020-03-25T17:30:53Z")

</div>

Hi. We have this setup: 4-nodes Elasticsearch cluster on dedicated physical server (only 3 of them has master role) Kubernetes cluster, which runs all parts of our application My idea is to run some client-only nodes…

---

## ["unepexted keyword argument" in Python script](https://discuss.elastic.co/t/unepexted-keyword-argument-in-python-script/225022)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 4:21pm UTC](https://discuss.elastic.co/t/unepexted-keyword-argument-in-python-script/225022 "2020-03-25T16:21:12Z")

</div>

Hello, We were in need of a way to check for shards growing above 50gb, found this Nagios plugin =\> https://github.com/DennyZhang/elasticsearch-cli-tool/blob/master/monitoring/check\_elasticsearch\_shard.py But it didn't…

---

## [Elasticsearch 7.5.1: Failed to resolve host exception](https://discuss.elastic.co/t/elasticsearch-7-5-1-failed-to-resolve-host-exception/225019)

<div class="topic-metadata">

**Author:** [@Yanislav\_Shetrev](https://discuss.elastic.co/u/Yanislav_Shetrev)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 4:18pm UTC](https://discuss.elastic.co/t/elasticsearch-7-5-1-failed-to-resolve-host-exception/225019 "2020-03-25T16:18:02Z")

</div>

I have recently upgraded Elasticsearch from 6.5.2 to 7.5.1 . But now when getting the cluster health via: curl localhost:9200/\_cluster/health?pretty I get master\_not\_discovered\_exception (503) Do I need to consider some…

---

## [Formatting date format in ES index template](https://discuss.elastic.co/t/formatting-date-format-in-es-index-template/225027)

<div class="topic-metadata">

**Author:** [@Dany1](https://discuss.elastic.co/u/Dany1)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 4:47pm UTC](https://discuss.elastic.co/t/formatting-date-format-in-es-index-template/225027 "2020-03-25T16:47:16Z")

</div>

Hi, I'm trying to use a date with the following format Jan 25, 2018 13:02:38.015514516 CET in my data as main timestamp. I've tried to parse it in logstash with date { match =\> \["frame.date", "MMM dd, yyyy HH:mm:ss.SS…

---

## [Ingest pipeline on Elastic cloud](https://discuss.elastic.co/t/ingest-pipeline-on-elastic-cloud/224985)

<div class="topic-metadata">

**Author:** [@gamlin](https://discuss.elastic.co/u/gamlin)\
**Replies:** 1\
**Last updated:** [March 25, 2020, 4:15pm UTC](https://discuss.elastic.co/t/ingest-pipeline-on-elastic-cloud/224985 "2020-03-25T16:15:44Z")

</div>

If I use Elasticsearch and Kibana hosted on Google Cloud Platform (gcp), can I use ingestion pipeline? Dedicated ingest node in case of Elasticsearch on cloud probably does not make sense, because there are no nodes if E…

---

## [Azure Cloud Monitoring with the Elastic Stack](https://discuss.elastic.co/t/azure-cloud-monitoring-with-the-elastic-stack/225014)

<div class="topic-metadata">

**Author:** [@franco.cuneo](https://discuss.elastic.co/u/franco.cuneo)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 3:51pm UTC](https://discuss.elastic.co/t/azure-cloud-monitoring-with-the-elastic-stack/225014 "2020-03-25T15:51:43Z")

</div>

Hello! I'm trying to implement the azure module (https://www.elastic.co/guide/en/logstash/current/azure-module.html) but without success (there's no new index nor has the dashboard been imported to kibana) ... I believe…

---

## [Problem elastic search not running](https://discuss.elastic.co/t/problem-elastic-search-not-running/224889)

<div class="topic-metadata">

**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\
**Replies:** 4\
**Last updated:** [March 25, 2020, 3:01pm UTC](https://discuss.elastic.co/t/problem-elastic-search-not-running/224889 "2020-03-25T15:01:35Z")

</div>

I have a problem when rainning elastic search Caused by: java.lang.IllegalStateException: failed to obtain node locks, tried \[\[/usr/share/elasticsearch/data\]\] with lock id \[0\]; maybe these locations are not writable or…

---

## [Default precision of cardinality in kibana visualizations](https://discuss.elastic.co/t/default-precision-of-cardinality-in-kibana-visualizations/225004)

<div class="topic-metadata">

**Author:** [@tamara1](https://discuss.elastic.co/u/tamara1)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 2:40pm UTC](https://discuss.elastic.co/t/default-precision-of-cardinality-in-kibana-visualizations/225004 "2020-03-25T14:40:31Z")

</div>

Hi! I'm using kibana 7.5 and i have an issue, in my json files i have an aggregation with features and scenarios by features items, each one have a state (passed or false by feature), and i need to show in a kibana visu…

---

## [Elasticsearch 7.5.1 does not have elasticsearch-keystore command](https://discuss.elastic.co/t/elasticsearch-7-5-1-does-not-have-elasticsearch-keystore-command/224909)

<div class="topic-metadata">

**Author:** [@Yanislav\_Shetrev](https://discuss.elastic.co/u/Yanislav_Shetrev)\
**Replies:** 2\
**Last updated:** [March 25, 2020, 2:29pm UTC](https://discuss.elastic.co/t/elasticsearch-7-5-1-does-not-have-elasticsearch-keystore-command/224909 "2020-03-25T14:29:15Z")

</div>

Hello, I have recently upgraded form elasticsearch 6.5.2 to 7.5.1 and when trying to add secrets to the keystore via bin/elasticsearch-keystore add I get the error message that the command was not found. There is no bin…

---

## [How to fetch field content from elasticsearch using java API](https://discuss.elastic.co/t/how-to-fetch-field-content-from-elasticsearch-using-java-api/224823)

<div class="topic-metadata">

**Author:** [@samanvi\_sweety](https://discuss.elastic.co/u/samanvi_sweety)\
**Replies:** 6\
**Last updated:** [March 25, 2020, 1:19pm UTC](https://discuss.elastic.co/t/how-to-fetch-field-content-from-elasticsearch-using-java-api/224823 "2020-03-25T13:19:31Z")

</div>

Hie team, I am trying to fetch content of "message" field which is of type binary,but it returns null. In elasticsearch data is stored as below { "\_index": "twitter", "\_type": "\_doc", "\_id": "56", "\_version": …

---

## [Elastic search start and stop after running](https://discuss.elastic.co/t/elastic-search-start-and-stop-after-running/224989)

<div class="topic-metadata">

**Author:** [@hardika\_desai](https://discuss.elastic.co/u/hardika_desai)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 1:08pm UTC](https://discuss.elastic.co/t/elastic-search-start-and-stop-after-running/224989 "2020-03-25T13:08:07Z")

</div>

In elasticsearch 5.2 version ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: enabled) Active: failed (Result: exit-code) since …

---

## [NoNodeException while connection to localhost cluster of elasticssearch](https://discuss.elastic.co/t/nonodeexception-while-connection-to-localhost-cluster-of-elasticssearch/224951)

<div class="topic-metadata">

**Author:** [@abhi90engg](https://discuss.elastic.co/u/abhi90engg)\
**Replies:** 5\
**Last updated:** [March 25, 2020, 1:00pm UTC](https://discuss.elastic.co/t/nonodeexception-while-connection-to-localhost-cluster-of-elasticssearch/224951 "2020-03-25T13:00:30Z")

</div>

Hi , I am using the docker image to configure the elasticsearch on my local machine . http://127.0.0.1:9200/\_nodes/http?pretty { "\_nodes" : { "total" : 1, "successful" : 1, "failed" : 0 }, "cluster\_na…

---

## [High Heap Usage and constant \[old\] GC processes](https://discuss.elastic.co/t/high-heap-usage-and-constant-old-gc-processes/224981)

<div class="topic-metadata">

**Author:** [@dbajra94](https://discuss.elastic.co/u/dbajra94)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 12:11pm UTC](https://discuss.elastic.co/t/high-heap-usage-and-constant-old-gc-processes/224981 "2020-03-25T12:11:07Z")

</div>

Hello elastic community, currently on one of our production nodes we are running into constant search delays due to old Garbage collection processes (up to every 2-3 minutes for around 1 minute runtime). Those seem to b…

---

## [Max data node throughput during ES recovery to new data nodes](https://discuss.elastic.co/t/max-data-node-throughput-during-es-recovery-to-new-data-nodes/224976)

<div class="topic-metadata">

**Author:** [@the123saurav](https://discuss.elastic.co/u/the123saurav)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 11:29am UTC](https://discuss.elastic.co/t/max-data-node-throughput-during-es-recovery-to-new-data-nodes/224976 "2020-03-25T11:29:09Z")

</div>

We use ES 6.0 hosted on EC2 boxes with AWS EBS as the storage layer. I was digging into the ES recovery API(https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-recovery.html). Below is the recovery …

---

## [What is minimum permission required to snapshot to GCS](https://discuss.elastic.co/t/what-is-minimum-permission-required-to-snapshot-to-gcs/224973)

<div class="topic-metadata">

**Author:** [@Peter.Peng](https://discuss.elastic.co/u/Peter.Peng)\
**Replies:** 0\
**Last updated:** [March 25, 2020, 10:46am UTC](https://discuss.elastic.co/t/what-is-minimum-permission-required-to-snapshot-to-gcs/224973 "2020-03-25T10:46:12Z")

</div>

What is minimum permission required to snapshot to GCS ?

---

## [Is "ip\_range" a real bucket aggregation?](https://discuss.elastic.co/t/is-ip-range-a-real-bucket-aggregation/219446)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 5\
**Last updated:** [March 25, 2020, 10:38am UTC](https://discuss.elastic.co/t/is-ip-range-a-real-bucket-aggregation/219446 "2020-03-25T10:38:16Z")

</div>

I'm getting a weird error when running the following ip\_range aggs with a buckets\_path: GET ecs-net-7\*/\_search { "size": 0, "aggs": { "1-bucket": { "ip\_range": { "field": "destination.ip", …

---

## [Synonyms with FSCrawler](https://discuss.elastic.co/t/synonyms-with-fscrawler/223234)

<div class="topic-metadata">

**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\
**Replies:** 4\
**Last updated:** [March 25, 2020, 10:02am UTC](https://discuss.elastic.co/t/synonyms-with-fscrawler/223234 "2020-03-25T10:02:33Z")

</div>

Hi I am trying to integrate the synonyms search when i use FSCrawler, i have tried changing the variables in ~/.fscrawler/\_default/7/\_settings.json but to no avail. Any pointers on how to get it working?

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=975)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=977)
