# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1101

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1102

---

## [How to format sum\_bucket aggregation float output?](https://discuss.elastic.co/t/how-to-format-sum-bucket-aggregation-float-output/293851)

<div class="topic-metadata">

**Author:** [@Eduardo\_Montes](https://discuss.elastic.co/u/Eduardo_Montes)\
**Replies:** 3\
**Last updated:** [January 10, 2022, 1:16pm UTC](https://discuss.elastic.co/t/how-to-format-sum-bucket-aggregation-float-output/293851 "2022-01-10T13:16:32Z")

</div>

I use Elasticsearch for my Search Service and I use this JSON request for sum\_bucket aggregation: "from": 0, "size": 0, "aggregations": { "aggr": { "type": "term", "field": "type.…

---

## [How to enrich one of field in logtash](https://discuss.elastic.co/t/how-to-enrich-one-of-field-in-logtash/293579)

<div class="topic-metadata">

**Author:** [@INS](https://discuss.elastic.co/u/INS)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 12:47pm UTC](https://discuss.elastic.co/t/how-to-enrich-one-of-field-in-logtash/293579 "2022-01-10T12:47:48Z")

</div>

I'm struggling on enrich (split one of field from) CSV file input in my document I have many of undefined fields so at the begging I've needed to avoid that value. so I've decided to use mutate { gsub =\> \["message"…

---

## [Migration error](https://discuss.elastic.co/t/migration-error/293764)

<div class="topic-metadata">

**Author:** [@pawars21](https://discuss.elastic.co/u/pawars21)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 12:25pm UTC](https://discuss.elastic.co/t/migration-error/293764 "2022-01-10T12:25:28Z")

</div>

I'm getting below error while running kibana.bat for 7.16.2 version. Error: Unable to complete saved object migrations for the \[.kibana\_task\_manager\] index: Migrations failed. Reason: 2 corrupt saved object documents we…

---

## [Heap issue - OutofMemory](https://discuss.elastic.co/t/heap-issue-outofmemory/291432)

<div class="topic-metadata">

**Author:** [@alicango](https://discuss.elastic.co/u/alicango)\
**Replies:** 7\
**Last updated:** [January 10, 2022, 12:23pm UTC](https://discuss.elastic.co/t/heap-issue-outofmemory/291432 "2022-01-10T12:23:12Z")

</div>

With the latest version of Elasticsearch, the HEAP is automatically defined by Elasticsearch... So I upgraded my elk system from 7.7.0 to 7.15.2 with rpm I tried to leave jvm.options config file as a default (i mean, I…

---

## [Dealing with Kibana plugin server dependencies that won't run in the browser](https://discuss.elastic.co/t/dealing-with-kibana-plugin-server-dependencies-that-wont-run-in-the-browser/293599)

<div class="topic-metadata">

**Author:** [@Specialist](https://discuss.elastic.co/u/Specialist)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 12:21pm UTC](https://discuss.elastic.co/t/dealing-with-kibana-plugin-server-dependencies-that-wont-run-in-the-browser/293599 "2022-01-10T12:21:57Z")

</div>

Hello again, during Kibana plugin development I came across the following issue: In the plugin's server part I'd like to use a dependency (currently declared via the plugin's package.json), which only works under node.…

---

## [Transform doesn't create a destination index](https://discuss.elastic.co/t/transform-doesnt-create-a-destination-index/293867)

<div class="topic-metadata">

**Author:** [@knopkosasha](https://discuss.elastic.co/u/knopkosasha)\
**Replies:** 3\
**Last updated:** [January 10, 2022, 12:18pm UTC](https://discuss.elastic.co/t/transform-doesnt-create-a-destination-index/293867 "2022-01-10T12:18:57Z")

</div>

I'm trying to compare data in two indices using a slightly altered version of transform from here curl -v -H "content-type: application/json" -X PUT http://elastic-cluster:9200/\_transform/compare\_idx -d '{ "id" : "com…

---

## [To compute ingestion rate to elasticsearch cluster](https://discuss.elastic.co/t/to-compute-ingestion-rate-to-elasticsearch-cluster/293843)

<div class="topic-metadata">

**Author:** [@Varun\_S](https://discuss.elastic.co/u/Varun_S)\
**Replies:** 6\
**Last updated:** [January 10, 2022, 12:18pm UTC](https://discuss.elastic.co/t/to-compute-ingestion-rate-to-elasticsearch-cluster/293843 "2022-01-10T12:18:12Z")

</div>

Hi Team, We are using fluentd to send data to Elasticsearch and fluentd is transmitting data to Elasticsearch using the HTTP layer. We want to compute the ingestion rate to the Elasticsearch cluster, but there are no me…

---

## [\_reindex task creates loads of bulk requests and destroys audit log disk space](https://discuss.elastic.co/t/reindex-task-creates-loads-of-bulk-requests-and-destroys-audit-log-disk-space/293884)

<div class="topic-metadata">

**Author:** [@can.ozdemir](https://discuss.elastic.co/u/can.ozdemir)\
**Replies:** 0\
**Last updated:** [January 10, 2022, 11:52am UTC](https://discuss.elastic.co/t/reindex-task-creates-loads-of-bulk-requests-and-destroys-audit-log-disk-space/293884 "2022-01-10T11:52:10Z")

</div>

Hello, I recently tried to reindex 40ish smaller indexes into on big index for better distribution. reindexing was going fine I was watching the process on monitoring ui, and the task was ok no failed shards. After quit…

---

## [Is there any way to search specific index according to time range?](https://discuss.elastic.co/t/is-there-any-way-to-search-specific-index-according-to-time-range/293822)

<div class="topic-metadata">

**Author:** [@Zephery\_Wen](https://discuss.elastic.co/u/Zephery_Wen)\
**Replies:** 1\
**Last updated:** [January 9, 2022, 9:29pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-search-specific-index-according-to-time-range/293822 "2022-01-09T21:29:05Z")

</div>

When i use aaaa-\* and limit time range to search, es will search all of index begin with aaaa index, if there any way to search specific index according to time range? for example: aaaa-\* have these index: aaaa-2022-01…

---

## [What is the best way to build an auto complete](https://discuss.elastic.co/t/what-is-the-best-way-to-build-an-auto-complete/293829)

<div class="topic-metadata">

**Author:** [@Amir\_Faramarzi](https://discuss.elastic.co/u/Amir_Faramarzi)\
**Replies:** 5\
**Last updated:** [January 10, 2022, 11:18am UTC](https://discuss.elastic.co/t/what-is-the-best-way-to-build-an-auto-complete/293829 "2022-01-10T11:18:55Z")

</div>

Hello friends What is the best way to build an auto complete program in terms of performance ?? Also consider that I want to prioritize information whose names start with the text that the user is searching for.

---

## [How to use carriage return in a script template with a runtime mapping field?](https://discuss.elastic.co/t/how-to-use-carriage-return-in-a-script-template-with-a-runtime-mapping-field/293879)

<div class="topic-metadata">

**Author:** [@Ricou13](https://discuss.elastic.co/u/Ricou13)\
**Replies:** 0\
**Last updated:** [January 10, 2022, 11:17am UTC](https://discuss.elastic.co/t/how-to-use-carriage-return-in-a-script-template-with-a-runtime-mapping-field/293879 "2022-01-10T11:17:32Z")

</div>

Here is an example that illustrates the problem we are having with "mustache" and the carriage return. In our script template, we need : a runtime mapping field : to compute a result (with a big script in our real cas…

---

## [Stop autoformat dates in kibana filters](https://discuss.elastic.co/t/stop-autoformat-dates-in-kibana-filters/293776)

<div class="topic-metadata">

**Author:** [@Michael\_Ubry](https://discuss.elastic.co/u/Michael_Ubry)\
**Replies:** 4\
**Last updated:** [January 10, 2022, 11:11am UTC](https://discuss.elastic.co/t/stop-autoformat-dates-in-kibana-filters/293776 "2022-01-10T11:11:37Z")

</div>

Hi, is there way to stop Kibana from autoformat date inputs in filters ? my dates are in format DD.MM.YYYY but when I input it manully in filters its gonna convert automatically to 2018-01-01T00:00:00.000+01:00... As u…

---

## [Kibana intermittently losing connectivity to Elasticsearch](https://discuss.elastic.co/t/kibana-intermittently-losing-connectivity-to-elasticsearch/293682)

<div class="topic-metadata">

**Author:** [@aidofitz](https://discuss.elastic.co/u/aidofitz)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 9:59am UTC](https://discuss.elastic.co/t/kibana-intermittently-losing-connectivity-to-elasticsearch/293682 "2022-01-10T09:59:24Z")

</div>

Hi, Am seeing an issue in my v7.8 cluster with 16 x Kibana nodes, 16 x Elastic nodes. Kibana nodes keep reporting status as red, with error as in screenshot. However, my Elastic cluster seems to be fine and I can test …

---

## [Elasticsearch aggregation on million or more data](https://discuss.elastic.co/t/elasticsearch-aggregation-on-million-or-more-data/293641)

<div class="topic-metadata">

**Author:** [@Nowrin\_Hossain](https://discuss.elastic.co/u/Nowrin_Hossain)\
**Replies:** 5\
**Last updated:** [January 10, 2022, 9:42am UTC](https://discuss.elastic.co/t/elasticsearch-aggregation-on-million-or-more-data/293641 "2022-01-10T09:42:08Z")

</div>

I have an index which can have millions of documents with time. I need to make several aggregation on those huge amount of documents fields. In these documents, I need to count number of unique value of a field which may…

---

## [Kibana dashboard with two timestamps](https://discuss.elastic.co/t/kibana-dashboard-with-two-timestamps/293684)

<div class="topic-metadata">

**Author:** [@Michael\_Ubry](https://discuss.elastic.co/u/Michael_Ubry)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 9:33am UTC](https://discuss.elastic.co/t/kibana-dashboard-with-two-timestamps/293684 "2022-01-10T09:33:52Z")

</div>

Hi, is it possible to have two different timestamps within one dashboard? There is always one which is in calendar in up right corner and applies to whole dashboard (lets say its production date) but what if I want ano…

---

## [Total doc\_count aggregations](https://discuss.elastic.co/t/total-doc-count-aggregations/293832)

<div class="topic-metadata">

**Author:** [@Miguel\_BA](https://discuss.elastic.co/u/Miguel_BA)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 9:11am UTC](https://discuss.elastic.co/t/total-doc-count-aggregations/293832 "2022-01-10T09:11:05Z")

</div>

I am looking for a way to sum up the Total doc\_count aggregations that I have defined in the query. I will try to explain my question through the following simple representative example: { "name" : false, "…

---

## [Configuring multiple nodes in one Elastic installation](https://discuss.elastic.co/t/configuring-multiple-nodes-in-one-elastic-installation/291936)

<div class="topic-metadata">

**Author:** [@arthytrip](https://discuss.elastic.co/u/arthytrip)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 9:07am UTC](https://discuss.elastic.co/t/configuring-multiple-nodes-in-one-elastic-installation/291936 "2022-01-10T09:07:46Z")

</div>

Hello everybody, I'm trying to set up multiple Elasticsearch nodes in one installation. For the moment it is a test so I have no performance problems (but any advice is welcome). Based on some readings on the net I tr…

---

## [Circuit Breaker Exception](https://discuss.elastic.co/t/circuit-breaker-exception/293737)

<div class="topic-metadata">

**Author:** [@Suresh\_Ghatuwa](https://discuss.elastic.co/u/Suresh_Ghatuwa)\
**Replies:** 9\
**Last updated:** [January 10, 2022, 9:00am UTC](https://discuss.elastic.co/t/circuit-breaker-exception/293737 "2022-01-10T09:00:50Z")

</div>

I am working on ES Circuit Breaker implementation. I got circuit breaker exception if heavy terms aggregation. But if multiple es query with less JVM usage than limit is executed, then we got Out Of Memory exception. Qu…

---

## [Delete All and multiple bulk puts](https://discuss.elastic.co/t/delete-all-and-multiple-bulk-puts/293756)

<div class="topic-metadata">

**Author:** [@snoopy20](https://discuss.elastic.co/u/snoopy20)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 8:59am UTC](https://discuss.elastic.co/t/delete-all-and-multiple-bulk-puts/293756 "2022-01-10T08:59:22Z")

</div>

Hi All, New user here and I've come across my first issue which the documentation doesn't seem to cater for. I have a need to index about 35,000 small records which I intend to do through /indexName/\_bulk. At first I t…

---

## [Change Kibana URL](https://discuss.elastic.co/t/change-kibana-url/292775)

<div class="topic-metadata">

**Author:** [@augandi](https://discuss.elastic.co/u/augandi)\
**Replies:** 3\
**Last updated:** [January 10, 2022, 8:43am UTC](https://discuss.elastic.co/t/change-kibana-url/292775 "2022-01-10T08:43:08Z")

</div>

Hi, I just set up the kibana Alerting but unfortunately the Link in the Mail ist unusable because of: (https://0.0.0.0:5601/app/monitoring#/elasticsearch/nodes/kbidk0kaQrSBNqIP\_QmvWA?\_g=(cluster\_uuid:XpQMlhk9TlCvzFukn0H…

---

## [Delete menu items](https://discuss.elastic.co/t/delete-menu-items/293861)

<div class="topic-metadata">

**Author:** [@Osysh](https://discuss.elastic.co/u/Osysh)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 8:40am UTC](https://discuss.elastic.co/t/delete-menu-items/293861 "2022-01-10T08:40:14Z")

</div>

Hi, Is it possible to delete a menu item from the kibana menu (version 7.15) ? I try showOnly method but it accept just one item. Regards

---

## [Sql query cannot be closed](https://discuss.elastic.co/t/sql-query-cannot-be-closed/293192)

<div class="topic-metadata">

**Author:** [@bxl](https://discuss.elastic.co/u/bxl)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 8:29am UTC](https://discuss.elastic.co/t/sql-query-cannot-be-closed/293192 "2022-01-10T08:29:41Z")

</div>

sql query cannot be closed, resulting in cluster exception，Restart Cluster Recovery Elasticsearch version: 7.9.3 query GET \_sql?format=txt {"query": """ SELECT app,tag,count(1) as c FROM "test" group by app,tag order …

---

## [Can a logstash filter error be forwarded to elastic?](https://discuss.elastic.co/t/can-a-logstash-filter-error-be-forwarded-to-elastic/293742)

<div class="topic-metadata">

**Author:** [@DavidMarcu](https://discuss.elastic.co/u/DavidMarcu)\
**Replies:** 4\
**Last updated:** [January 10, 2022, 8:15am UTC](https://discuss.elastic.co/t/can-a-logstash-filter-error-be-forwarded-to-elastic/293742 "2022-01-10T08:15:44Z")

</div>

I'm having these json parsing errors from time to time: 2022-01-07T12:15:19,872\]\[WARN \]\[logstash.filters.json \] Error parsing json {:source=\>"message", :raw=\>" { the invalid json }", :exception=\>#\<LogStash::Json::Pa…

---

## [Does transform job's groupBy order matter?](https://discuss.elastic.co/t/does-transform-jobs-groupby-order-matter/293787)

<div class="topic-metadata">

**Author:** [@Ashfur](https://discuss.elastic.co/u/Ashfur)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 8:01am UTC](https://discuss.elastic.co/t/does-transform-jobs-groupby-order-matter/293787 "2022-01-10T08:01:45Z")

</div>

When we specify multiple groupBys in a pivot transform job, does the order matter? For example, let's say we have a TermGroupBy by userId and a DateHistogramGroupBy by timestamp. Does it matter which is declared firs…

---

## [Transform Retention Policy](https://discuss.elastic.co/t/transform-retention-policy/293683)

<div class="topic-metadata">

**Author:** [@KentHHarris](https://discuss.elastic.co/u/KentHHarris)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 7:49am UTC](https://discuss.elastic.co/t/transform-retention-policy/293683 "2022-01-10T07:49:57Z")

</div>

Hello, I was hoping for some clarity around transforms' retention policy. My understanding is that any documents in the destination index would be "ignored" from the pivot computations, when the retention policy dateti…

---

## [Shard is not working due to \_source field](https://discuss.elastic.co/t/shard-is-not-working-due-to-source-field/293806)

<div class="topic-metadata">

**Author:** [@Butovoboy](https://discuss.elastic.co/u/Butovoboy)\
**Replies:** 2\
**Last updated:** [January 10, 2022, 7:36am UTC](https://discuss.elastic.co/t/shard-is-not-working-due-to-source-field/293806 "2022-01-10T07:36:17Z")

</div>

Hello, guys! I have a server with running ELK and other four servers with running filebeat on them. All these four filebeats send information directly to Elasticsearch on the first server. One shard is not working and…

---

## [The indices which match this index pattern don't contain any time fields](https://discuss.elastic.co/t/the-indices-which-match-this-index-pattern-dont-contain-any-time-fields/293403)

<div class="topic-metadata">

**Author:** [@damienhaynes](https://discuss.elastic.co/u/damienhaynes)\
**Replies:** 21\
**Last updated:** [January 10, 2022, 6:41am UTC](https://discuss.elastic.co/t/the-indices-which-match-this-index-pattern-dont-contain-any-time-fields/293403 "2022-01-10T06:41:07Z")

</div>

Hello, I need assistance in creating an index pattern so I can search logs in Kibana. I have the following logstash configuration: input { beats { port =\> 5044 host =\> "0.0.0.0" } } filter { json { …

---

## [Upgrading elasticsearch 6.3.2 to 6.8.22](https://discuss.elastic.co/t/upgrading-elasticsearch-6-3-2-to-6-8-22/293849)

<div class="topic-metadata">

**Author:** [@Vishnu\_Vijay](https://discuss.elastic.co/u/Vishnu_Vijay)\
**Replies:** 1\
**Last updated:** [January 10, 2022, 6:23am UTC](https://discuss.elastic.co/t/upgrading-elasticsearch-6-3-2-to-6-8-22/293849 "2022-01-10T06:23:34Z")

</div>

Hello Team, We are planning to upgrade Elasticsearch from 6.3.2 to 6.8.22. We noticed that there are no breaking changes as per the documentation. Kindly suggest whether there are any areas to be focused about. Also ple…

---

## [Merging the index with lower max\_number\_segement causing increasing index size](https://discuss.elastic.co/t/merging-the-index-with-lower-max-number-segement-causing-increasing-index-size/293844)

<div class="topic-metadata">

**Author:** [@arvin495](https://discuss.elastic.co/u/arvin495)\
**Replies:** 8\
**Last updated:** [January 10, 2022, 6:01am UTC](https://discuss.elastic.co/t/merging-the-index-with-lower-max-number-segement-causing-increasing-index-size/293844 "2022-01-10T06:01:04Z")

</div>

Hello Team, We have performed force merging on one index size of 74GB with 2 shards (primary + replica) and 36 segments (primary + replica) to remove deleted docs. curl -s -X POST "https://elasticsearch.com/index/\_forc…

---

## [Convert YYYY-MM-DD-HH.MM.SS to date](https://discuss.elastic.co/t/convert-yyyy-mm-dd-hh-mm-ss-to-date/293820)

<div class="topic-metadata">

**Author:** [@Hooman24](https://discuss.elastic.co/u/Hooman24)\
**Replies:** 4\
**Last updated:** [January 10, 2022, 5:35am UTC](https://discuss.elastic.co/t/convert-yyyy-mm-dd-hh-mm-ss-to-date/293820 "2022-01-10T05:35:20Z")

</div>

Hi I have a dateTime field with the following format: yyyy-mm-dd-HH.mm.ss I want to use this field as a date time field in ELK. I don't know how to change 11th position of the string('-') to 'T' to convert this field …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1100)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1102)
