# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1782

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1783

---

## [Creating and Recycling Dashboard Template over multiple indices](https://discuss.elastic.co/t/creating-and-recycling-dashboard-template-over-multiple-indices/250169)

<div class="topic-metadata">

**Author:** [@Max\_Handle](https://discuss.elastic.co/u/Max_Handle)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 11:46am UTC](https://discuss.elastic.co/t/creating-and-recycling-dashboard-template-over-multiple-indices/250169 "2020-09-28T11:46:05Z")

</div>

Hi, I am relatively new to Kibana and elastic. But for quite some time I am struggling to to find an answer to this question: Is it possible with Kibana to create a Dashboard template, that I can re-use for different in…

---

## [To which type of elasticsearch node should I send x-pack messages (from Elasticsearch, Logstash, Kibana, and Beats), and normal messages (from Logstash)?](https://discuss.elastic.co/t/to-which-type-of-elasticsearch-node-should-i-send-x-pack-messages-from-elasticsearch-logstash-kibana-and-beats-and-normal-messages-from-logstash/250096)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 0\
**Last updated:** [September 27, 2020, 5:03pm UTC](https://discuss.elastic.co/t/to-which-type-of-elasticsearch-node-should-i-send-x-pack-messages-from-elasticsearch-logstash-kibana-and-beats-and-normal-messages-from-logstash/250096 "2020-09-27T17:03:47Z")

</div>

Hi folks, I am using Elastic Stack 7.9, and I have 11 VMs like below; 1 - Elasticsearch Client Node (also injest) + Kibana 2,3 - Elasticsearch Master Nodes 4 - Elasticsearch Voting-only Master Node 5,6,7 - Elasticse…

---

## [How create histogram with fixed bucket](https://discuss.elastic.co/t/how-create-histogram-with-fixed-bucket/250142)

<div class="topic-metadata">

**Author:** [@natthawut](https://discuss.elastic.co/u/natthawut)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 10:24am UTC](https://discuss.elastic.co/t/how-create-histogram-with-fixed-bucket/250142 "2020-09-28T10:24:02Z")

</div>

I try to create histogram by fixed minimum interval=5 when histogram generate It auto generate bucket to 400 or something was not interval then i fixed.

---

## [Index patterns keep disappearing](https://discuss.elastic.co/t/index-patterns-keep-disappearing/249965)

<div class="topic-metadata">

**Author:** [@mutt13y](https://discuss.elastic.co/u/mutt13y)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 10:15am UTC](https://discuss.elastic.co/t/index-patterns-keep-disappearing/249965 "2020-09-28T10:15:49Z")

</div>

Hi I was experiencing this issue, I see it has been reported previously. As it seems there were no solutions I though I would post my findings. I determined that the cause was that I had defined a catchall index-templ…

---

## [Mapping not respected](https://discuss.elastic.co/t/mapping-not-respected/249670)

<div class="topic-metadata">

**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\
**Replies:** 4\
**Last updated:** [September 28, 2020, 9:55am UTC](https://discuss.elastic.co/t/mapping-not-respected/249670 "2020-09-28T09:55:35Z")

</div>

Hi, In Elastic 7.9.1I have this template (which is considered 'legacy' for some reason) which has several mappings like for example this one: However, when I look at the actual index I see everything is mapped as te…

---

## [Archive Elasticsearch indices to Azure blob storage](https://discuss.elastic.co/t/archive-elasticsearch-indices-to-azure-blob-storage/250134)

<div class="topic-metadata">

**Author:** [@Dubru](https://discuss.elastic.co/u/Dubru)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 9:31am UTC](https://discuss.elastic.co/t/archive-elasticsearch-indices-to-azure-blob-storage/250134 "2020-09-28T09:31:14Z")

</div>

I am using ElasticSearch and Kibana 7x version, I've a requirement to archive the ElasticSearch indices which are older than 10 days, How to we configure it from kibana dashboard/how do we automate the process?

---

## [Convert Date String Into Date Format](https://discuss.elastic.co/t/convert-date-string-into-date-format/249124)

<div class="topic-metadata">

**Author:** [@wahzix](https://discuss.elastic.co/u/wahzix)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 9:28am UTC](https://discuss.elastic.co/t/convert-date-string-into-date-format/249124 "2020-09-28T09:28:26Z")

</div>

Hi, I want to convert a date which is like this : 2020-09-18 15:42:41.5721 To do so, I have tried to use date plugin but it seems that the number of milliseconds is limited ( according to the doc ) date { match…

---

## [Elasticsearch can't execute watcher due to hooks.slack not being resolved](https://discuss.elastic.co/t/elasticsearch-cant-execute-watcher-due-to-hooks-slack-not-being-resolved/249835)

<div class="topic-metadata">

**Author:** [@cctk](https://discuss.elastic.co/u/cctk)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 9:19am UTC](https://discuss.elastic.co/t/elasticsearch-cant-execute-watcher-due-to-hooks-slack-not-being-resolved/249835 "2020-09-28T09:19:44Z")

</div>

I Have elasticsearch v7.9.1 Kibana v7.9.1 unfortunately the watchers have stopped working after I set up x-pack security. I cannot curl hooks.slack.com , this is my result. curl -v https://hooks.slack.com \* Could no…

---

## [Range query input type string vs numeric](https://discuss.elastic.co/t/range-query-input-type-string-vs-numeric/249211)

<div class="topic-metadata">

**Author:** [@bnarang](https://discuss.elastic.co/u/bnarang)\
**Replies:** 4\
**Last updated:** [September 28, 2020, 9:15am UTC](https://discuss.elastic.co/t/range-query-input-type-string-vs-numeric/249211 "2020-09-28T09:15:06Z")

</div>

Is there a negative impact on using a string input type vs numeric input type on the search query? For e.g. below in second example, quoted 10 { "query": { "range": { "age": { "gte": 10 } …

---

## [Unable to send log files where newline character is not present](https://discuss.elastic.co/t/unable-to-send-log-files-where-newline-character-is-not-present/249871)

<div class="topic-metadata">

**Author:** [@anirbansaha](https://discuss.elastic.co/u/anirbansaha)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 9:13am UTC](https://discuss.elastic.co/t/unable-to-send-log-files-where-newline-character-is-not-present/249871 "2020-09-28T09:13:18Z")

</div>

The log data which I am trying to send is a single line in file similar to the following \[{"empid" : "1", "empname": "anirban", "location":"India"}\] It is not having newline at the end. How to work for this? If this t…

---

## [Async query not returning results + search context failures](https://discuss.elastic.co/t/async-query-not-returning-results-search-context-failures/248746)

<div class="topic-metadata">

**Author:** [@csewack\_asym](https://discuss.elastic.co/u/csewack_asym)\
**Replies:** 13\
**Last updated:** [September 28, 2020, 9:08am UTC](https://discuss.elastic.co/t/async-query-not-returning-results-search-context-failures/248746 "2020-09-28T09:08:15Z")

</div>

We recently added many frozen indices to our cluster. We have been having trouble querying them using the regular search api, with a frequent error that there is no search context found. We believe this is because some s…

---

## [Max Agg on lowest value inside a list property of the document](https://discuss.elastic.co/t/max-agg-on-lowest-value-inside-a-list-property-of-the-document/249875)

<div class="topic-metadata">

**Author:** [@thevu](https://discuss.elastic.co/u/thevu)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 9:07am UTC](https://discuss.elastic.co/t/max-agg-on-lowest-value-inside-a-list-property-of-the-document/249875 "2020-09-28T09:07:06Z")

</div>

I'm looking to do a Max aggregation on a value of the property under my document, the property is a list of complex object (key and value). Here's my data: \[{ "id" : "1", "listItems" : \[ { …

---

## [Field Collapsing & Pagination](https://discuss.elastic.co/t/field-collapsing-pagination/249936)

<div class="topic-metadata">

**Author:** [@Prahalad\_Rathod](https://discuss.elastic.co/u/Prahalad_Rathod)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 9:00am UTC](https://discuss.elastic.co/t/field-collapsing-pagination/249936 "2020-09-28T09:00:18Z")

</div>

I just want to know how pagination works with collapsing. I have below index data: {'departmentNo': 1, 'departmentName': 'Food', 'departmentLoc': "I1", "departmentScore": "5", "employeeid" : 1, "employeeName": "vij…

---

## [Pass Data to Elasticsearch from a Remote Server](https://discuss.elastic.co/t/pass-data-to-elasticsearch-from-a-remote-server/249945)

<div class="topic-metadata">

**Author:** [@Amantha](https://discuss.elastic.co/u/Amantha)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 8:58am UTC](https://discuss.elastic.co/t/pass-data-to-elasticsearch-from-a-remote-server/249945 "2020-09-28T08:58:10Z")

</div>

I have two PCs. Assueme that they are Server1 and Server2. Logstash is installed in Server2 and Elasticsearch is configured in Server1. I want to send filtered logstash data from Server2 to Server1. Which configuration…

---

## [Elasticsearch.js client objects are all empty](https://discuss.elastic.co/t/elasticsearch-js-client-objects-are-all-empty/249961)

<div class="topic-metadata">

**Author:** [@JLobato](https://discuss.elastic.co/u/JLobato)\
**Replies:** 0\
**Last updated:** [September 25, 2020, 10:34am UTC](https://discuss.elastic.co/t/elasticsearch-js-client-objects-are-all-empty/249961 "2020-09-25T10:34:47Z")

</div>

Hi All, I am trying to create a rest API with the NodeJS client so that I can retrieve data from Elastic cloud. Now when I create the client in node and return the client everything is empty. So client.cat for example …

---

## [Metricbeat AzureStack](https://discuss.elastic.co/t/metricbeat-azurestack/250149)

<div class="topic-metadata">

**Author:** [@nurhambali](https://discuss.elastic.co/u/nurhambali)\
**Replies:** 0\
**Last updated:** [September 28, 2020, 8:51am UTC](https://discuss.elastic.co/t/metricbeat-azurestack/250149 "2020-09-28T08:51:19Z")

</div>

I tried to configure the metricbeat add module azure but the azure that I am monitoring the azure stack can?

---

## ["Unable to connect to Elasticsearch. Error: \[resource\_already\_exists\_exception\]" after upgrade ELK](https://discuss.elastic.co/t/unable-to-connect-to-elasticsearch-error-resource-already-exists-exception-after-upgrade-elk/249998)

<div class="topic-metadata">

**Author:** [@bognad](https://discuss.elastic.co/u/bognad)\
**Replies:** 3\
**Last updated:** [September 28, 2020, 8:50am UTC](https://discuss.elastic.co/t/unable-to-connect-to-elasticsearch-error-resource-already-exists-exception-after-upgrade-elk/249998 "2020-09-28T08:50:18Z")

</div>

Hi! I am upgrade ELK from 7.2 to 7.9.1. Kibana is unable to connect to ES After upgrade kibana had two indexes: curl https://localhost:9200/\_cat/indices/\*?v&s=index health status index …

---

## [How to transform a json object into flat fields in watcher?](https://discuss.elastic.co/t/how-to-transform-a-json-object-into-flat-fields-in-watcher/250044)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 1\
**Last updated:** [September 28, 2020, 8:48am UTC](https://discuss.elastic.co/t/how-to-transform-a-json-object-into-flat-fields-in-watcher/250044 "2020-09-28T08:48:59Z")

</div>

we got a watcher to capture certain payload in json format. for example "host": "myserver": { "jvm": { { "version": "14.0.1", "vm\_name": "OpenJDK", …

---

## [LDAP authentication error](https://discuss.elastic.co/t/ldap-authentication-error/250118)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 6\
**Last updated:** [September 28, 2020, 8:36am UTC](https://discuss.elastic.co/t/ldap-authentication-error/250118 "2020-09-28T08:36:32Z")

</div>

Hi all I have a little problems with authenticate to ldap server, i set it to work already but sometime the authen give me an error timeout, and all the time all of our account have to wait for some time to log in the…

---

## [Watch is stuck at error, always needs a manual restart](https://discuss.elastic.co/t/watch-is-stuck-at-error-always-needs-a-manual-restart/249778)

<div class="topic-metadata">

**Author:** [@Shubhangi](https://discuss.elastic.co/u/Shubhangi)\
**Replies:** 4\
**Last updated:** [September 28, 2020, 8:13am UTC](https://discuss.elastic.co/t/watch-is-stuck-at-error-always-needs-a-manual-restart/249778 "2020-09-28T08:13:11Z")

</div>

Hi, I'm using Elastic Stack 7.8. I've enable a watcher. Every night it shows error: connection timeout for webhook action. And the action status in But only when I edit the watch(I'm not actually changing any thing, rea…

---

## [Filebeat monitoring metrics sent bytes and throughput shown as 0](https://discuss.elastic.co/t/filebeat-monitoring-metrics-sent-bytes-and-throughput-shown-as-0/246215)

<div class="topic-metadata">

**Author:** [@daniel\_fablius](https://discuss.elastic.co/u/daniel_fablius)\
**Replies:** 5\
**Last updated:** [September 28, 2020, 8:04am UTC](https://discuss.elastic.co/t/filebeat-monitoring-metrics-sent-bytes-and-throughput-shown-as-0/246215 "2020-09-28T08:04:53Z")

</div>

Hi, when i loadtest and monitoring filebeat, i found out that the throughput (/s) and sent bytest shown as 0, while the Event (/s) showing some value and also the logs data is shown in Kibana. which then i assume, the co…

---

## [Calculating Percentage](https://discuss.elastic.co/t/calculating-percentage/250141)

<div class="topic-metadata">

**Author:** [@rcganesh](https://discuss.elastic.co/u/rcganesh)\
**Replies:** 0\
**Last updated:** [September 28, 2020, 7:56am UTC](https://discuss.elastic.co/t/calculating-percentage/250141 "2020-09-28T07:56:50Z")

</div>

Hello Experts, I am trying to find a way to calculate percentage of certain events in Elasticsearch using Logstash. Here is what I am trying to do. Injecting IIB data into Elasticsearch. Below is the sample json of th…

---

## [Heavy queuing on logstash nodes](https://discuss.elastic.co/t/heavy-queuing-on-logstash-nodes/250050)

<div class="topic-metadata">

**Author:** [@suyog1](https://discuss.elastic.co/u/suyog1)\
**Replies:** 5\
**Last updated:** [September 28, 2020, 7:20am UTC](https://discuss.elastic.co/t/heavy-queuing-on-logstash-nodes/250050 "2020-09-28T07:20:47Z")

</div>

Hello Team, I have below architecture in place. 400-800 EC2 ---\> AWS NLB ---\> 10 Logstash EC2s ---\> 14 EC2 of data node with filebeat …

---

## [Logstash beats input cant start with ssl enabled](https://discuss.elastic.co/t/logstash-beats-input-cant-start-with-ssl-enabled/249633)

<div class="topic-metadata">

**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\
**Replies:** 3\
**Last updated:** [September 28, 2020, 7:10am UTC](https://discuss.elastic.co/t/logstash-beats-input-cant-start-with-ssl-enabled/249633 "2020-09-28T07:10:50Z")

</div>

I would like to make secure connection between fielbeat and logstash. Both version 7.8.1. input { beats { port =\> 5000 ssl =\> true ssl\_certificate =\> "/ssl/instance.crt" ssl\_key =\> "/ssl/instance.key" …

---

## [Rufus scheduler error when using timestamp with time zone](https://discuss.elastic.co/t/rufus-scheduler-error-when-using-timestamp-with-time-zone/250135)

<div class="topic-metadata">

**Author:** [@PinballWizard](https://discuss.elastic.co/u/PinballWizard)\
**Replies:** 0\
**Last updated:** [September 28, 2020, 6:59am UTC](https://discuss.elastic.co/t/rufus-scheduler-error-when-using-timestamp-with-time-zone/250135 "2020-09-28T06:59:59Z")

</div>

I'm using Logstash jdbc plugin with DB2 on z/OS. Timestamp column is set to timestamp with time zone type. After initial execution of SQL statement I'm getting following error in Logstash log: logstash\[21949\]: { 2082 r…

---

## [How to search when there are 2 fields with dense vectors](https://discuss.elastic.co/t/how-to-search-when-there-are-2-fields-with-dense-vectors/248630)

<div class="topic-metadata">

**Author:** [@Chetan\_Ambi](https://discuss.elastic.co/u/Chetan_Ambi)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 6:23am UTC](https://discuss.elastic.co/t/how-to-search-when-there-are-2-fields-with-dense-vectors/248630 "2020-09-28T06:23:08Z")

</div>

I am working on implementing semantic search. I was able to implement where there is only one text field for which we can create dense vector. Can anyone please suggest how to achieve when there are more than one text fi…

---

## [How to increase replicas for .kibana index](https://discuss.elastic.co/t/how-to-increase-replicas-for-kibana-index/250124)

<div class="topic-metadata">

**Author:** [@shubhamblackstratus](https://discuss.elastic.co/u/shubhamblackstratus)\
**Replies:** 7\
**Last updated:** [September 28, 2020, 5:28am UTC](https://discuss.elastic.co/t/how-to-increase-replicas-for-kibana-index/250124 "2020-09-28T05:28:48Z")

</div>

Hi Team, In my cluster, I've found that by default every new index created with 1 shard and 1 replica; So I also changed default settings with 2 primary and 2 replica successfully for every new indices, which was found …

---

## [Workload Profile](https://discuss.elastic.co/t/workload-profile/249858)

<div class="topic-metadata">

**Author:** [@cdale](https://discuss.elastic.co/u/cdale)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 5:20am UTC](https://discuss.elastic.co/t/workload-profile/249858 "2020-09-28T05:20:16Z")

</div>

What are typical read/write ratio% for Elasticsearch solution for log analytics? 80% read and 20% write for Elasticsearch, Logstash, Machine Learning and Kibana? Thank you.

---

## [Metricbeat is unable to send data to elastic search(011Attempting to reconnect to backoff(elasticsearch(http://x.x.x.x:9200)) with 441 reconnect attempt(s))](https://discuss.elastic.co/t/metricbeat-is-unable-to-send-data-to-elastic-search-011attempting-to-reconnect-to-backoff-elasticsearch-http-x-x-x-x-9200-with-441-reconnect-attempt-s/250102)

<div class="topic-metadata">

**Author:** [@NiranjanMurali](https://discuss.elastic.co/u/NiranjanMurali)\
**Replies:** 10\
**Last updated:** [September 28, 2020, 4:56am UTC](https://discuss.elastic.co/t/metricbeat-is-unable-to-send-data-to-elastic-search-011attempting-to-reconnect-to-backoff-elasticsearch-http-x-x-x-x-9200-with-441-reconnect-attempt-s/250102 "2020-09-28T04:56:25Z")

</div>

I have recently updated ES, Kibana, Logstash, All the services are running but the data is not getting collected. and UI is also loading. Please help me to resolve this. Kibana Log: {"type":"log","@timestamp":"2020-09-…

---

## [Safe way to downgrade 7.8.1 index to 7.7.1](https://discuss.elastic.co/t/safe-way-to-downgrade-7-8-1-index-to-7-7-1/250117)

<div class="topic-metadata">

**Author:** [@chakradarraju](https://discuss.elastic.co/u/chakradarraju)\
**Replies:** 2\
**Last updated:** [September 28, 2020, 4:56am UTC](https://discuss.elastic.co/t/safe-way-to-downgrade-7-8-1-index-to-7-7-1/250117 "2020-09-28T04:56:07Z")

</div>

I have ES installed using helm in kubernetes v7.8.1, we're migrating to EKS and latest supported version in Amazon Elasticsearch service is 7.7. Trying to restore 7.8.1 snapshot in 7.7 is failing and I tried to delete a…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1781)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1783)
