# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1433

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1434

---

## [Ship Kubernenetes events logs to kibana](https://discuss.elastic.co/t/ship-kubernenetes-events-logs-to-kibana/271390)

<div class="topic-metadata">

**Author:** [@frozen\_walker](https://discuss.elastic.co/u/frozen_walker)\
**Replies:** 0\
**Last updated:** [April 27, 2021, 1:55pm UTC](https://discuss.elastic.co/t/ship-kubernenetes-events-logs-to-kibana/271390 "2021-04-27T13:55:37Z")

</div>

How can we ship Kubernetes events logs to kibana. ie: That we can get from kubectl get events command. example output: LAST SEEN TYPE REASON OBJECT MESSAGE 47s Warning Failed p…

---

## [Metricbeat: failed to publish events -\> security\_exception](https://discuss.elastic.co/t/metricbeat-failed-to-publish-events-security-exception/271505)

<div class="topic-metadata">

**Author:** [@sderungs](https://discuss.elastic.co/u/sderungs)\
**Replies:** 0\
**Last updated:** [April 28, 2021, 12:14pm UTC](https://discuss.elastic.co/t/metricbeat-failed-to-publish-events-security-exception/271505 "2021-04-28T12:14:32Z")

</div>

Hi, While upgrading our environment (self-hosted) from 7.8 to 7.12 I'm trying to setup Metricbeat to monitor my Elasticsearch cluster as described in the deprecation log shown on startup and in the Stack Monitoring in K…

---

## [Index data on disk between versions](https://discuss.elastic.co/t/index-data-on-disk-between-versions/271857)

<div class="topic-metadata">

**Author:** [@zissop](https://discuss.elastic.co/u/zissop)\
**Replies:** 6\
**Last updated:** [May 3, 2021, 9:12am UTC](https://discuss.elastic.co/t/index-data-on-disk-between-versions/271857 "2021-05-03T09:12:40Z")

</div>

Hello I have setup 2 different elasticsearch instances on 2 different servers. The first is elasticsearch v 7.10 and the other v 7.12 I create the same exact index and use the same exact data for indexing, both are 100…

---

## [What is the recommend memory size to run logstash?](https://discuss.elastic.co/t/what-is-the-recommend-memory-size-to-run-logstash/271083)

<div class="topic-metadata">

**Author:** [@talbehat](https://discuss.elastic.co/u/talbehat)\
**Replies:** 13\
**Last updated:** [May 3, 2021, 8:47am UTC](https://discuss.elastic.co/t/what-is-the-recommend-memory-size-to-run-logstash/271083 "2021-05-03T08:47:46Z")

</div>

Hi all, Please explain What is the recommend memory size to run logstash. Thanks

---

## [Missing results using query\_string wildcard query with rewrite top\_terms\_n](https://discuss.elastic.co/t/missing-results-using-query-string-wildcard-query-with-rewrite-top-terms-n/269680)

<div class="topic-metadata">

**Author:** [@carantunes](https://discuss.elastic.co/u/carantunes)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 8:40am UTC](https://discuss.elastic.co/t/missing-results-using-query-string-wildcard-query-with-rewrite-top-terms-n/269680 "2021-05-03T08:40:25Z")

</div>

I'm using Elasticsearch version 7.1.1. I'm experiencing a weird behaviour. When using top\_terms\_n in order to obtain a score in wildcard query\_string queries almost all results are missing. Without top\_terms\_n I obtain…

---

## [A plugin had an unrecoverable error. Will restart this plugin](https://discuss.elastic.co/t/a-plugin-had-an-unrecoverable-error-will-restart-this-plugin/271946)

<div class="topic-metadata">

**Author:** [@Safir](https://discuss.elastic.co/u/Safir)\
**Replies:** 0\
**Last updated:** [May 3, 2021, 8:37am UTC](https://discuss.elastic.co/t/a-plugin-had-an-unrecoverable-error-will-restart-this-plugin/271946 "2021-05-03T08:37:09Z")

</div>

/Users/lab/Desktop/logstash/logstash-core/lib/logstash/java\_pipeline.rb:396:in block in start\_input' \[2021-05-03T11:31:51,605\]\[ERROR\]\[logstash.javapipeline \]\[main\]\[6a3d8ecc5c72c85e305635d46ccbd177399eb255a591231ec278b…

---

## [Stopping Elasticsearch causes Windows Server to crash/restart](https://discuss.elastic.co/t/stopping-elasticsearch-causes-windows-server-to-crash-restart/271608)

<div class="topic-metadata">

**Author:** [@mbalzary](https://discuss.elastic.co/u/mbalzary)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 8:35am UTC](https://discuss.elastic.co/t/stopping-elasticsearch-causes-windows-server-to-crash-restart/271608 "2021-05-03T08:35:00Z")

</div>

Hi, we installed Elasticsearch 7.10 on a Windows Server 2016. Only configuration changes made are regarding cluster.name and node.name. Elasticsearch can be started without a problem and runs, but when it is stopped it …

---

## [Kibana dashboard dynamic labeling](https://discuss.elastic.co/t/kibana-dashboard-dynamic-labeling/271852)

<div class="topic-metadata">

**Author:** [@Rachitha](https://discuss.elastic.co/u/Rachitha)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 8:14am UTC](https://discuss.elastic.co/t/kibana-dashboard-dynamic-labeling/271852 "2021-05-03T08:14:09Z")

</div>

We can just add the single data column and the contents be visible in the drop down of Control Visualization. Is there any way so that we get the all the data column as the dropdown list?

---

## [Authentication to realm default native failed - Password authentication failed for xyz](https://discuss.elastic.co/t/authentication-to-realm-default-native-failed-password-authentication-failed-for-xyz/271759)

<div class="topic-metadata">

**Author:** [@Ekta](https://discuss.elastic.co/u/Ekta)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 8:09am UTC](https://discuss.elastic.co/t/authentication-to-realm-default-native-failed-password-authentication-failed-for-xyz/271759 "2021-05-03T08:09:15Z")

</div>

Hi All, Elasticsearch-version-7.6.2 I have created xyz admin user for only monitoring the url. For that I have created one custom role and add that role into the user. Below is my role code with the name my\_admin\_role …

---

## [Could not index event to Elasticsearch](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch/271929)

<div class="topic-metadata">

**Author:** [@BASHEER\_DS](https://discuss.elastic.co/u/BASHEER_DS)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 7:15am UTC](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch/271929 "2021-05-03T07:15:44Z")

</div>

Hi, I am trying to index my data into Elasticsearch from logstash but I keep getting this type of errors for all indices. Could not index event to Elasticsearch. {:status=\>400, :action=\>\["index", {:\_id=\>nil, :\_index=\>"…

---

## [Setup X-pack](https://discuss.elastic.co/t/setup-x-pack/271497)

<div class="topic-metadata">

**Author:** [@Stefan\_Stopka](https://discuss.elastic.co/u/Stefan_Stopka)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 6:48am UTC](https://discuss.elastic.co/t/setup-x-pack/271497 "2021-05-03T06:48:15Z")

</div>

Have a nice day, I want to ask someone who would be able to help me at how to run the X-pack set so that I used it exclusively within the scope of the free license does not exceed the limit of the free license and also …

---

## [Cluster management: 2000+ open active shards](https://discuss.elastic.co/t/cluster-management-2000-open-active-shards/271868)

<div class="topic-metadata">

**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\
**Replies:** 30\
**Last updated:** [May 3, 2021, 6:35am UTC](https://discuss.elastic.co/t/cluster-management-2000-open-active-shards/271868 "2021-05-03T06:35:14Z")

</div>

Hello, I hope this messages finds you and your loved ones safe and healthy. I have a 3 node Elastic cluster with 2 data nodes and 1 voting node. Nodes are running Ubuntu 20.04.2 LTS with the stack at the latest current…

---

## [Unable to authenticate user \[elastic\] for REST request](https://discuss.elastic.co/t/unable-to-authenticate-user-elastic-for-rest-request/270480)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 6\
**Last updated:** [May 3, 2021, 5:49am UTC](https://discuss.elastic.co/t/unable-to-authenticate-user-elastic-for-rest-request/270480 "2021-05-03T05:49:05Z")

</div>

I upgraded the ELK cluster on a rolling basis according to the documentation (7.4.2 to 7.12.0), and I only have three master/node nodes. I rolled each es node in turn, and then reinstalled the new version of kibana. An …

---

## [Can the index's roll alias be set dynamically？](https://discuss.elastic.co/t/can-the-indexs-roll-alias-be-set-dynamically/271748)

<div class="topic-metadata">

**Author:** [@ktpktr0](https://discuss.elastic.co/u/ktpktr0)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 5:42am UTC](https://discuss.elastic.co/t/can-the-indexs-roll-alias-be-set-dynamically/271748 "2021-05-03T05:42:54Z")

</div>

I use filebeat to add fields to dynamically generate indexes. index =\> "%{\[service\]}-%{+YYYY.MM.dd}" I configure the following index template to match the generated index { "index\_templates" : \[ { "name" :…

---

## [Kibana Table visualisation search error](https://discuss.elastic.co/t/kibana-table-visualisation-search-error/271813)

<div class="topic-metadata">

**Author:** [@Marouane\_K](https://discuss.elastic.co/u/Marouane_K)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 5:33am UTC](https://discuss.elastic.co/t/kibana-table-visualisation-search-error/271813 "2021-05-03T05:33:20Z")

</div>

please help me with this error of the table visualisation the table was working for a long period of time an then it started showing an error message of type 'search error'

---

## [How to combine search results](https://discuss.elastic.co/t/how-to-combine-search-results/271730)

<div class="topic-metadata">

**Author:** [@Ruth\_Smith](https://discuss.elastic.co/u/Ruth_Smith)\
**Replies:** 1\
**Last updated:** [May 2, 2021, 6:22am UTC](https://discuss.elastic.co/t/how-to-combine-search-results/271730 "2021-05-02T06:22:03Z")

</div>

I'm using ES 7.1.2. I have indices of log records of customer logins, one index per day. I want to find a list of all customers who have not logged in the prior month. I know how to execute two aggregations, one which re…

---

## [One element fails](https://discuss.elastic.co/t/one-element-fails/271726)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 5\
**Last updated:** [May 3, 2021, 4:32am UTC](https://discuss.elastic.co/t/one-element-fails/271726 "2021-05-03T04:32:45Z")

</div>

Hi, I have a canvas slide where all elements show as usual. Only one element fails. The Error How can I debug? Troubleshoot? Understand what's going on there? Version 7.9.1 Cheers!

---

## [Filebeat: Exiting: error loading config file: yaml: line 107: could not find expect ':'](https://discuss.elastic.co/t/filebeat-exiting-error-loading-config-file-yaml-line-107-could-not-find-expect/271276)

<div class="topic-metadata">

**Author:** [@itsec](https://discuss.elastic.co/u/itsec)\
**Replies:** 5\
**Last updated:** [May 3, 2021, 4:19am UTC](https://discuss.elastic.co/t/filebeat-exiting-error-loading-config-file-yaml-line-107-could-not-find-expect/271276 "2021-05-03T04:19:52Z")

</div>

Hi, i'm new to filebeat and kafka and i'm trying to learn how to send server logs to kafka. filebeat.inputs: '- type: log Change to true to enable this input configuration. enabled: true Paths that should be crawled …

---

## [json insert](https://discuss.elastic.co/t/json-insert/271891)

<div class="topic-metadata">

**Author:** [@pyeonzzang123](https://discuss.elastic.co/u/pyeonzzang123)\
**Replies:** 8\
**Last updated:** [May 3, 2021, 1:45am UTC](https://discuss.elastic.co/t/json-insert/271891 "2021-05-03T01:45:26Z")

</div>

I want to write the same c# code as the Python code below. But there was an error. I don’t' know the reason. python // import json import sys from elasticsearch import Elasticsearch from elasticsearch.helpers impor…

---

## [How to insert json data into elasticsearch](https://discuss.elastic.co/t/how-to-insert-json-data-into-elasticsearch/271921)

<div class="topic-metadata">

**Author:** [@pyeonzzang123](https://discuss.elastic.co/u/pyeonzzang123)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 1:34am UTC](https://discuss.elastic.co/t/how-to-insert-json-data-into-elasticsearch/271921 "2021-05-03T01:34:23Z")

</div>

I want to write the same c# code as the Python code below. But there was an error. I don’t' know the reason. python ''' import json import time from elasticsearch import Elasticsearch from elasticsearch.helpers imp…

---

## [Output values into a Json dictionary](https://discuss.elastic.co/t/output-values-into-a-json-dictionary/271919)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 0\
**Last updated:** [May 3, 2021, 12:36am UTC](https://discuss.elastic.co/t/output-values-into-a-json-dictionary/271919 "2021-05-03T00:36:26Z")

</div>

I get the following values from a database: 1234 , first 1, 123 ,third and I want to output them as a json dictionary to a file "1234" =\> {"key1" =\> "first 1" "key2" =\> 123 "key3" =\> "third 1"} i can do this with cod…

---

## [How can I monitor the queue of Filebeat](https://discuss.elastic.co/t/how-can-i-monitor-the-queue-of-filebeat/271750)

<div class="topic-metadata">

**Author:** [@Ben\_Tang](https://discuss.elastic.co/u/Ben_Tang)\
**Replies:** 2\
**Last updated:** [May 2, 2021, 11:50pm UTC](https://discuss.elastic.co/t/how-can-i-monitor-the-queue-of-filebeat/271750 "2021-05-02T23:50:08Z")

</div>

I'm currently using the default setting for filebeat, and also sends the monitoring data to an Elasticsearch cluster. My workflow for logs is Filebeat -\> Logstash -\> Elasticsearch Just wondering how can we monitor the …

---

## [Why should I have to split index](https://discuss.elastic.co/t/why-should-i-have-to-split-index/271824)

<div class="topic-metadata">

**Author:** [@surya3](https://discuss.elastic.co/u/surya3)\
**Replies:** 1\
**Last updated:** [May 2, 2021, 9:54pm UTC](https://discuss.elastic.co/t/why-should-i-have-to-split-index/271824 "2021-05-02T21:54:10Z")

</div>

Hi team I am newbie to the elastic search. While I am looking at static index settings I found index.number\_of\_routing\_shards there mentioned that it is used to split an index. After seeing this sentence I got some ques…

---

## [Is there a schema of API types (such as aggregations and pipeline processors) available somewhere?](https://discuss.elastic.co/t/is-there-a-schema-of-api-types-such-as-aggregations-and-pipeline-processors-available-somewhere/271829)

<div class="topic-metadata">

**Author:** [@Chance](https://discuss.elastic.co/u/Chance)\
**Replies:** 0\
**Last updated:** [April 30, 2021, 7:24pm UTC](https://discuss.elastic.co/t/is-there-a-schema-of-api-types-such-as-aggregations-and-pipeline-processors-available-somewhere/271829 "2021-04-30T19:24:06Z")

</div>

I'm putting together a package that's basically types for the official elasticsearch go client. I've gotten most of the queries done (I need to finish up the span set and a couple of others). Writing them out was rather …

---

## [Logstash Error - elasticsearch - Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"http://elastichost:9200/\_bulk"}](https://discuss.elastic.co/t/logstash-error-elasticsearch-encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400-url-http-elastichost-9200-bulk/271854)

<div class="topic-metadata">

**Author:** [@PavanB](https://discuss.elastic.co/u/PavanB)\
**Replies:** 1\
**Last updated:** [May 2, 2021, 9:49pm UTC](https://discuss.elastic.co/t/logstash-error-elasticsearch-encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400-url-http-elastichost-9200-bulk/271854 "2021-05-02T21:49:45Z")

</div>

Hi Team, Please help for the below error. This is happening recently as Logstash is not able to ingest data to Elasticsearch. elasticsearch - Encountered a retryable error. Will Retry with exponential backoff {:code=\>4…

---

## [Create multiple Elasticsearch processes on a single physical host](https://discuss.elastic.co/t/create-multiple-elasticsearch-processes-on-a-single-physical-host/271883)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 2\
**Last updated:** [May 2, 2021, 9:41pm UTC](https://discuss.elastic.co/t/create-multiple-elasticsearch-processes-on-a-single-physical-host/271883 "2021-05-02T21:41:44Z")

</div>

I'm planning to use single node cluster for my application deployment. We have more use cases of scaling vertically than adding a new physical host. Elasticsearch is planning to deprecate multi node path in near future. …

---

## [Aggregate Filter mapping](https://discuss.elastic.co/t/aggregate-filter-mapping/271723)

<div class="topic-metadata">

**Author:** [@StashLogs](https://discuss.elastic.co/u/StashLogs)\
**Replies:** 2\
**Last updated:** [May 2, 2021, 8:35pm UTC](https://discuss.elastic.co/t/aggregate-filter-mapping/271723 "2021-05-02T20:35:50Z")

</div>

Hello everyone! I am trying to understand this behaviour with the map field syntax in the aggregate filter. In the code below, if I keep the field name as 'syntaxOddity', no data is copied over. But if I change the fie…

---

## [Filebeat Nginx ingress controller module doesn't work in 7.11+](https://discuss.elastic.co/t/filebeat-nginx-ingress-controller-module-doesnt-work-in-7-11/271804)

<div class="topic-metadata">

**Author:** [@Evgeni\_Gordeev](https://discuss.elastic.co/u/Evgeni_Gordeev)\
**Replies:** 6\
**Last updated:** [May 2, 2021, 6:36pm UTC](https://discuss.elastic.co/t/filebeat-nginx-ingress-controller-module-doesnt-work-in-7-11/271804 "2021-05-02T18:36:14Z")

</div>

This configuration used to work in Elastic Stack 7.10. It stopped in 7.11 and doesn't work in 7.12 as well. Elastic: 7.12.1 ES Helm chart: 7.12.1 Kubernetes: 1.18 ingress-nginx Helm chart: 3.19.0 (ingress-nginx contr…

---

## [Logstash type error conversion geo\_point type field must be a number](https://discuss.elastic.co/t/logstash-type-error-conversion-geo-point-type-field-must-be-a-number/271914)

<div class="topic-metadata">

**Author:** [@luis\_vaglian](https://discuss.elastic.co/u/luis_vaglian)\
**Replies:** 0\
**Last updated:** [May 2, 2021, 6:11pm UTC](https://discuss.elastic.co/t/logstash-type-error-conversion-geo-point-type-field-must-be-a-number/271914 "2021-05-02T18:11:06Z")

</div>

Hi, I have created my index pattern to map my csv file(geoLocation in geo\_point) ''' PUT \_template/geotemplate \*\* {\*\* \*\* "index\_patterns": \[\*\* \*\* "flightgeolocation"\*\* \*\* \],\*\* \*\* "setting…

---

## [Curator timeout\_override parameter not working for snapshot\_delete action](https://discuss.elastic.co/t/curator-timeout-override-parameter-not-working-for-snapshot-delete-action/271473)

<div class="topic-metadata">

**Author:** [@shivpathak23](https://discuss.elastic.co/u/shivpathak23)\
**Replies:** 2\
**Last updated:** [May 2, 2021, 4:52pm UTC](https://discuss.elastic.co/t/curator-timeout-override-parameter-not-working-for-snapshot-delete-action/271473 "2021-05-02T16:52:21Z")

</div>

Hello community, I am using curator for elasticsearch snapshot deletion, since couple of days I started observing that snapshot deleting took longer time than previous in short (more than 5 minutes) since then my curato…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1432)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1434)
