# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1684

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1685

---

## [Why does Beat need to connect to Kibana?](https://discuss.elastic.co/t/why-does-beat-need-to-connect-to-kibana/255417)

<div class="topic-metadata">

**Author:** [@houmie](https://discuss.elastic.co/u/houmie)\
**Replies:** 4\
**Last updated:** [November 22, 2020, 1:11am UTC](https://discuss.elastic.co/t/why-does-beat-need-to-connect-to-kibana/255417 "2020-11-22T01:11:54Z")

</div>

In filebeat.yml there is this line Starting with Beats version 6.0.0, the dashboards are loaded via the Kibana API. But filebeat either connects to logstash or directly to Elasticsearch. Elastic search then in return…

---

## [Add parameter "include\_type\_name":true in index settings block](https://discuss.elastic.co/t/add-parameter-include-type-name-true-in-index-settings-block/256078)

<div class="topic-metadata">

**Author:** [@Tamil\_Selvan](https://discuss.elastic.co/u/Tamil_Selvan)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 6:52pm UTC](https://discuss.elastic.co/t/add-parameter-include-type-name-true-in-index-settings-block/256078 "2020-11-20T18:52:07Z")

</div>

In ES version 7.9.3, the include\_type\_name is defaulted to false, need to make it true, Need to pass include\_type\_name=true in request URL Is there is another way without passing in the request url

---

## [Elasticsearch: "high" CPU usage every 6 minutes for one minute](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-every-6-minutes-for-one-minute/256235)

<div class="topic-metadata">

**Author:** [@oicfar](https://discuss.elastic.co/u/oicfar)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 8:03pm UTC](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-every-6-minutes-for-one-minute/256235 "2020-11-21T20:03:43Z")

</div>

Hi, I'm running ELK Stack 7.10.0 (elasticsearch, filebeat, kibana, logstash) on the same server. And since two days elasticsearch is doing something every 6 minutes for one minute. The CPU usage is not high, but it's li…

---

## [SearchTemplate issue Java API](https://discuss.elastic.co/t/searchtemplate-issue-java-api/256185)

<div class="topic-metadata">

**Author:** [@Mombasa](https://discuss.elastic.co/u/Mombasa)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 7:57pm UTC](https://discuss.elastic.co/t/searchtemplate-issue-java-api/256185 "2020-11-20T19:57:45Z")

</div>

I'm stuck with a SearchTemplate request, until now I've been able to write queries thru the QueryBuilder and execute them calling the "search" method of the RestHighLevelClient java client, but when I try to execute the …

---

## [\[Grok\] Array of patterns - only first pattern matched](https://discuss.elastic.co/t/grok-array-of-patterns-only-first-pattern-matched/256234)

<div class="topic-metadata">

**Author:** [@james64](https://discuss.elastic.co/u/james64)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 5:19pm UTC](https://discuss.elastic.co/t/grok-array-of-patterns-only-first-pattern-matched/256234 "2020-11-21T17:19:21Z")

</div>

Hello, based on this documentation I am trying to use grok filter with this configuration: grok { match =\> { "message" =\> \[ ' volume\_path="%{UNIXPATH:csi\_volume\_path}', …

---

## [WARN#011\[elasticsearch\]#011elasticsearch/client.go:408#011Cannot index event publisher.Event](https://discuss.elastic.co/t/warn-011-elasticsearch-011elasticsearch-client-go-408-011cannot-index-event-publisher-event/254608)

<div class="topic-metadata">

**Author:** [@oicfar](https://discuss.elastic.co/u/oicfar)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 4:52pm UTC](https://discuss.elastic.co/t/warn-011-elasticsearch-011elasticsearch-client-go-408-011cannot-index-event-publisher-event/254608 "2020-11-21T16:52:50Z")

</div>

Hi, ES is flooting syslog. Nov 7 13:57:04 nuc-mini-server filebeat\[757\]: 2020-11-07T13:57:04.044+0100#011WARN#011\[elasticsearch\]#011elasticsearch/client.go:408#011Cannot index event publisher.Event{Content:beat.Event{…

---

## [Alternative to running logstash from the command line](https://discuss.elastic.co/t/alternative-to-running-logstash-from-the-command-line/256231)

<div class="topic-metadata">

**Author:** [@jafri6](https://discuss.elastic.co/u/jafri6)\
**Replies:** 1\
**Last updated:** [November 21, 2020, 4:05pm UTC](https://discuss.elastic.co/t/alternative-to-running-logstash-from-the-command-line/256231 "2020-11-21T16:05:26Z")

</div>

I have a perfect working solution on ELK. The only issue that I am facing is that I want the logstash config to be run in the background as compared to running in the command line: /usr/share/logstash/bin/logstash --pat…

---

## [Parsing error Logstash with file as input](https://discuss.elastic.co/t/parsing-error-logstash-with-file-as-input/256227)

<div class="topic-metadata">

**Author:** [@Xor44](https://discuss.elastic.co/u/Xor44)\
**Replies:** 1\
**Last updated:** [November 21, 2020, 3:09pm UTC](https://discuss.elastic.co/t/parsing-error-logstash-with-file-as-input/256227 "2020-11-21T15:09:30Z")

</div>

Hi Folks , I'm new in ELK , i'm trying read and parse a file with logstash. But I get some errors during the parsing process Here is an example of logs // date="Nov 21 2020 14:36:00" AED="1.1.1.1" type=group\_location …

---

## [How does ES stores the geopoints or location of an entry?](https://discuss.elastic.co/t/how-does-es-stores-the-geopoints-or-location-of-an-entry/256230)

<div class="topic-metadata">

**Author:** [@HseinBitar](https://discuss.elastic.co/u/HseinBitar)\
**Replies:** 0\
**Last updated:** [November 21, 2020, 3:09pm UTC](https://discuss.elastic.co/t/how-does-es-stores-the-geopoints-or-location-of-an-entry/256230 "2020-11-21T15:09:14Z")

</div>

I need to return nearest 10 results with score above a threshold that I specify. I do have the location of every entry, as a geopoint with latitude and longitude. I doubt a geospatial index would be useful for such a …

---

## [Ruby exception occurred: undefined method \`\[\]' for #\<LogStash](https://discuss.elastic.co/t/ruby-exception-occurred-undefined-method-for-logstash/256131)

<div class="topic-metadata">

**Author:** [@sujeetjha](https://discuss.elastic.co/u/sujeetjha)\
**Replies:** 3\
**Last updated:** [November 21, 2020, 2:02pm UTC](https://discuss.elastic.co/t/ruby-exception-occurred-undefined-method-for-logstash/256131 "2020-11-21T14:02:51Z")

</div>

filter { ## Ignore the comments that IIS will add to the start of the W3C logs # if \[message\] =~ "^#" { drop {} } grok { ## Very helpful site for building these statements: # http://grokdebug.her…

---

## [How to search text field for list of "terms" / "keywords"](https://discuss.elastic.co/t/how-to-search-text-field-for-list-of-terms-keywords/256218)

<div class="topic-metadata">

**Author:** [@msta](https://discuss.elastic.co/u/msta)\
**Replies:** 0\
**Last updated:** [November 21, 2020, 11:50am UTC](https://discuss.elastic.co/t/how-to-search-text-field-for-list-of-terms-keywords/256218 "2020-11-21T11:50:29Z")

</div>

Hi ES Community, We have a set of text-documents indexed, and their primary field is an analyzed version of their text (stored in a text field). We want to exact or partial match any of a long list of keywords in the te…

---

## [Unable to load an index with more than 2.1 B documents](https://discuss.elastic.co/t/unable-to-load-an-index-with-more-than-2-1-b-documents/256211)

<div class="topic-metadata">

**Author:** [@amir\_veyseh](https://discuss.elastic.co/u/amir_veyseh)\
**Replies:** 10\
**Last updated:** [November 21, 2020, 10:43am UTC](https://discuss.elastic.co/t/unable-to-load-an-index-with-more-than-2-1-b-documents/256211 "2020-11-21T10:43:54Z")

</div>

I stopped the elasticSearch service and restarted it. Now, one of the indices cannot be loaded. Here's the status of the indeices: yellow open test-index \_taPEhm3ReSwCYjb1Y5hQA 1 1 3 0 7.5kb …

---

## [Filebeat-\* index pattern (Can´t find it!)](https://discuss.elastic.co/t/filebeat-index-pattern-can-t-find-it/256208)

<div class="topic-metadata">

**Author:** [@771M771](https://discuss.elastic.co/u/771M771)\
**Replies:** 3\
**Last updated:** [November 21, 2020, 4:43am UTC](https://discuss.elastic.co/t/filebeat-index-pattern-can-t-find-it/256208 "2020-11-21T04:43:24Z")

</div>

I´ve installed and configured ELK (elasticsearch, logstash, kibana, and filebeat) and they are up and running on localhost:ports. But when I try to create an index pattern in Kibana after uploading my .json it can´t find…

---

## [Stack Monitoring shows "No monitoring data found"](https://discuss.elastic.co/t/stack-monitoring-shows-no-monitoring-data-found/254502)

<div class="topic-metadata">

**Author:** [@kavier](https://discuss.elastic.co/u/kavier)\
**Replies:** 6\
**Last updated:** [November 21, 2020, 4:21am UTC](https://discuss.elastic.co/t/stack-monitoring-shows-no-monitoring-data-found/254502 "2020-11-21T04:21:26Z")

</div>

Hi all, Our Single Node Elastic Stack's Stack Monitoring was working all along and stopped working suddenly. We've took a look at https://github.com/elastic/kibana/issues/33760 but not much information obtained too. W…

---

## [How to migrate elastic version 5.6.5?](https://discuss.elastic.co/t/how-to-migrate-elastic-version-5-6-5/255313)

<div class="topic-metadata">

**Author:** [@balainit](https://discuss.elastic.co/u/balainit)\
**Replies:** 6\
**Last updated:** [November 21, 2020, 4:14am UTC](https://discuss.elastic.co/t/how-to-migrate-elastic-version-5-6-5/255313 "2020-11-21T04:14:20Z")

</div>

Hi everyone, how to migrate 57 nodes and 58 nodes to the new one, the data volume is 1T, thank you all

---

## [How to change kibana's password complexity setting](https://discuss.elastic.co/t/how-to-change-kibanas-password-complexity-setting/256209)

<div class="topic-metadata">

**Author:** [@shawn\_sun](https://discuss.elastic.co/u/shawn_sun)\
**Replies:** 1\
**Last updated:** [November 21, 2020, 2:51am UTC](https://discuss.elastic.co/t/how-to-change-kibanas-password-complexity-setting/256209 "2020-11-21T02:51:35Z")

</div>

Such as title, I need to improve the PASSWORD Complexity of the kibana user. my kibana is Basic license，if there have any method meet the need. defalt setting just 6 characters:

---

## [GROK Date/time filter not working](https://discuss.elastic.co/t/grok-date-time-filter-not-working/256201)

<div class="topic-metadata">

**Author:** [@earlsanchez](https://discuss.elastic.co/u/earlsanchez)\
**Replies:** 2\
**Last updated:** [November 21, 2020, 2:26am UTC](https://discuss.elastic.co/t/grok-date-time-filter-not-working/256201 "2020-11-21T02:26:20Z")

</div>

Getting logstash failure when parsing the date/time stamp from my log. This seems to work in the GROK Debugger but fails when logstash filters it. Can someone please help to filter the date/time stamp into "date"? In GR…

---

## [How to handle gaps in date histogram (missing values) in Kibana and Elastic Search?](https://discuss.elastic.co/t/how-to-handle-gaps-in-date-histogram-missing-values-in-kibana-and-elastic-search/255430)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 11:07pm UTC](https://discuss.elastic.co/t/how-to-handle-gaps-in-date-histogram-missing-values-in-kibana-and-elastic-search/255430 "2020-11-20T23:07:30Z")

</div>

Our indices have missing values from time to time, and when that happens, what I’d like to see in date histogram plots is to simply ignore missing values and connect the lines before and after. Please see this example pl…

---

## [ES 7.10 ignores analyzer in "as\_you\_type" fields](https://discuss.elastic.co/t/es-7-10-ignores-analyzer-in-as-you-type-fields/256113)

<div class="topic-metadata">

**Author:** [@\_ZN3val](https://discuss.elastic.co/u/_ZN3val)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 10:06pm UTC](https://discuss.elastic.co/t/es-7-10-ignores-analyzer-in-as-you-type-fields/256113 "2020-11-20T22:06:14Z")

</div>

Hello, Since an upgrade from 7.9 to 7.10, ES tokenizes "as\_you\_type" fields with a "simple" analyzer differently, causing less results to be returned. While this analyzer should split on any non-letter, it stopped split…

---

## [WinlogBeat shipping custom event log to ES, Parsing woes](https://discuss.elastic.co/t/winlogbeat-shipping-custom-event-log-to-es-parsing-woes/256186)

<div class="topic-metadata">

**Author:** [@SigmazGFX](https://discuss.elastic.co/u/SigmazGFX)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 7:58pm UTC](https://discuss.elastic.co/t/winlogbeat-shipping-custom-event-log-to-es-parsing-woes/256186 "2020-11-20T19:58:46Z")

</div>

Hey gang.. Some of our devs have been working on Application API's and are using windows events to store errors and audits and the like. I have winlogbeat picking up these events and shipping them into the winlogbeat-\* …

---

## [Group by and sum](https://discuss.elastic.co/t/group-by-and-sum/256190)

<div class="topic-metadata">

**Author:** [@Giovanni\_Di\_Lembo](https://discuss.elastic.co/u/Giovanni_Di_Lembo)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 9:20pm UTC](https://discuss.elastic.co/t/group-by-and-sum/256190 "2020-11-20T21:20:16Z")

</div>

hi all and sorry for my poor english I tried with no success to create an aggregation query that group hits by a field "category" and get a sum of field "eventCount". Please help

---

## [QueueResizingEsThreadPoolExecutor exception](https://discuss.elastic.co/t/queueresizingesthreadpoolexecutor-exception/256189)

<div class="topic-metadata">

**Author:** [@Igor\_Domshchikov](https://discuss.elastic.co/u/Igor_Domshchikov)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 9:04pm UTC](https://discuss.elastic.co/t/queueresizingesthreadpoolexecutor-exception/256189 "2020-11-20T21:04:28Z")

</div>

At some point during 35k endurance load test of my java web app which fetches static data from Elasticsearch, I am start getting following elasticsearch exception: Caused by: org.elasticsearch.common.util.concurrent.EsR…

---

## [Using custom JVM options files in jvm.options.d/ shows duplicate JVM args](https://discuss.elastic.co/t/using-custom-jvm-options-files-in-jvm-options-d-shows-duplicate-jvm-args/256188)

<div class="topic-metadata">

**Author:** [@ben-charles](https://discuss.elastic.co/u/ben-charles)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 8:43pm UTC](https://discuss.elastic.co/t/using-custom-jvm-options-files-in-jvm-options-d-shows-duplicate-jvm-args/256188 "2020-11-20T20:43:42Z")

</div>

I have a custom.options file in my config/jvm.options.d/ directory with the following contents: -Xms2g -Xmx2g When looking at the running Elasticsearch process, I see that there are two sets of command line parameters …

---

## [MetricBeat Logstash Monitoring Error](https://discuss.elastic.co/t/metricbeat-logstash-monitoring-error/256048)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 8:21pm UTC](https://discuss.elastic.co/t/metricbeat-logstash-monitoring-error/256048 "2020-11-20T20:21:15Z")

</div>

Running Elastic Stack 7.10.0 and am trying to modernize the monitoring by implementing Metricbeat. Elasticsearch and Kibana run on one server and logstash is running on a different server. I've got both Elasticsearch a…

---

## [Painless forEach + Replace failing](https://discuss.elastic.co/t/painless-foreach-replace-failing/256058)

<div class="topic-metadata">

**Author:** [@ramiriskis](https://discuss.elastic.co/u/ramiriskis)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 7:03pm UTC](https://discuss.elastic.co/t/painless-foreach-replace-failing/256058 "2020-11-20T19:03:46Z")

</div>

Hi guys, I'm trying to write a script within watcher that applies a transform to each log before sending it through slack. My current script is like this: "script": { "source": """ ctx…

---

## [Logstash not sending data to elastic](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic/256176)

<div class="topic-metadata">

**Author:** [@DedSec](https://discuss.elastic.co/u/DedSec)\
**Replies:** 5\
**Last updated:** [November 20, 2020, 6:50pm UTC](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic/256176 "2020-11-20T18:50:15Z")

</div>

Hello, I have a logstash file and when I am running the command sudo logstash -f bug.conf logstash starts but there is no data in ELK This is my bug.conf file: input { file { path =\> "/Users/siddharth/Desktop/program…

---

## [Filter with criteria before sum aggregation](https://discuss.elastic.co/t/filter-with-criteria-before-sum-aggregation/256051)

<div class="topic-metadata">

**Author:** [@erv](https://discuss.elastic.co/u/erv)\
**Replies:** 0\
**Last updated:** [November 19, 2020, 11:17pm UTC](https://discuss.elastic.co/t/filter-with-criteria-before-sum-aggregation/256051 "2020-11-19T23:17:35Z")

</div>

Hey everyone! I'm having a hard time with the following issue. Suppose I have the following three documents: { "entity\_id": "A", "stringField1": "SF1A", "stringField2": "SF2", "numericField": 10, …

---

## [Filebeat connect with Kafka Kerberos(SASL\_SSL) not working](https://discuss.elastic.co/t/filebeat-connect-with-kafka-kerberos-sasl-ssl-not-working/256175)

<div class="topic-metadata">

**Author:** [@Jockj](https://discuss.elastic.co/u/Jockj)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 6:46pm UTC](https://discuss.elastic.co/t/filebeat-connect-with-kafka-kerberos-sasl-ssl-not-working/256175 "2020-11-20T18:46:28Z")

</div>

Continuing the discussion from \[Filebeat connect with Kafka Kerberos(SASL\_SSL) not working\](https://discuss.elastic.co/t/filebeat-connect-with-kafka-kerberos-sasl-ssl-not-working/246160/10): @ascherbakov686, can you ple…

---

## [Get a link to single document page in Discover section in Kibana](https://discuss.elastic.co/t/get-a-link-to-single-document-page-in-discover-section-in-kibana/256126)

<div class="topic-metadata">

**Author:** [@malsioufi](https://discuss.elastic.co/u/malsioufi)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 6:25pm UTC](https://discuss.elastic.co/t/get-a-link-to-single-document-page-in-discover-section-in-kibana/256126 "2020-11-20T18:25:33Z")

</div>

I am building a search page for a web application that is backed with Elasticsearch. In that web app I want to let the user search and filter the data and the result of the search should show some fields of the documents…

---

## [Date Joda parse does not work](https://discuss.elastic.co/t/date-joda-parse-does-not-work/256163)

<div class="topic-metadata">

**Author:** [@Jan\_Kabelka](https://discuss.elastic.co/u/Jan_Kabelka)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 5:58pm UTC](https://discuss.elastic.co/t/date-joda-parse-does-not-work/256163 "2020-11-20T17:58:53Z")

</div>

Hi, I am trying to parse date to field @timestamp. My timestamp looks like below: "Timestamp" : "11/20/2020 3:32:01 PM" I tried: date { match =\> \[ "Timestamp", "MM/dd/yyyy HH:mm:ss a" \] remove\_field =\> \["Timestamp"\] …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1683)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1685)
