# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1714

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1715

---

## [Get a length/size of message field value](https://discuss.elastic.co/t/get-a-length-size-of-message-field-value/254368)

<div class="topic-metadata">

**Author:** [@EugeneZ](https://discuss.elastic.co/u/EugeneZ)\
**Replies:** 4\
**Last updated:** [November 5, 2020, 10:02am UTC](https://discuss.elastic.co/t/get-a-length-size-of-message-field-value/254368 "2020-11-05T10:02:14Z")

</div>

Hi, I try to make a scripted fields with size of message field value. I tried doc\['message'\].value.getSize() doc\['message'\].value.size() I tried also with \['message.keyword'\] but nothing. I have in preview. Where am…

---

## [Defective token when using SPNEGO in Kibana](https://discuss.elastic.co/t/defective-token-when-using-spnego-in-kibana/254287)

<div class="topic-metadata">

**Author:** [@marvi](https://discuss.elastic.co/u/marvi)\
**Replies:** 3\
**Last updated:** [November 5, 2020, 9:45am UTC](https://discuss.elastic.co/t/defective-token-when-using-spnego-in-kibana/254287 "2020-11-05T09:45:58Z")

</div>

Environment: CentOS 7 Active Directory Elasticsearch & Kibana 7.9.3 Realms configured in ES: Kerberos and AD Kerberos authorization\_realm: AD ES cluster set up with keytabs on master and data nodes. I can run curl --n…

---

## [Kibana unknown index pattern fields](https://discuss.elastic.co/t/kibana-unknown-index-pattern-fields/252803)

<div class="topic-metadata">

**Author:** [@Sh3ldoris](https://discuss.elastic.co/u/Sh3ldoris)\
**Replies:** 5\
**Last updated:** [November 5, 2020, 9:35am UTC](https://discuss.elastic.co/t/kibana-unknown-index-pattern-fields/252803 "2020-11-05T09:35:58Z")

</div>

Hello, I'm trying to do aggregations on some fields in my index pattern, but they are unknown. I've tried refresh index pattern but they still don't show in Stack managment. On the other hand, I can see them in my disco…

---

## [Filter on specific field](https://discuss.elastic.co/t/filter-on-specific-field/253731)

<div class="topic-metadata">

**Author:** [@Thomas\_Sieger](https://discuss.elastic.co/u/Thomas_Sieger)\
**Replies:** 3\
**Last updated:** [November 5, 2020, 9:30am UTC](https://discuss.elastic.co/t/filter-on-specific-field/253731 "2020-11-05T09:30:27Z")

</div>

Hello guys, above my log message. user \<TEST\> from client \<xyz (connection-xyz.de)\> I want to filter on the content in the brackets \<\>, but I don´t only want to test how many hits this delivers. I also want to know ho…

---

## [Cross field serch problem](https://discuss.elastic.co/t/cross-field-serch-problem/254360)

<div class="topic-metadata">

**Author:** [@squareEngine](https://discuss.elastic.co/u/squareEngine)\
**Replies:** 1\
**Last updated:** [November 5, 2020, 9:23am UTC](https://discuss.elastic.co/t/cross-field-serch-problem/254360 "2020-11-05T09:23:56Z")

</div>

Hi I'm trying to implement search functionality in our project using Nest. I have following query: query .Bool(must =\> must .Filter(m =\> m .MultiMatch(qs =\> qs .Type(TextQueryType.CrossFields) .Len…

---

## [Pass the schedule dynamically to logstash config file](https://discuss.elastic.co/t/pass-the-schedule-dynamically-to-logstash-config-file/254351)

<div class="topic-metadata">

**Author:** [@Shanmuka\_Chowdary](https://discuss.elastic.co/u/Shanmuka_Chowdary)\
**Replies:** 5\
**Last updated:** [November 5, 2020, 9:17am UTC](https://discuss.elastic.co/t/pass-the-schedule-dynamically-to-logstash-config-file/254351 "2020-11-05T09:17:31Z")

</div>

I'm Indexing data from mssql using logstash with schedule like below jdbc { jdbc\_driver\_library =\> "C:\\Program Files\\Microsoft JDBC Driver 4.2 for SQL Server\\sqljdbc\_4.2\\enu\\jre8\\sqljdbc42.jar" …

---

## [Elastiflow / logstash netflow plugin - reduce logging to syslog](https://discuss.elastic.co/t/elastiflow-logstash-netflow-plugin-reduce-logging-to-syslog/254219)

<div class="topic-metadata">

**Author:** [@davidsm](https://discuss.elastic.co/u/davidsm)\
**Replies:** 2\
**Last updated:** [November 5, 2020, 9:04am UTC](https://discuss.elastic.co/t/elastiflow-logstash-netflow-plugin-reduce-logging-to-syslog/254219 "2020-11-05T09:04:56Z")

</div>

Greetings! I'm using elastiflow with the logstash netflow plugin. Logs can get quite noisy with expected DNS timeouts and waiting for flow templates. These are logged in both /var/log/logstash/logstash-plain.log as well…

---

## [Help: Elasticsearch Regexp query](https://discuss.elastic.co/t/help-elasticsearch-regexp-query/253445)

<div class="topic-metadata">

**Author:** [@Ketan\_Talreja](https://discuss.elastic.co/u/Ketan_Talreja)\
**Replies:** 6\
**Last updated:** [November 5, 2020, 7:58am UTC](https://discuss.elastic.co/t/help-elasticsearch-regexp-query/253445 "2020-11-05T07:58:48Z")

</div>

Hello All, I am new to elasticsearch and recently started using ES 6.x which is integrated with one of the third party application which stores all the data using indexes in ES. I have a scenario where I would like to r…

---

## [Elastic Stack 6.8.11 and 7.8.1 security update - CVE ID: CVE-2020-7017](https://discuss.elastic.co/t/elastic-stack-6-8-11-and-7-8-1-security-update-cve-id-cve-2020-7017/254237)

<div class="topic-metadata">

**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\
**Replies:** 2\
**Last updated:** [November 5, 2020, 8:17am UTC](https://discuss.elastic.co/t/elastic-stack-6-8-11-and-7-8-1-security-update-cve-id-cve-2020-7017/254237 "2020-11-05T08:17:16Z")

</div>

Hi, this is in reference to cve id : CVE-2020-7017 and the announcement for our usecase, region map is a must and we cannot disable it by ‘region\_map.enabled: false’. since we have kibana 7.0 and kibana 7.8 both vers…

---

## [Filter with select in logstash](https://discuss.elastic.co/t/filter-with-select-in-logstash/253732)

<div class="topic-metadata">

**Author:** [@juuuhuuu](https://discuss.elastic.co/u/juuuhuuu)\
**Replies:** 8\
**Last updated:** [November 5, 2020, 8:15am UTC](https://discuss.elastic.co/t/filter-with-select-in-logstash/253732 "2020-11-05T08:15:02Z")

</div>

Hi Community, I would like to have a filter to dissect my logs and aggregate them like this SELECT COUNT(CustomerID), Country FROM Customers GROUP BY Country; Could you please help me? =\> in the logname are c…

---

## [Hadling duplicated records in elastic using logstash configuration](https://discuss.elastic.co/t/hadling-duplicated-records-in-elastic-using-logstash-configuration/254365)

<div class="topic-metadata">

**Author:** [@prathibha](https://discuss.elastic.co/u/prathibha)\
**Replies:** 0\
**Last updated:** [November 5, 2020, 7:56am UTC](https://discuss.elastic.co/t/hadling-duplicated-records-in-elastic-using-logstash-configuration/254365 "2020-11-05T07:56:02Z")

</div>

I would like to segregate duplicated records in elastic -kibana by using a field with flag value like 'yes ' or ' no'. So the idea is to add a field from logstash to each documents and value of the field will be 'yes' i…

---

## [How to find the common phrase in a bucket](https://discuss.elastic.co/t/how-to-find-the-common-phrase-in-a-bucket/254362)

<div class="topic-metadata">

**Author:** [@Ehsan\_sarshar](https://discuss.elastic.co/u/Ehsan_sarshar)\
**Replies:** 0\
**Last updated:** [November 5, 2020, 7:42am UTC](https://discuss.elastic.co/t/how-to-find-the-common-phrase-in-a-bucket/254362 "2020-11-05T07:42:35Z")

</div>

I want to create an ecommerce search functionality. that user search for a product name and then I group the result base on product category. and then I want to find a common phrase in each category and suggest to user f…

---

## [FATAL \[index\_not\_found\_exception\] no such index \[.kibana\_task\_manager\], with { resource.type="index\_or\_alias" & resource.id=".kibana\_task\_manager" & index\_uuid="\_na\_" & index=".kibana\_task\_manager" }](https://discuss.elastic.co/t/fatal-index-not-found-exception-no-such-index-kibana-task-manager-with-resource-type-index-or-alias-resource-id-kibana-task-manager-index-uuid-na-index-kibana-task-manager/253676)

<div class="topic-metadata">

**Author:** [@Priya\_Zingade](https://discuss.elastic.co/u/Priya_Zingade)\
**Replies:** 4\
**Last updated:** [November 5, 2020, 7:20am UTC](https://discuss.elastic.co/t/fatal-index-not-found-exception-no-such-index-kibana-task-manager-with-resource-type-index-or-alias-resource-id-kibana-task-manager-index-uuid-na-index-kibana-task-manager/253676 "2020-11-05T07:20:43Z")

</div>

Hi am facing this error FATAL \[index\_not\_found\_exception\] no such index \[.kibana\_task\_manager\], with { resource.type="index\_or\_alias" & resource.id=".kibana\_task\_manager" & index\_uuid="na" & index=".kibana\_task\_manager…

---

## [Roll up Jobs](https://discuss.elastic.co/t/roll-up-jobs/254354)

<div class="topic-metadata">

**Author:** [@Dimple\_Goyal](https://discuss.elastic.co/u/Dimple_Goyal)\
**Replies:** 0\
**Last updated:** [November 5, 2020, 6:39am UTC](https://discuss.elastic.co/t/roll-up-jobs/254354 "2020-11-05T06:39:03Z")

</div>

Can I filter the documents in elastic search before rolling them up, or can I define filter query in rollup job, If yes how?

---

## [Logstash failing to send to Kafka](https://discuss.elastic.co/t/logstash-failing-to-send-to-kafka/254104)

<div class="topic-metadata">

**Author:** [@tamilarasanbravo](https://discuss.elastic.co/u/tamilarasanbravo)\
**Replies:** 5\
**Last updated:** [November 5, 2020, 5:36am UTC](https://discuss.elastic.co/t/logstash-failing-to-send-to-kafka/254104 "2020-11-05T05:36:16Z")

</div>

Hi Team, I am parsing Gihthub Log details from Logstash to Kafka and the logstash keeps throwing the below issue. After a certain time, I need to restart logstash to get rid of those warnings. Once initiating the docke…

---

## [How to plot a graph using data from two filters?](https://discuss.elastic.co/t/how-to-plot-a-graph-using-data-from-two-filters/254186)

<div class="topic-metadata">

**Author:** [@I\_Hathout](https://discuss.elastic.co/u/I_Hathout)\
**Replies:** 3\
**Last updated:** [November 5, 2020, 5:26am UTC](https://discuss.elastic.co/t/how-to-plot-a-graph-using-data-from-two-filters/254186 "2020-11-05T05:26:25Z")

</div>

I've two filters each of which gets data from a database query. I wanna have a single visualization vertical bar which has data histograms monthly on X axis and for the Y-axis, I need to (count transfer failures from…

---

## [Partially dynamic mappings](https://discuss.elastic.co/t/partially-dynamic-mappings/254289)

<div class="topic-metadata">

**Author:** [@SorenAndersenCactus](https://discuss.elastic.co/u/SorenAndersenCactus)\
**Replies:** 2\
**Last updated:** [November 5, 2020, 4:46am UTC](https://discuss.elastic.co/t/partially-dynamic-mappings/254289 "2020-11-05T04:46:02Z")

</div>

Hi there! We have an elastic mapping that looks something like: "mappings": { "full-text-content": { "dynamic": "strict", "properties": {} "doi": { …

---

## [Request entity too large / error in filebeat](https://discuss.elastic.co/t/request-entity-too-large-error-in-filebeat/254238)

<div class="topic-metadata">

**Author:** [@grynhtjnyuk](https://discuss.elastic.co/u/grynhtjnyuk)\
**Replies:** 9\
**Last updated:** [November 5, 2020, 3:32am UTC](https://discuss.elastic.co/t/request-entity-too-large-error-in-filebeat/254238 "2020-11-05T03:32:58Z")

</div>

I have filebeat installed on kubernetes, and elasticsearch installed on kubernetes also. I got this error and I do not see logs in elasticsearch. Could you please tell me how can I solve the problem: \[elasticsearch\] el…

---

## [How to get previous indexed document in painless script](https://discuss.elastic.co/t/how-to-get-previous-indexed-document-in-painless-script/253966)

<div class="topic-metadata">

**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\
**Replies:** 2\
**Last updated:** [November 5, 2020, 3:12am UTC](https://discuss.elastic.co/t/how-to-get-previous-indexed-document-in-painless-script/253966 "2020-11-05T03:12:55Z")

</div>

Hello, I want to access previous index document using painless script to compute value difference between document for my visualization. I want to count network utilization using data forwarded via logstash snmp. Is I…

---

## [JDBC through a SSH tunnel](https://discuss.elastic.co/t/jdbc-through-a-ssh-tunnel/254341)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 0\
**Last updated:** [November 5, 2020, 1:25am UTC](https://discuss.elastic.co/t/jdbc-through-a-ssh-tunnel/254341 "2020-11-05T01:25:05Z")

</div>

Im getting data from a PostgreSQL DB through an SSH tunnel: autossh -M 0 -o "ServerAliveInterval 30" -o "ServerAliveCountMax 3" -L 9999:localhost:5432 root@mypostgresip The data is requested using Logstash JDBC pointin…

---

## [Enable debug logs](https://discuss.elastic.co/t/enable-debug-logs/254339)

<div class="topic-metadata">

**Author:** [@animageofmine](https://discuss.elastic.co/u/animageofmine)\
**Replies:** 0\
**Last updated:** [November 5, 2020, 12:54am UTC](https://discuss.elastic.co/t/enable-debug-logs/254339 "2020-11-05T00:54:28Z")

</div>

This is a quick question, if someone can confirm this. Does this disable info logs? { "persistent": { "logger": { "org": { "elasticsearch": { "deprecation": "ERROR" …

---

## [ELK - index pattern configuration as code](https://discuss.elastic.co/t/elk-index-pattern-configuration-as-code/254308)

<div class="topic-metadata">

**Author:** [@krishkir\_k](https://discuss.elastic.co/u/krishkir_k)\
**Replies:** 1\
**Last updated:** [November 4, 2020, 11:08pm UTC](https://discuss.elastic.co/t/elk-index-pattern-configuration-as-code/254308 "2020-11-04T23:08:05Z")

</div>

Is there a way to configure default index pattern in configuration file so I wouldn't have to set it manually after each redeploy?Also to configure and persist field level format ?

---

## [Kibana vega chart timeline graphs, need to show some expectation with static value comparing with actual value](https://discuss.elastic.co/t/kibana-vega-chart-timeline-graphs-need-to-show-some-expectation-with-static-value-comparing-with-actual-value/254003)

<div class="topic-metadata">

**Author:** [@jagdishsamdani](https://discuss.elastic.co/u/jagdishsamdani)\
**Replies:** 1\
**Last updated:** [November 4, 2020, 11:04pm UTC](https://discuss.elastic.co/t/kibana-vega-chart-timeline-graphs-need-to-show-some-expectation-with-static-value-comparing-with-actual-value/254003 "2020-11-04T23:04:50Z")

</div>

I have need to show batches execution in our env, I am able show this using existing index data. But i have another need to show some expected batch execution with value avg execution time. To compare and show if execut…

---

## [Grok debugger error for multiple patterns](https://discuss.elastic.co/t/grok-debugger-error-for-multiple-patterns/254335)

<div class="topic-metadata">

**Author:** [@Carlos\_Fernando\_Palm](https://discuss.elastic.co/u/Carlos_Fernando_Palm)\
**Replies:** 1\
**Last updated:** [November 4, 2020, 10:29pm UTC](https://discuss.elastic.co/t/grok-debugger-error-for-multiple-patterns/254335 "2020-11-04T22:29:42Z")

</div>

Hello there. This works: Also this works: Their combination however does not work: Any idea why?

---

## [How to view detailed progress of INITIALIZING replica shard(s)?](https://discuss.elastic.co/t/how-to-view-detailed-progress-of-initializing-replica-shard-s/254333)

<div class="topic-metadata">

**Author:** [@21908](https://discuss.elastic.co/u/21908)\
**Replies:** 1\
**Last updated:** [November 4, 2020, 9:56pm UTC](https://discuss.elastic.co/t/how-to-view-detailed-progress-of-initializing-replica-shard-s/254333 "2020-11-04T21:56:53Z")

</div>

I have a 3 node Elasticsearch cluster. All 3 nodes are master, ingest and data nodes. I shutdown one of the nodes. As expected, the cluster goes into a yellow state. If I query the cluster using the following "\_cat/s…

---

## [Elasticserach change TimeZone](https://discuss.elastic.co/t/elasticserach-change-timezone/254143)

<div class="topic-metadata">

**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\
**Replies:** 4\
**Last updated:** [November 4, 2020, 9:55pm UTC](https://discuss.elastic.co/t/elasticserach-change-timezone/254143 "2020-11-04T21:55:51Z")

</div>

i have a Elasticsearch cluster for storing logz, and my current timezone is+06, but Elasticsearch work in UTC +0, so how can i change the timezone in Elasticsearch cluster?

---

## [OSS-KIBANA with Elasticbasic and ILM](https://discuss.elastic.co/t/oss-kibana-with-elasticbasic-and-ilm/254297)

<div class="topic-metadata">

**Author:** [@vazma](https://discuss.elastic.co/u/vazma)\
**Replies:** 1\
**Last updated:** [November 4, 2020, 9:49pm UTC](https://discuss.elastic.co/t/oss-kibana-with-elasticbasic-and-ilm/254297 "2020-11-04T21:49:25Z")

</div>

Hi, I am using Elasticsearch basic 7.9 with the ILM feature for my logs management and I am running also Kibana-OSS. In this case, will it be any problem/conflict with the ILM since is not supported in the OSS version? …

---

## [Packetbeat capturing responsetime and sending it to Logstash](https://discuss.elastic.co/t/packetbeat-capturing-responsetime-and-sending-it-to-logstash/253155)

<div class="topic-metadata">

**Author:** [@21908](https://discuss.elastic.co/u/21908)\
**Replies:** 2\
**Last updated:** [November 4, 2020, 8:50pm UTC](https://discuss.elastic.co/t/packetbeat-capturing-responsetime-and-sending-it-to-logstash/253155 "2020-11-04T20:50:00Z")

</div>

My goal is to capture and store all queries run against Elasticsearch in Elasticsearch. I am mimicking the scenario discussed at monitoring-the-search-queries. I am using v7.9.2 of Elasticsearch, Logstash, Kibana and P…

---

## [Functionbeat.keystore: permission denied](https://discuss.elastic.co/t/functionbeat-keystore-permission-denied/254329)

<div class="topic-metadata">

**Author:** [@hyochang](https://discuss.elastic.co/u/hyochang)\
**Replies:** 0\
**Last updated:** [November 4, 2020, 8:31pm UTC](https://discuss.elastic.co/t/functionbeat-keystore-permission-denied/254329 "2020-11-04T20:31:44Z")

</div>

Hi, I am preparing a demo to send Cloudwatch log to the Elastic Cloud, and deployed cloudwatch\_log functionbeat lambda. It seems the lambda detecting cloudwatch log changes, but I am getting an error: Exiting: could no…

---

## [AWS Kinesis streaming to elastic.co](https://discuss.elastic.co/t/aws-kinesis-streaming-to-elastic-co/254170)

<div class="topic-metadata">

**Author:** [@hyochang](https://discuss.elastic.co/u/hyochang)\
**Replies:** 4\
**Last updated:** [November 4, 2020, 8:26pm UTC](https://discuss.elastic.co/t/aws-kinesis-streaming-to-elastic-co/254170 "2020-11-04T20:26:17Z")

</div>

Hello, I have a project requiring to stream log files to elastic.co using AWS Kiness(firehoss or data stream) . The project team wants to use elastic.co instead of AWS ElasticService. Does anyone have experience with…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1713)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1715)
