# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1960

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1961

---

## [Messages in Kibana appear truncated](https://discuss.elastic.co/t/messages-in-kibana-appear-truncated/239381)

<div class="topic-metadata">

**Author:** [@TomWBM](https://discuss.elastic.co/u/TomWBM)\
**Replies:** 2\
**Last updated:** [July 1, 2020, 12:48am UTC](https://discuss.elastic.co/t/messages-in-kibana-appear-truncated/239381 "2020-07-01T00:48:23Z")

</div>

I have an ELK implementation on a single server as a test box, I am receiving log data from a Mulesoft cluster via Filebeats at the source, received by Logstash at the server. When I view what should be a 3000+ line of l…

---

## [Filebeat on kubernetes not pulling logs from all pods](https://discuss.elastic.co/t/filebeat-on-kubernetes-not-pulling-logs-from-all-pods/239379)

<div class="topic-metadata">

**Author:** [@eyesmoker](https://discuss.elastic.co/u/eyesmoker)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 11:24pm UTC](https://discuss.elastic.co/t/filebeat-on-kubernetes-not-pulling-logs-from-all-pods/239379 "2020-06-30T23:24:52Z")

</div>

Hi, I am running file beat as daemonset on the k8s. It is pulling logs from few pods and not all. Here is the simple config used. filebeat.autodiscover: providers: - type: kubernetes node: ${NOD…

---

## [Winlogbeat Starts then Stops - Server 2016](https://discuss.elastic.co/t/winlogbeat-starts-then-stops-server-2016/239062)

<div class="topic-metadata">

**Author:** [@minorsatellite](https://discuss.elastic.co/u/minorsatellite)\
**Replies:** 7\
**Last updated:** [June 30, 2020, 11:24pm UTC](https://discuss.elastic.co/t/winlogbeat-starts-then-stops-server-2016/239062 "2020-06-30T23:24:49Z")

</div>

In the log is the following error message: 2020-06-28T22:46:03.550-0700 INFO \[monitoring\] log/log.go:131 Stopping metrics logging. 2020-06-28T22:46:03.550-0700 INFO instance/beat.go:460 winlogbeat stopped. 2020-06-28T…

---

## [Hyphenation Patterns XML file in Cloud?](https://discuss.elastic.co/t/hyphenation-patterns-xml-file-in-cloud/149687)

<div class="topic-metadata">

**Author:** [@Kim\_Rauff\_Schurmann](https://discuss.elastic.co/u/Kim_Rauff_Schurmann)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 11:06pm UTC](https://discuss.elastic.co/t/hyphenation-patterns-xml-file-in-cloud/149687 "2020-06-30T23:06:50Z")

</div>

Hi guys How do I add a Hyphenation Patterns XML file when working in elastic cloud? The API only have the option for a Path (HyphenationPatternsPath). I should be able to upload and use a bundle with the file - but the…

---

## [Privileges to create index patterns](https://discuss.elastic.co/t/privileges-to-create-index-patterns/235109)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 8\
**Last updated:** [June 30, 2020, 11:01pm UTC](https://discuss.elastic.co/t/privileges-to-create-index-patterns/235109 "2020-06-30T23:01:00Z")

</div>

Hi, I have a role that I would like to give the option to create index patterns. How is that possible? The role already have to all (\*) indices in the cluster. What am I missing? Thanks!

---

## [Does Logstash support oracle wallet for jdbc connection?](https://discuss.elastic.co/t/does-logstash-support-oracle-wallet-for-jdbc-connection/237536)

<div class="topic-metadata">

**Author:** [@amritpal\_singh](https://discuss.elastic.co/u/amritpal_singh)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 10:38pm UTC](https://discuss.elastic.co/t/does-logstash-support-oracle-wallet-for-jdbc-connection/237536 "2020-06-30T22:38:26Z")

</div>

Hi , I am trying to use oracle wallet in logstash jdbc connection and I am getting below error in logs. Unable to connect to database. Tried 1 times {:error\_message=\>"Java::JavaSql::SQLRecoverableException: IO Error: Un…

---

## [Bar chart of 500 status by host](https://discuss.elastic.co/t/bar-chart-of-500-status-by-host/239139)

<div class="topic-metadata">

**Author:** [@popefelix](https://discuss.elastic.co/u/popefelix)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 9:27pm UTC](https://discuss.elastic.co/t/bar-chart-of-500-status-by-host/239139 "2020-06-30T21:27:38Z")

</div>

I'm trying to create a bar graph that counts hosts that have returned HTTP 500 in response to a request. The relevant record structure: { "host": \<hostname\>, "status": \<HTTP response status\> } In SQL this would be "SEL…

---

## [Elastic search 7.8.0 and multiple geoshapes](https://discuss.elastic.co/t/elastic-search-7-8-0-and-multiple-geoshapes/239350)

<div class="topic-metadata">

**Author:** [@pandzel](https://discuss.elastic.co/u/pandzel)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 9:22pm UTC](https://discuss.elastic.co/t/elastic-search-7-8-0-and-multiple-geoshapes/239350 "2020-06-30T21:22:08Z")

</div>

Hi, I have created an index and I put the following mapping: { "dynamic\_templates": \[ { "\_geo": { "match": "\*\_geo", "mapping": { "type": "geo…

---

## [Why processors need inode/fileid in the event (why is file.StateOS under Private?)](https://discuss.elastic.co/t/why-processors-need-inode-fileid-in-the-event-why-is-file-stateos-under-private/239307)

<div class="topic-metadata">

**Author:** [@rmauri](https://discuss.elastic.co/u/rmauri)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:01pm UTC](https://discuss.elastic.co/t/why-processors-need-inode-fileid-in-the-event-why-is-file-stateos-under-private/239307 "2020-06-30T13:01:40Z")

</div>

I have filebeat, built with a custom regexprocessor, that processes events from input log files that have no date, only time, in the log messages. The regexprocessor constructs the @timestamp using the time from the log…

---

## [Java API - trying to fetch data from Index](https://discuss.elastic.co/t/java-api-trying-to-fetch-data-from-index/238971)

<div class="topic-metadata">

**Author:** [@Venkat\_Raj](https://discuss.elastic.co/u/Venkat_Raj)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 8:34pm UTC](https://discuss.elastic.co/t/java-api-trying-to-fetch-data-from-index/238971 "2020-06-30T20:34:25Z")

</div>

I am trying to fetch data from index using java API to generate a report using jasper reports. I have added the maven dependency and able to make connection to ES. While trying to fetch the data corresponding to the pa…

---

## [Syntax for Aggregate Filter Plugin (No End Event)?](https://discuss.elastic.co/t/syntax-for-aggregate-filter-plugin-no-end-event/239188)

<div class="topic-metadata">

**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 7:25pm UTC](https://discuss.elastic.co/t/syntax-for-aggregate-filter-plugin-no-end-event/239188 "2020-06-30T19:25:38Z")

</div>

Hi Logstash Maestros, Suppose I have a continuous stream of data records flowing into Logstash, tracking how many widgets a producer as cranked out. The data fields are {timestamp} {producer} {numWidgits} and the data …

---

## [Elasticsearch 7.x data allocation?](https://discuss.elastic.co/t/elasticsearch-7-x-data-allocation/239196)

<div class="topic-metadata">

**Author:** [@ryebread157](https://discuss.elastic.co/u/ryebread157)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:43pm UTC](https://discuss.elastic.co/t/elasticsearch-7-x-data-allocation/239196 "2020-06-30T14:43:20Z")

</div>

I have been using the ELK stack for years, and upgraded to ELK 7 last month and updated to 7.8 last week. Previous to 7.x data allocation to my Elastic data nodes was automatically distributed among nodes to be similar. …

---

## [Push\_previous\_map\_as\_event into fields](https://discuss.elastic.co/t/push-previous-map-as-event-into-fields/239310)

<div class="topic-metadata">

**Author:** [@mohsin106](https://discuss.elastic.co/u/mohsin106)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 6:41pm UTC](https://discuss.elastic.co/t/push-previous-map-as-event-into-fields/239310 "2020-06-30T18:41:49Z")

</div>

Hi, I'm trying to use push\_previous\_map\_as\_event to aggregate and save everything as key/value fields in a document. My data looks like this: device: router1 property: mem\_prop1 ( there are twelve properties per comp…

---

## [How does the Beats load balancing option work?](https://discuss.elastic.co/t/how-does-the-beats-load-balancing-option-work/239358)

<div class="topic-metadata">

**Author:** [@Guerreiro\_Sousa](https://discuss.elastic.co/u/Guerreiro_Sousa)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 6:12pm UTC](https://discuss.elastic.co/t/how-does-the-beats-load-balancing-option-work/239358 "2020-06-30T18:12:42Z")

</div>

How does balancing work? Does Beat monitor server availability and distribute events among available machines?

---

## [Filebeat modules doesn' follow symlinks](https://discuss.elastic.co/t/filebeat-modules-doesn-follow-symlinks/239357)

<div class="topic-metadata">

**Author:** [@Elbanby](https://discuss.elastic.co/u/Elbanby)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 6:11pm UTC](https://discuss.elastic.co/t/filebeat-modules-doesn-follow-symlinks/239357 "2020-06-30T18:11:09Z")

</div>

Hi folks, I am running into a problem where I can't seem to get the Nginx module (ingress-controller) to follow symlinks. Is there is a way to accomplish that? If not, what is the recommended approach to do so? There i…

---

## [Logstash Pipeline grok filter (match) fails - Expected one of \[ \\\\t\\\\r\\\\n\], \\"#\\", \\"{\\", \\"}\\"](https://discuss.elastic.co/t/logstash-pipeline-grok-filter-match-fails-expected-one-of-t-r-n/239332)

<div class="topic-metadata">

**Author:** [@madduck](https://discuss.elastic.co/u/madduck)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 5:22pm UTC](https://discuss.elastic.co/t/logstash-pipeline-grok-filter-match-fails-expected-one-of-t-r-n/239332 "2020-06-30T17:22:22Z")

</div>

Hi Logstash community, I'm trying to parse a log through logstash but there seems to be an issue with my grok pattern, however I have tried a lot of different things now and always get the exact same error message. The…

---

## [MongoDB-Elasticsearch Integration Via Logstash](https://discuss.elastic.co/t/mongodb-elasticsearch-integration-via-logstash/239316)

<div class="topic-metadata">

**Author:** [@leoper](https://discuss.elastic.co/u/leoper)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 5:15pm UTC](https://discuss.elastic.co/t/mongodb-elasticsearch-integration-via-logstash/239316 "2020-06-30T17:15:55Z")

</div>

Hi everyone. I am trying to make an integration between MongoDB (Version 4.2.7) and Elasticsearch (Version 7.7.0) via Logstash (Version 7.8.0). The goal is to synchronize data from MongoDB to Elasticsearch. The scena…

---

## [Filter jdbc\_static mongodb error](https://discuss.elastic.co/t/filter-jdbc-static-mongodb-error/239194)

<div class="topic-metadata">

**Author:** [@pedropilla](https://discuss.elastic.co/u/pedropilla)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 5:04pm UTC](https://discuss.elastic.co/t/filter-jdbc-static-mongodb-error/239194 "2020-06-30T17:04:06Z")

</div>

Hello, I'm trying to enrich data with mongodb objects, here's the related part in my pipeline: jdbc\_static { loaders =\> \[ { id =\> "circuitosOLT" table …

---

## [Elastic Stack with Network Security Zones](https://discuss.elastic.co/t/elastic-stack-with-network-security-zones/239337)

<div class="topic-metadata">

**Author:** [@bretonj](https://discuss.elastic.co/u/bretonj)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 5:02pm UTC](https://discuss.elastic.co/t/elastic-stack-with-network-security-zones/239337 "2020-06-30T17:02:15Z")

</div>

I would like to know if what I'm trying to do is possible with Elastic Stack? I have multiple network security zones, all firewalled from each other: (PAZ - Public Access Zone, OZ - Operation Zone, RZ - Restricted Zone)…

---

## [Add a backslash at the end of a string](https://discuss.elastic.co/t/add-a-backslash-at-the-end-of-a-string/239336)

<div class="topic-metadata">

**Author:** [@Florent\_Fauvin](https://discuss.elastic.co/u/Florent_Fauvin)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 4:54pm UTC](https://discuss.elastic.co/t/add-a-backslash-at-the-end-of-a-string/239336 "2020-06-30T16:54:02Z")

</div>

Hello, I want to add a backslash at the end of a field value, but logstash does not allow it: \`mutate { add\_field =\> { "\[prefix\]" =\> "%{\[domain\]}\\\\"}}\` Do you know how I could add a backslash at the end of the strin…

---

## [Unable to send input log to Elastic search via filebeat docker installation](https://discuss.elastic.co/t/unable-to-send-input-log-to-elastic-search-via-filebeat-docker-installation/237973)

<div class="topic-metadata">

**Author:** [@Bhanu\_Praveen](https://discuss.elastic.co/u/Bhanu_Praveen)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 4:50pm UTC](https://discuss.elastic.co/t/unable-to-send-input-log-to-elastic-search-via-filebeat-docker-installation/237973 "2020-06-30T16:50:37Z")

</div>

Hello, I have installed ELK in 3 different containers. All are working fine. Pulled docker image and Installed Filebeat in docker container with below command: docker run -d --name=filebeat --user=root --volume="…

---

## [Not able to parse log file which contains xml format](https://discuss.elastic.co/t/not-able-to-parse-log-file-which-contains-xml-format/239348)

<div class="topic-metadata">

**Author:** [@Bhanu\_Praveen](https://discuss.elastic.co/u/Bhanu_Praveen)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 4:49pm UTC](https://discuss.elastic.co/t/not-able-to-parse-log-file-which-contains-xml-format/239348 "2020-06-30T16:49:11Z")

</div>

Hello, I am having below webshpere GC log file which is generated in \*.log format. Different GC cycles and for every GC cycle start tag: "cycle-start" End Tage: "cycle-End" Now i need to parse each cycle as single mess…

---

## [\[ERROR\]\[logstash.filters.ruby \] Ruby exception occur red: too few arguments : Need Help](https://discuss.elastic.co/t/error-logstash-filters-ruby-ruby-exception-occur-red-too-few-arguments-need-help/238852)

<div class="topic-metadata">

**Author:** [@upasana\_sarangi](https://discuss.elastic.co/u/upasana_sarangi)\
**Replies:** 11\
**Last updated:** [June 30, 2020, 4:44pm UTC](https://discuss.elastic.co/t/error-logstash-filters-ruby-ruby-exception-occur-red-too-few-arguments-need-help/238852 "2020-06-30T16:44:12Z")

</div>

Hi , I am getting Ruby Exception too few arguments everytime I run logstash on our server . Below is the config and error msg I am trying to Parse :slight\_smile: Message : 20200515T005009.898-0500 Warning Fail Connect…

---

## [Understanding skipped documents in Data Frame Analytics](https://discuss.elastic.co/t/understanding-skipped-documents-in-data-frame-analytics/238760)

<div class="topic-metadata">

**Author:** [@davemoore](https://discuss.elastic.co/u/davemoore)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 4:28pm UTC](https://discuss.elastic.co/t/understanding-skipped-documents-in-data-frame-analytics/238760 "2020-06-30T16:28:41Z")

</div>

When running a Data Frame Analytics job in 7.8.0, documents with unsupported values are skipped (source). Suppose I run a job that fails after the loading\_data phase because every document was skipped, and the data\_coun…

---

## [Timestamping issues with Winlogbeat and Logstash](https://discuss.elastic.co/t/timestamping-issues-with-winlogbeat-and-logstash/239325)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 2:39pm UTC](https://discuss.elastic.co/t/timestamping-issues-with-winlogbeat-and-logstash/239325 "2020-06-30T14:39:52Z")

</div>

Hello, Our setup is: Winlogbeat on endpoints which ships data to an API API sends logs to sqs queue Logstash VM picks up from sqs and contextualises logs then forwards them on to another sqs queue Another applicatio…

---

## [Querying Apache URL Requests in Kibana](https://discuss.elastic.co/t/querying-apache-url-requests-in-kibana/239156)

<div class="topic-metadata">

**Author:** [@Andrew225](https://discuss.elastic.co/u/Andrew225)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 4:17pm UTC](https://discuss.elastic.co/t/querying-apache-url-requests-in-kibana/239156 "2020-06-30T16:17:49Z")

</div>

I have deployed Elasticsearch 7.7.1-1, Logstash 7.7.1-1 and Kibana 7.7.1-1. I am shipping logs to Logstash using Filebeat. I am developing a query to parse the request field of the apache logs. I have noticed there is a…

---

## [Upgraded to Elasticsearch 7.8.0 and now date fields are in fields key instead of \_source](https://discuss.elastic.co/t/upgraded-to-elasticsearch-7-8-0-and-now-date-fields-are-in-fields-key-instead-of-source/239137)

<div class="topic-metadata">

**Author:** [@Federico\_Foschini](https://discuss.elastic.co/u/Federico_Foschini)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 4:15pm UTC](https://discuss.elastic.co/t/upgraded-to-elasticsearch-7-8-0-and-now-date-fields-are-in-fields-key-instead-of-source/239137 "2020-06-30T16:15:30Z")

</div>

Hello, I've upgraded my cluster from 6.8.0 to 7.8.0. This is my template: { "index\_patterns": \[ "example-\*" \], "settings": { "number\_of\_shards": 1, "number\_of\_replicas": 0, "…

---

## [Regex in Painless script](https://discuss.elastic.co/t/regex-in-painless-script/239344)

<div class="topic-metadata">

**Author:** [@Jalpesh1](https://discuss.elastic.co/u/Jalpesh1)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 4:11pm UTC](https://discuss.elastic.co/t/regex-in-painless-script/239344 "2020-06-30T16:11:27Z")

</div>

Hi Team, Need help to regex below doc to find "ERR\_ADM\_MAKER\_NOT\_FOUND " "value": "{\\"errorCode\\":\\"ERR\_ADM\_MAKER\_NOT\_FOUND\\",\\"errorMessage\\":\\"Maker not found\\"}", Regards, Jalpesh

---

## [Kibana Alerting](https://discuss.elastic.co/t/kibana-alerting/235775)

<div class="topic-metadata">

**Author:** [@Reeker](https://discuss.elastic.co/u/Reeker)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 4:08pm UTC](https://discuss.elastic.co/t/kibana-alerting/235775 "2020-06-30T16:08:57Z")

</div>

Hello Team, I am trying to get the Alerting to work in Kibana but i think i am missing something. I would like to set a log alerting for specific strings from the logs. Would that be possible? Also is Alerting and Ac…

---

## [Why Is Vega and Vega-Lite In Kibana Still Supporting Old Versions Of the Package?](https://discuss.elastic.co/t/why-is-vega-and-vega-lite-in-kibana-still-supporting-old-versions-of-the-package/239215)

<div class="topic-metadata">

**Author:** [@Ethan777100](https://discuss.elastic.co/u/Ethan777100)\
**Replies:** 6\
**Last updated:** [June 30, 2020, 3:59pm UTC](https://discuss.elastic.co/t/why-is-vega-and-vega-lite-in-kibana-still-supporting-old-versions-of-the-package/239215 "2020-06-30T15:59:59Z")

</div>

Why Is Vega and Vega-Lite In Kibana Still Supporting Old Versions Of the Package? Vega currently is at 5.13.0 whilst Kibana only supports 4.3.0 Vega-Lite is now at 4.13.1 whilst Kibana only supports 2.6.0 I feel we wi…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1959)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1961)
