# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1769

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1770

---

## [Kibana Canvas - SQL Innerjoin & Text Colour Formatting](https://discuss.elastic.co/t/kibana-canvas-sql-innerjoin-text-colour-formatting/250590)

<div class="topic-metadata">

**Author:** [@noralilingyan](https://discuss.elastic.co/u/noralilingyan)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 4:26pm UTC](https://discuss.elastic.co/t/kibana-canvas-sql-innerjoin-text-colour-formatting/250590 "2020-10-05T16:26:08Z")

</div>

Hi there, I would like to seek your help with regard to kibana visualizations. Above shows a sample list of data & screenshot given by the end user of its expected outcome for the data uploaded into elasticsearch. …

---

## [ML jobs](https://discuss.elastic.co/t/ml-jobs/225697)

<div class="topic-metadata">

**Author:** [@pinguin](https://discuss.elastic.co/u/pinguin)\
**Replies:** 9\
**Last updated:** [October 5, 2020, 4:25pm UTC](https://discuss.elastic.co/t/ml-jobs/225697 "2020-10-05T16:25:11Z")

</div>

hello, i have created the built-in machine learning jobs for windows and linux, for linux it s working as expected, for windows some of the jobs are showing 0 Processed data. one of the jobs is "windows\_anomalous\_proc…

---

## [Weighting HTML files to move them up search rankings](https://discuss.elastic.co/t/weighting-html-files-to-move-them-up-search-rankings/251025)

<div class="topic-metadata">

**Author:** [@oceanclub](https://discuss.elastic.co/u/oceanclub)\
**Replies:** 0\
**Last updated:** [October 5, 2020, 4:02pm UTC](https://discuss.elastic.co/t/weighting-html-files-to-move-them-up-search-rankings/251025 "2020-10-05T16:02:34Z")

</div>

Hi all, I'm working in tandem with a developer to create an online help site to which Madcap Flare HTML files are published. On top of the standard Flare search is an additional global search implemented using Elasticse…

---

## [Custom filebeat processor](https://discuss.elastic.co/t/custom-filebeat-processor/248029)

<div class="topic-metadata">

**Author:** [@yoklmn](https://discuss.elastic.co/u/yoklmn)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 4:01pm UTC](https://discuss.elastic.co/t/custom-filebeat-processor/248029 "2020-10-05T16:01:40Z")

</div>

Hello. I hard trying create my own plugin of filebeat's processor. I use filebeat v7.9.1 from official repository on machine B, CentOS 7.6.1810, CPU Intel Xeon E-2176G: filebeat version 7.9.1 (amd64), libbeat 7.9.1 \[ad8…

---

## [Enabling Anonymous Access](https://discuss.elastic.co/t/enabling-anonymous-access/250847)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:58pm UTC](https://discuss.elastic.co/t/enabling-anonymous-access/250847 "2020-10-05T15:58:12Z")

</div>

I am running Elastic Stack 7.9.2 and want to enable anonymous access to a dashboard. I have created the anonymous user and role in Kibana and configured Elasticsearch for anonymous user access. However, I can't figure …

---

## [Painless script to jsonify](https://discuss.elastic.co/t/painless-script-to-jsonify/250854)

<div class="topic-metadata">

**Author:** [@Narendra\_Jain](https://discuss.elastic.co/u/Narendra_Jain)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:56pm UTC](https://discuss.elastic.co/t/painless-script-to-jsonify/250854 "2020-10-05T15:56:54Z")

</div>

I have index with http response body stored as string json, is it possible to treat json as string to json to read as json using json path.

---

## [Painless third party library](https://discuss.elastic.co/t/painless-third-party-library/250855)

<div class="topic-metadata">

**Author:** [@Narendra\_Jain](https://discuss.elastic.co/u/Narendra_Jain)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:53pm UTC](https://discuss.elastic.co/t/painless-third-party-library/250855 "2020-10-05T15:53:19Z")

</div>

Is there a way i can use org.apache.commons.math4.stat.regression library inside painless, or any third party lib support available in any form.

---

## [How to send formatted json logs to logstash?](https://discuss.elastic.co/t/how-to-send-formatted-json-logs-to-logstash/250944)

<div class="topic-metadata">

**Author:** [@nandalapadu\_shamriya](https://discuss.elastic.co/u/nandalapadu_shamriya)\
**Replies:** 0\
**Last updated:** [October 5, 2020, 7:55am UTC](https://discuss.elastic.co/t/how-to-send-formatted-json-logs-to-logstash/250944 "2020-10-05T07:55:13Z")

</div>

We are printing the logs in json format in K8 kernel from where the centralized system reading though logstash Agent. {"app":"Svc","@timestamp":"2020-10-05T07:25:37.575Z","logger":"com.ljec.service.impl.LjecServiceImpl"…

---

## [Dropdown Dashboard multiselect bug](https://discuss.elastic.co/t/dropdown-dashboard-multiselect-bug/250984)

<div class="topic-metadata">

**Author:** [@Bender](https://discuss.elastic.co/u/Bender)\
**Replies:** 2\
**Last updated:** [October 5, 2020, 3:50pm UTC](https://discuss.elastic.co/t/dropdown-dashboard-multiselect-bug/250984 "2020-10-05T15:50:40Z")

</div>

Hello Community, if we use multiselect und dropdown (select box) all selected items got deleted when the text from one item or multiple items is to long and its not get breaked to new line then the whole selected items …

---

## [Display all rows in canvas kibana when taking pdf](https://discuss.elastic.co/t/display-all-rows-in-canvas-kibana-when-taking-pdf/250917)

<div class="topic-metadata">

**Author:** [@Saurabh\_Anand](https://discuss.elastic.co/u/Saurabh_Anand)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:47pm UTC](https://discuss.elastic.co/t/display-all-rows-in-canvas-kibana-when-taking-pdf/250917 "2020-10-05T15:47:24Z")

</div>

In the above screenshot of Demo data, the data table contains 300 pagination. When i try to take pdf of the canvas, it only shows the value at first page and values at other pages are not shown. Is there a way to disp…

---

## [Create map layer from longitude and latitude](https://discuss.elastic.co/t/create-map-layer-from-longitude-and-latitude/251002)

<div class="topic-metadata">

**Author:** [@Luca\_Padovan](https://discuss.elastic.co/u/Luca_Padovan)\
**Replies:** 7\
**Last updated:** [October 5, 2020, 3:39pm UTC](https://discuss.elastic.co/t/create-map-layer-from-longitude-and-latitude/251002 "2020-10-05T15:39:34Z")

</div>

I want to create a kibana map using two float fields: lat and lon (latitude and longitude), but when i try to create a map in Kibana I can't do it because i don't have a geoip location field. How can i solve it?

---

## [Push\_map\_as\_event\_on\_timeout with interlaced events](https://discuss.elastic.co/t/push-map-as-event-on-timeout-with-interlaced-events/251017)

<div class="topic-metadata">

**Author:** [@mohsin106](https://discuss.elastic.co/u/mohsin106)\
**Replies:** 0\
**Last updated:** [October 5, 2020, 3:23pm UTC](https://discuss.elastic.co/t/push-map-as-event-on-timeout-with-interlaced-events/251017 "2020-10-05T15:23:50Z")

</div>

Hi, I have interlaced events that stream in every minute. For example: event 1: task\_id: "routerA-site1" metric1: val1 metric2: val2 event 2: task\_id:"routerB-site1" metric1: val1 metric2: val2 …

---

## [User can access index not allowed in role (security is not working)](https://discuss.elastic.co/t/user-can-access-index-not-allowed-in-role-security-is-not-working/250993)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 4\
**Last updated:** [October 5, 2020, 3:13pm UTC](https://discuss.elastic.co/t/user-can-access-index-not-allowed-in-role-security-is-not-working/250993 "2020-10-05T15:13:16Z")

</div>

Hi community, I am asking for advice, if you could help with this security problem: ES version 7.92 (in docker ) created role with access the index bs\_hdm\_tr69\_\* created user this role but user can access all indice…

---

## [Logstash and JAVA plugins](https://discuss.elastic.co/t/logstash-and-java-plugins/251008)

<div class="topic-metadata">

**Author:** [@David\_Kennedy](https://discuss.elastic.co/u/David_Kennedy)\
**Replies:** 4\
**Last updated:** [October 5, 2020, 3:12pm UTC](https://discuss.elastic.co/t/logstash-and-java-plugins/251008 "2020-10-05T15:12:35Z")

</div>

Wondering if someone would be able to give me a hand. I'm trying to compile a java filter. I've followed the instructions here: https://github.com/logstash-plugins/logstash-filter-java\_filter\_example but get this: \[2…

---

## [How much AWS EBS iops do I need?](https://discuss.elastic.co/t/how-much-aws-ebs-iops-do-i-need/250961)

<div class="topic-metadata">

**Author:** [@vamsikrishna\_medeti](https://discuss.elastic.co/u/vamsikrishna_medeti)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:11pm UTC](https://discuss.elastic.co/t/how-much-aws-ebs-iops-do-i-need/250961 "2020-10-05T15:11:05Z")

</div>

Hi, I am provisioning the ELK stack on AWS kubernetes (EKS) with EBS storage. Can someone help me in configuring the IOPS? How much IOPS do I need to configure for EBS io2, for elastic stack?

---

## [Journalbeat -multiline](https://discuss.elastic.co/t/journalbeat-multiline/251013)

<div class="topic-metadata">

**Author:** [@sidhesh\_kumar](https://discuss.elastic.co/u/sidhesh_kumar)\
**Replies:** 0\
**Last updated:** [October 5, 2020, 3:04pm UTC](https://discuss.elastic.co/t/journalbeat-multiline/251013 "2020-10-05T15:04:20Z")

</div>

Hi.. Is there multiline support avaialble for journalbeat . I am using 7.9

---

## [Packet beat in stopped stae](https://discuss.elastic.co/t/packet-beat-in-stopped-stae/250960)

<div class="topic-metadata">

**Author:** [@ashwinvijay](https://discuss.elastic.co/u/ashwinvijay)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 3:00pm UTC](https://discuss.elastic.co/t/packet-beat-in-stopped-stae/250960 "2020-10-05T15:00:06Z")

</div>

Installed packet beat and started service for packet beat. Not showing any error. But when checking the service status, it shows packet beat is stopped. Any way to fix this.

---

## [Logstash warning (hanshaking error) when connecting with MongoDB](https://discuss.elastic.co/t/logstash-warning-hanshaking-error-when-connecting-with-mongodb/250979)

<div class="topic-metadata">

**Author:** [@carlos-bernad](https://discuss.elastic.co/u/carlos-bernad)\
**Replies:** 2\
**Last updated:** [October 5, 2020, 2:47pm UTC](https://discuss.elastic.co/t/logstash-warning-hanshaking-error-when-connecting-with-mongodb/250979 "2020-10-05T14:47:10Z")

</div>

I am trying to store in a MongoDB collection some JSON datalogs filtered by Logstash. Mongod instance and Logstash are running on Windows 8.1 in the same laptop and I also installed logstash-output-mongodb plugin. My co…

---

## [Parsing Sysmon Logs to filter on Event.Code](https://discuss.elastic.co/t/parsing-sysmon-logs-to-filter-on-event-code/250834)

<div class="topic-metadata">

**Author:** [@Lee\_Archinal](https://discuss.elastic.co/u/Lee_Archinal)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 2:45pm UTC](https://discuss.elastic.co/t/parsing-sysmon-logs-to-filter-on-event-code/250834 "2020-10-05T14:45:37Z")

</div>

Good afternoon everyone, I recently blew away my old ELK stack and built a new one. I still maintained the same log sources, Sysmon, Windows events, and Powershell, (using the configuration that came with winlogbeat) bu…

---

## [Metricbeat Dashboard only some stats working](https://discuss.elastic.co/t/metricbeat-dashboard-only-some-stats-working/248929)

<div class="topic-metadata">

**Author:** [@rplus](https://discuss.elastic.co/u/rplus)\
**Replies:** 3\
**Last updated:** [October 5, 2020, 2:27pm UTC](https://discuss.elastic.co/t/metricbeat-dashboard-only-some-stats-working/248929 "2020-10-05T14:27:23Z")

</div>

Hi, I've setup metricbeat on a windows server. It currently ships it's logs to logstash and then elastic. For some reason the deafult metric dashboard only shows some stats: (Dont worry about the filtering, I only h…

---

## [Filebeat Azure Module with Intune Diagnostics?](https://discuss.elastic.co/t/filebeat-azure-module-with-intune-diagnostics/248635)

<div class="topic-metadata">

**Author:** [@victor.nilsson](https://discuss.elastic.co/u/victor.nilsson)\
**Replies:** 2\
**Last updated:** [October 5, 2020, 2:23pm UTC](https://discuss.elastic.co/t/filebeat-azure-module-with-intune-diagnostics/248635 "2020-10-05T14:23:41Z")

</div>

Hi, We're interested in trying out the Azure module for Filebeat in order to fetch logs from an Azure event hub. The event hub will be fed diagnostics logs from Intune. If we look at the documentation for the Azure mod…

---

## [Parse csv attachment in email with IMAP](https://discuss.elastic.co/t/parse-csv-attachment-in-email-with-imap/251006)

<div class="topic-metadata">

**Author:** [@charles97](https://discuss.elastic.co/u/charles97)\
**Replies:** 0\
**Last updated:** [October 5, 2020, 2:21pm UTC](https://discuss.elastic.co/t/parse-csv-attachment-in-email-with-imap/251006 "2020-10-05T14:21:39Z")

</div>

I have this kind of use case where I have to parse email's attachment that have .csv format. I saw that logstash offer IMAP input and I saw save\_attachments and strip\_attachments but how do I use it to do with my use ca…

---

## [Cannot query ip address fields using elastic SQL](https://discuss.elastic.co/t/cannot-query-ip-address-fields-using-elastic-sql/249038)

<div class="topic-metadata">

**Author:** [@fporrata](https://discuss.elastic.co/u/fporrata)\
**Replies:** 7\
**Last updated:** [October 5, 2020, 2:10pm UTC](https://discuss.elastic.co/t/cannot-query-ip-address-fields-using-elastic-sql/249038 "2020-10-05T14:10:55Z")

</div>

I am using the Kibana console to run a SQL query with an ip field as criteria. Here is the query: POST /\_sql?format=json { "query": """SELECT "@timestamp", "destination.ip" FROM "dummyindex" WHERE "destination.ip"…

---

## [\[Filebeat\] AWS module & ELB fileset, not parsing message](https://discuss.elastic.co/t/filebeat-aws-module-elb-fileset-not-parsing-message/250690)

<div class="topic-metadata">

**Author:** [@Salim\_B](https://discuss.elastic.co/u/Salim_B)\
**Replies:** 8\
**Last updated:** [October 5, 2020, 2:05pm UTC](https://discuss.elastic.co/t/filebeat-aws-module-elb-fileset-not-parsing-message/250690 "2020-10-05T14:05:34Z")

</div>

Hi there ! I've been setting the aws module and the ELB fileset with it, and got it mostly working. It reads the SQS Queue, then get the matching log on S3 side, but it doesn't parse the Access Log message at all. Im …

---

## [Kibana Math Aggregation on Terms](https://discuss.elastic.co/t/kibana-math-aggregation-on-terms/250816)

<div class="topic-metadata">

**Author:** [@savior1307](https://discuss.elastic.co/u/savior1307)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 1:54pm UTC](https://discuss.elastic.co/t/kibana-math-aggregation-on-terms/250816 "2020-10-05T13:54:37Z")

</div>

Kibana Term Math Aggregation Hey guys, I'd like to ask if there's any way to do Math aggregation on individual Term buckets in TSVB. TSVB Metric I've divided my data into buckets by Term and aggregated by Count. Thi…

---

## [7.9.x greying out disables additional criteria selection](https://discuss.elastic.co/t/7-9-x-greying-out-disables-additional-criteria-selection/250880)

<div class="topic-metadata">

**Author:** [@kmfreder1](https://discuss.elastic.co/u/kmfreder1)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 1:27pm UTC](https://discuss.elastic.co/t/7-9-x-greying-out-disables-additional-criteria-selection/250880 "2020-10-05T13:27:06Z")

</div>

Hi all, I have been using Elasticsearch for a couple of years now for integration with my SIEM (using Wazuh). This has worked quite well for me as I go through my daily threat hunting activities. I appreciate all of t…

---

## [\[Kibana painless alert\] Unable to read a string value from an array](https://discuss.elastic.co/t/kibana-painless-alert-unable-to-read-a-string-value-from-an-array/250837)

<div class="topic-metadata">

**Author:** [@roel\_m](https://discuss.elastic.co/u/roel_m)\
**Replies:** 1\
**Last updated:** [October 5, 2020, 1:15pm UTC](https://discuss.elastic.co/t/kibana-painless-alert-unable-to-read-a-string-value-from-an-array/250837 "2020-10-05T13:15:07Z")

</div>

Hi, We are using elastic and kibana to store and visualize automated testing data and we want to create an alerting system that sends a message to Flowdock if a certain threshold of failed tests is reached. For this pu…

---

## [Kibana Discover Extremely Slow (unusable)](https://discuss.elastic.co/t/kibana-discover-extremely-slow-unusable/250260)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 4\
**Last updated:** [October 5, 2020, 12:27pm UTC](https://discuss.elastic.co/t/kibana-discover-extremely-slow-unusable/250260 "2020-10-05T12:27:28Z")

</div>

Hi All, I have a bit of a problem and was wondering if anyone has any ideas. I'm running Kibana 7.9.1 (docker container) (entire stack is 7.9.1), and the Discover feature is unusably slow. I don't believe its the Elast…

---

## [Data synchronization time in elasticsearch](https://discuss.elastic.co/t/data-synchronization-time-in-elasticsearch/246748)

<div class="topic-metadata">

**Author:** [@akshatsharma](https://discuss.elastic.co/u/akshatsharma)\
**Replies:** 14\
**Last updated:** [October 5, 2020, 12:26pm UTC](https://discuss.elastic.co/t/data-synchronization-time-in-elasticsearch/246748 "2020-10-05T12:26:53Z")

</div>

Hi, This is a query regarding data synchronization in elasticsearch. We encountered a problem where we insert some data into elasticsearch at a regular interval. Now, immediately after data insertion, we run a search q…

---

## [Modifying Discover page with plugin](https://discuss.elastic.co/t/modifying-discover-page-with-plugin/250968)

<div class="topic-metadata">

**Author:** [@Introverrso](https://discuss.elastic.co/u/Introverrso)\
**Replies:** 2\
**Last updated:** [October 5, 2020, 12:01pm UTC](https://discuss.elastic.co/t/modifying-discover-page-with-plugin/250968 "2020-10-05T12:01:40Z")

</div>

Hi everybody. I have questions about the potential of modifying the Discover page using the plugin. I read some old topics related to my challenge, which revealed that the maximum that can be done is to add a new tab t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1768)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1770)
