# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1924 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1925 --- ## [How to disable error message in Kibana?](https://discuss.elastic.co/t/how-to-disable-error-message-in-kibana/241138)
**Author:** [@Murango](https://discuss.elastic.co/u/Murango)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 1:27pm UTC](https://discuss.elastic.co/t/how-to-disable-error-message-in-kibana/241138 "2020-07-16T13:27:29Z")
Hello, Problem description: Elasticsearch version: 6.8.10 Kibana version: 6.8.10 Describe the issue: When user go to Discover in Kibana and he don’t have access to some data, he receive error: Discover: no permissi… --- ## [Use Ruby to get field string length](https://discuss.elastic.co/t/use-ruby-to-get-field-string-length/241460)
**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 1:13pm UTC](https://discuss.elastic.co/t/use-ruby-to-get-field-string-length/241460 "2020-07-16T13:13:43Z")
I am trying to get the string length of a dns domain name and place into a new field. I've seen several posts to use ruby to achieve this but I can't seem to get it to work. This code is placed inside the filter {} brack… --- ## [Efficiency (Processing Time) of Filebeat and Logstash](https://discuss.elastic.co/t/efficiency-processing-time-of-filebeat-and-logstash/241263)
**Author:** [@pulkit007](https://discuss.elastic.co/u/pulkit007)\ **Replies:** 3\ **Last updated:** [July 16, 2020, 1:06pm UTC](https://discuss.elastic.co/t/efficiency-processing-time-of-filebeat-and-logstash/241263 "2020-07-16T13:06:36Z")
I have couple of questions regarding Filebeat and Logstash. How can we find the exact time Filebeat takes to process (send logs from Logfile to Logstash) a certain set of logs? How can we find the time which Logsta… --- ## [Tag metrics as testing](https://discuss.elastic.co/t/tag-metrics-as-testing/241277)
**Author:** [@A\_Mightiev](https://discuss.elastic.co/u/A_Mightiev)\ **Replies:** 5\ **Last updated:** [July 16, 2020, 1:04pm UTC](https://discuss.elastic.co/t/tag-metrics-as-testing/241277 "2020-07-16T13:04:44Z")
Hello, I use Metricbeat with Logstash to process and send to my Elasticsearch cluster. I do performance testing in some equipment and I have to write down the start and end time of the test so I can go to Kibana and loo… --- ## [Embed visualization loads a ton js files](https://discuss.elastic.co/t/embed-visualization-loads-a-ton-js-files/241368)
**Author:** [@jodinathan](https://discuss.elastic.co/u/jodinathan)\ **Replies:** 3\ **Last updated:** [July 16, 2020, 12:57pm UTC](https://discuss.elastic.co/t/embed-visualization-loads-a-ton-js-files/241368 "2020-07-16T12:57:01Z")
I am embedding a visualization in a website and looking at the network tab of chrome, kibana loads 97 JS files. Most of them are under a directory called 31997. I guess that is some kind of version number. Is this norma… --- ## [Logstash Performance Statistics](https://discuss.elastic.co/t/logstash-performance-statistics/241451)
**Author:** [@pulkit007](https://discuss.elastic.co/u/pulkit007)\ **Replies:** 0\ **Last updated:** [July 16, 2020, 12:23pm UTC](https://discuss.elastic.co/t/logstash-performance-statistics/241451 "2020-07-16T12:23:01Z")
Hi, I have these questions regarding Logstash : How can we find the time which Logstash takes to send logs to Elasticsearch? How can be find out the number of records present at any time in persistant queue for Log… --- ## [Cant Create index pattern](https://discuss.elastic.co/t/cant-create-index-pattern/241405)
**Author:** [@shmuel](https://discuss.elastic.co/u/shmuel)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 12:20pm UTC](https://discuss.elastic.co/t/cant-create-index-pattern/241405 "2020-07-16T12:20:50Z")
The "Next Step" is blank... --- ## [Show / Hide Global Filter Bar in Kibana](https://discuss.elastic.co/t/show-hide-global-filter-bar-in-kibana/240646)
**Author:** [@jeeva](https://discuss.elastic.co/u/jeeva)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 12:20pm UTC](https://discuss.elastic.co/t/show-hide-global-filter-bar-in-kibana/240646 "2020-07-16T12:20:15Z")
Hi Team, We would like to hide Global Filter Bar( KQL Search and Calendar controls) in all our dashboard to end-users , we have tried to do in filter bar styles but it's not working. Can you please help to use attain t… --- ## [Multiple concurrent modules](https://discuss.elastic.co/t/multiple-concurrent-modules/241449)
**Author:** [@hazcod](https://discuss.elastic.co/u/hazcod)\ **Replies:** 0\ **Last updated:** [July 16, 2020, 12:10pm UTC](https://discuss.elastic.co/t/multiple-concurrent-modules/241449 "2020-07-16T12:10:46Z")
Hi, I have following config for running concurrent checkpoint modules: filebeat.modules: - module: checkpoint firewall: ....port: 9001 - module: checkpoint firewall: ......port: 9002 However I only see por… --- ## [Get text similarity by Levenstein distance in range 0-1](https://discuss.elastic.co/t/get-text-similarity-by-levenstein-distance-in-range-0-1/241399)
**Author:** [@Alex\_D](https://discuss.elastic.co/u/Alex_D)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 11:50am UTC](https://discuss.elastic.co/t/get-text-similarity-by-levenstein-distance-in-range-0-1/241399 "2020-07-16T11:50:12Z")
Hi all ! I search by a text field and want to get a similarity score for the entire phrase. Algorithm - Levenshtein distance. The result should be normalized in the range 0 - 1 Example: text in query: "big hat" ex… --- ## [Logstash configs and grok pattern for java logs](https://discuss.elastic.co/t/logstash-configs-and-grok-pattern-for-java-logs/241135)
**Author:** [@Montego](https://discuss.elastic.co/u/Montego)\ **Replies:** 4\ **Last updated:** [July 16, 2020, 11:49am UTC](https://discuss.elastic.co/t/logstash-configs-and-grok-pattern-for-java-logs/241135 "2020-07-16T11:49:47Z")
Hi there! I have logs, wich looks like: \[INFO \] 28-04-2019 08:49:41.675 PM \[main\] client.Application - No active profile set, falling back to default profiles: default \[INFO \] 28-04-2019 08:49:41.735 PM \[main\] o.s.b.… --- ## [Maximum heap reached and GC not working](https://discuss.elastic.co/t/maximum-heap-reached-and-gc-not-working/241436)
**Author:** [@Barak](https://discuss.elastic.co/u/Barak)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 11:23am UTC](https://discuss.elastic.co/t/maximum-heap-reached-and-gc-not-working/241436 "2020-07-16T11:23:08Z")
Hi, As can be seen in the attached screenshot, at around 06:45:20 the heap scrapes the limit, when the GC count is 0 for the next minute. This causes this node to be unresponsive for this time period. It happens quite… --- ## [AWS EC2 based cluster best practices](https://discuss.elastic.co/t/aws-ec2-based-cluster-best-practices/235354)
**Author:** [@Lior\_Yakobov](https://discuss.elastic.co/u/Lior_Yakobov)\ **Replies:** 17\ **Last updated:** [July 16, 2020, 11:22am UTC](https://discuss.elastic.co/t/aws-ec2-based-cluster-best-practices/235354 "2020-07-16T11:22:23Z")
Hello, We are currently running a 20 data nodes cluster on AWS EC2 instances. Since we have only 1 replica per shard, and we cannot tolerate failure of more than 1 node at the time, we are not using ephermal storage bu… --- ## [High CPU usage for auditbeat](https://discuss.elastic.co/t/high-cpu-usage-for-auditbeat/133430)
**Author:** [@gbmzjy](https://discuss.elastic.co/u/gbmzjy)\ **Replies:** 6\ **Last updated:** [July 16, 2020, 10:40am UTC](https://discuss.elastic.co/t/high-cpu-usage-for-auditbeat/133430 "2020-07-16T10:40:04Z")
Hi, I am trying to use auditbeat to collect Linux Audit log and send them to our elasticsearch server. In order to compare performance with auditd, I tried the following configuration: auditbeat.modules: -module: audi… --- ## [Annotating a main class with enable elasticsearch repositories in Spring Data Elasticsearch](https://discuss.elastic.co/t/annotating-a-main-class-with-enable-elasticsearch-repositories-in-spring-data-elasticsearch/241434)
**Author:** [@imacpherson](https://discuss.elastic.co/u/imacpherson)\ **Replies:** 0\ **Last updated:** [July 16, 2020, 10:33am UTC](https://discuss.elastic.co/t/annotating-a-main-class-with-enable-elasticsearch-repositories-in-spring-data-elasticsearch/241434 "2020-07-16T10:33:25Z")
I've got a question regarding Spring Data Elasticsearch best practices using the EnableElasticsearchRepositories annotation. We've been working on writing a common Elasticsearch library to avoid repeating the same boiler… --- ## [How Attachments or file storage and searching is handled in Elasticsearch](https://discuss.elastic.co/t/how-attachments-or-file-storage-and-searching-is-handled-in-elasticsearch/241246)
**Author:** [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\ **Replies:** 6\ **Last updated:** [July 16, 2020, 10:32am UTC](https://discuss.elastic.co/t/how-attachments-or-file-storage-and-searching-is-handled-in-elasticsearch/241246 "2020-07-16T10:32:41Z")
Hello Team, Could you please help me understand How Attachments or files like (pdf/text files/doc) are stored in elasticsearch and how the content and inverted index managed for searching. tried searching the document… --- ## [ILM hot-warm with beats and component templates](https://discuss.elastic.co/t/ilm-hot-warm-with-beats-and-component-templates/241272)
**Author:** [@niklaskurvinen](https://discuss.elastic.co/u/niklaskurvinen)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 10:13am UTC](https://discuss.elastic.co/t/ilm-hot-warm-with-beats-and-component-templates/241272 "2020-07-16T10:13:22Z")
I've been looking at implementing hot-warm architecture in the most default way possible, but with 7.8 the component templates were introduced which changes some behavior previously documented in guides for this topic. I… --- ## [Logstash user-agent filter can't parse the user agent os with version](https://discuss.elastic.co/t/logstash-user-agent-filter-cant-parse-the-user-agent-os-with-version/240937)
**Author:** [@chairxiao](https://discuss.elastic.co/u/chairxiao)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 10:08am UTC](https://discuss.elastic.co/t/logstash-user-agent-filter-cant-parse-the-user-agent-os-with-version/240937 "2020-07-16T10:08:29Z")
Hello, My logstash's version is 7.7.1 I use the logstash user agent to parse the url,but i can't get the user agent os with version I got the parse info as blow: "name" =\> "Firefox", "os\_name… --- ## [Intersect documents with same id in two indices (5.6)](https://discuss.elastic.co/t/intersect-documents-with-same-id-in-two-indices-5-6/241321)
**Author:** [@AsafHirschfeld](https://discuss.elastic.co/u/AsafHirschfeld)\ **Replies:** 3\ **Last updated:** [July 16, 2020, 9:55am UTC](https://discuss.elastic.co/t/intersect-documents-with-same-id-in-two-indices-5-6/241321 "2020-07-16T09:55:37Z")
I have two indices with documents, each document assigned with a unique id. My goal is to find duplicate documents among the indices. Is there any sort of an intersection aggregation that i can make in order to determi… --- ## [Kibana Lens split chart](https://discuss.elastic.co/t/kibana-lens-split-chart/239120)
**Author:** [@cjabrantes](https://discuss.elastic.co/u/cjabrantes)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 9:53am UTC](https://discuss.elastic.co/t/kibana-lens-split-chart/239120 "2020-07-16T09:53:10Z")
Hi all, Can you confirm me if Lens support split chart? I can only found split series via "Break down by". Thanks, --- ## [No able to access Kibana in Azure](https://discuss.elastic.co/t/no-able-to-access-kibana-in-azure/241410)
**Author:** [@nilbak](https://discuss.elastic.co/u/nilbak)\ **Replies:** 4\ **Last updated:** [July 16, 2020, 9:52am UTC](https://discuss.elastic.co/t/no-able-to-access-kibana-in-azure/241410 "2020-07-16T09:52:34Z")
Hi , I have installed elasticsearch and kibana on linux in cloud. Both services are up and running. Output of curl for elastic search root@vm4:~# curl -XGET http://localhost:9200/\_cluster/health?pretty { "cluster\_n… --- ## [Creating dashboard in kibana based on logs](https://discuss.elastic.co/t/creating-dashboard-in-kibana-based-on-logs/241406)
**Author:** [@raj\_elk](https://discuss.elastic.co/u/raj_elk)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 9:33am UTC](https://discuss.elastic.co/t/creating-dashboard-in-kibana-based-on-logs/241406 "2020-07-16T09:33:56Z")
In logs we have text like below so based on which we want to build dashboard INFO:root:2020-07-16 07:34:34.159403-Delta Count for sampleRegion\_sampleTrustee: 53 want to display delta count for every sampleRegion and sa… --- ## [Elasticsearch 7.7 crashing for Term Query if term text 200 - 300 char](https://discuss.elastic.co/t/elasticsearch-7-7-crashing-for-term-query-if-term-text-200-300-char/241395)
**Author:** [@pappukhode](https://discuss.elastic.co/u/pappukhode)\ **Replies:** 9\ **Last updated:** [July 16, 2020, 9:29am UTC](https://discuss.elastic.co/t/elasticsearch-7-7-crashing-for-term-query-if-term-text-200-300-char/241395 "2020-07-16T09:29:26Z")
Hi, I have upgraded Elasticsearch 5.5 to 7.7 recently. I have only 1 index of 30 fields and 6K data. Dataset is very simple in nature. \[provided 1g memory in jvm options\] In the dataset i have a field description whi… --- ## [Azure Event Hub logs not parsing](https://discuss.elastic.co/t/azure-event-hub-logs-not-parsing/241142)
**Author:** [@probson](https://discuss.elastic.co/u/probson)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 8:45am UTC](https://discuss.elastic.co/t/azure-event-hub-logs-not-parsing/241142 "2020-07-16T08:45:43Z")
Hi, i am using the logstash azure\_event\_hubs plugin in basic configuration, i am running7.7, the logs are been pulled but the message is not been parsed, any suggestions? Thanks Phil --- ## [Parsing Error in Fortinet-Module Pipeline blasts up message log](https://discuss.elastic.co/t/parsing-error-in-fortinet-module-pipeline-blasts-up-message-log/241411)
**Author:** [@Moritz\_Kiesewetter](https://discuss.elastic.co/u/Moritz_Kiesewetter)\ **Replies:** 1\ **Last updated:** [July 16, 2020, 8:44am UTC](https://discuss.elastic.co/t/parsing-error-in-fortinet-module-pipeline-blasts-up-message-log/241411 "2020-07-16T08:44:10Z")
Hey guys, First of a few details about my cluster: Cluster of 3 Servers - 1xMaster 2xData Nodes All of them are running ES 7.8 Filebeat 7.8 (ofc Kibana as well on the master node) OS: CentOS 7 (Kernel 3.10.0-957) I … --- ## [Embed Kibana iframe in react app and one time authenticate with aws cognito user for both (react app & kibana)](https://discuss.elastic.co/t/embed-kibana-iframe-in-react-app-and-one-time-authenticate-with-aws-cognito-user-for-both-react-app-kibana/241231)
**Author:** [@Kuppusamy\_k](https://discuss.elastic.co/u/Kuppusamy_k)\ **Replies:** 2\ **Last updated:** [July 16, 2020, 8:42am UTC](https://discuss.elastic.co/t/embed-kibana-iframe-in-react-app-and-one-time-authenticate-with-aws-cognito-user-for-both-react-app-kibana/241231 "2020-07-16T08:42:08Z")
Hi Guys, I have a requirement for my dashboard is to embed kibana iframe into my react application, for that i need to follow up below 2 conditions One time login for react app configured with aws cognito user pool. a… --- ## [Benchmarking and stress/load testing scripted fields](https://discuss.elastic.co/t/benchmarking-and-stress-load-testing-scripted-fields/241252)
**Author:** [@vivekkarne](https://discuss.elastic.co/u/vivekkarne)\ **Replies:** 0\ **Last updated:** [July 15, 2020, 8:46am UTC](https://discuss.elastic.co/t/benchmarking-and-stress-load-testing-scripted-fields/241252 "2020-07-15T08:46:07Z")
I would like to know if there is a set standard to test the performance of an elastic cluster when scripted fields are sent in a request? I am trying to extract some sort of parity between the cluster performance without… --- ## [How Data scientist can use data stored in elasticsearch](https://discuss.elastic.co/t/how-data-scientist-can-use-data-stored-in-elasticsearch/241244)
**Author:** [@vero](https://discuss.elastic.co/u/vero)\ **Replies:** 3\ **Last updated:** [July 16, 2020, 8:32am UTC](https://discuss.elastic.co/t/how-data-scientist-can-use-data-stored-in-elasticsearch/241244 "2020-07-16T08:32:06Z")
Hi, I have a new project to do an IA project ( predictive maintenace). I'm looking for an architecture to store the data for the Data scientist. We hesitate between PostgreSQL or Elasticsearch. My proposititon currentl… --- ## [How to improve my GeoPoint ElasticSearch Index for better response time?](https://discuss.elastic.co/t/how-to-improve-my-geopoint-elasticsearch-index-for-better-response-time/241353)
**Author:** [@zoomash](https://discuss.elastic.co/u/zoomash)\ **Replies:** 7\ **Last updated:** [July 16, 2020, 8:29am UTC](https://discuss.elastic.co/t/how-to-improve-my-geopoint-elasticsearch-index-for-better-response-time/241353 "2020-07-16T08:29:50Z")
Below is my Index (tz\_geo) and mapping details: Index setting: { "index.blocks.read\_only\_allow\_delete": "false", "index.priority": "1", "index.query.default\_field": \[ "\*" \], "index.write.wait\_for\_active\_s… --- ## [Suggestion on summarizing running total value](https://discuss.elastic.co/t/suggestion-on-summarizing-running-total-value/241339)
**Author:** [@Jehutywong](https://discuss.elastic.co/u/Jehutywong)\ **Replies:** 6\ **Last updated:** [July 16, 2020, 7:54am UTC](https://discuss.elastic.co/t/suggestion-on-summarizing-running-total-value/241339 "2020-07-16T07:54:54Z")
ES version 7.6 I am finding difficult to do summarize or transforms on running total values like network traffic metrics. For example i want to get the max bucket on inbound bytes/s. But prior to that, looks like i hav… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1923) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1925)