# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1742 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1743 --- ## [Fields Coming as unknown in Index](https://discuss.elastic.co/t/fields-coming-as-unknown-in-index/252644)
**Author:** [@Ayush\_Agrahari](https://discuss.elastic.co/u/Ayush_Agrahari)\ **Replies:** 0\ **Last updated:** [October 20, 2020, 7:16am UTC](https://discuss.elastic.co/t/fields-coming-as-unknown-in-index/252644 "2020-10-20T07:16:39Z")
I am getting unknown fields in .monitoring-es-\* Index. I recently enabled stack monitoring in ELK Stack then I am getting data in .monitoring-\* Indices. I wanted to create alerts based on this data but I am unable to us… --- ## [Using json in logstash](https://discuss.elastic.co/t/using-json-in-logstash/252643)
**Author:** [@igersht](https://discuss.elastic.co/u/igersht)\ **Replies:** 0\ **Last updated:** [October 20, 2020, 7:08am UTC](https://discuss.elastic.co/t/using-json-in-logstash/252643 "2020-10-20T07:08:37Z")
Hey, I'm trying to send JSON to logstash looking like this: "build\_url" =\> "https://www.build.url", "fields" =\> { "log\_source" =\> "log\_json" }, "@timestamp" =\> 2020-10-19T11:… --- ## [Max data that can be stored based on memory configured](https://discuss.elastic.co/t/max-data-that-can-be-stored-based-on-memory-configured/251752)
**Author:** [@mrudrego](https://discuss.elastic.co/u/mrudrego)\ **Replies:** 6\ **Last updated:** [October 20, 2020, 6:57am UTC](https://discuss.elastic.co/t/max-data-that-can-be-stored-based-on-memory-configured/251752 "2020-10-20T06:57:15Z")
Hi, I was going through the blog which talks about shards in a cluster https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster In one of their tips they say " A good rule-of-thumb is to en… --- ## [Delete Sync Operation using Logstash JDBC](https://discuss.elastic.co/t/delete-sync-operation-using-logstash-jdbc/252636)
**Author:** [@sharath\_sai](https://discuss.elastic.co/u/sharath_sai)\ **Replies:** 0\ **Last updated:** [October 20, 2020, 6:28am UTC](https://discuss.elastic.co/t/delete-sync-operation-using-logstash-jdbc/252636 "2020-10-20T06:28:26Z")
Hi all, We have configured JDBC logstash, to migrate data from Cassandra to logstash. we have able to move data from Cassandra to logstash, we are also updating the data in elastic search based on document\_id, but we n… --- ## [Auto detection of Data type](https://discuss.elastic.co/t/auto-detection-of-data-type/252571)
**Author:** [@rdeshmukh](https://discuss.elastic.co/u/rdeshmukh)\ **Replies:** 2\ **Last updated:** [October 20, 2020, 6:02am UTC](https://discuss.elastic.co/t/auto-detection-of-data-type/252571 "2020-10-20T06:02:13Z")
This is the mapping initially which I created, considering that Roll number will be limit to only numbers. But eventually as they are growing in the roll numbers are Alphanumeric and the data type is changed. PUT studen… --- ## [Metricbeat - filesystem metrics does not include remote network drives](https://discuss.elastic.co/t/metricbeat-filesystem-metrics-does-not-include-remote-network-drives/252346)
**Author:** [@qwinkler](https://discuss.elastic.co/u/qwinkler)\ **Replies:** 4\ **Last updated:** [October 20, 2020, 6:01am UTC](https://discuss.elastic.co/t/metricbeat-filesystem-metrics-does-not-include-remote-network-drives/252346 "2020-10-20T06:01:09Z")
Hello! I attached a few S3 buckets via TntDrive (https://tntdrive.com/) as a network device. They have a "remote" type in the old metricbeat: { "\_index": "metricbeat-6.3.0-2020.10", "\_type": "\_doc", "\_id": "k-8OM… --- ## [Watcher POST URL Error](https://discuss.elastic.co/t/watcher-post-url-error/251067)
**Author:** [@karnamonkster](https://discuss.elastic.co/u/karnamonkster)\ **Replies:** 4\ **Last updated:** [October 20, 2020, 5:38am UTC](https://discuss.elastic.co/t/watcher-post-url-error/251067 "2020-10-20T05:38:27Z")
Hi, Setup: ES/Kibana 7.5.2 We are trying to configure automatic PDF report generation and sent to the email on a schedule. The dashboard pdf works fine if we simply download it using Generate PDF option. However wh… --- ## [Logstash elasticsearch input plugin observes frequent Faraday::TimeoutError. How can we increase the default timeout settings for the request?](https://discuss.elastic.co/t/logstash-elasticsearch-input-plugin-observes-frequent-faraday-timeouterror-how-can-we-increase-the-default-timeout-settings-for-the-request/252621)
**Author:** [@vikrant\_baraiya1](https://discuss.elastic.co/u/vikrant_baraiya1)\ **Replies:** 0\ **Last updated:** [October 20, 2020, 2:37am UTC](https://discuss.elastic.co/t/logstash-elasticsearch-input-plugin-observes-frequent-faraday-timeouterror-how-can-we-increase-the-default-timeout-settings-for-the-request/252621 "2020-10-20T02:37:42Z")
We are using Logstash with an elastic search input plugin and elastic search output plugin. The data volume increased heavily during the peak hours between 10 AM - 5 PM Eastern time. And during this time frame, we observ… --- ## [Identify indexing performance bottleneck](https://discuss.elastic.co/t/identify-indexing-performance-bottleneck/252456)
**Author:** [@larryzhu](https://discuss.elastic.co/u/larryzhu)\ **Replies:** 3\ **Last updated:** [October 20, 2020, 1:05am UTC](https://discuss.elastic.co/t/identify-indexing-performance-bottleneck/252456 "2020-10-20T01:05:48Z")
we have elastic data nodes that run on 52 physical processors/104 logic processors, the machines are using Intel Xeon Platinum 8167M. Base frequency 2.0 GHz, max turbo frequency 2.4 GHz. however we are consistently seei… --- ## [How to setup logstash to send whole xml event log to elasticsearch](https://discuss.elastic.co/t/how-to-setup-logstash-to-send-whole-xml-event-log-to-elasticsearch/252098)
**Author:** [@muru1](https://discuss.elastic.co/u/muru1)\ **Replies:** 15\ **Last updated:** [October 20, 2020, 12:26am UTC](https://discuss.elastic.co/t/how-to-setup-logstash-to-send-whole-xml-event-log-to-elasticsearch/252098 "2020-10-20T00:26:04Z")
I am trying to setup logstash to send xml event logs to elasticseach, however it is inserting each line as a separate entry into es, I tried using multiline codec but its buffering that many lines and inserting into es i… --- ## [Kibana LDAP 401](https://discuss.elastic.co/t/kibana-ldap-401/252609)
**Author:** [@IanGabes](https://discuss.elastic.co/u/IanGabes)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 11:51pm UTC](https://discuss.elastic.co/t/kibana-ldap-401/252609 "2020-10-19T23:51:44Z")
Hi all, I am receiving 401 Unauthorized errors when trying to log in via the kibana UI with LDAP credentials. I have spun up a Elasticsearch cluster on Azure's AKS using the official helm charts and images, and have co… --- ## [Kibana Customize Plugin](https://discuss.elastic.co/t/kibana-customize-plugin/252476)
**Author:** [@Syed.Ubaid](https://discuss.elastic.co/u/Syed.Ubaid)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 11:26pm UTC](https://discuss.elastic.co/t/kibana-customize-plugin/252476 "2020-10-19T23:26:57Z")
Can we add customise plugin in kibana is it free ? I want to add email button in the visualisation after creating the visualisation it will email the people. For example i have the visualisation name expired cnic i creat… --- ## [Error in visualisation](https://discuss.elastic.co/t/error-in-visualisation/252119)
**Author:** [@pmk](https://discuss.elastic.co/u/pmk)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 11:16pm UTC](https://discuss.elastic.co/t/error-in-visualisation/252119 "2020-10-19T23:16:13Z")
no error message. It was not recorded in log(kibana.strerr). what's wrong? help me plz... I do not know the cause. --- ## [Migrate from rollover aliases to data streams](https://discuss.elastic.co/t/migrate-from-rollover-aliases-to-data-streams/252161)
**Author:** [@Julien\_HENRY](https://discuss.elastic.co/u/Julien_HENRY)\ **Replies:** 0\ **Last updated:** [October 15, 2020, 9:47am UTC](https://discuss.elastic.co/t/migrate-from-rollover-aliases-to-data-streams/252161 "2020-10-15T09:47:11Z")
Hi, I'm just discovering the new data stream concept in Elastic Cloud 7.9.2. We are ingesting time based documents, so this seems the perfect fit. Previously, we were using rollover\_alias. I have created the data str… --- ## [Unable to start Logstash docker](https://discuss.elastic.co/t/unable-to-start-logstash-docker/252614)
**Author:** [@tamilarasanbravo](https://discuss.elastic.co/u/tamilarasanbravo)\ **Replies:** 0\ **Last updated:** [October 19, 2020, 9:26pm UTC](https://discuss.elastic.co/t/unable-to-start-logstash-docker/252614 "2020-10-19T21:26:05Z")
Hi Team, I am unable to start my logstash docker stack and below is the config and log Config logstash: image: logstash:7.9.1 hostname: "{{.Node.Hostname}}-logstash" environment: - XPACK\_MONITORING… --- ## [Why can't I access the index alias I created to use in Kibana Discover/Visualize?](https://discuss.elastic.co/t/why-cant-i-access-the-index-alias-i-created-to-use-in-kibana-discover-visualize/252591)
**Author:** [@bgiordano](https://discuss.elastic.co/u/bgiordano)\ **Replies:** 4\ **Last updated:** [October 19, 2020, 9:24pm UTC](https://discuss.elastic.co/t/why-cant-i-access-the-index-alias-i-created-to-use-in-kibana-discover-visualize/252591 "2020-10-19T21:24:17Z")
What am I missing? Why can't I access an alias index by name from Kibana? I currently am using ES/K 7.6.2 I have been working with ES/K since 2014 --- used alias indices all the time. What has changed in 7.x that I am … --- ## [Logstash mapping wrong field types](https://discuss.elastic.co/t/logstash-mapping-wrong-field-types/252460)
**Author:** [@JFC](https://discuss.elastic.co/u/JFC)\ **Replies:** 3\ **Last updated:** [October 19, 2020, 9:22pm UTC](https://discuss.elastic.co/t/logstash-mapping-wrong-field-types/252460 "2020-10-19T21:22:48Z")
Hi , I'm new to logstash and ELK stack. So apologies in advance if this question sounds obvious. Problem: I have fields that are being detected as strings by Kibana even after the template.json file explicitly maps the… --- ## [Kibana Dev Tools Console won't load in Safari](https://discuss.elastic.co/t/kibana-dev-tools-console-wont-load-in-safari/252612)
**Author:** [@jeffkirk1](https://discuss.elastic.co/u/jeffkirk1)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 9:22pm UTC](https://discuss.elastic.co/t/kibana-dev-tools-console-wont-load-in-safari/252612 "2020-10-19T21:22:44Z")
I've had an issue plaguing me through several of the recent minor releases of Kibana. I can't load the Dev Tools Console in Safari. I always get a not-especially-helpful error message "Cannot load Console. Try reloading … --- ## [Sum of aggregated terms are not per bucket, but total](https://discuss.elastic.co/t/sum-of-aggregated-terms-are-not-per-bucket-but-total/252541)
**Author:** [@obayd.mir](https://discuss.elastic.co/u/obayd.mir)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 9:14pm UTC](https://discuss.elastic.co/t/sum-of-aggregated-terms-are-not-per-bucket-but-total/252541 "2020-10-19T21:14:16Z")
I want to sum up a field value per bucket for that specific bucket, but instead of this, I'm getting the total for all buckets per bucket. See below for some details. Search request: GET index-001/\_search { "size": 0… --- ## [Mutate rename multiple fields, how to improve performance?](https://discuss.elastic.co/t/mutate-rename-multiple-fields-how-to-improve-performance/252606)
**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 9:05pm UTC](https://discuss.elastic.co/t/mutate-rename-multiple-fields-how-to-improve-performance/252606 "2020-10-19T21:05:02Z")
Hello, I have a pipeline where I need to rename something around 1100 fields, the documents do not have all the fields, but in total I need to rename near 1100 fields. Currently I have one mutate filter with a rename a… --- ## [Exiting: 1 error: missing required field accessing '0.queries' (source:'/etc/metricbeat/modules.d/mysql.yml')](https://discuss.elastic.co/t/exiting-1-error-missing-required-field-accessing-0-queries-source-etc-metricbeat-modules-d-mysql-yml/250895)
**Author:** [@ranajoy\_banerjee](https://discuss.elastic.co/u/ranajoy_banerjee)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 8:12pm UTC](https://discuss.elastic.co/t/exiting-1-error-missing-required-field-accessing-0-queries-source-etc-metricbeat-modules-d-mysql-yml/250895 "2020-10-19T20:12:56Z")
Hi , Has anyone found a solution to this error? --- ## [Varying hilightling behavior](https://discuss.elastic.co/t/varying-hilightling-behavior/252601)
**Author:** [@stevo](https://discuss.elastic.co/u/stevo)\ **Replies:** 0\ **Last updated:** [October 19, 2020, 7:35pm UTC](https://discuss.elastic.co/t/varying-hilightling-behavior/252601 "2020-10-19T19:35:52Z")
I am seeing some unexplainable behavior with highlighting returning different responses depending on the search text. Below are two examples of nearly identical queries with different search texts. I am not sure how to e… --- ## [Importing a Dashboard onto a Space](https://discuss.elastic.co/t/importing-a-dashboard-onto-a-space/252402)
**Author:** [@teej](https://discuss.elastic.co/u/teej)\ **Replies:** 6\ **Last updated:** [October 19, 2020, 7:21pm UTC](https://discuss.elastic.co/t/importing-a-dashboard-onto-a-space/252402 "2020-10-19T19:21:36Z")
I have created spaces for various users but now I want to have them see existing dashboards on their respective spaces when they log in. The problem I am having is that while the spaces are letting me create a dashboard,… --- ## [Logstash multiline codec with xml filter](https://discuss.elastic.co/t/logstash-multiline-codec-with-xml-filter/252593)
**Author:** [@Arvind\_Ks](https://discuss.elastic.co/u/Arvind_Ks)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 7:00pm UTC](https://discuss.elastic.co/t/logstash-multiline-codec-with-xml-filter/252593 "2020-10-19T19:00:08Z")
Hello Everyone i have a input xml file, that i am using to send to elasticsearch. i want all fields within and . However i am getting below error. pls suggest. Input file 2020-09-30 11:59:54,755 (Test worker) JobSch… --- ## [How to setup Refresh Interval for Kibana Dashboard](https://discuss.elastic.co/t/how-to-setup-refresh-interval-for-kibana-dashboard/252296)
**Author:** [@Souvik\_Das](https://discuss.elastic.co/u/Souvik_Das)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 6:52pm UTC](https://discuss.elastic.co/t/how-to-setup-refresh-interval-for-kibana-dashboard/252296 "2020-10-19T18:52:07Z")
How to set up the Refresh Interval for Kibana Dashboard from its Saved Object. So that it will set for the rest of the time. Please find below the reference image where I want to set up the interval. Please suggest. T… --- ## [Doubts about extract field](https://discuss.elastic.co/t/doubts-about-extract-field/252558)
**Author:** [@rildo](https://discuss.elastic.co/u/rildo)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 6:31pm UTC](https://discuss.elastic.co/t/doubts-about-extract-field/252558 "2020-10-19T18:31:34Z")
Hello People , I have this code ´ ´ ´ input { stdin { } } output { stdout { codec =\> rubydebug } } filter { json { source =\> "message" } mutate { gsub =\> \[ "message" , "\\n", "," \] } mutate { gsub =\> \[ "messa… --- ## [Where should I drop records? And how?](https://discuss.elastic.co/t/where-should-i-drop-records-and-how/252383)
**Author:** [@mbuster](https://discuss.elastic.co/u/mbuster)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 6:18pm UTC](https://discuss.elastic.co/t/where-should-i-drop-records-and-how/252383 "2020-10-19T18:18:59Z")
Background: Sending Sonicwall syslog to Logstash in order to keep records on SSL VPN logins/logouts Sonicwall indices are accounting for a majority of my storage usage Need: Drop Sonicwall records based on specific … --- ## [Is it possible to export the Watch History (Alerts triggered by Watcher)?](https://discuss.elastic.co/t/is-it-possible-to-export-the-watch-history-alerts-triggered-by-watcher/252559)
**Author:** [@mdamera](https://discuss.elastic.co/u/mdamera)\ **Replies:** 2\ **Last updated:** [October 19, 2020, 5:28pm UTC](https://discuss.elastic.co/t/is-it-possible-to-export-the-watch-history-alerts-triggered-by-watcher/252559 "2020-10-19T17:28:36Z")
Team, Is it possible to export the Watch History (Alerts triggered by Watcher) ? I am looking to find what are all the Alerts triggered by my watchers over a Period of time & would like to understand how many alerts f… --- ## [Kibana 7.0 and 7.8 : Date Histogram Auto interval does not appear for alias fields](https://discuss.elastic.co/t/kibana-7-0-and-7-8-date-histogram-auto-interval-does-not-appear-for-alias-fields/250452)
**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\ **Replies:** 4\ **Last updated:** [October 19, 2020, 5:12pm UTC](https://discuss.elastic.co/t/kibana-7-0-and-7-8-date-histogram-auto-interval-does-not-appear-for-alias-fields/250452 "2020-10-19T17:12:46Z")
Hi, In Visualisations, I have enabled alias fields for all data types, but if I select a date field alias in date histogram..auto interval does not come up..it looks like a bug to me, can anyone please look into it. T… --- ## [Edit index template settings](https://discuss.elastic.co/t/edit-index-template-settings/251142)
**Author:** [@mikejdunphy](https://discuss.elastic.co/u/mikejdunphy)\ **Replies:** 1\ **Last updated:** [October 19, 2020, 5:07pm UTC](https://discuss.elastic.co/t/edit-index-template-settings/251142 "2020-10-19T17:07:10Z")
so I have 2 indexes created everyday on my elkstack filebeat-%{\[@metadata\]\[version\]}-2020.10.03 filebeat-7.9.2-2020.10.03 the filebeat-7.9.2-2020.10.03 is from the elk server itself and the other is from filebeat fro… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1741) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1743)