# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1711 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1712 --- ## [Can filebeat.autodiscover load external configuration files, like inputs and modules can?](https://discuss.elastic.co/t/can-filebeat-autodiscover-load-external-configuration-files-like-inputs-and-modules-can/254546)
**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 5:12pm UTC](https://discuss.elastic.co/t/can-filebeat-autodiscover-load-external-configuration-files-like-inputs-and-modules-can/254546 "2020-11-06T17:12:40Z")
Title says it all. Filebeat has the capability to load external configuration files for inputs and modules, which is documented here. Does this capability also exist for autodiscover configurations? I suspect the answe… --- ## [Fleet and Elastic-Agent Installed but No Dataset](https://discuss.elastic.co/t/fleet-and-elastic-agent-installed-but-no-dataset/253462)
**Author:** [@rudyamid](https://discuss.elastic.co/u/rudyamid)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 5:33pm UTC](https://discuss.elastic.co/t/fleet-and-elastic-agent-installed-but-no-dataset/253462 "2020-11-06T17:33:59Z")
I've installed a fresh version (clean filesystem) of Elasticsearch 7.9.2 in Docker environment as outlined here: https://www.elastic.co/guide/en/elastic-stack-get-started/7.9/get-started-docker.html#get-started-docker-tl… --- ## [Who is client for kibana?](https://discuss.elastic.co/t/who-is-client-for-kibana/254309)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 4\ **Last updated:** [November 6, 2020, 5:33pm UTC](https://discuss.elastic.co/t/who-is-client-for-kibana/254309 "2020-11-06T17:33:01Z")
What is request in kibana i mean who requesting the kibana is it the elasticsearch ? and kibana is showing 3 connections i open only one kibana in web browser please tell me what it is all these --- ## [Kubernetes metadata missing with add\_kubernetes\_metadata enabled](https://discuss.elastic.co/t/kubernetes-metadata-missing-with-add-kubernetes-metadata-enabled/254314)
**Author:** [@xsb](https://discuss.elastic.co/u/xsb)\ **Replies:** 6\ **Last updated:** [November 6, 2020, 4:48pm UTC](https://discuss.elastic.co/t/kubernetes-metadata-missing-with-add-kubernetes-metadata-enabled/254314 "2020-11-06T16:48:12Z")
Hello, I am trying to enable add\_kubernetes\_metadata to an ECK setup with no luck. My ECK has a Beats resource that manages a filebeat DaemonSet, it's all pretty standard as I've been mostly copying the config from the… --- ## [Filebeat- syntax for regex file exclusion](https://discuss.elastic.co/t/filebeat-syntax-for-regex-file-exclusion/254452)
**Author:** [@txmrlevine](https://discuss.elastic.co/u/txmrlevine)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 4:46pm UTC](https://discuss.elastic.co/t/filebeat-syntax-for-regex-file-exclusion/254452 "2020-11-06T16:46:27Z")
I am having issues figuring out the syntax for excluding a list of files in a directory. They all come or none come. Here is the file listing in the directory I am pushing. total 232676 drwxr-xr-x 6 deploy deploy … --- ## [User Mgmt Role](https://discuss.elastic.co/t/user-mgmt-role/254311)
**Author:** [@teej](https://discuss.elastic.co/u/teej)\ **Replies:** 3\ **Last updated:** [November 6, 2020, 4:43pm UTC](https://discuss.elastic.co/t/user-mgmt-role/254311 "2020-11-06T16:43:45Z")
Hi, Is there a way to create a user that can manage (e.g. Create, Delete) user accounts and nothing else? --- ## [SAML & Kibana](https://discuss.elastic.co/t/saml-kibana/254467)
**Author:** [@teej](https://discuss.elastic.co/u/teej)\ **Replies:** 6\ **Last updated:** [November 6, 2020, 4:39pm UTC](https://discuss.elastic.co/t/saml-kibana/254467 "2020-11-06T16:39:53Z")
Hi, I was curious to understand...When using saml, do you have to create the users locally? Or does the saml mechanism fetch the users based on credentials? I inherited a system in which saml is used but it has all the … --- ## [Distribution of ElasticSearch](https://discuss.elastic.co/t/distribution-of-elasticsearch/254500)
**Author:** [@Anik\_Saha](https://discuss.elastic.co/u/Anik_Saha)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 4:28pm UTC](https://discuss.elastic.co/t/distribution-of-elasticsearch/254500 "2020-11-06T16:28:20Z")
Is it allowed to distribute ElasticSearch as a part of an application? --- ## [Pagination for Nested Objects?](https://discuss.elastic.co/t/pagination-for-nested-objects/254552)
**Author:** [@mobeit00](https://discuss.elastic.co/u/mobeit00)\ **Replies:** 0\ **Last updated:** [November 6, 2020, 3:55pm UTC](https://discuss.elastic.co/t/pagination-for-nested-objects/254552 "2020-11-06T15:55:24Z")
I currently have an array of objects in my Elasticsearch. Currently I only have one filter on the name and I load all objects from the Elasticsearch and process them later in the application. Now I have too much data in … --- ## [Don't see logs in kibana stack montoring](https://discuss.elastic.co/t/dont-see-logs-in-kibana-stack-montoring/254433)
**Author:** [@JC83](https://discuss.elastic.co/u/JC83)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 3:51pm UTC](https://discuss.elastic.co/t/dont-see-logs-in-kibana-stack-montoring/254433 "2020-11-06T15:51:02Z")
No structured logs found Check if the var.paths setting \[points to JSON logs\] Here is my elasticsearch.yml (Filebeat -elasticsearch Module) - module: elasticsearch # Server log server: enabled: true # Set… --- ## [Remove a pattern from json nested fields](https://discuss.elastic.co/t/remove-a-pattern-from-json-nested-fields/254542)
**Author:** [@nilubkal](https://discuss.elastic.co/u/nilubkal)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 3:42pm UTC](https://discuss.elastic.co/t/remove-a-pattern-from-json-nested-fields/254542 "2020-11-06T15:42:57Z")
Hey guys, i have the following json structure which i would like to rename from : json.detail.info.processed\_event.instance\_id json.detail.info.processed\_event.invalidations.metadata json.detail.info.p… --- ## [What backend to use for EUI library?](https://discuss.elastic.co/t/what-backend-to-use-for-eui-library/254547)
**Author:** [@spyderman4g63](https://discuss.elastic.co/u/spyderman4g63)\ **Replies:** 0\ **Last updated:** [November 6, 2020, 3:18pm UTC](https://discuss.elastic.co/t/what-backend-to-use-for-eui-library/254547 "2020-11-06T15:18:38Z")
The EUI react.js library looks very interesting. I'd like to experiment with it but I can't find any examples of the backend code people are using to connect to elasticsearch. Is there any recommendation for this? --- ## [Control timeline of Line Visualization in Dashboard](https://discuss.elastic.co/t/control-timeline-of-line-visualization-in-dashboard/254539)
**Author:** [@Agenobarb](https://discuss.elastic.co/u/Agenobarb)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 3:14pm UTC](https://discuss.elastic.co/t/control-timeline-of-line-visualization-in-dashboard/254539 "2020-11-06T15:14:44Z")
I'd like my Line chart to follow time interval setting on the upper right of the Dashboard. However, when I configure visualization I can't keep the default 'auto' for Minimum interval - getting error. Can I do somethin… --- ## [Logstash doesn't process some logs](https://discuss.elastic.co/t/logstash-doesnt-process-some-logs/254436)
**Author:** [@pab1it0](https://discuss.elastic.co/u/pab1it0)\ **Replies:** 3\ **Last updated:** [November 6, 2020, 3:07pm UTC](https://discuss.elastic.co/t/logstash-doesnt-process-some-logs/254436 "2020-11-06T15:07:29Z")
Hi, I've encountered an issue where only a subset of the logs are being processed via ELK stack: Digesting logs from k8s pods using kubernetes Hints based autodiscover with logstash. Pod annotations: annotations: … --- ## [Problems with visualizing a co-occurrence matrix in Kibana](https://discuss.elastic.co/t/problems-with-visualizing-a-co-occurrence-matrix-in-kibana/254403)
**Author:** [@Matthew\_1979](https://discuss.elastic.co/u/Matthew_1979)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 3:04pm UTC](https://discuss.elastic.co/t/problems-with-visualizing-a-co-occurrence-matrix-in-kibana/254403 "2020-11-06T15:04:36Z")
Hello everyone, I am trying to visualize a co-occurrence matrix. This matrix consists of two lists with terms (list1: n\_columns & list2: n\_rows). The data itself shows the article identifiers in which the terms co-occur… --- ## [Filebeat fields](https://discuss.elastic.co/t/filebeat-fields/254507)
**Author:** [@alfredo.deluca](https://discuss.elastic.co/u/alfredo.deluca)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 2:30pm UTC](https://discuss.elastic.co/t/filebeat-fields/254507 "2020-11-06T14:30:07Z")
Hi all. I am testing filebeat on a minikube where I have a few pods and I send the logs to a local logstah and its job is to forward the logs to Elastic/kibana node on AWS. I can see some fields in the logs like host.i… --- ## [Soft\_deletes enabled maybe slow down the index performance](https://discuss.elastic.co/t/soft-deletes-enabled-maybe-slow-down-the-index-performance/254520)
**Author:** [@hackerwin7](https://discuss.elastic.co/u/hackerwin7)\ **Replies:** 6\ **Last updated:** [November 6, 2020, 2:28pm UTC](https://discuss.elastic.co/t/soft-deletes-enabled-maybe-slow-down-the-index-performance/254520 "2020-11-06T14:28:32Z")
Hi, Our elasticsearch is on 6.8.0 when we use soft\_delete is enabled, we find that the index which indexing requests is mainly updates, so the segments bytes grow up more and more bigger, and docs.deleted count is more… --- ## [Create an alert based on contradicting logs](https://discuss.elastic.co/t/create-an-alert-based-on-contradicting-logs/253050)
**Author:** [@mimoo](https://discuss.elastic.co/u/mimoo)\ **Replies:** 4\ **Last updated:** [November 6, 2020, 2:13pm UTC](https://discuss.elastic.co/t/create-an-alert-based-on-contradicting-logs/253050 "2020-11-06T14:13:58Z")
Hello, I am trying to figure out alerts, and if Kibana is the best place to setup these alerts, or if it'd be better for me to write a program that queries elastic search instead. I'm in a situation where I log tuples … --- ## [Filebeat puts all logs in only one index](https://discuss.elastic.co/t/filebeat-puts-all-logs-in-only-one-index/254386)
**Author:** [@yukpun](https://discuss.elastic.co/u/yukpun)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 2:12pm UTC](https://discuss.elastic.co/t/filebeat-puts-all-logs-in-only-one-index/254386 "2020-11-06T14:12:51Z")
I have server with nginx running on. I'm trying to make filebeat installed on this server to send logs to elasticsearch directly. It sends logs, but however puts in "common" index filebeat-7.9.3-2020.11.04-000001 Here i… --- ## [Max\_open\_scroll\_context, scroll\_ids, and shards](https://discuss.elastic.co/t/max-open-scroll-context-scroll-ids-and-shards/253872)
**Author:** [@Michael\_Cayanan](https://discuss.elastic.co/u/Michael_Cayanan)\ **Replies:** 3\ **Last updated:** [November 6, 2020, 1:39pm UTC](https://discuss.elastic.co/t/max-open-scroll-context-scroll-ids-and-shards/253872 "2020-11-06T13:39:03Z")
Hi. I'm making a query across several indices with 8 shards per index. To be specific it ends up being about 752 shards in total. When I make a scroll query, I initially get that Trying to create too many scroll contex… --- ## [Kibana : The connection has timed out when trying to connect](https://discuss.elastic.co/t/kibana-the-connection-has-timed-out-when-trying-to-connect/254454)
**Author:** [@hyochang](https://discuss.elastic.co/u/hyochang)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 1:36pm UTC](https://discuss.elastic.co/t/kibana-the-connection-has-timed-out-when-trying-to-connect/254454 "2020-11-06T13:36:18Z")
Hi, I am trying elastic cloud deployment, and have created a 14-day trial one. When trying to connect Kibana from the service main UI, I am getting timed-out error. I am not sure where to look at for a troubleshootin… --- ## [org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?)](https://discuss.elastic.co/t/org-apache-lucene-index-corruptindexexception-codec-footer-mismatch-file-truncated/254517)
**Author:** [@Tin\_Deng](https://discuss.elastic.co/u/Tin_Deng)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 1:34pm UTC](https://discuss.elastic.co/t/org-apache-lucene-index-corruptindexexception-codec-footer-mismatch-file-truncated/254517 "2020-11-06T13:34:38Z")
ES version: 5.6.8 1 master, 3 data nodes, replica = 0 Hi everyone, I was wondering if it's possible to recover the data with the exception in this case? Caused by: org.elasticsearch.gateway.CorruptStateException: org… --- ## [Ingesting/appending pandas dataframe to same index everyday](https://discuss.elastic.co/t/ingesting-appending-pandas-dataframe-to-same-index-everyday/254532)
**Author:** [@aditya5](https://discuss.elastic.co/u/aditya5)\ **Replies:** 1\ **Last updated:** [November 6, 2020, 1:32pm UTC](https://discuss.elastic.co/t/ingesting-appending-pandas-dataframe-to-same-index-everyday/254532 "2020-11-06T13:32:53Z")
I want to append data to same ES index from dataframe every day. Please let me know if its possible ? If yes how? --- ## [Some Change in Percolation/QueryStringQuery/Mapping between 7.6.2 and 7.7.0?](https://discuss.elastic.co/t/some-change-in-percolation-querystringquery-mapping-between-7-6-2-and-7-7-0/250579)
**Author:** [@Andrew\_DS](https://discuss.elastic.co/u/Andrew_DS)\ **Replies:** 4\ **Last updated:** [November 6, 2020, 1:31pm UTC](https://discuss.elastic.co/t/some-change-in-percolation-querystringquery-mapping-between-7-6-2-and-7-7-0/250579 "2020-11-06T13:31:15Z")
I've noticed that, while trying to migrate from Elasticsearch 7.5.2 -\> 7.9.2, something seems to have changed in how percolator queries seem to work. I have narrowed down my problem to a change between 7.6.2 and 7.7.0; t… --- ## [Logstash shutdown after startup](https://discuss.elastic.co/t/logstash-shutdown-after-startup/254530)
**Author:** [@boernd](https://discuss.elastic.co/u/boernd)\ **Replies:** 0\ **Last updated:** [November 6, 2020, 1:22pm UTC](https://discuss.elastic.co/t/logstash-shutdown-after-startup/254530 "2020-11-06T13:22:47Z")
Hi, Version: 7.8.1 Plattform: OpenShift 3.11 Sometimes during Logstash pod startups it happens that the container restarts after startup. We use the monitoring feature and the logs indicate that there is some problem … --- ## [Kibana outlook alert doesn't work](https://discuss.elastic.co/t/kibana-outlook-alert-doesnt-work/254529)
**Author:** [@TomChv](https://discuss.elastic.co/u/TomChv)\ **Replies:** 0\ **Last updated:** [November 6, 2020, 1:21pm UTC](https://discuss.elastic.co/t/kibana-outlook-alert-doesnt-work/254529 "2020-11-06T13:21:22Z")
Hi everybody, I'm sorry for that newbie question, I'm new on elastic... I would like to setup an email alert when I have some logs with error level.. I've successfully setup the event, I can see my alert been triggere… --- ## [Session expires very fast](https://discuss.elastic.co/t/session-expires-very-fast/254446)
**Author:** [@cdy5159](https://discuss.elastic.co/u/cdy5159)\ **Replies:** 7\ **Last updated:** [November 6, 2020, 1:09pm UTC](https://discuss.elastic.co/t/session-expires-very-fast/254446 "2020-11-06T13:09:54Z")
Ever since I upgraded to version 7.X, my session will expire even though I'm working in Kibana. It could happen anytime for seemingly no reason. Is there some timeout config that is causing this? --- ## [Metricbeat MSSQL DB connection](https://discuss.elastic.co/t/metricbeat-mssql-db-connection/252519)
**Author:** [@kavi\_anand](https://discuss.elastic.co/u/kavi_anand)\ **Replies:** 2\ **Last updated:** [November 6, 2020, 12:25pm UTC](https://discuss.elastic.co/t/metricbeat-mssql-db-connection/252519 "2020-11-06T12:25:18Z")
I need to monitor particular a DB in MSSQL server, Is there any way to specify the DB name in MSSQL module itself --- ## [Creating Single URL for multiple Kibana URL](https://discuss.elastic.co/t/creating-single-url-for-multiple-kibana-url/254525)
**Author:** [@ksaha](https://discuss.elastic.co/u/ksaha)\ **Replies:** 4\ **Last updated:** [November 6, 2020, 12:53pm UTC](https://discuss.elastic.co/t/creating-single-url-for-multiple-kibana-url/254525 "2020-11-06T12:53:45Z")
Hi, I have a ELK stack with 2 Logstash server, 3 node Elasticsearch cluster and 2 Kibana server (considering High Availability). Due to two Kibana instance we have two Kibana URL. Both the Kibana URL is working. Can I h… --- ## [Erally stuck while running against already existing cluster](https://discuss.elastic.co/t/erally-stuck-while-running-against-already-existing-cluster/254415)
**Author:** [@juriskr](https://discuss.elastic.co/u/juriskr)\ **Replies:** 5\ **Last updated:** [November 6, 2020, 12:25pm UTC](https://discuss.elastic.co/t/erally-stuck-while-running-against-already-existing-cluster/254415 "2020-11-06T12:25:23Z")
I'm trying to start erally using docker based installation and the following command: docker run elastic/rally --track=nyc\_taxis --test-mode --pipeline=benchmark-only --target-hosts=, got the following output and then e… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1710) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1712)