# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1983 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1984 --- ## [Why I am getting this error when using JDBC input plugin of Logstash](https://discuss.elastic.co/t/why-i-am-getting-this-error-when-using-jdbc-input-plugin-of-logstash/237988)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 7\ **Last updated:** [June 22, 2020, 1:42pm UTC](https://discuss.elastic.co/t/why-i-am-getting-this-error-when-using-jdbc-input-plugin-of-logstash/237988 "2020-06-22T13:42:01Z")
Here is the query I had put in the logstash conf file: select a.ID, a.TransactionID, b.Result from MyDB.Result a inner join MyDB.ResultData b on a.ID=b.ID where a.ID \< :sql\_last\_value and a.CreatedOn \> '2020-01-01' o… --- ## [How to highlight the selected dashboard in a markdown](https://discuss.elastic.co/t/how-to-highlight-the-selected-dashboard-in-a-markdown/236331)
**Author:** [@Anirudhan](https://discuss.elastic.co/u/Anirudhan)\ **Replies:** 2\ **Last updated:** [June 22, 2020, 1:29pm UTC](https://discuss.elastic.co/t/how-to-highlight-the-selected-dashboard-in-a-markdown/236331 "2020-06-22T13:29:19Z")
In the markdown visualization have added 5 dashboards.Is there anyway to highlight which dashboard is selected.Please to help. --- ## [Elasticsearch index not created after adding logstash (works fine with filebeat -\> es)](https://discuss.elastic.co/t/elasticsearch-index-not-created-after-adding-logstash-works-fine-with-filebeat-es/237374)
**Author:** [@code\_share](https://discuss.elastic.co/u/code_share)\ **Replies:** 13\ **Last updated:** [June 22, 2020, 12:45pm UTC](https://discuss.elastic.co/t/elasticsearch-index-not-created-after-adding-logstash-works-fine-with-filebeat-es/237374 "2020-06-22T12:45:11Z")
I spin up an ELK stack using docker-compose (see below). I have manged to successfully enable basic authentication (using xpack + certs + built-in passwords) for the ES cluster and connect filebeat to the the ES cluster … --- ## [Syslog to different indexes](https://discuss.elastic.co/t/syslog-to-different-indexes/238050)
**Author:** [@arun\_k](https://discuss.elastic.co/u/arun_k)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 12:41pm UTC](https://discuss.elastic.co/t/syslog-to-different-indexes/238050 "2020-06-22T12:41:23Z")
Hi Team Am using filebeat to collect logs (mainly syslog) from multiple NW devices belongs to multiple tenants How can i configure logstash conf to index this to seperate indexes based on customers? Log source x,y(sys… --- ## [How to delete kibana.log](https://discuss.elastic.co/t/how-to-delete-kibana-log/238079)
**Author:** [@Burga](https://discuss.elastic.co/u/Burga)\ **Replies:** 2\ **Last updated:** [June 22, 2020, 12:35pm UTC](https://discuss.elastic.co/t/how-to-delete-kibana-log/238079 "2020-06-22T12:35:36Z")
Hi , my kibana.log is growing rapidly how can I delete it and create a new one , I tried to rename it but it kept growing ... Thanks in advance. --- ## [Winlogbeat not filtering event more than 21 sources](https://discuss.elastic.co/t/winlogbeat-not-filtering-event-more-than-21-sources/237740)
**Author:** [@kumarbn](https://discuss.elastic.co/u/kumarbn)\ **Replies:** 7\ **Last updated:** [June 22, 2020, 12:00pm UTC](https://discuss.elastic.co/t/winlogbeat-not-filtering-event-more-than-21-sources/237740 "2020-06-22T12:00:52Z")
unable to get alert on kafka if we mention more than 21 event source in winlogbeat yml file . --- ## [Kibana Static Lookup](https://discuss.elastic.co/t/kibana-static-lookup/236309)
**Author:** [@Anton91](https://discuss.elastic.co/u/Anton91)\ **Replies:** 8\ **Last updated:** [June 22, 2020, 11:57am UTC](https://discuss.elastic.co/t/kibana-static-lookup/236309 "2020-06-22T11:57:57Z")
Hello, I am faced with the following problem: I'm getting two fields A and B. For example, field A contains a 6 and field B should now contain Ethernet. Both fields are already stored in the index pattern and I have a… --- ## [Logststash](https://discuss.elastic.co/t/logststash/238080)
**Author:** [@Eryadav](https://discuss.elastic.co/u/Eryadav)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 11:55am UTC](https://discuss.elastic.co/t/logststash/238080 "2020-06-22T11:55:35Z")
i am using the docker compose to configure the logstash .but while i trying to mount the sincedb path of logstash in host container its not working if anyone can help me with this. \< - /opt/sanjay/logs/aartech:/usr/sha… --- ## [How to add the count of 2 values in logstash](https://discuss.elastic.co/t/how-to-add-the-count-of-2-values-in-logstash/238077)
**Author:** [@Matish\_Bhuyan](https://discuss.elastic.co/u/Matish_Bhuyan)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 11:43am UTC](https://discuss.elastic.co/t/how-to-add-the-count-of-2-values-in-logstash/238077 "2020-06-22T11:43:56Z")
Hi All, I have a requirement in logstash. For an example in fruits keyword i have 3 values 1- Mangoes ---- 5 2- Oranges -----6 3- Brinjal -----7 But in Kibana i need to visualize the sum of only 2 objects as… --- ## [How to parse this xml data each rate plan id data should go to new row or new column dynamically by using xml filter xpath option or any other solution let me know please (edited)](https://discuss.elastic.co/t/how-to-parse-this-xml-data-each-rate-plan-id-data-should-go-to-new-row-or-new-column-dynamically-by-using-xml-filter-xpath-option-or-any-other-solution-let-me-know-please-edited/238073)
**Author:** [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 11:30am UTC](https://discuss.elastic.co/t/how-to-parse-this-xml-data-each-rate-plan-id-data-should-go-to-new-row-or-new-column-dynamically-by-using-xml-filter-xpath-option-or-any-other-solution-let-me-know-please-edited/238073 "2020-06-22T11:30:04Z")
my logstash input { beats { port =\> 5044 } } filter { mutate { split =\> { "message" =\> "@$@" }} mutate { add\_field =\> { "response" =\> "%{\[message\]\[1\]}" "request" =\> "%{\[message\]\[0\]}" } } xml { store\_xml =\> "fa… --- ## [SAML settings on elasticsearch and kibana](https://discuss.elastic.co/t/saml-settings-on-elasticsearch-and-kibana/236158)
**Author:** [@Muhammad\_Umair\_Baig](https://discuss.elastic.co/u/Muhammad_Umair_Baig)\ **Replies:** 32\ **Last updated:** [June 22, 2020, 11:36am UTC](https://discuss.elastic.co/t/saml-settings-on-elasticsearch-and-kibana/236158 "2020-06-22T11:36:42Z")
Hi Guys, i am using kibana and elasticsearch version 7.6.2 free version and trying to enable SAML 2.0 on elasticsearch and kibana. Mentioned below are the configuration files that i am using: elasticsearch log trace: \[… --- ## [Lens description not displayed](https://discuss.elastic.co/t/lens-description-not-displayed/238060)
**Author:** [@artobstrel](https://discuss.elastic.co/u/artobstrel)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 11:36am UTC](https://discuss.elastic.co/t/lens-description-not-displayed/238060 "2020-06-22T11:36:12Z")
"Lens" and "Metric" dashlets has "Description" field, but only the Metric description is displayed. How to fix it? --- ## [Elasticsearch input missing logs](https://discuss.elastic.co/t/elasticsearch-input-missing-logs/238071)
**Author:** [@magnalite](https://discuss.elastic.co/u/magnalite)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 11:06am UTC](https://discuss.elastic.co/t/elasticsearch-input-missing-logs/238071 "2020-06-22T11:06:17Z")
I'm using the Elasticsearch input plugin to reindex through a Logstash pipeline however it appears as though it is mysteriously skipping ~20% of logs! I do not terminate the process myself and wait for it to come to comp… --- ## [Fastest way to restore ElasticSearch snapshot](https://discuss.elastic.co/t/fastest-way-to-restore-elasticsearch-snapshot/236572)
**Author:** [@bhuvaneshdct](https://discuss.elastic.co/u/bhuvaneshdct)\ **Replies:** 2\ **Last updated:** [June 22, 2020, 11:04am UTC](https://discuss.elastic.co/t/fastest-way-to-restore-elasticsearch-snapshot/236572 "2020-06-22T11:04:34Z")
I have 2 node elasticsearch cluster version 7.4. CPU 32 Memory 250G Disk IOPS 50K IOPS (SSD) Heap 32GB Snapshot size 3TB since its a bigger instance, how to change the config files to restore the snapshot in the faste… --- ## [FQDN for whitelisting in firewall for pulling filebeat docker image](https://discuss.elastic.co/t/fqdn-for-whitelisting-in-firewall-for-pulling-filebeat-docker-image/238069)
**Author:** [@manav](https://discuss.elastic.co/u/manav)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 10:55am UTC](https://discuss.elastic.co/t/fqdn-for-whitelisting-in-firewall-for-pulling-filebeat-docker-image/238069 "2020-06-22T10:55:02Z")
Hi All, I'm trying to deploy filebeat docker image in an network restricting egress traffic. The outbound traffic of the network is locked down to only allowed domains. I'm going to pull filebeat docker official reposi… --- ## [Problems with FileBeat and FreeBSD](https://discuss.elastic.co/t/problems-with-filebeat-and-freebsd/238067)
**Author:** [@daniel.valle](https://discuss.elastic.co/u/daniel.valle)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 10:44am UTC](https://discuss.elastic.co/t/problems-with-filebeat-and-freebsd/238067 "2020-06-22T10:44:15Z")
I am encountering a problem in the filebeat setup for our Elastic Cloud system. This is our scenario: We have a FreeBSD server where several applications are installed. Each application generates a set of log files. W… --- ## [How to debug elasticsearch logstash ingestion pipelines](https://discuss.elastic.co/t/how-to-debug-elasticsearch-logstash-ingestion-pipelines/237618)
**Author:** [@genehunter29009](https://discuss.elastic.co/u/genehunter29009)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 10:28am UTC](https://discuss.elastic.co/t/how-to-debug-elasticsearch-logstash-ingestion-pipelines/237618 "2020-06-22T10:28:57Z")
Trying to use the pipelines in a beats config on logstash. The issue is its not seeing the pipeline so the data is going straight into the index unprocessed. I am sure something is wrong with the code that builds the pip… --- ## [Terms aggregation on a nested field for calculating stats based on a parent-field](https://discuss.elastic.co/t/terms-aggregation-on-a-nested-field-for-calculating-stats-based-on-a-parent-field/237932)
**Author:** [@Andy1990](https://discuss.elastic.co/u/Andy1990)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 10:01am UTC](https://discuss.elastic.co/t/terms-aggregation-on-a-nested-field-for-calculating-stats-based-on-a-parent-field/237932 "2020-06-22T10:01:58Z")
Hello, in my use case i have documents with a client and a price. The client is a nested object (containing id, and acronym), the price is on the first json level of my source). I would like to calculate metric values (… --- ## [Filebeat doesn't bring me all the logs i need](https://discuss.elastic.co/t/filebeat-doesnt-bring-me-all-the-logs-i-need/236698)
**Author:** [@Alexandros888](https://discuss.elastic.co/u/Alexandros888)\ **Replies:** 3\ **Last updated:** [June 22, 2020, 9:37am UTC](https://discuss.elastic.co/t/filebeat-doesnt-bring-me-all-the-logs-i-need/236698 "2020-06-22T09:37:25Z")
Hello, I have filebeat and ELK version 7.7.0 I successfully enabled the Elasticsearch module of Filebeat and i can see server and gc logs now in kibana. Nevertheless i cant see in kibana my gc, audit and deprecation … --- ## [After upgrading logstash to 6.6, I get failed authentication due to: SSL handshake failed](https://discuss.elastic.co/t/after-upgrading-logstash-to-6-6-i-get-failed-authentication-due-to-ssl-handshake-failed/238052)
**Author:** [@Zalman\_Goldstein1](https://discuss.elastic.co/u/Zalman_Goldstein1)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 9:27am UTC](https://discuss.elastic.co/t/after-upgrading-logstash-to-6-6-i-get-failed-authentication-due-to-ssl-handshake-failed/238052 "2020-06-22T09:27:58Z")
we have kafka\_2.12-2.3.0, and use logstash. after upgrading to logstash version 6.6, and plugin 7.3.2 logstash-output-kafka, we got an error of The setting ssl in plugin kafka is obsolete and is no longer available. … --- ## [Filter ruby exception occurred with no message](https://discuss.elastic.co/t/filter-ruby-exception-occurred-with-no-message/238051)
**Author:** [@sam\_rui](https://discuss.elastic.co/u/sam_rui)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 9:24am UTC](https://discuss.elastic.co/t/filter-ruby-exception-occurred-with-no-message/238051 "2020-06-22T09:24:35Z")
I encountered same issue with https://discuss.elastic.co/t/ruby-exception-with-no-message/198887. following is logstash log info. following is configuration info. When I get output, the "index\_postfix" can not b… --- ## [Bar chart percentage not working](https://discuss.elastic.co/t/bar-chart-percentage-not-working/237525)
**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\ **Replies:** 4\ **Last updated:** [June 22, 2020, 9:15am UTC](https://discuss.elastic.co/t/bar-chart-percentage-not-working/237525 "2020-06-22T09:15:32Z")
all values seem to be one hundred percent. instead this is the way I want. --- ## [Aggregations & or query](https://discuss.elastic.co/t/aggregations-or-query/237784)
**Author:** [@gbu](https://discuss.elastic.co/u/gbu)\ **Replies:** 2\ **Last updated:** [June 22, 2020, 9:01am UTC](https://discuss.elastic.co/t/aggregations-or-query/237784 "2020-06-22T09:01:17Z")
Hi, { 'id': 1, 'productType': 'a'} { 'id': 2, 'productType': 'b'} { 'id': 3, 'productType': 'c'} we are doing a query with aggregations like { "aggs": { "productType": { … --- ## [/usr/share/elasticsearch/tmp\] does not exist](https://discuss.elastic.co/t/usr-share-elasticsearch-tmp-does-not-exist/238046)
**Author:** [@Matt\_Ayres](https://discuss.elastic.co/u/Matt_Ayres)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 8:56am UTC](https://discuss.elastic.co/t/usr-share-elasticsearch-tmp-does-not-exist/238046 "2020-06-22T08:56:48Z")
Hi GUys after downloading the latest rpm and and installing for the first time I am getting this error in the logs: Jun 22 09:47:31 ssd316r.simpleservers.co.uk systemd\[1\]: Starting Elasticsearch... Jun 22 09:47:32 ssd31… --- ## [SAP .AUD log parsin](https://discuss.elastic.co/t/sap-aud-log-parsin/238041)
**Author:** [@yasin\_mohammed](https://discuss.elastic.co/u/yasin_mohammed)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 8:36am UTC](https://discuss.elastic.co/t/sap-aud-log-parsin/238041 "2020-06-22T08:36:49Z")
Hi... I am trying to parse a .AUD log file of SAP through logstash. The log is in binary. Any clues on what is the encoding to use for SAP .AUD files to read them in logstash. --- ## [Elasticsearch as primary datastore for chat application](https://discuss.elastic.co/t/elasticsearch-as-primary-datastore-for-chat-application/238014)
**Author:** [@Deshmukhm](https://discuss.elastic.co/u/Deshmukhm)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 8:29am UTC](https://discuss.elastic.co/t/elasticsearch-as-primary-datastore-for-chat-application/238014 "2020-06-22T08:29:56Z")
As per various articles to choose elasticsearch as a primary datasource is solely depends on the usecase. So if I want to implement chat application similar to Microsoft teams or any, Will it be a good idea to use it as … --- ## [Problem beetween elastic and logstash: csv files are saved twice](https://discuss.elastic.co/t/problem-beetween-elastic-and-logstash-csv-files-are-saved-twice/236655)
**Author:** [@IneedHelp](https://discuss.elastic.co/u/IneedHelp)\ **Replies:** 5\ **Last updated:** [June 22, 2020, 8:27am UTC](https://discuss.elastic.co/t/problem-beetween-elastic-and-logstash-csv-files-are-saved-twice/236655 "2020-06-22T08:27:13Z")
Hello ! I use ELK to parse log file and csv file but yesterday a little problem appeared. All the data in my csv file were saved twice so a 1000 lines document is now a 2000 lines document. In fact you just have to divi… --- ## [Filebeat how to autodiscover kubernetes service and fetch pod log?](https://discuss.elastic.co/t/filebeat-how-to-autodiscover-kubernetes-service-and-fetch-pod-log/237997)
**Author:** [@chanjarster](https://discuss.elastic.co/u/chanjarster)\ **Replies:** 3\ **Last updated:** [June 22, 2020, 8:18am UTC](https://discuss.elastic.co/t/filebeat-how-to-autodiscover-kubernetes-service-and-fetch-pod-log/237997 "2020-06-22T08:18:21Z")
I've deploy filebeat on kubernetes cluster following the doc. And set resource: service in the config file: filebeat.autodiscover: providers: - type: kubernetes resource: service no… --- ## [Fatal error: \[config validation of server.uuid\]: must be a valid uuid](https://discuss.elastic.co/t/fatal-error-config-validation-of-server-uuid-must-be-a-valid-uuid/237866)
**Author:** [@pr0b3l](https://discuss.elastic.co/u/pr0b3l)\ **Replies:** 1\ **Last updated:** [June 22, 2020, 8:11am UTC](https://discuss.elastic.co/t/fatal-error-config-validation-of-server-uuid-must-be-a-valid-uuid/237866 "2020-06-22T08:11:06Z")
Hello guys! I setup prod.server (7.6 version all stack): Using Kibana in a production environment | Kibana Guide \[7.6\] | Elastic Settings unique across each Kibana instance: server.uuid server.name server.uuid in … --- ## [Cross Cluster Search in kubernetes clusters](https://discuss.elastic.co/t/cross-cluster-search-in-kubernetes-clusters/238035)
**Author:** [@a3984](https://discuss.elastic.co/u/a3984)\ **Replies:** 0\ **Last updated:** [June 22, 2020, 8:10am UTC](https://discuss.elastic.co/t/cross-cluster-search-in-kubernetes-clusters/238035 "2020-06-22T08:10:18Z")
We have 2 kubernetes clusters each with fluentd/elasticsearch/kibana in it but we would like to pool this data together into a single kibana UI for investigations etc... Am I right in thinking that I would need to have a… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1982) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1984)