# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1318 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1319 --- ## [I'm not able to see logs in \[Filebeat Logstash\] Logstash Logs ECS dashboard](https://discuss.elastic.co/t/im-not-able-to-see-logs-in-filebeat-logstash-logstash-logs-ecs-dashboard/241961)
**Author:** [@Bhavin\_Varsur](https://discuss.elastic.co/u/Bhavin_Varsur)\ **Replies:** 1\ **Last updated:** [July 23, 2020, 12:41am UTC](https://discuss.elastic.co/t/im-not-able-to-see-logs-in-filebeat-logstash-logstash-logs-ecs-dashboard/241961 "2020-07-23T00:41:08Z")
I installed both filebeat and logstash. i aslo create a pipeline in logstash which is input data from beats and output to elasticsearch. when i run pipeline the logs are succesfully index in logstash.index pattern cre… --- ## [Trying to create an index template to create a data stream](https://discuss.elastic.co/t/trying-to-create-an-index-template-to-create-a-data-stream/242089)
**Author:** [@randoran](https://discuss.elastic.co/u/randoran)\ **Replies:** 3\ **Last updated:** [July 22, 2020, 11:35pm UTC](https://discuss.elastic.co/t/trying-to-create-an-index-template-to-create-a-data-stream/242089 "2020-07-22T23:35:51Z")
I'm attempting to follow this tutorial https://www.elastic.co/guide/en/elasticsearch/reference/7.x/getting-started-index-lifecycle-management.html And I am at the point where it says to Create an index template PUT \_i… --- ## [Cleanup: How to delete unused saved searches, visualizations and dashboards?](https://discuss.elastic.co/t/cleanup-how-to-delete-unused-saved-searches-visualizations-and-dashboards/242232)
**Author:** [@igorgatis](https://discuss.elastic.co/u/igorgatis)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 11:21pm UTC](https://discuss.elastic.co/t/cleanup-how-to-delete-unused-saved-searches-visualizations-and-dashboards/242232 "2020-07-22T23:21:36Z")
We've been using Kibana in production for a while now and we accumulated saved searches, visualizations and dashboards we're not used are actually being in use. Is there a way to figure out which saved objects are used … --- ## [Handling exception from HTTP logstash 6.8](https://discuss.elastic.co/t/handling-exception-from-http-logstash-6-8/242259)
**Author:** [@pvaithee07](https://discuss.elastic.co/u/pvaithee07)\ **Replies:** 4\ **Last updated:** [July 22, 2020, 11:18pm UTC](https://discuss.elastic.co/t/handling-exception-from-http-logstash-6-8/242259 "2020-07-22T23:18:17Z")
Hello - I am trying to handle exception in my logstash after HTTP filter plugin. I am using Logstash version 6.8. I have couple of question on this - How to handle exception if the HTTP response code is other than 200… --- ## [Not able to get the CSV values in the filter columns](https://discuss.elastic.co/t/not-able-to-get-the-csv-values-in-the-filter-columns/242263)
**Author:** [@Harshil\_Narielwala](https://discuss.elastic.co/u/Harshil_Narielwala)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 10:40pm UTC](https://discuss.elastic.co/t/not-able-to-get-the-csv-values-in-the-filter-columns/242263 "2020-07-22T22:40:26Z")
My logstash configuration is as below : input { beats { port =\> "5044" } } filter { csv { columns =\> \["REQUEST\_ID","SERVICE\_NAME","OPERATION\_NAME","OPERATION\_TYPE","REQUEST\_PAYLOAD","LOGGED\_BY","LOGGED\_ON"\] } } … --- ## [Kibana Uptime- Internal Server Error](https://discuss.elastic.co/t/kibana-uptime-internal-server-error/242070)
**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\ **Replies:** 3\ **Last updated:** [July 22, 2020, 7:29pm UTC](https://discuss.elastic.co/t/kibana-uptime-internal-server-error/242070 "2020-07-22T19:29:09Z")
ELK-Stack Version: 7.8 Installed and configured Heartbeat agent on a linux server and the ping/logs are being ingested into elasticsearch. I do see the logs being populated under "heartbeat-7\*" index But when I visit u… --- ## [Logstash config: Elastic search indices not being properly populated from multiple http\_poller inputs](https://discuss.elastic.co/t/logstash-config-elastic-search-indices-not-being-properly-populated-from-multiple-http-poller-inputs/241929)
**Author:** [@AnEpicK9](https://discuss.elastic.co/u/AnEpicK9)\ **Replies:** 8\ **Last updated:** [July 22, 2020, 7:25pm UTC](https://discuss.elastic.co/t/logstash-config-elastic-search-indices-not-being-properly-populated-from-multiple-http-poller-inputs/241929 "2020-07-22T19:25:07Z")
Currently, I have two http\_poller input blocks with a url for a live and backup instance of our app in my logstash config. What I'm then doing is I'm trying to output to two different elastic search indices: logstash\_pol… --- ## [Auto\_flush\_interval is invalid with Logstash 7.5.1](https://discuss.elastic.co/t/auto-flush-interval-is-invalid-with-logstash-7-5-1/242057)
**Author:** [@thanhlam](https://discuss.elastic.co/u/thanhlam)\ **Replies:** 16\ **Last updated:** [July 22, 2020, 7:09pm UTC](https://discuss.elastic.co/t/auto-flush-interval-is-invalid-with-logstash-7-5-1/242057 "2020-07-22T19:09:53Z")
Hello, I've been running Logstash 7.5.1 on IBM Power systems for a couple of months. But, the last time I restarted Logstash, it kept shutdown and restarting. So I run it with config.debug = true log.level: trace and … --- ## [Pipeline not discovering with correct paths](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243)
**Author:** [@mattr](https://discuss.elastic.co/u/mattr)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 6:26pm UTC](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243 "2020-07-22T18:26:35Z")
I am having trouble with the logstash pipeline. I've had the pipeline working with the exact same settings on a different server. The config works when I run it manually using the command line command. The discoverer d… --- ## [Timestamp conversion](https://discuss.elastic.co/t/timestamp-conversion/242136)
**Author:** [@ishank](https://discuss.elastic.co/u/ishank)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 5:37pm UTC](https://discuss.elastic.co/t/timestamp-conversion/242136 "2020-07-22T17:37:57Z")
Hi The data in my csv file is having the timestamp in format: 2019-04-11 12:00 AM (There are 3 spaces between the date & time) My logstash configuration for same: filter{ date { match =\> \["Time", "yyyy-MM-… --- ## [Добавление новых нод в кластер с настроенным security](https://discuss.elastic.co/t/security/241172)
**Author:** [@Sergei\_Frolov](https://discuss.elastic.co/u/Sergei_Frolov)\ **Replies:** 10\ **Last updated:** [July 22, 2020, 4:53pm UTC](https://discuss.elastic.co/t/security/241172 "2020-07-22T16:53:35Z")
Добрый день! Есть кластер из 8 нод (5 дата-нод, 3 мастер-ноды). Появилась необходимость добавить еще 5 дата-нод. Security настраивал по инструкции, сертификаты генерил так: elasticsearch-certutil cert ca --pem --in in… --- ## [Ошибка "all shards failed - Task cancelled before it started: channel closed"](https://discuss.elastic.co/t/all-shards-failed-task-cancelled-before-it-started-channel-closed/242199)
**Author:** [@Sergei\_Frolov](https://discuss.elastic.co/u/Sergei_Frolov)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 4:20pm UTC](https://discuss.elastic.co/t/all-shards-failed-task-cancelled-before-it-started-channel-closed/242199 "2020-07-22T16:20:46Z")
Добрый день! В логах наблюдаю ошибку временами: \[2020-07-22T16:00:15,317\]\[WARN \]\[r.suppressed \] \[wss-es-data5a.blabla\] path: /indexname/\_search, params: {pretty=true, index=indexname} org.elasticsearch.acti… --- ## [Problem ingesting vpc flow logs](https://discuss.elastic.co/t/problem-ingesting-vpc-flow-logs/239172)
**Author:** [@andywt123](https://discuss.elastic.co/u/andywt123)\ **Replies:** 4\ **Last updated:** [July 22, 2020, 3:12pm UTC](https://discuss.elastic.co/t/problem-ingesting-vpc-flow-logs/239172 "2020-07-22T15:12:29Z")
We are using filebeat 7.6.2 to ingest vpc flow logs. IT appears that it is taking longer then 24 hours for the vpc flow logs to be ingested. Everything seems to be working fine for the elb logs. The SQS queue still has … --- ## [Introduction to Observability: Logging](https://discuss.elastic.co/t/introduction-to-observability-logging/241974)
**Author:** [@Nhavene](https://discuss.elastic.co/u/Nhavene)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 2:57pm UTC](https://discuss.elastic.co/t/introduction-to-observability-logging/241974 "2020-07-22T14:57:04Z")
I'm doing the Introduction to Observability: Logging training and when trying to setup filebeat I got the below error: elastic@ip-172-31-13-13:~/filebeat-7.8.0-darwin-x86\_64$ ./filebeat modules enable nginx -bash: ./fi… --- ## [Aggregate query on filtered array of objects across documents](https://discuss.elastic.co/t/aggregate-query-on-filtered-array-of-objects-across-documents/242207)
**Author:** [@Aditya\_Anirudh\_T](https://discuss.elastic.co/u/Aditya_Anirudh_T)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 1:57pm UTC](https://discuss.elastic.co/t/aggregate-query-on-filtered-array-of-objects-across-documents/242207 "2020-07-22T13:57:41Z")
Hi all, I want to do a term aggregation on a field inside an array of objects, after filtering the array of objects on two other fields. For example, let's say I have the below documents in my database \[ { … --- ## [How to create exact replica of data table from mysql mariaDB](https://discuss.elastic.co/t/how-to-create-exact-replica-of-data-table-from-mysql-mariadb/241903)
**Author:** [@Sahilvaishnav](https://discuss.elastic.co/u/Sahilvaishnav)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 1:56pm UTC](https://discuss.elastic.co/t/how-to-create-exact-replica-of-data-table-from-mysql-mariadb/241903 "2020-07-22T13:56:21Z")
Hello, Scenario : I have a database in mysql below is the structure : JOBID Wokflow Ingest Formula Load modification\_time insertion\_time 1 Pipeline1 Completed Completed Completed 2020-07-18 17:12:35 2020-07-18… --- ## [Logs are indexed into logstash indices but not showing in kibana dashboard?](https://discuss.elastic.co/t/logs-are-indexed-into-logstash-indices-but-not-showing-in-kibana-dashboard/242015)
**Author:** [@Bhavin\_Varsur](https://discuss.elastic.co/u/Bhavin_Varsur)\ **Replies:** 8\ **Last updated:** [July 22, 2020, 1:25pm UTC](https://discuss.elastic.co/t/logs-are-indexed-into-logstash-indices-but-not-showing-in-kibana-dashboard/242015 "2020-07-22T13:25:10Z")
logs are showing in index in Discover page. but not showing in dashboard. need help? here are my index patterns: here are log lines : but here in dashboard i can't see. --- ## [Grokparsefailure and type problems in logstash configuration file](https://discuss.elastic.co/t/grokparsefailure-and-type-problems-in-logstash-configuration-file/242200)
**Author:** [@Mathis\_Gourc](https://discuss.elastic.co/u/Mathis_Gourc)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 1:18pm UTC](https://discuss.elastic.co/t/grokparsefailure-and-type-problems-in-logstash-configuration-file/242200 "2020-07-22T13:18:27Z")
Hi everybody, I have several problems with my configuration file. My goal is to parse three types of logs (for the moment). Here they are : \[29/05/2020 07:41:51.354\] - ih912865 - 10.107.119.121 - 93 - Transaction 7635 … --- ## [Nodos máster como Data](https://discuss.elastic.co/t/nodos-master-como-data/242185)
**Author:** [@Jesus2121](https://discuss.elastic.co/u/Jesus2121)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 12:17pm UTC](https://discuss.elastic.co/t/nodos-master-como-data/242185 "2020-07-22T12:17:39Z")
Buenas. Tengo 4 datas, 2 máster y un nodo de ingesta. ¿Es mejor poner el ingesta que también sea data? o ¿un máster que sea data a la vez? Gracias de antemano --- ## [Discover-gce plugin and old google api libraries](https://discuss.elastic.co/t/discover-gce-plugin-and-old-google-api-libraries/242183)
**Author:** [@Daniel\_S](https://discuss.elastic.co/u/Daniel_S)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 12:06pm UTC](https://discuss.elastic.co/t/discover-gce-plugin-and-old-google-api-libraries/242183 "2020-07-22T12:06:46Z")
Hi! Google is going to deprecate (Aug 12, 2020) for JSON-RPC and global HTTP batch endpoints and their recommendation for clients is to update all Google API Service packages to a version 1.23.1 or higher. Currently, d… --- ## [Kibana "Url Template" based access Issue](https://discuss.elastic.co/t/kibana-url-template-based-access-issue/241925)
**Author:** [@tenet\_testuser1](https://discuss.elastic.co/u/tenet_testuser1)\ **Replies:** 6\ **Last updated:** [July 22, 2020, 11:22am UTC](https://discuss.elastic.co/t/kibana-url-template-based-access-issue/241925 "2020-07-22T11:22:20Z")
Hello, In the index, for a column, I have the option of setting the type to "Url" and provide a url template. There are videos explaining how to get this done. I wanted to use this feature, and set the URL template UR… --- ## [Remove specific fields from index pattern](https://discuss.elastic.co/t/remove-specific-fields-from-index-pattern/242165)
**Author:** [@sfenman](https://discuss.elastic.co/u/sfenman)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 11:20am UTC](https://discuss.elastic.co/t/remove-specific-fields-from-index-pattern/242165 "2020-07-22T11:20:32Z")
Hello, I am using filebeat to parse my logs to Elasticsearch and after some testing with the dissect processor on ingest pipelines, I created too many random fields by mistake as I have noticed from my index patterns on… --- ## [Logstash AWS Elastic Search issue](https://discuss.elastic.co/t/logstash-aws-elastic-search-issue/242164)
**Author:** [@ggiff](https://discuss.elastic.co/u/ggiff)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 11:17am UTC](https://discuss.elastic.co/t/logstash-aws-elastic-search-issue/242164 "2020-07-22T11:17:59Z")
I have set up Logstash to send user inputs to AWS ElasticSearch, but getting the following issue: \[WARN \] 2020-07-22 09:27:50.704 \[Ruby-0-Thread-4: :1\] elasticsearch - Attempted to resurrect connection to dead ES instan… --- ## [Aggregation of nearby dense vectors](https://discuss.elastic.co/t/aggregation-of-nearby-dense-vectors/242163)
**Author:** [@JulGor](https://discuss.elastic.co/u/JulGor)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 9:37am UTC](https://discuss.elastic.co/t/aggregation-of-nearby-dense-vectors/242163 "2020-07-22T09:37:49Z")
Hello, Is there any aggregation that group documents in terms of closeness of dense vectors? My documents have the following structure: { "label": "value", "vector": \[1, 0, 3, 0, 0, 0, 18, 0, 0, 0, ...\] # N dimen… --- ## [Drop message content](https://discuss.elastic.co/t/drop-message-content/242158)
**Author:** [@Champion\_Xie](https://discuss.elastic.co/u/Champion_Xie)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 9:35am UTC](https://discuss.elastic.co/t/drop-message-content/242158 "2020-07-22T09:35:22Z")
hi all, message content 07/20/20 23:57:48 INFO transfercity:sh(city/cityTransferQueryBusiness.cpp:72) how to only get 07/20/20 23:57:48 INFO transfercity:sh --- ## [File output with data from field](https://discuss.elastic.co/t/file-output-with-data-from-field/241895)
**Author:** [@elk2](https://discuss.elastic.co/u/elk2)\ **Replies:** 2\ **Last updated:** [July 21, 2020, 7:47am UTC](https://discuss.elastic.co/t/file-output-with-data-from-field/241895 "2020-07-21T07:47:47Z")
I collect different logs from various sources. I replaced logstash timestamp with machine logs timestamp to have time based events into elasticsearch and I added a "processed\_at" field with a part of logstash timestamp. … --- ## [Filebeat sets the multi-line mode, the unmatched rows are also multi-line, the match result is abnormal](https://discuss.elastic.co/t/filebeat-sets-the-multi-line-mode-the-unmatched-rows-are-also-multi-line-the-match-result-is-abnormal/239090)
**Author:** [@lklkxcxc](https://discuss.elastic.co/u/lklkxcxc)\ **Replies:** 3\ **Last updated:** [July 21, 2020, 10:09am UTC](https://discuss.elastic.co/t/filebeat-sets-the-multi-line-mode-the-unmatched-rows-are-also-multi-line-the-match-result-is-abnormal/239090 "2020-07-21T10:09:33Z")
set multiline filebeat config: multiline.pattern: '^\[0-9\]{4}-\[0-9\]{2}-\[0-9\]{2}|^\[0-9\]{4}/\[0-9\]{2}/\[0-9\]{2}' multiline.negate: true multiline.match: after As a result, the following log was matched as multiple lines i… --- ## [Log messages with same index timestamps are not in the order as in the actual log file](https://discuss.elastic.co/t/log-messages-with-same-index-timestamps-are-not-in-the-order-as-in-the-actual-log-file/242000)
**Author:** [@Aj\_t](https://discuss.elastic.co/u/Aj_t)\ **Replies:** 9\ **Last updated:** [July 22, 2020, 9:12am UTC](https://discuss.elastic.co/t/log-messages-with-same-index-timestamps-are-not-in-the-order-as-in-the-actual-log-file/242000 "2020-07-22T09:12:27Z")
I have a filebeat \> logstash \> elastic set up I am using to process multi-line logs. I can see the logs in kibana, but they are not in the right order as the actual log. Here's my filebeat.yml file: filebeat.inputs: - … --- ## [How to get string from path](https://discuss.elastic.co/t/how-to-get-string-from-path/242156)
**Author:** [@Champion\_Xie](https://discuss.elastic.co/u/Champion_Xie)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 8:59am UTC](https://discuss.elastic.co/t/how-to-get-string-from-path/242156 "2020-07-22T08:59:50Z")
hi all, My application log file name format is room1\_num\_perf.log, i want get the string 'room1' ,and then the string as a new field into ES --- ## [Cannot call \_cluster / \_search API](https://discuss.elastic.co/t/cannot-call-cluster-search-api/241383)
**Author:** [@worapojc](https://discuss.elastic.co/u/worapojc)\ **Replies:** 2\ **Last updated:** [July 22, 2020, 7:39am UTC](https://discuss.elastic.co/t/cannot-call-cluster-search-api/241383 "2020-07-22T07:39:27Z")
Hi, I've Elasticsearch 6.3.2 installed on AWS EC2 and Kibana 6.3.2 installed on on-prem. I can call some ES API from on-prem such as \_cat, \_xpack or \_template. For \_cluster and \_search API, I always get the request ti… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1317) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1319)