# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=410 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 411 --- ## [Logstash pipeline MS SQL Server Query](https://discuss.elastic.co/t/logstash-pipeline-ms-sql-server-query/217798)
**Author:** [@ginu](https://discuss.elastic.co/u/ginu)\ **Replies:** 1\ **Last updated:** [February 4, 2020, 1:18pm UTC](https://discuss.elastic.co/t/logstash-pipeline-ms-sql-server-query/217798 "2020-02-04T13:18:09Z")
Hi all I am trying to do SQL Query to SQL Server using JDBC and trying to get some data from SQL Server database. my logstash pipeline looks: input { jdbc { jdbc\_validate\_connection =\> true jdbc\_driver\_libr… --- ## [Import csv to Logstash 7.5.2 on Windows (Failed to execute action, expected one of... )](https://discuss.elastic.co/t/import-csv-to-logstash-7-5-2-on-windows-failed-to-execute-action-expected-one-of/217659)
**Author:** [@wall](https://discuss.elastic.co/u/wall)\ **Replies:** 4\ **Last updated:** [February 4, 2020, 9:47am UTC](https://discuss.elastic.co/t/import-csv-to-logstash-7-5-2-on-windows-failed-to-execute-action-expected-one-of/217659 "2020-02-04T09:47:27Z")
I'm trying to import csv to elasticsearch using logstash. but I'm not being able of doing it. As I searched for this error, this is usually related with mistyping something or missing character. But as far as I inspect… --- ## [Logstash Java hashSetting Syntax](https://discuss.elastic.co/t/logstash-java-hashsetting-syntax/217317)
**Author:** [@Tom\_Mahy](https://discuss.elastic.co/u/Tom_Mahy)\ **Replies:** 2\ **Last updated:** [February 4, 2020, 9:41am UTC](https://discuss.elastic.co/t/logstash-java-hashsetting-syntax/217317 "2020-02-04T09:41:02Z")
Hello, We are currently in the process of writing a JAVA based logstash plugin We can easily set custom properties in the logstash config and read them inside our class But we cant get the maps to work ie: // public… --- ## [Logstash-Plug in-JMS Weblogic 12.2.1](https://discuss.elastic.co/t/logstash-plug-in-jms-weblogic-12-2-1/217391)
**Author:** [@Chris\_Morfopoulos](https://discuss.elastic.co/u/Chris_Morfopoulos)\ **Replies:** 1\ **Last updated:** [February 4, 2020, 9:36am UTC](https://discuss.elastic.co/t/logstash-plug-in-jms-weblogic-12-2-1/217391 "2020-02-04T09:36:47Z")
Hi, I have installed Weblogic 12.2.1 and the latest Logstash 7.5.2 version as well as the jms plugin v3.1.2. I am struggling with the jms plug in and I have already set the .conf and .yml, but it doesn't work! In the D… --- ## [Logstash config file alerting in telegram](https://discuss.elastic.co/t/logstash-config-file-alerting-in-telegram/217730)
**Author:** [@Sagar\_Mandal](https://discuss.elastic.co/u/Sagar_Mandal)\ **Replies:** 2\ **Last updated:** [February 4, 2020, 9:33am UTC](https://discuss.elastic.co/t/logstash-config-file-alerting-in-telegram/217730 "2020-02-04T09:33:13Z")
Hi Team, So i want to send alerts in telegram through it's bot, using http output plugin. the purpose of this config is that whenever data is ingested in elasticsearch, i'll get a message in my telegram. the data is b… --- ## [Splitted huge csv file to less ones - fastest way to indexing using logstash/pipeline or filebeat?](https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742)
**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 8:32am UTC](https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742 "2020-02-04T08:32:45Z")
Hi there, I just have a little question to manage following case: I have mega huge csv files which I consider to split to less big files in same folder due to the fact indexing big csv files may take 2 or 4 days of wr… --- ## [Index data from MSSQL server to Elasticsearch using Logstash as nested documents](https://discuss.elastic.co/t/index-data-from-mssql-server-to-elasticsearch-using-logstash-as-nested-documents/217179)
**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\ **Replies:** 7\ **Last updated:** [February 4, 2020, 7:23am UTC](https://discuss.elastic.co/t/index-data-from-mssql-server-to-elasticsearch-using-logstash-as-nested-documents/217179 "2020-02-04T07:23:33Z")
Hi All i am new to elasticsearch i am trying to index data from MSSQL server to elasticsearch using logstash as nested documents i am having some issues while creating a topic so i have created the issue in stack overflo… --- ## [Convert time field type string to integer](https://discuss.elastic.co/t/convert-time-field-type-string-to-integer/217578)
**Author:** [@111207](https://discuss.elastic.co/u/111207)\ **Replies:** 2\ **Last updated:** [February 4, 2020, 5:47am UTC](https://discuss.elastic.co/t/convert-time-field-type-string-to-integer/217578 "2020-02-04T05:47:25Z")
I have a data type string format "22h30m15s" I would like to convert this data to type integer = 81,015 second --- ## [A question on Persistent Queues](https://discuss.elastic.co/t/a-question-on-persistent-queues/217724)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 5:47am UTC](https://discuss.elastic.co/t/a-question-on-persistent-queues/217724 "2020-02-04T05:47:10Z")
We want to put in some network resilience in our setup. As of now the systems directly send logs to ES cluster. There is always a question of loss of logs when the network is down. With that in mind I was thinking of put… --- ## [Elasticsearch output](https://discuss.elastic.co/t/elasticsearch-output/216502)
**Author:** [@fvegaucr](https://discuss.elastic.co/u/fvegaucr)\ **Replies:** 2\ **Last updated:** [February 4, 2020, 12:26am UTC](https://discuss.elastic.co/t/elasticsearch-output/216502 "2020-02-04T00:26:09Z")
Hi Im trying to use logstash to use elasticsearch output plugin to send logs to elasticsearch. The version of elastic that Im using is 7.4.2 as well as logstash. The issue that Im having is when I try to load the templ… --- ## [Date times SQL and output differents values](https://discuss.elastic.co/t/date-times-sql-and-output-differents-values/217545)
**Author:** [@Mbt\_Mbt](https://discuss.elastic.co/u/Mbt_Mbt)\ **Replies:** 11\ **Last updated:** [February 3, 2020, 10:44pm UTC](https://discuss.elastic.co/t/date-times-sql-and-output-differents-values/217545 "2020-02-03T22:44:32Z")
Hi, Good afternoon, I am having problems viewing data of type date in kibana. I am using an elk platform with the jdbc connector. Where to make the query I get date type information. In the database I have the field … --- ## [Logstash File Input Won't Re-read Files](https://discuss.elastic.co/t/logstash-file-input-wont-re-read-files/217684)
**Author:** [@mfisher](https://discuss.elastic.co/u/mfisher)\ **Replies:** 3\ **Last updated:** [February 3, 2020, 9:51pm UTC](https://discuss.elastic.co/t/logstash-file-input-wont-re-read-files/217684 "2020-02-03T21:51:45Z")
I've configured logstash to read all .system files from a specific directory and it works for new files. However after the file is read and indexed it won't re-read a file with the same file name even if I edit it or de… --- ## [Regex express to eliminate private address space from geoip](https://discuss.elastic.co/t/regex-express-to-eliminate-private-address-space-from-geoip/217677)
**Author:** [@DWbank](https://discuss.elastic.co/u/DWbank)\ **Replies:** 2\ **Last updated:** [February 3, 2020, 8:49pm UTC](https://discuss.elastic.co/t/regex-express-to-eliminate-private-address-space-from-geoip/217677 "2020-02-03T20:49:10Z")
I am trying to eliminate private address spacing going through geoip. I am guessing my regexp is not quite right, seems to still match everything. ################### This checks to see that address is not internal for… --- ## [Installing logstash-input-mongodb](https://discuss.elastic.co/t/installing-logstash-input-mongodb/217685)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 8:05pm UTC](https://discuss.elastic.co/t/installing-logstash-input-mongodb/217685 "2020-02-03T20:05:17Z")
I can't seems to figure out how to install this. downloaded zip file and use this \[root@elktst01 logstash\]# bin/logstash-plugin install logstash-input-mongodb-master.zip ERROR: Something went wrong when installing log… --- ## [Urldecode filter doesn't replace plus sign](https://discuss.elastic.co/t/urldecode-filter-doesnt-replace-plus-sign/217671)
**Author:** [@Micah\_Hunsberger](https://discuss.elastic.co/u/Micah_Hunsberger)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 6:19pm UTC](https://discuss.elastic.co/t/urldecode-filter-doesnt-replace-plus-sign/217671 "2020-02-03T18:19:51Z")
The urldecode ingest processor will convert decode+me =\> decode me, but the logstash filter plugin only handles %-encoded values, so + are not replaced with spaces. The workaround is to add a gsub filter above the urlde… --- ## [Extract json array using logstash to elasticsearch](https://discuss.elastic.co/t/extract-json-array-using-logstash-to-elasticsearch/217276)
**Author:** [@emailshak](https://discuss.elastic.co/u/emailshak)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 4:55pm UTC](https://discuss.elastic.co/t/extract-json-array-using-logstash-to-elasticsearch/217276 "2020-02-03T16:55:46Z")
I am trying to extract the following json to elasticsearch using logstash { "times\_submitted": 6, "name": "task1", "sub\_names": \["rescan", "that.doc", "c:\\sorted\\files\\file1.exe"\], "tree": { "child1" : "abc", "chil… --- ## [Sort tickets by age group](https://discuss.elastic.co/t/sort-tickets-by-age-group/216186)
**Author:** [@katara](https://discuss.elastic.co/u/katara)\ **Replies:** 11\ **Last updated:** [February 3, 2020, 4:42pm UTC](https://discuss.elastic.co/t/sort-tickets-by-age-group/216186 "2020-02-03T16:42:08Z")
Hello all, Im trying to create a graph similar to the below in Kibana. I am using an API to get all the ticketing fields including the created date and closed date. So I need to do the follwing to get to this: che… --- ## [Logs not showing up in readable format in Kibana after Logstash ingestion](https://discuss.elastic.co/t/logs-not-showing-up-in-readable-format-in-kibana-after-logstash-ingestion/217484)
**Author:** [@ckough](https://discuss.elastic.co/u/ckough)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 4:32pm UTC](https://discuss.elastic.co/t/logs-not-showing-up-in-readable-format-in-kibana-after-logstash-ingestion/217484 "2020-02-03T16:32:41Z")
Hi There, I've a problem with cloudwatch logs showing up in readable format in kibana and I believe the problem is with setting Logstash charset. The error is: \[main\] Received an event that has a different character en… --- ## [Temporary Array for converting values](https://discuss.elastic.co/t/temporary-array-for-converting-values/217438)
**Author:** [@mvdlippe](https://discuss.elastic.co/u/mvdlippe)\ **Replies:** 2\ **Last updated:** [February 3, 2020, 3:29pm UTC](https://discuss.elastic.co/t/temporary-array-for-converting-values/217438 "2020-02-03T15:29:28Z")
Hello, I am fairly new to Elastic and I have been working through getting Office 365 data into ECS format. I am looking for a solution to convert a numerical value (key) to a known string value. I know a simple solutio… --- ## [Invalid setting for jdbc streaming filter plugin](https://discuss.elastic.co/t/invalid-setting-for-jdbc-streaming-filter-plugin/217498)
**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\ **Replies:** 11\ **Last updated:** [February 3, 2020, 2:00pm UTC](https://discuss.elastic.co/t/invalid-setting-for-jdbc-streaming-filter-plugin/217498 "2020-02-03T14:00:29Z")
Hi All i am trying to use jdbc streaming in logstash but i am getting below error. Below is my config input { jdbc { jdbc\_driver\_library =\> "mssql-jdbc-7.4.1.jre12-shaded" jdbc\_driver\_class =\> "com.microsoft.sqlserv… --- ## [Mcafee Web Gateway with Logstash](https://discuss.elastic.co/t/mcafee-web-gateway-with-logstash/217637)
**Author:** [@Gleison\_Rodrigo](https://discuss.elastic.co/u/Gleison_Rodrigo)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 2:35pm UTC](https://discuss.elastic.co/t/mcafee-web-gateway-with-logstash/217637 "2020-02-03T14:35:30Z")
Hello guys, has anyone created a filter for mcafee web gateway? --- ## [Ruby filter double event.set not index the content](https://discuss.elastic.co/t/ruby-filter-double-event-set-not-index-the-content/217359)
**Author:** [@vmoragar](https://discuss.elastic.co/u/vmoragar)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 11:21am UTC](https://discuss.elastic.co/t/ruby-filter-double-event-set-not-index-the-content/217359 "2020-02-03T11:21:10Z")
Hi, With Logstasth --\> 7.5.1 The problem is when ia put: event.set('\[jolokia\]\[metrics\]\[threadpool\]\[webcontainer\]\[activecount\]', item\['current'\]) event.set('\[jolokia\]\[metrics\]\[threadpool\]\[webcontainer\]\[highwatermark\]'… --- ## [(Net::OpenTimeout) The same configuration but not working when moving to another environment](https://discuss.elastic.co/t/net-opentimeout-the-same-configuration-but-not-working-when-moving-to-another-environment/217605)
**Author:** [@karamen1](https://discuss.elastic.co/u/karamen1)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 10:22am UTC](https://discuss.elastic.co/t/net-opentimeout-the-same-configuration-but-not-working-when-moving-to-another-environment/217605 "2020-02-03T10:22:54Z")
Hi Logtash team I am using logstash mail output plugin for sending alert mail. it has been working normally on DEV environment by setting as below. email { from =\> "xxx@gmail.com" body =\> "body… --- ## [Email Ouput: AUTH Unrecognized authentication type](https://discuss.elastic.co/t/email-ouput-auth-unrecognized-authentication-type/217599)
**Author:** [@karamen1](https://discuss.elastic.co/u/karamen1)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 10:11am UTC](https://discuss.elastic.co/t/email-ouput-auth-unrecognized-authentication-type/217599 "2020-02-03T10:11:37Z")
Hi Logstash team, I have been using Logstash 7.4.2 version without problem with output email plugin I updated ELK stack version to 7.5.2 in last week due to some Vulnerability. But i am facing the bellow errors when t… --- ## [Sometimes messages are split](https://discuss.elastic.co/t/sometimes-messages-are-split/217591)
**Author:** [@111284](https://discuss.elastic.co/u/111284)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 9:50am UTC](https://discuss.elastic.co/t/sometimes-messages-are-split/217591 "2020-02-03T09:50:00Z")
Hi I'm new with ELK stack. And I'm trying to get logs from ESXi hosts. Rsyslog (version 7.4.4-1) gets the messages on port 1514, it uses such a template: //template(name="bladetemplate" type="list") { property(name=… --- ## [How to : Using Ruby filter, Perform db lookup while iterating the array](https://discuss.elastic.co/t/how-to-using-ruby-filter-perform-db-lookup-while-iterating-the-array/217570)
**Author:** [@inhinyera16](https://discuss.elastic.co/u/inhinyera16)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 7:53am UTC](https://discuss.elastic.co/t/how-to-using-ruby-filter-perform-db-lookup-while-iterating-the-array/217570 "2020-02-03T07:53:30Z")
My jdbc\_streaming produce an array like this "attachment": \[ { "departmentid" : "2" }\] now i would like to lookup my db using the departmentid, and get the equivalent department name and put it as below "attachment"… --- ## [Logstash not updating record and not giving any error](https://discuss.elastic.co/t/logstash-not-updating-record-and-not-giving-any-error/216977)
**Author:** [@saifrehman](https://discuss.elastic.co/u/saifrehman)\ **Replies:** 3\ **Last updated:** [February 3, 2020, 7:29am UTC](https://discuss.elastic.co/t/logstash-not-updating-record-and-not-giving-any-error/216977 "2020-02-03T07:29:09Z")
Logstash not updating documents. I am not receiving any error . Here is my code. input{ jdbc { jdbc\_connection\_string =\> "-------" jdbc\_user =\> "------" jdbc\_password =\> "-----" jdbc\_validate\_connection =\> true … --- ## [Parse csv data wrapped in "message" from filebeat in logstash](https://discuss.elastic.co/t/parse-csv-data-wrapped-in-message-from-filebeat-in-logstash/216835)
**Author:** [@mohammad\_hasan\_dabba](https://discuss.elastic.co/u/mohammad_hasan_dabba)\ **Replies:** 6\ **Last updated:** [February 3, 2020, 7:22am UTC](https://discuss.elastic.co/t/parse-csv-data-wrapped-in-message-from-filebeat-in-logstash/216835 "2020-02-03T07:22:39Z")
Hi i'm using filebeat to send jmeter logs to logstash but i have a problem log data are wrapped in "message" key and the value is a csv formatted text i tried to unwrap data with CSV filter plugin in logstash. i can … --- ## [Polling New/Modified elasticsearch records to another endpoint](https://discuss.elastic.co/t/polling-new-modified-elasticsearch-records-to-another-endpoint/217530)
**Author:** [@Zee](https://discuss.elastic.co/u/Zee)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 12:32am UTC](https://discuss.elastic.co/t/polling-new-modified-elasticsearch-records-to-another-endpoint/217530 "2020-02-03T00:32:47Z")
Hi, I am trying to find a solution to read all elasticsearch records periodically every 1 minute, that have been modified or newly created in an elasticsearch index. These new records further need to be published using … --- ## [Multi Filebeats input and one output via logstash](https://discuss.elastic.co/t/multi-filebeats-input-and-one-output-via-logstash/217534)
**Author:** [@hispeed](https://discuss.elastic.co/u/hispeed)\ **Replies:** 0\ **Last updated:** [February 2, 2020, 3:15pm UTC](https://discuss.elastic.co/t/multi-filebeats-input-and-one-output-via-logstash/217534 "2020-02-02T15:15:05Z")
Hi Hi I have at the moment 2 vm's from where I want to send log files (centos 8 machines) to logstash. I have this input configuration: # 01-inputs.conf input { udp { port =\> 5140 } beats { port =\> 5044 } … [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=409) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=411)