# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=694 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 695 --- ## [Logstash binding problems](https://discuss.elastic.co/t/logstash-binding-problems/146410)
**Author:** [@temp44](https://discuss.elastic.co/u/temp44)\ **Replies:** 2\ **Last updated:** [August 29, 2018, 8:20am UTC](https://discuss.elastic.co/t/logstash-binding-problems/146410 "2018-08-29T08:20:18Z")
I am having an issue when running Logstash. When I run it with systemctl, it does not bind on port 5044 at all but logstash is not failing to run. When I run "logstash -f /etc/logstash/conf.d/" it binds to port 5044, but… --- ## [Jdbcstreaming exception](https://discuss.elastic.co/t/jdbcstreaming-exception/146456)
**Author:** [@seungtae](https://discuss.elastic.co/u/seungtae)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 2:34am UTC](https://discuss.elastic.co/t/jdbcstreaming-exception/146456 "2018-08-29T02:34:06Z")
Hi everyone. I have an issue with jdbc\_streaming filter. My config like.. jdbc\_streaming { jdbc\_driver\_library =\> "/usr/share/logstash/vendor/jar/jdbc/ojdbc6.jar" jdbc\_driver\_class =\> "Java::oracle.jdbc.driver.Ora… --- ## [ASN.1 Encoded File](https://discuss.elastic.co/t/asn-1-encoded-file/146443)
**Author:** [@niismail](https://discuss.elastic.co/u/niismail)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 12:42am UTC](https://discuss.elastic.co/t/asn-1-encoded-file/146443 "2018-08-29T00:42:47Z")
Hi Has anybody here have an idea on how to process an ASN.1 encoded file in Logstash? I have the ASN description file, but have not found a way for logstash to process the ASN encoded file. I know there is external too… --- ## [Error while running logstash.bat 5.4.1](https://discuss.elastic.co/t/error-while-running-logstash-bat-5-4-1/146423)
**Author:** [@Rijugp](https://discuss.elastic.co/u/Rijugp)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 9:22pm UTC](https://discuss.elastic.co/t/error-while-running-logstash-bat-5-4-1/146423 "2018-08-28T21:22:06Z")
Hello, Anyone help me out while running the logstash.bat on windows server 2008 R2, getting the error as shown in the screenshot, appreciate any help --- ## [How to debug workers not pulling from persistent queue](https://discuss.elastic.co/t/how-to-debug-workers-not-pulling-from-persistent-queue/146414)
**Author:** [@smbullet](https://discuss.elastic.co/u/smbullet)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 9:04pm UTC](https://discuss.elastic.co/t/how-to-debug-workers-not-pulling-from-persistent-queue/146414 "2018-08-28T21:04:54Z")
Hi! I noticed I was no longer receiving data from Logstash so I logged in and noticed the persistent queue filled up but Logstash is not picking anything up from it: $ sudo ls -l /home/naas\_logstash/logstash/data/queue… --- ## [Dissect no longer matching?](https://discuss.elastic.co/t/dissect-no-longer-matching/146416)
**Author:** [@S\_Chase](https://discuss.elastic.co/u/S_Chase)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 8:30pm UTC](https://discuss.elastic.co/t/dissect-no-longer-matching/146416 "2018-08-28T20:30:38Z")
I'm curious if anyone else had dissect filters matching just fine in 6.3.0 but they stopped working in 6.4.0? I'm going to spend some time on this tomorrow to recreate the dissect filter from scratch - just thought I'd … --- ## [Format time field after xml plugin](https://discuss.elastic.co/t/format-time-field-after-xml-plugin/146413)
**Author:** [@fionamacd](https://discuss.elastic.co/u/fionamacd)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 7:20pm UTC](https://discuss.elastic.co/t/format-time-field-after-xml-plugin/146413 "2018-08-28T19:20:26Z")
Hi, I have the xml plugin running successfully on my data and can see our log files split out nicely in Kibana. What I need to do is convert a time field from this format: 00:00:00.0312000 Which I think is saying mill… --- ## [Can't modify field after KV filter v6.3](https://discuss.elastic.co/t/cant-modify-field-after-kv-filter-v6-3/146354)
**Author:** [@ryannelle](https://discuss.elastic.co/u/ryannelle)\ **Replies:** 2\ **Last updated:** [August 28, 2018, 7:15pm UTC](https://discuss.elastic.co/t/cant-modify-field-after-kv-filter-v6-3/146354 "2018-08-28T19:15:59Z")
Here is my sample data msg=key,value key2,value1 key3,value2,value3 key4,value4 My kv filter works and I end up with the result below "toplvl.midlvl" = { "key" =\> "value", "key2" =\> "value1", "key3" =\> "value2,value3… --- ## [Receiving not latest logs in kibana](https://discuss.elastic.co/t/receiving-not-latest-logs-in-kibana/146394)
**Author:** [@rohitg](https://discuss.elastic.co/u/rohitg)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 6:39pm UTC](https://discuss.elastic.co/t/receiving-not-latest-logs-in-kibana/146394 "2018-08-28T18:39:19Z")
Hi, I have installed ELK 6.3.2 and beats on windows server and everything looks good as i cab view logs till yesterday when i did the installation. But today i cannot see any logs, only available logs are from yesterda… --- ## [Logstash parsing each log multiple times](https://discuss.elastic.co/t/logstash-parsing-each-log-multiple-times/146246)
**Author:** [@Samvid\_Kulkarni](https://discuss.elastic.co/u/Samvid_Kulkarni)\ **Replies:** 4\ **Last updated:** [August 28, 2018, 5:49pm UTC](https://discuss.elastic.co/t/logstash-parsing-each-log-multiple-times/146246 "2018-08-28T17:49:53Z")
This is how my logs look like. I am using multi grok parser to parse different type of logs but in same input file. Below is the grok filter that works for first log ^%{SOCBOX\_HEADER}%{NUMBER}:%{NUMBER}:%{NUMBER} %{USER… --- ## [Logstash wont start when adding a match statement in a grok block](https://discuss.elastic.co/t/logstash-wont-start-when-adding-a-match-statement-in-a-grok-block/146145)
**Author:** [@mhyousefi](https://discuss.elastic.co/u/mhyousefi)\ **Replies:** 6\ **Last updated:** [August 28, 2018, 5:22pm UTC](https://discuss.elastic.co/t/logstash-wont-start-when-adding-a-match-statement-in-a-grok-block/146145 "2018-08-28T17:22:08Z")
Hey guys, so in my logstash.conf, I have the following: input { beats { port =\> "5044" } } filter { grok { patterns\_dir =\> \["./patterns"\] match =\> { "message" =\> "%{WORD:event\_type}\\t%{NUMBER:server\_time… --- ## [Logstash 6.3.2 - File input plugin 4.1.5 stops writing to .sincedb after some time](https://discuss.elastic.co/t/logstash-6-3-2-file-input-plugin-4-1-5-stops-writing-to-sincedb-after-some-time/146395)
**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 3:48pm UTC](https://discuss.elastic.co/t/logstash-6-3-2-file-input-plugin-4-1-5-stops-writing-to-sincedb-after-some-time/146395 "2018-08-28T15:48:36Z")
Hi Team, I have LS 6.3.2 installed with file input plugin 4.1.5 (manually upgraded from the 4.0.x shipped inside LS 6.3.2). For context, the scenario I am dealing with is: the log files that are being monitored by this… --- ## [Logstash sometimes incorrectly parses input documents with logstash-input-azureblob](https://discuss.elastic.co/t/logstash-sometimes-incorrectly-parses-input-documents-with-logstash-input-azureblob/146398)
**Author:** [@Supermathie](https://discuss.elastic.co/u/Supermathie)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 4:14pm UTC](https://discuss.elastic.co/t/logstash-sometimes-incorrectly-parses-input-documents-with-logstash-input-azureblob/146398 "2018-08-28T16:14:41Z")
Using: logstash (tested with 6.0.1 and 6.4.0) logstash-input-azureblob 0.9.12 I've got the following pipeline configured for pulling in Application Gateway logs from Azure: input { azureblob { storage\_account\_n… --- ## [Java Execution Engine Logstash 6.4.0 Default](https://discuss.elastic.co/t/java-execution-engine-logstash-6-4-0-default/146384)
**Author:** [@haifidelity](https://discuss.elastic.co/u/haifidelity)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 2:58pm UTC](https://discuss.elastic.co/t/java-execution-engine-logstash-6-4-0-default/146384 "2018-08-28T14:58:48Z")
Was the Java Execution Engine set to default in Logstash 6.4.0? I could not find anything in the release notes that this is the case: https://www.elastic.co/guide/en/logstash/current/logstash-6-4-0.html Links regarding … --- ## [Logstash filter plugin fingerprint failing from unknown reason](https://discuss.elastic.co/t/logstash-filter-plugin-fingerprint-failing-from-unknown-reason/146381)
**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 2:51pm UTC](https://discuss.elastic.co/t/logstash-filter-plugin-fingerprint-failing-from-unknown-reason/146381 "2018-08-28T14:51:14Z")
Hello, since a few days I am trying to solve a problem of failing logstash. I am downloading ip database using http\_poller. It is approximately 30k IP addresses. I want to change the \_id field using fingerprint filter… --- ## [XML filter, parse key](https://discuss.elastic.co/t/xml-filter-parse-key/146203)
**Author:** [@Sebastian\_Herrera](https://discuss.elastic.co/u/Sebastian_Herrera)\ **Replies:** 5\ **Last updated:** [August 28, 2018, 2:13pm UTC](https://discuss.elastic.co/t/xml-filter-parse-key/146203 "2018-08-28T14:13:26Z")
Hi all, i am parsing a xml, my problem is that one of the kml key is having the action so i am wondering to save that key in one field is that possible? \ \\ \asdasdreg\ \… --- ## [Version conflict, document already exists (current version \[1\])](https://discuss.elastic.co/t/version-conflict-document-already-exists-current-version-1/139230)
**Author:** [@darkmoon](https://discuss.elastic.co/u/darkmoon)\ **Replies:** 13\ **Last updated:** [August 28, 2018, 1:16pm UTC](https://discuss.elastic.co/t/version-conflict-document-already-exists-current-version-1/139230 "2018-08-28T13:16:46Z")
With this config: output { if (\[type\] == "state" ) { elasticsearch { hosts =\> \[ \] index =\> "%{\[meta\]\[target\]\[index\]}" document\_id =\> "%{\[@metadata\]\[target\]\[id\]}" action =\> "update" doc\_as\_upsert =\> true id =\> "… --- ## [Read CSV till a certain condition](https://discuss.elastic.co/t/read-csv-till-a-certain-condition/146342)
**Author:** [@Muhammad\_Ateeb](https://discuss.elastic.co/u/Muhammad_Ateeb)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 12:54pm UTC](https://discuss.elastic.co/t/read-csv-till-a-certain-condition/146342 "2018-08-28T12:54:58Z")
Hello Guys.. i am new to logstash and trying to simulate a scenario I have to read the CSV file i.e. get all the entries in the CSV till a specific condition is met and then use drop or something to discard the rest of … --- ## [Logstash ingest pipeline at elasticsearch](https://discuss.elastic.co/t/logstash-ingest-pipeline-at-elasticsearch/146322)
**Author:** [@Vijayakumar\_Kannan](https://discuss.elastic.co/u/Vijayakumar_Kannan)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 11:11am UTC](https://discuss.elastic.co/t/logstash-ingest-pipeline-at-elasticsearch/146322 "2018-08-28T11:11:23Z")
Hi All i m trying to use the filebeat -\> logstash -\> elasticsearch flow. When i enable the system module from filebeat the message doesn't parse so trying to use the output.elasticsearch pipeline option is not working… --- ## [Sending data from same source for different type of beat agents to logstash](https://discuss.elastic.co/t/sending-data-from-same-source-for-different-type-of-beat-agents-to-logstash/144228)
**Author:** [@ravikt](https://discuss.elastic.co/u/ravikt)\ **Replies:** 21\ **Last updated:** [August 28, 2018, 9:06am UTC](https://discuss.elastic.co/t/sending-data-from-same-source-for-different-type-of-beat-agents-to-logstash/144228 "2018-08-28T09:06:49Z")
I have got these beat agents installed on a machine : winlogbeat metricbeat Trying to send data to same logstash instance. Wondering, how logstash would differentiate the data from these 2 inputs and send output to el… --- ## [Bad certificate error](https://discuss.elastic.co/t/bad-certificate-error/146240)
**Author:** [@Nina\_brown](https://discuss.elastic.co/u/Nina_brown)\ **Replies:** 2\ **Last updated:** [August 28, 2018, 8:44am UTC](https://discuss.elastic.co/t/bad-certificate-error/146240 "2018-08-28T08:44:17Z")
Hi, I want to create a self-signed certificate based on the IP of the logstash server, so my filebeat connection to logstash would be secure. I used the following command to generate the certificate: openssl req -config… --- ## [Jdbc input plugin and sql\_last\_value](https://discuss.elastic.co/t/jdbc-input-plugin-and-sql-last-value/145869)
**Author:** [@rubpa](https://discuss.elastic.co/u/rubpa)\ **Replies:** 5\ **Last updated:** [August 28, 2018, 8:39am UTC](https://discuss.elastic.co/t/jdbc-input-plugin-and-sql-last-value/145869 "2018-08-28T08:39:26Z")
I'm considering replicating a MySQL database into elasticsearch to enable Kibana visualizations on that data. There's another application that runs off the database and the existing data gets updated. It appears that lo… --- ## [Why I need to restart my logstash to add logs in index from my logfile?](https://discuss.elastic.co/t/why-i-need-to-restart-my-logstash-to-add-logs-in-index-from-my-logfile/146291)
**Author:** [@Vyankatesh\_S\_Repal](https://discuss.elastic.co/u/Vyankatesh_S_Repal)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 8:38am UTC](https://discuss.elastic.co/t/why-i-need-to-restart-my-logstash-to-add-logs-in-index-from-my-logfile/146291 "2018-08-28T08:38:50Z")
I am creating an application where I need to retrieve all logs from log file in particular index. I have installed logstash, kibana and elasticsearch (version 6.3.2) by NSSM Any time there is new log, I need to restart… --- ## [Using logstash with elasticsearch for IIS log files Error Failled to execute action Pipeline ConfigurationError](https://discuss.elastic.co/t/using-logstash-with-elasticsearch-for-iis-log-files-error-failled-to-execute-action-pipeline-configurationerror/146266)
**Author:** [@anwarshahtarn](https://discuss.elastic.co/u/anwarshahtarn)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 7:36am UTC](https://discuss.elastic.co/t/using-logstash-with-elasticsearch-for-iis-log-files-error-failled-to-execute-action-pipeline-configurationerror/146266 "2018-08-28T07:36:14Z")
Microsoft Windows \[Version 6.1.7601\] Copyright (c) 2009 Microsoft Corporation. All rights reserved. C:\\Users\\Wahab\>cd C:\\Program Files\\Elastic\\logstash-6.4.0\\logstash-6.4.0\\bin\\nss m-2.24\\win64 C:\\Program Files\\Elas… --- ## [Converting MMM to MM in Logstash 2](https://discuss.elastic.co/t/converting-mmm-to-mm-in-logstash-2/145640)
**Author:** [@Lydia](https://discuss.elastic.co/u/Lydia)\ **Replies:** 2\ **Last updated:** [August 28, 2018, 7:18am UTC](https://discuss.elastic.co/t/converting-mmm-to-mm-in-logstash-2/145640 "2018-08-28T07:18:33Z")
I have the same problem with this person, and i am trying to make the output of my log\_date as the following format but i don't have a clue how to do it. log original input : \[23/AUG/2018:00:00:00 +0800\] and the outp… --- ## [How to improve the performance of Elastic plugin of logstash](https://discuss.elastic.co/t/how-to-improve-the-performance-of-elastic-plugin-of-logstash/146269)
**Author:** [@Jingyan](https://discuss.elastic.co/u/Jingyan)\ **Replies:** 3\ **Last updated:** [August 28, 2018, 7:14am UTC](https://discuss.elastic.co/t/how-to-improve-the-performance-of-elastic-plugin-of-logstash/146269 "2018-08-28T07:14:30Z")
Hi I have a data sender, a logstash and two elastic node(one is ingest node and another is data node). When I use data sender to sen huge data to logstash, logstash will be hang, but have no error log. And my data send… --- ## [Logstash Output Plugin MongoDB with SSL](https://discuss.elastic.co/t/logstash-output-plugin-mongodb-with-ssl/146278)
**Author:** [@MaikLinnemann](https://discuss.elastic.co/u/MaikLinnemann)\ **Replies:** 0\ **Last updated:** [August 28, 2018, 7:13am UTC](https://discuss.elastic.co/t/logstash-output-plugin-mongodb-with-ssl/146278 "2018-08-28T07:13:22Z")
Hi, i have an issue about the plugin logstash-output-mongodb. I try to get i working with ssl but fail. Without ssl (works if mongodb server is set to allowSSL, what means that the output do not use ssl): output { if… --- ## [Logstash Polling Loop Error](https://discuss.elastic.co/t/logstash-polling-loop-error/146188)
**Author:** [@David\_Barnett](https://discuss.elastic.co/u/David_Barnett)\ **Replies:** 1\ **Last updated:** [August 28, 2018, 6:24am UTC](https://discuss.elastic.co/t/logstash-polling-loop-error/146188 "2018-08-28T06:24:45Z")
Hi, I am trying to get started with the ELK stack but have run into an issue that is blocking me. I am using the ELK docker stack "sebp/elk" (latest) It starts up fine and then I use "goinside" to access the machine … --- ## [I have an erroe while using logstash to config with elasticsearch](https://discuss.elastic.co/t/i-have-an-erroe-while-using-logstash-to-config-with-elasticsearch/146074)
**Author:** [@anwarshahtarn](https://discuss.elastic.co/u/anwarshahtarn)\ **Replies:** 2\ **Last updated:** [August 27, 2018, 7:12pm UTC](https://discuss.elastic.co/t/i-have-an-erroe-while-using-logstash-to-config-with-elasticsearch/146074 "2018-08-27T19:12:35Z")
C:\\Program Files\\Elastic\\Elasticsearch\\logstash-6.4.0\\logstash-6.4.0\\bin\>logstas h.bat agent -f ..\\conf ERROR: Unknown command 'agent' See: 'bin/logstash --help' \[ERROR\] 2018-08-26 18:29:55.009 \[main\] Logstash - java… --- ## [How to input CSV files into Logstash from a front end UI?](https://discuss.elastic.co/t/how-to-input-csv-files-into-logstash-from-a-front-end-ui/145246)
**Author:** [@APJ](https://discuss.elastic.co/u/APJ)\ **Replies:** 11\ **Last updated:** [August 27, 2018, 8:06pm UTC](https://discuss.elastic.co/t/how-to-input-csv-files-into-logstash-from-a-front-end-ui/145246 "2018-08-27T20:06:42Z")
Hi all, I am developing a JavaScript application (Backend in Node.js and Frontend in Vue.js), wherein I want to send CSV data into logstash from the front end or UI, i.e, the user can choose any CSV file from local syst… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=693) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=695)