# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=950 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 951 --- ## [Problem with POST request with http\_poller plugin](https://discuss.elastic.co/t/problem-with-post-request-with-http-poller-plugin/91910)
**Author:** [@Sayantan\_Dey](https://discuss.elastic.co/u/Sayantan_Dey)\ **Replies:** 1\ **Last updated:** [July 7, 2017, 9:35am UTC](https://discuss.elastic.co/t/problem-with-post-request-with-http-poller-plugin/91910 "2017-07-07T09:35:01Z")
Hi, I'm using Logstash to import data from a http web-service. It uses post method to retrieve data. Now whenever I'm using the following format in my conf file, its throwing the following error: "Invalid url post". My … --- ## [Error processing Twitter](https://discuss.elastic.co/t/error-processing-twitter/92059)
**Author:** [@legolas\_bilbao](https://discuss.elastic.co/u/legolas_bilbao)\ **Replies:** 4\ **Last updated:** [July 7, 2017, 9:27am UTC](https://discuss.elastic.co/t/error-processing-twitter/92059 "2017-07-07T09:27:23Z")
Good morning, I've deployed the input plugin filter and it works but during the parsing occurs the following error \[2017-07-06T11:00:15,593\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsear… --- ## [Persistence Queue Implimentation configuration](https://discuss.elastic.co/t/persistence-queue-implimentation-configuration/92214)
**Author:** [@prash](https://discuss.elastic.co/u/prash)\ **Replies:** 0\ **Last updated:** [July 7, 2017, 6:56am UTC](https://discuss.elastic.co/t/persistence-queue-implimentation-configuration/92214 "2017-07-07T06:56:36Z")
Hi Team, I am trying to implement the PQ in the Logstash. Step 1: syslog-ng is installed in multiple servers and logs are forwarded to centralized Logstash. Step 2: Logstash is installed in centralized server and it … --- ## [Permission denied logstash forwarder : trying to setup filebeat?](https://discuss.elastic.co/t/permission-denied-logstash-forwarder-trying-to-setup-filebeat/92100)
**Author:** [@atharvajava](https://discuss.elastic.co/u/atharvajava)\ **Replies:** 1\ **Last updated:** [July 6, 2017, 1:13pm UTC](https://discuss.elastic.co/t/permission-denied-logstash-forwarder-trying-to-setup-filebeat/92100 "2017-07-06T13:13:48Z")
sudo scp /etc/pki/tls/certs/logstash-forwarder.crt root@192.168.40.175:/etc/pki/tls/certs/ I was trying to setup filebeat on my elk stack but I am getting the the above error scp: /etc/pki/tls/certs//logstash-forwarde… --- ## [Logstash 6.0.0-alpha2 error elasticsearch output (bug?)](https://discuss.elastic.co/t/logstash-6-0-0-alpha2-error-elasticsearch-output-bug/92223)
**Author:** [@Nico-DF](https://discuss.elastic.co/u/Nico-DF)\ **Replies:** 0\ **Last updated:** [July 7, 2017, 7:54am UTC](https://discuss.elastic.co/t/logstash-6-0-0-alpha2-error-elasticsearch-output-bug/92223 "2017-07-07T07:54:55Z")
Hi, I've decided to try the pre-released version of the stack (to check changes, improvements, etc.). So I've downloaded all pre-released versions, stopped my current stack and launch the new stack. I've migrated the … --- ## [Using two input plugins ( beats and udp ) and output it to Elasticsearch](https://discuss.elastic.co/t/using-two-input-plugins-beats-and-udp-and-output-it-to-elasticsearch/92097)
**Author:** [@amarjeetxc](https://discuss.elastic.co/u/amarjeetxc)\ **Replies:** 5\ **Last updated:** [July 7, 2017, 6:23am UTC](https://discuss.elastic.co/t/using-two-input-plugins-beats-and-udp-and-output-it-to-elasticsearch/92097 "2017-07-07T06:23:13Z")
I am using the following logstash configuration but output is only on single index pattern and other one is not working : I am using the following logstash configuration but output is only on single index pattern and … --- ## [Logstash-plugin-install hangs forever](https://discuss.elastic.co/t/logstash-plugin-install-hangs-forever/92144)
**Author:** [@tcouto](https://discuss.elastic.co/u/tcouto)\ **Replies:** 1\ **Last updated:** [July 6, 2017, 11:37pm UTC](https://discuss.elastic.co/t/logstash-plugin-install-hangs-forever/92144 "2017-07-06T23:37:10Z")
Well at least 12 hours... I know there are other topics very similar to this, but since they're closed I suppose I need to open a new one. From https://discuss.elastic.co/t/logstash-install-plugin-extremely-slow/50642 … --- ## [Can't convert types using mutate or ruby filter from fields generated with kv](https://discuss.elastic.co/t/cant-convert-types-using-mutate-or-ruby-filter-from-fields-generated-with-kv/91339)
**Author:** [@poorbob](https://discuss.elastic.co/u/poorbob)\ **Replies:** 4\ **Last updated:** [July 6, 2017, 11:31pm UTC](https://discuss.elastic.co/t/cant-convert-types-using-mutate-or-ruby-filter-from-fields-generated-with-kv/91339 "2017-07-06T23:31:50Z")
I have many fields generated from the kv plugin like so: kv { source =\> "kvpairs" remove\_field =\> \[ "kvpairs" \] } I have tried both of the following and neither result in the fields being converted to their proper… --- ## [Regex to integer\\float](https://discuss.elastic.co/t/regex-to-integer-float/54333)
**Author:** [@Boris\_Borshevsky](https://discuss.elastic.co/u/Boris_Borshevsky)\ **Replies:** 4\ **Last updated:** [June 23, 2017, 5:25pm UTC](https://discuss.elastic.co/t/regex-to-integer-float/54333 "2017-06-23T17:25:00Z")
Hi, I'm a little new to logstash. I'm trying to figure out if there is a way to convert fields that match specific regex to integer: i thought i could do it with grok but something there is not very clear to me. use c… --- ## [How to Run Logstash using Java program](https://discuss.elastic.co/t/how-to-run-logstash-using-java-program/92115)
**Author:** [@ent\_1](https://discuss.elastic.co/u/ent_1)\ **Replies:** 1\ **Last updated:** [July 6, 2017, 8:08pm UTC](https://discuss.elastic.co/t/how-to-run-logstash-using-java-program/92115 "2017-07-06T20:08:34Z")
Hai I would like to run logstash through Java .. please help me to configure this regards Dileep --- ## [Having Trouble parsing string like '20170705T104907-0400' into date using date filter](https://discuss.elastic.co/t/having-trouble-parsing-string-like-20170705t104907-0400-into-date-using-date-filter/91955)
**Author:** [@aman\_yadav](https://discuss.elastic.co/u/aman_yadav)\ **Replies:** 2\ **Last updated:** [July 5, 2017, 5:40pm UTC](https://discuss.elastic.co/t/having-trouble-parsing-string-like-20170705t104907-0400-into-date-using-date-filter/91955 "2017-07-05T17:40:19Z")
date { match =\> \["startDate", "yyyyMMddTHHmmssz"\] target =\> "@timestamp" } I tried this but because of 'T' in match, logstash gives me error. --- ## [Logstash Data parsing error - \_dateparsefailure](https://discuss.elastic.co/t/logstash-data-parsing-error--dateparsefailure/91492)
**Author:** [@aswinkumart](https://discuss.elastic.co/u/aswinkumart)\ **Replies:** 2\ **Last updated:** [July 6, 2017, 7:13pm UTC](https://discuss.elastic.co/t/logstash-data-parsing-error--dateparsefailure/91492 "2017-07-06T19:13:00Z")
I am trying to parse the Time format "timestamp" =\> "27/06/17 11:19:53:053 EDT" - I tried the following match pattarns in Logstash Filter but I am getting \_dateparsefailure error Filter in Logstash: -------------------… --- ## [Tape library](https://discuss.elastic.co/t/tape-library/92111)
**Author:** [@l.savarese](https://discuss.elastic.co/u/l.savarese)\ **Replies:** 3\ **Last updated:** [July 6, 2017, 6:50pm UTC](https://discuss.elastic.co/t/tape-library/92111 "2017-07-06T18:50:02Z")
Hello everybody, in a new project my customer ask me if logstash can write the log files directly to a tape library. There is a plugin that does this job? The customer tape library software is bacula. Someone… --- ## [Beats handler syslog errors every minute](https://discuss.elastic.co/t/beats-handler-syslog-errors-every-minute/60822)
**Author:** [@xternal](https://discuss.elastic.co/u/xternal)\ **Replies:** 6\ **Last updated:** [July 6, 2017, 3:14pm UTC](https://discuss.elastic.co/t/beats-handler-syslog-errors-every-minute/60822 "2017-07-06T15:14:41Z")
Hi Im testing the 5-alpha ELK stack on Ubuntu 16.04 (x64) and when I enable the beats input (no ssl) the syslog on the logstash server shows this error every 1 minute: \[nioEventLoopGroup-3-1\] ERROR org.logstash.beats.B… --- ## [Configure logstash for the Beats Plugin in logstash.yml](https://discuss.elastic.co/t/configure-logstash-for-the-beats-plugin-in-logstash-yml/91990)
**Author:** [@rbroaddus](https://discuss.elastic.co/u/rbroaddus)\ **Replies:** 2\ **Last updated:** [July 6, 2017, 1:06pm UTC](https://discuss.elastic.co/t/configure-logstash-for-the-beats-plugin-in-logstash-yml/91990 "2017-07-06T13:06:39Z")
Hi, I am trying to configure logstash for filebeat and the beats plugin in logstash.yml. I have already done this with the logstash.conf file and it works fine. I have not seen an example of this in logstash.yml after … --- ## [Multiline codec and grok - cannot match fields on seperate lines](https://discuss.elastic.co/t/multiline-codec-and-grok-cannot-match-fields-on-seperate-lines/89189)
**Author:** [@hbj](https://discuss.elastic.co/u/hbj)\ **Replies:** 0\ **Last updated:** [June 13, 2017, 12:37pm UTC](https://discuss.elastic.co/t/multiline-codec-and-grok-cannot-match-fields-on-seperate-lines/89189 "2017-06-13T12:37:57Z")
Disregard - could not find a way to delete. --- ## [Illegal quoting in line (When i use " in csv file)](https://discuss.elastic.co/t/illegal-quoting-in-line-when-i-use-in-csv-file/90908)
**Author:** [@Yimjunhyeok](https://discuss.elastic.co/u/Yimjunhyeok)\ **Replies:** 3\ **Last updated:** [July 6, 2017, 10:52am UTC](https://discuss.elastic.co/t/illegal-quoting-in-line-when-i-use-in-csv-file/90908 "2017-07-06T10:52:07Z")
I use Logstash 5.4.1 This is my log 1498530290428|172.16.110.65|119.205.238.31|55081|80||||10|1|0|1|0|0|0|HTTP/1.1|www.dreamsearch.or.kr|/servlet/nateWebServlet?s=8375|Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWe… --- ## [Import data from MySQL into ElasticSearch using Lostash to visualize in Kibana](https://discuss.elastic.co/t/import-data-from-mysql-into-elasticsearch-using-lostash-to-visualize-in-kibana/92076)
**Author:** [@saafianihan](https://discuss.elastic.co/u/saafianihan)\ **Replies:** 5\ **Last updated:** [July 6, 2017, 10:36am UTC](https://discuss.elastic.co/t/import-data-from-mysql-into-elasticsearch-using-lostash-to-visualize-in-kibana/92076 "2017-07-06T10:36:56Z")
I have to create a dashboard in Kibana by loading data from MySQL Table.I just followed the following steps, 1)Kibana Installed 2)ElasticSearch Installed 3)Logstash Downloaded. What are the next steps which i have to fol… --- ## [Input from Mongodb to Elasticsearch](https://discuss.elastic.co/t/input-from-mongodb-to-elasticsearch/92072)
**Author:** [@Manoj\_Kumar1](https://discuss.elastic.co/u/Manoj_Kumar1)\ **Replies:** 0\ **Last updated:** [July 6, 2017, 10:01am UTC](https://discuss.elastic.co/t/input-from-mongodb-to-elasticsearch/92072 "2017-07-06T10:01:09Z")
HI I am trying to get mongodb data into Elasticssearch using logstash, with logstash-input-mongodb plugin. I tried to update the plugin to support version 5 of ES. In terminal it shows version 0.4.1 but in error log… --- ## [Logstash-filter-elasticsearch plugin not installing](https://discuss.elastic.co/t/logstash-filter-elasticsearch-plugin-not-installing/91892)
**Author:** [@bterhorst](https://discuss.elastic.co/u/bterhorst)\ **Replies:** 1\ **Last updated:** [July 5, 2017, 3:53pm UTC](https://discuss.elastic.co/t/logstash-filter-elasticsearch-plugin-not-installing/91892 "2017-07-05T15:53:32Z")
Hello, When trying to install the logstash-filter-elasticsearch plugin (v3.1.4) I get the below exception: I have tried installing the zip and the gem file. My logstash version is 5.4.0. java/util/Hashtable.java:459:… --- ## [StackTrace with multiline filter on logstash](https://discuss.elastic.co/t/stacktrace-with-multiline-filter-on-logstash/91718)
**Author:** [@Govind\_Raj](https://discuss.elastic.co/u/Govind_Raj)\ **Replies:** 1\ **Last updated:** [July 6, 2017, 8:20am UTC](https://discuss.elastic.co/t/stacktrace-with-multiline-filter-on-logstash/91718 "2017-07-06T08:20:32Z")
hi We user beats to send the logs to our centralized log server. We are finding it bit difficult to parse a stack trace . The sample log is below , INFO 2017-07-02 03:46:52,714 \[\[corn-ice-1.0.0-SNAPSHOT\].schedule-db\_… --- ## [Is the Logstash persistence queue support input plugins as udp?](https://discuss.elastic.co/t/is-the-logstash-persistence-queue-support-input-plugins-as-udp/91871)
**Author:** [@prash](https://discuss.elastic.co/u/prash)\ **Replies:** 2\ **Last updated:** [July 6, 2017, 6:12am UTC](https://discuss.elastic.co/t/is-the-logstash-persistence-queue-support-input-plugins-as-udp/91871 "2017-07-06T06:12:05Z")
Hi Team, In my project we are using input as UDP for ex: input{ udp { port =\> "${UDP\_PORT:514}" type =\> syslog } } Is the Logstash persistence queue support input plugins as udp? --- ## [Old logs needs to be indexed](https://discuss.elastic.co/t/old-logs-needs-to-be-indexed/91511)
**Author:** [@vu\_test](https://discuss.elastic.co/u/vu_test)\ **Replies:** 2\ **Last updated:** [July 6, 2017, 5:51am UTC](https://discuss.elastic.co/t/old-logs-needs-to-be-indexed/91511 "2017-07-06T05:51:55Z")
Hi All, new to ELK environment, I have some old logs (a month old) I want to index it. When on running logstash with OUTPUT as {stdout =\> rubydebug} ..gets the result. But doing the same enabling elasticsearch {} doesn't… --- ## [Log stash & redis cluster with sentinel](https://discuss.elastic.co/t/log-stash-redis-cluster-with-sentinel/92019)
**Author:** [@yanivk](https://discuss.elastic.co/u/yanivk)\ **Replies:** 0\ **Last updated:** [July 6, 2017, 5:32am UTC](https://discuss.elastic.co/t/log-stash-redis-cluster-with-sentinel/92019 "2017-07-06T05:32:06Z")
Hi All, We have installed cluster of Redis server 2 slave and one master with Sentinel as a input for log stash what should be the logstash input configuration in order to use redis cluster (sentinel)? ,right now i co… --- ## [Multiline codec and csv filter](https://discuss.elastic.co/t/multiline-codec-and-csv-filter/92016)
**Author:** [@Yimjunhyeok](https://discuss.elastic.co/u/Yimjunhyeok)\ **Replies:** 0\ **Last updated:** [July 6, 2017, 5:10am UTC](https://discuss.elastic.co/t/multiline-codec-and-csv-filter/92016 "2017-07-06T05:10:58Z")
This is source (2 logs) 172.16.110.11|ABC|!|@|#|abcd abcdkasjdlaskd asdsadlksadklsdakl |!|@|#| 123.123.11.1|ddaskd|!|@|#|skdlsadsakdljadd,vcmacl askdlsad ask dkas dska d |!|@|#| Seperator ==\> | , |!|@|#| Column… --- ## [Logstash error : Couldn't find any codec plugin named "nmap"](https://discuss.elastic.co/t/logstash-error-couldnt-find-any-codec-plugin-named-nmap/91998)
**Author:** [@gugansankar](https://discuss.elastic.co/u/gugansankar)\ **Replies:** 1\ **Last updated:** [July 6, 2017, 1:20am UTC](https://discuss.elastic.co/t/logstash-error-couldnt-find-any-codec-plugin-named-nmap/91998 "2017-07-06T01:20:35Z")
I tried to parse nmap log using logstash . but logstash stopped with below error message \[2017-07-06T06:10:19,811\]\[ERROR\]\[logstash.agent \] Cannot create pipeline {:reason=\>"Couldn't find any codec plugin name… --- ## [\[ERROR\]\[logstash.inputs.metrics](https://discuss.elastic.co/t/error-logstash-inputs-metrics/91997)
**Author:** [@geremias.santiago](https://discuss.elastic.co/u/geremias.santiago)\ **Replies:** 0\ **Last updated:** [July 6, 2017, 12:17am UTC](https://discuss.elastic.co/t/error-logstash-inputs-metrics/91997 "2017-07-06T00:17:04Z")
Hello, I have installed the ELK with docker in this images versions: docker.elastic.co/kibana/kibana 5.4.3 docker.elastic.co/elasticsearch/elasticsearch 5.4.3 docker.elastic.co/kibana/kibana 5.4.… --- ## [Metricbeat to logstash duplicate events](https://discuss.elastic.co/t/metricbeat-to-logstash-duplicate-events/89592)
**Author:** [@ELK\_GB](https://discuss.elastic.co/u/ELK_GB)\ **Replies:** 1\ **Last updated:** [July 5, 2017, 9:23pm UTC](https://discuss.elastic.co/t/metricbeat-to-logstash-duplicate-events/89592 "2017-07-05T21:23:01Z")
Hi, I hope someone can help me understand the following behavior im seeing from logstash outputting duplicate metric beat events to local file. I was looking at the output today and I can see the same event from the… --- ## [Facing issues while installing stomp plugin in logstash](https://discuss.elastic.co/t/facing-issues-while-installing-stomp-plugin-in-logstash/91347)
**Author:** [@gs21](https://discuss.elastic.co/u/gs21)\ **Replies:** 1\ **Last updated:** [July 5, 2017, 6:44pm UTC](https://discuss.elastic.co/t/facing-issues-while-installing-stomp-plugin-in-logstash/91347 "2017-07-05T18:44:28Z")
Hello Everyone, Facing issues while installing stomp plugin in logstash. Need help in resolving it. Error message: C:\\ES\_NEW\\logstash-5.4.2\>bin\\logstash-plugin install logstash-input-stomp ERROR: Something went wro… --- ## [Why can't logstash accept any other ssl key format than PKCS8?](https://discuss.elastic.co/t/why-cant-logstash-accept-any-other-ssl-key-format-than-pkcs8/91961)
**Author:** [@raazeev64](https://discuss.elastic.co/u/raazeev64)\ **Replies:** 0\ **Last updated:** [July 5, 2017, 4:53pm UTC](https://discuss.elastic.co/t/why-cant-logstash-accept-any-other-ssl-key-format-than-pkcs8/91961 "2017-07-05T16:53:01Z")
I am trying to implement SSL security to the communication between FileBeat and Logstash. I have all the certificates and keys(server as well as CA) except for the format of the server key. I have that in PKCS12 and JKS … [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=949) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=951)