# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1219 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1220 --- ## [Logstash data Loss](https://discuss.elastic.co/t/logstash-data-loss/35032)
**Author:** [@billy6](https://discuss.elastic.co/u/billy6)\ **Replies:** 3\ **Last updated:** [November 19, 2015, 11:28am UTC](https://discuss.elastic.co/t/logstash-data-loss/35032 "2015-11-19T11:28:27Z")
Hi! I have noticed I'm loosing data in logstash, when I send 500 packages from my application, logstash only send 300 more or less. I have included a counter in the packages sent and I have realized I'm loosing data af… --- ## [Couldn't find any output plugin named 'elasticsearch'](https://discuss.elastic.co/t/couldnt-find-any-output-plugin-named-elasticsearch/35041)
**Author:** [@narendra\_reddy](https://discuss.elastic.co/u/narendra_reddy)\ **Replies:** 0\ **Last updated:** [November 19, 2015, 11:14am UTC](https://discuss.elastic.co/t/couldnt-find-any-output-plugin-named-elasticsearch/35041 "2015-11-19T11:14:26Z")
Hi Team, I get logs from scribe on 1463 port to log stash, and I have installed logstash-output-elasticsearch as well, when I try run log stash with both the paths its not detecting the output path; below is the comma… --- ## [Unknown setting 'port' for elasticsearch {:level=\>:error}](https://discuss.elastic.co/t/unknown-setting-port-for-elasticsearch-level-error/34921)
**Author:** [@r.ganeshbabu](https://discuss.elastic.co/u/r.ganeshbabu)\ **Replies:** 2\ **Last updated:** [November 19, 2015, 7:16am UTC](https://discuss.elastic.co/t/unknown-setting-port-for-elasticsearch-level-error/34921 "2015-11-19T07:16:19Z")
Hi All, I am using Elasticsearch 1.7.2 and try to copy docs from one index to another index by using logstash 1.5.5 When I am doing configtest of the logstash configuration file. bin/logstash agent --configtest … --- ## [Connecting logstash to swift-ceph](https://discuss.elastic.co/t/connecting-logstash-to-swift-ceph/34901)
**Author:** [@Jin\_Nguyen](https://discuss.elastic.co/u/Jin_Nguyen)\ **Replies:** 2\ **Last updated:** [November 19, 2015, 4:28am UTC](https://discuss.elastic.co/t/connecting-logstash-to-swift-ceph/34901 "2015-11-19T04:28:37Z")
Hi all, I find out a custom plugin here GitHub - jedipunkz/logstash-output-plugin-swift: Logstash output plugin for OpenStack Swift to connect to swift Openstack. But what I need is connecting to swift on Ceph storage u… --- ## [Does multiple indices in output work?](https://discuss.elastic.co/t/does-multiple-indices-in-output-work/35009)
**Author:** [@davidweir](https://discuss.elastic.co/u/davidweir)\ **Replies:** 0\ **Last updated:** [November 19, 2015, 1:39am UTC](https://discuss.elastic.co/t/does-multiple-indices-in-output-work/35009 "2015-11-19T01:39:39Z")
Continuing the discussion from Multiple Elasticsearch Indices in Logstash output: Running logstash 1.5.4, elasticsearch 1.4.5 and kibana 4.1.2 Ive set up this output configuration for logstash but I'm not seeing the d… --- ## [Install logstash as a service via Powershell](https://discuss.elastic.co/t/install-logstash-as-a-service-via-powershell/34900)
**Author:** [@pedrovac](https://discuss.elastic.co/u/pedrovac)\ **Replies:** 2\ **Last updated:** [November 19, 2015, 1:05am UTC](https://discuss.elastic.co/t/install-logstash-as-a-service-via-powershell/34900 "2015-11-19T01:05:34Z")
Hello. I have a problem. I'm trying to install Logstash as a service in Windows OS via Powershell. I have run.bat file to start logstash: logstash.bat agent -f logstash.conf My PS command looks like: New-Service -… --- ## [How to configure logstash to pick (not receive) data](https://discuss.elastic.co/t/how-to-configure-logstash-to-pick-not-receive-data/35003)
**Author:** [@sampasei](https://discuss.elastic.co/u/sampasei)\ **Replies:** 0\ **Last updated:** [November 18, 2015, 11:34pm UTC](https://discuss.elastic.co/t/how-to-configure-logstash-to-pick-not-receive-data/35003 "2015-11-18T23:34:58Z")
Hi all, i have two servers with these features: Server1: collects data with Logstash. The data can be saved locally Server2 : takes the data from Server1 The communication can be only from Server2 to Server1 in HTTP… --- ## [Send router logs to Logstash](https://discuss.elastic.co/t/send-router-logs-to-logstash/34974)
**Author:** [@Kaufusihm](https://discuss.elastic.co/u/Kaufusihm)\ **Replies:** 1\ **Last updated:** [November 18, 2015, 10:56pm UTC](https://discuss.elastic.co/t/send-router-logs-to-logstash/34974 "2015-11-18T22:56:31Z")
I'm trying to get logs from a switch (router) to Logstash, but I am having trouble figuring out how to do so. !) Do I need to use the UDP input? I am not sure... --- ## [Elasticsearch input with AWS ES as service](https://discuss.elastic.co/t/elasticsearch-input-with-aws-es-as-service/34988)
**Author:** [@treehouse](https://discuss.elastic.co/u/treehouse)\ **Replies:** 0\ **Last updated:** [November 18, 2015, 8:13pm UTC](https://discuss.elastic.co/t/elasticsearch-input-with-aws-es-as-service/34988 "2015-11-18T20:13:13Z")
wondering if anyone has tried streaming data out of AWS ES with the elasticsearch input plugin.. i can write to it fine, but seemingly can't read with the input plugin -- A plugin had an unrecoverable error. Will resta… --- ## [Logstash 1.5.x grok regex multiline behavior change?](https://discuss.elastic.co/t/logstash-1-5-x-grok-regex-multiline-behavior-change/34347)
**Author:** [@bitsofinfo](https://discuss.elastic.co/u/bitsofinfo)\ **Replies:** 3\ **Last updated:** [November 18, 2015, 6:00pm UTC](https://discuss.elastic.co/t/logstash-1-5-x-grok-regex-multiline-behavior-change/34347 "2015-11-18T18:00:29Z")
Hi, Currently upgrading from 1.4.1 to 1.5.4 This filter works fine in 1.4.x : https://github.com/bitsofinfo/logstash-modsecurity/blob/master/logstash-modsecurity.conf When I run it in 1.5.4 it "sort of" works. Ther… --- ## [\_datepassefailure](https://discuss.elastic.co/t/-datepassefailure/34180)
**Author:** [@tgdesrochers](https://discuss.elastic.co/u/tgdesrochers)\ **Replies:** 8\ **Last updated:** [November 18, 2015, 1:21pm UTC](https://discuss.elastic.co/t/-datepassefailure/34180 "2015-11-18T13:21:48Z")
Logstash 2.0 I am parsing logs in JSON with date format as: 2015-11-09T17:28:44.978477Z I am using date { match =\> \["ts", "UNIX"\] } I am getting errors that state "\_dateparsefailure" I tried to change… --- ## [Logstash for solr logs](https://discuss.elastic.co/t/logstash-for-solr-logs/34798)
**Author:** [@Maddy](https://discuss.elastic.co/u/Maddy)\ **Replies:** 4\ **Last updated:** [November 18, 2015, 11:08am UTC](https://discuss.elastic.co/t/logstash-for-solr-logs/34798 "2015-11-18T11:08:02Z")
I am trying to process solr logs using logstash, but the "solr.log" file contains logs from all the collections, i want log of one particular collection. Can someone help? --- ## [How to connect logstash 1.5.5 to s3-ceph storage?](https://discuss.elastic.co/t/how-to-connect-logstash-1-5-5-to-s3-ceph-storage/34789)
**Author:** [@Jin\_Nguyen](https://discuss.elastic.co/u/Jin_Nguyen)\ **Replies:** 3\ **Last updated:** [November 18, 2015, 10:29am UTC](https://discuss.elastic.co/t/how-to-connect-logstash-1-5-5-to-s3-ceph-storage/34789 "2015-11-18T10:29:44Z")
Dear all, I need to connect logstash output to my s3-ceph storage but the s3 output settings does not let me choose custom region\_enpoint. I have a endpoint named s3.myhost.com so what do I need to do to connect logst… --- ## [Showing Result of http output plugin](https://discuss.elastic.co/t/showing-result-of-http-output-plugin/34918)
**Author:** [@maisyweb](https://discuss.elastic.co/u/maisyweb)\ **Replies:** 0\ **Last updated:** [November 18, 2015, 10:29am UTC](https://discuss.elastic.co/t/showing-result-of-http-output-plugin/34918 "2015-11-18T10:29:37Z")
Hi, I have the following output code that sends the results to an API output { stdout {} http { http\_method =\> post url =\> "http://api.xxxxxxxxxx.com/v1/properties" content\_type =\> "application/json;… --- ## [Logstash custom filter is not taking the field, and takes the filed name as the string instead](https://discuss.elastic.co/t/logstash-custom-filter-is-not-taking-the-field-and-takes-the-filed-name-as-the-string-instead/34779)
**Author:** [@Isra](https://discuss.elastic.co/u/Isra)\ **Replies:** 3\ **Last updated:** [November 18, 2015, 8:11am UTC](https://discuss.elastic.co/t/logstash-custom-filter-is-not-taking-the-field-and-takes-the-filed-name-as-the-string-instead/34779 "2015-11-18T08:11:36Z")
The following is my filter .rb file # encoding: utf-8 require "logstash/filters/base" require "logstash/namespace" require 'java' require 'myProject.jar' $CLASSPATH \<\< 'lib' class LogStash::Filters::Analyze \< LogSta… --- ## [Data Upload to elasticsearch](https://discuss.elastic.co/t/data-upload-to-elasticsearch/34887)
**Author:** [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\ **Replies:** 1\ **Last updated:** [November 18, 2015, 7:25am UTC](https://discuss.elastic.co/t/data-upload-to-elasticsearch/34887 "2015-11-18T07:25:51Z")
Hi , I am trying to import .json file to elasticsearch through logstash but not able to see the data.Also it getting processed through logstash once only ,it is not performing activities. PFA snapshot. Please find bel… --- ## [Logstash-2.0 issue with stdout | help required](https://discuss.elastic.co/t/logstash-2-0-issue-with-stdout-help-required/34743)
**Author:** [@pramodmax](https://discuss.elastic.co/u/pramodmax)\ **Replies:** 3\ **Last updated:** [November 18, 2015, 6:59am UTC](https://discuss.elastic.co/t/logstash-2-0-issue-with-stdout-help-required/34743 "2015-11-18T06:59:48Z")
Hi Team, I have an issue, in which the logstash is writing all the details into the "logstash.stdout" file. The file grows in time and consumes all the disk space\[100GB\], since we have 16 servers pushing all the log deta… --- ## [Jtds error](https://discuss.elastic.co/t/jtds-error/34769)
**Author:** [@vikas.saini](https://discuss.elastic.co/u/vikas.saini)\ **Replies:** 2\ **Last updated:** [November 18, 2015, 5:46am UTC](https://discuss.elastic.co/t/jtds-error/34769 "2015-11-18T05:46:29Z")
file: contacts-index-logstash.conf input { jdbc { jdbc\_connection\_string =\> "jdbc:jtds:sqlserver://host:port/database" jdbc\_user =\> "username" jdbc\_password =\> "password" jdbc\_validat… --- ## [Geoip filter not creating type geo\_point](https://discuss.elastic.co/t/geoip-filter-not-creating-type-geo-point/34873)
**Author:** [@treehouse](https://discuss.elastic.co/u/treehouse)\ **Replies:** 2\ **Last updated:** [November 18, 2015, 5:43am UTC](https://discuss.elastic.co/t/geoip-filter-not-creating-type-geo-point/34873 "2015-11-18T05:43:28Z")
hello team elastic i'm using the regular geoip filter in elasticsearch: geoip{ source =\> "clientip" target =\> "geoip" } but if you take a look at the geoip mapping in elasticsearch it seems as though \[geoip\]\[loc… --- ## [Problem installing Logstash plugins](https://discuss.elastic.co/t/problem-installing-logstash-plugins/34808)
**Author:** [@Kryten](https://discuss.elastic.co/u/Kryten)\ **Replies:** 2\ **Last updated:** [November 18, 2015, 5:14am UTC](https://discuss.elastic.co/t/problem-installing-logstash-plugins/34808 "2015-11-18T05:14:58Z")
Hi, I'd really appreciate some assistance in understanding how to deal with installing Logstash plugins locally (no internet access). I was given some gem files to install as filter plugins so I followed the process … --- ## [How to install http\_pollar plugin manually in Logstash?](https://discuss.elastic.co/t/how-to-install-http-pollar-plugin-manually-in-logstash/29308)
**Author:** [@RohanKumbhar](https://discuss.elastic.co/u/RohanKumbhar)\ **Replies:** 4\ **Last updated:** [November 18, 2015, 4:48am UTC](https://discuss.elastic.co/t/how-to-install-http-pollar-plugin-manually-in-logstash/29308 "2015-11-18T04:48:13Z")
How to install http\_pollar plugin manually in Logstash? --- ## [Logstash - Report line Number on error](https://discuss.elastic.co/t/logstash-report-line-number-on-error/34866)
**Author:** [@Raggyman](https://discuss.elastic.co/u/Raggyman)\ **Replies:** 7\ **Last updated:** [November 18, 2015, 2:08am UTC](https://discuss.elastic.co/t/logstash-report-line-number-on-error/34866 "2015-11-18T02:08:31Z")
Becoming increasingly frustrated using Logstash for the simple need of a line number when there is an error occurs when reading the configuration. The move from 1.6 to 2.0 has been anything but painless. Error meanin… --- ## [Logstash losing connection to Elasticsearch](https://discuss.elastic.co/t/logstash-losing-connection-to-elasticsearch/33446)
**Author:** [@kelv1n](https://discuss.elastic.co/u/kelv1n)\ **Replies:** 7\ **Last updated:** [November 17, 2015, 9:28pm UTC](https://discuss.elastic.co/t/logstash-losing-connection-to-elasticsearch/33446 "2015-11-17T21:28:58Z")
Hi Guys I'm tried to setup a ELK cluster using the latest 2.0 releases, after a period of about 15-20 minutes it seems Logstash can no longer connect to Elasticsearch and the Logstash logs get flooded with the messages… --- ## [Logstash FlushSize correlation to Heap Size](https://discuss.elastic.co/t/logstash-flushsize-correlation-to-heap-size/34729)
**Author:** [@rahulnadella](https://discuss.elastic.co/u/rahulnadella)\ **Replies:** 1\ **Last updated:** [November 17, 2015, 8:39pm UTC](https://discuss.elastic.co/t/logstash-flushsize-correlation-to-heap-size/34729 "2015-11-17T20:39:33Z")
I trying to figure out if there is a way to calculate (via specific formula) the corresponding Logstash Heap Size should be based on the set Flush\_Size. Currently we are trying to set the flush\_size to 5000 and the heap\_… --- ## [Is JDBC input plugin installed default while installing logstash 1.4.2 or logstash 1.5.4?](https://discuss.elastic.co/t/is-jdbc-input-plugin-installed-default-while-installing-logstash-1-4-2-or-logstash-1-5-4/34446)
**Author:** [@thiruna](https://discuss.elastic.co/u/thiruna)\ **Replies:** 15\ **Last updated:** [November 17, 2015, 8:07pm UTC](https://discuss.elastic.co/t/is-jdbc-input-plugin-installed-default-while-installing-logstash-1-4-2-or-logstash-1-5-4/34446 "2015-11-17T20:07:44Z")
Hi, is JDBC input plugin installed default while installing logstash 1.4.2 or logstash 1.5.4? We need to use this plugin for Oracle Database. How to know the list of input plugins installed on logstash 1.4.2? I c… --- ## [Logstash running out of memory, tcp{} input](https://discuss.elastic.co/t/logstash-running-out-of-memory-tcp-input/34735)
**Author:** [@nrgetik](https://discuss.elastic.co/u/nrgetik)\ **Replies:** 1\ **Last updated:** [November 17, 2015, 7:29pm UTC](https://discuss.elastic.co/t/logstash-running-out-of-memory-tcp-input/34735 "2015-11-17T19:29:27Z")
Error: Your application used more memory than the safety cap of 500M I began encountering this crash/error condition a few days ago when setting up Logstash 2.0.0 alongside Elasticsearch 2.0.0, both installed via RPM.… --- ## [Filter problems](https://discuss.elastic.co/t/filter-problems/34827)
**Author:** [@Jackal9301](https://discuss.elastic.co/u/Jackal9301)\ **Replies:** 7\ **Last updated:** [November 17, 2015, 7:01pm UTC](https://discuss.elastic.co/t/filter-problems/34827 "2015-11-17T19:01:53Z")
Hey guys I'm trying to match a string in a filter. But the output isn't giving me what i'm expecting. The input is: \<36\>Nov 02 15:48:57 LCE: \[not-matched\] 0.0.0.0:0 -\> 10.1.116.173:0 :: filter{ grok{ match =\> {"mess… --- ## [\_grokparsefailure for IIS logs](https://discuss.elastic.co/t/-grokparsefailure-for-iis-logs/34829)
**Author:** [@Omar\_Al\_Zabir](https://discuss.elastic.co/u/Omar_Al_Zabir)\ **Replies:** 9\ **Last updated:** [November 17, 2015, 6:58pm UTC](https://discuss.elastic.co/t/-grokparsefailure-for-iis-logs/34829 "2015-11-17T18:58:08Z")
I have been trying various combinations of patterns to get IIS logs parsed, but have been unsuccessful in getting the patterns to match. I can get apache logs to parse perfectly fine, even with geoip. But I just can't ge… --- ## [JDBC Input from last document\_id](https://discuss.elastic.co/t/jdbc-input-from-last-document-id/34801)
**Author:** [@pedrovieira](https://discuss.elastic.co/u/pedrovieira)\ **Replies:** 0\ **Last updated:** [November 17, 2015, 1:04pm UTC](https://discuss.elastic.co/t/jdbc-input-from-last-document-id/34801 "2015-11-17T13:04:08Z")
Hi, I´m using Logstash with JDBC to connect to a Microsoft SQL Server. My Table (or query) return a datetime and a id field. Since last\_run\_metadata\_path saves on a different time format than SQL Server, I´d like to qu… --- ## [Logstash falls from time to time. tcp input module error](https://discuss.elastic.co/t/logstash-falls-from-time-to-time-tcp-input-module-error/34775)
**Author:** [@ipeacocks](https://discuss.elastic.co/u/ipeacocks)\ **Replies:** 0\ **Last updated:** [November 17, 2015, 9:39am UTC](https://discuss.elastic.co/t/logstash-falls-from-time-to-time-tcp-input-module-error/34775 "2015-11-17T09:39:15Z")
Hello. Sometimes our Logstash falls with such error in logs: {:timestamp=\>"2015-11-11T15:55:33.706000+0000", :message=\>"An error occurred. Closing connection", :client=\>"10.100.54.60:31166", :exception=\>#\