# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1249 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1250 --- ## [Getting a warning while using the latest version of logstash 1.5.3](https://discuss.elastic.co/t/getting-a-warning-while-using-the-latest-version-of-logstash-1-5-3/26379)
**Author:** [@Kuldip\_Madnani](https://discuss.elastic.co/u/Kuldip_Madnani)\ **Replies:** 3\ **Last updated:** [July 28, 2015, 6:06am UTC](https://discuss.elastic.co/t/getting-a-warning-while-using-the-latest-version-of-logstash-1-5-3/26379 "2015-07-28T06:06:40Z")
Command executed : /opt/app/logstash/bin/logstash --configtest --config /home/logstash/apache.config Warning received : '\[DEPRECATED\] use require 'concurrent' instead of require 'concurrent\_ruby' Configuration OK --- ## [Log stash process keeps crashing](https://discuss.elastic.co/t/log-stash-process-keeps-crashing/26353)
**Author:** [@utpal\_das123](https://discuss.elastic.co/u/utpal_das123)\ **Replies:** 1\ **Last updated:** [July 27, 2015, 10:36pm UTC](https://discuss.elastic.co/t/log-stash-process-keeps-crashing/26353 "2015-07-27T22:36:26Z")
Hi, My log stash process keeps crashing periodically. I need to debug the root cause, is there any logs or crash dumps i can inspect. I have installed on red hat linux --- ## [Delete datas before insert](https://discuss.elastic.co/t/delete-datas-before-insert/26336)
**Author:** [@Vince059](https://discuss.elastic.co/u/Vince059)\ **Replies:** 1\ **Last updated:** [July 27, 2015, 10:18pm UTC](https://discuss.elastic.co/t/delete-datas-before-insert/26336 "2015-07-27T22:18:39Z")
Hello ! I use logstash to save my CSV files in ElasticSearch. I need to delete my old datas before each treatment. Example : a new CSV file is copied in my directory logstash delete items in elasticsearch with a q… --- ## [Conditional on file input plugin](https://discuss.elastic.co/t/conditional-on-file-input-plugin/26339)
**Author:** [@martbhell](https://discuss.elastic.co/u/martbhell)\ **Replies:** 3\ **Last updated:** [July 27, 2015, 6:05pm UTC](https://discuss.elastic.co/t/conditional-on-file-input-plugin/26339 "2015-07-27T18:05:38Z")
Hello! Goal: Have one logstash config for many hosts with only file inputs, except on one or few of them don't read this one type of logs. Basically I would like to have something like: input { if \[hostname\] != "… --- ## [Logstash Duplicate message](https://discuss.elastic.co/t/logstash-duplicate-message/26096)
**Author:** [@Junior\_Burleon](https://discuss.elastic.co/u/Junior_Burleon)\ **Replies:** 3\ **Last updated:** [July 27, 2015, 2:06pm UTC](https://discuss.elastic.co/t/logstash-duplicate-message/26096 "2015-07-27T14:06:59Z")
Hi, I really need your help. I use LogStash-Forwarder on a server to send my log on another server that use LogStash. And I Visualize all of my logs with Kibana. (Of course a use ElasticSearch for the analyze but I th… --- ## [Is there a way to feed live data to logstash?](https://discuss.elastic.co/t/is-there-a-way-to-feed-live-data-to-logstash/26325)
**Author:** [@Anmol\_Gupta](https://discuss.elastic.co/u/Anmol_Gupta)\ **Replies:** 4\ **Last updated:** [July 27, 2015, 8:04am UTC](https://discuss.elastic.co/t/is-there-a-way-to-feed-live-data-to-logstash/26325 "2015-07-27T08:04:34Z")
as this is possible in CSV file that we can add live data to it, is it possible for databse as well? for example while running a csv file on logstash we add rows to it i9t get reflected on KIBANA but this is not possible… --- ## [Error when converting timestamp date](https://discuss.elastic.co/t/error-when-converting-timestamp-date/26327)
**Author:** [@EricK](https://discuss.elastic.co/u/EricK)\ **Replies:** 1\ **Last updated:** [July 27, 2015, 7:14am UTC](https://discuss.elastic.co/t/error-when-converting-timestamp-date/26327 "2015-07-27T07:14:08Z")
Trying to add date from field (start\_date) to @timestamp using the following filter: date { match =\> \[ "start\_date", "yyyy-MM-dd HH:mm:ss Z" \] } start\_date is in the format: 2015-07-26 11:54:43 +0100 I get the followi… --- ## [F5 log to logstash via Redis](https://discuss.elastic.co/t/f5-log-to-logstash-via-redis/26299)
**Author:** [@bw57899](https://discuss.elastic.co/u/bw57899)\ **Replies:** 2\ **Last updated:** [July 27, 2015, 12:07am UTC](https://discuss.elastic.co/t/f5-log-to-logstash-via-redis/26299 "2015-07-27T00:07:36Z")
The network F5 team export the log via syslog protocol to logstash. I provide the port with below, and get the logs successfully. input { syslog { type =\> syslog port =\> 5514 } } But I want to export the … --- ## [Newbie: logstash not talking to elasticsearch](https://discuss.elastic.co/t/newbie-logstash-not-talking-to-elasticsearch/26291)
**Author:** [@creepwood](https://discuss.elastic.co/u/creepwood)\ **Replies:** 5\ **Last updated:** [July 26, 2015, 4:12pm UTC](https://discuss.elastic.co/t/newbie-logstash-not-talking-to-elasticsearch/26291 "2015-07-26T16:12:12Z")
I'm been struggling for three days more or less to get pfsense logs into elasticsearch. I'm running debian jessie on a VM. pfsense is running real. I did the easy config in pfsense, setting up IP local IP and port 514. I… --- ## [Logstash-jdbc-input mapping issues \[bug \]](https://discuss.elastic.co/t/logstash-jdbc-input-mapping-issues-bug/26283)
**Author:** [@Navneet\_Mathpal](https://discuss.elastic.co/u/Navneet_Mathpal)\ **Replies:** 2\ **Last updated:** [July 26, 2015, 4:30am UTC](https://discuss.elastic.co/t/logstash-jdbc-input-mapping-issues-bug/26283 "2015-07-26T04:30:05Z")
I was trying to specify the type : lets us suppose I have already a mapping available for index . Lets say type is "mydata". If i talk about csv filter in Logstash it has the feature to specify the type =\> "mycsv", so t… --- ## [Logstash/Elasticsearch beginner: Can't get File plugin to work. What am I doing wrong?](https://discuss.elastic.co/t/logstash-elasticsearch-beginner-cant-get-file-plugin-to-work-what-am-i-doing-wrong/26020)
**Author:** [@Marius\_Mathisen](https://discuss.elastic.co/u/Marius_Mathisen)\ **Replies:** 11\ **Last updated:** [July 25, 2015, 8:20am UTC](https://discuss.elastic.co/t/logstash-elasticsearch-beginner-cant-get-file-plugin-to-work-what-am-i-doing-wrong/26020 "2015-07-25T08:20:39Z")
I try to run a JSON file trough Logstash to index in Elasticsearch, but I can't seem to get it indexed. I don't get any error messages or anything. It says: "Logstash startup complete". I have a conf file called "logst… --- ## [Statsd - send metric only if exists](https://discuss.elastic.co/t/statsd-send-metric-only-if-exists/24072)
**Author:** [@matejzero](https://discuss.elastic.co/u/matejzero)\ **Replies:** 3\ **Last updated:** [July 25, 2015, 12:42am UTC](https://discuss.elastic.co/t/statsd-send-metric-only-if-exists/24072 "2015-07-25T00:42:56Z")
Hello! I'm using logstash to send apache and amavis metrics to statsd. I define all fields that should be sent to statsd but sometimes, some of the fields doesn't exist and I get error on stasd side. Statsd config: … --- ## [Logstash error](https://discuss.elastic.co/t/logstash-error/26244)
**Author:** [@fabioebner](https://discuss.elastic.co/u/fabioebner)\ **Replies:** 1\ **Last updated:** [July 25, 2015, 12:31am UTC](https://discuss.elastic.co/t/logstash-error/26244 "2015-07-25T00:31:22Z")
I'm trying o use with elastic and got this error: at org.elasticsearch.discovery.zen.ZenDiscovery$JoinThreadControl$1.run(ZenDiscovery.java:1384) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolE… --- ## [Custom pattern problems in the grok filter](https://discuss.elastic.co/t/custom-pattern-problems-in-the-grok-filter/26221)
**Author:** [@simonrisberg](https://discuss.elastic.co/u/simonrisberg)\ **Replies:** 1\ **Last updated:** [July 24, 2015, 8:14pm UTC](https://discuss.elastic.co/t/custom-pattern-problems-in-the-grok-filter/26221 "2015-07-24T20:14:00Z")
Hi! I'm currently using two different custom patterns that I've made in my logstash config. One pattern serves the purpose of filter a certain word in a filepath in the event message in every log and take out that par… --- ## [Logstash 1.5.2 : uninitialized constant LogStash::Inputs::Http::Base64](https://discuss.elastic.co/t/logstash-1-5-2-uninitialized-constant-logstash-inputs-http-base64/25149)
**Author:** [@marjolaine](https://discuss.elastic.co/u/marjolaine)\ **Replies:** 2\ **Last updated:** [July 24, 2015, 3:07pm UTC](https://discuss.elastic.co/t/logstash-1-5-2-uninitialized-constant-logstash-inputs-http-base64/25149 "2015-07-24T15:07:21Z")
Hello, I wanted to use the plugin http logsatsh input, but it is not in Logstash 1.5.1 (my actual version). So I update to 1.5.2 but when I try to start logsatsh, I have this error message : The error reported is: … --- ## [Nxlog - https - logstash error](https://discuss.elastic.co/t/nxlog-https-logstash-error/26159)
**Author:** [@quejinho](https://discuss.elastic.co/u/quejinho)\ **Replies:** 4\ **Last updated:** [July 24, 2015, 6:28am UTC](https://discuss.elastic.co/t/nxlog-https-logstash-error/26159 "2015-07-24T06:28:16Z")
So i have configured nxlog with https to talk with logstash. I got an error on nxlog side " ERROR unexpected data from server (64 bytes)" I looked it up and it looks like nxlog got https://github.com/lamby/pkg-nxlog-c… --- ## [Simple use case?](https://discuss.elastic.co/t/simple-use-case/26201)
**Author:** [@Sean\_McIlvenna](https://discuss.elastic.co/u/Sean_McIlvenna)\ **Replies:** 0\ **Last updated:** [July 24, 2015, 3:20am UTC](https://discuss.elastic.co/t/simple-use-case/26201 "2015-07-24T03:20:30Z")
Hello all... I am very new to ELK, I have what may be a stupid question but I've searched and searched and without any luck. Apologies if this is in some FAQ I have overlooked. I have many exciting use-cases I am worki… --- ## [Using Shield with SSO and ldap authorization](https://discuss.elastic.co/t/using-shield-with-sso-and-ldap-authorization/26154)
**Author:** [@Pierre\_Jacquot](https://discuss.elastic.co/u/Pierre_Jacquot)\ **Replies:** 1\ **Last updated:** [July 23, 2015, 9:43pm UTC](https://discuss.elastic.co/t/using-shield-with-sso-and-ldap-authorization/26154 "2015-07-23T21:43:18Z")
Hello, I am studying Elastic solution (including Shield and Whatcher) and I have some questions about feasability to integrate this product with our security constraint. All product we have to install on our network m… --- ## [Error while transferrring data from one ES cluster to another](https://discuss.elastic.co/t/error-while-transferrring-data-from-one-es-cluster-to-another/26187)
**Author:** [@vilas](https://discuss.elastic.co/u/vilas)\ **Replies:** 1\ **Last updated:** [July 23, 2015, 9:37pm UTC](https://discuss.elastic.co/t/error-while-transferrring-data-from-one-es-cluster-to-another/26187 "2015-07-23T21:37:21Z")
I'm using to transfer data from one elasticsearch cluster to another using logstash configuration above. Getting this error while running the logstash: Host Cluster: Elasticsearch 1.1.1 Destination Cluster: Elasticsear… --- ## [Updated to 1.6.1 and seeing an issue. Time to jump to 1.7?](https://discuss.elastic.co/t/updated-to-1-6-1-and-seeing-an-issue-time-to-jump-to-1-7/26013)
**Author:** [@bdunbar](https://discuss.elastic.co/u/bdunbar)\ **Replies:** 4\ **Last updated:** [July 23, 2015, 8:54pm UTC](https://discuss.elastic.co/t/updated-to-1-6-1-and-seeing-an-issue-time-to-jump-to-1-7/26013 "2015-07-23T20:54:08Z")
I have four ES nodes, one of which is a client, and is streaming archived log data into the cluster. After upgrading all nodes to 1.6.1. \[1\] I restarted my intake script. While it appears to be adding data, it's also … --- ## [Multiline filter scrambling messages](https://discuss.elastic.co/t/multiline-filter-scrambling-messages/26186)
**Author:** [@psampson](https://discuss.elastic.co/u/psampson)\ **Replies:** 0\ **Last updated:** [July 23, 2015, 6:58pm UTC](https://discuss.elastic.co/t/multiline-filter-scrambling-messages/26186 "2015-07-23T18:58:44Z")
I am inputting logs using Logstash forwarder and using a multiline filter to build the logs into messages (each log is at least 2 lines). The problem is occasionally messages get mixed up. An example of the file with … --- ## [A docker image to build gems on docker hub](https://discuss.elastic.co/t/a-docker-image-to-build-gems-on-docker-hub/26175)
**Author:** [@Suny](https://discuss.elastic.co/u/Suny)\ **Replies:** 0\ **Last updated:** [July 23, 2015, 5:00pm UTC](https://discuss.elastic.co/t/a-docker-image-to-build-gems-on-docker-hub/26175 "2015-07-23T17:00:04Z")
Hi. I had to build gems for two logstash plugins, filter-translate and filter-math. I struggled a bit with jruby and bundler and ended up creating a docker image that automates this process. In case this is helpful for o… --- ## [How parse this field Transport: PTU.13-3034-3345-70;](https://discuss.elastic.co/t/how-parse-this-field-transport-ptu-13-3034-3345-70/26147)
**Author:** [@Smasell](https://discuss.elastic.co/u/Smasell)\ **Replies:** 4\ **Last updated:** [July 23, 2015, 12:07pm UTC](https://discuss.elastic.co/t/how-parse-this-field-transport-ptu-13-3034-3345-70/26147 "2015-07-23T12:07:27Z")
Hi!!! How to parse this field? Transport: PTU.13-3034-3345-70; Is it GREEDYDATA? --- ## [File locking in Windows of logs from logstash preventing deletion](https://discuss.elastic.co/t/file-locking-in-windows-of-logs-from-logstash-preventing-deletion/26010)
**Author:** [@trekr5](https://discuss.elastic.co/u/trekr5)\ **Replies:** 1\ **Last updated:** [July 23, 2015, 7:00am UTC](https://discuss.elastic.co/t/file-locking-in-windows-of-logs-from-logstash-preventing-deletion/26010 "2015-07-23T07:00:11Z")
Hello, I'm hoping someone can help me with this... I've got logstash running on a windows machine. The logs from logstash are then transferred to an AWS S3 bucket using an S3 plugin (which is essentially a Ruby scrip… --- ## [Read error looking for ack: read tcp 10.11.12.13:1223 i/o timeout](https://discuss.elastic.co/t/read-error-looking-for-ack-read-tcp-10-11-12-13-1223-i-o-timeout/23825)
**Author:** [@gugansankar](https://discuss.elastic.co/u/gugansankar)\ **Replies:** 3\ **Last updated:** [July 23, 2015, 4:19am UTC](https://discuss.elastic.co/t/read-error-looking-for-ack-read-tcp-10-11-12-13-1223-i-o-timeout/23825 "2015-07-23T04:19:54Z")
I'm getting this error message on Logstash-Forwarder. Since the logs are not sent to Logstash-Server. I have cross verified the Network connection. There is no blocking / Disturbance in Network \[ Firewall, Server iptable… --- ## [Logstashh : Got error to send bulk of actions to elasticsearch server at xx.xx.xxx](https://discuss.elastic.co/t/logstashh-got-error-to-send-bulk-of-actions-to-elasticsearch-server-at-xx-xx-xxx/26037)
**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\ **Replies:** 1\ **Last updated:** [July 23, 2015, 1:20am UTC](https://discuss.elastic.co/t/logstashh-got-error-to-send-bulk-of-actions-to-elasticsearch-server-at-xx-xx-xxx/26037 "2015-07-23T01:20:04Z")
Hi, I was facing low disk watermark issue on ES. I dont know solution of this, So I deleted old indexes and restarted the cluster. Then Logstash indexer started giving error {:timestamp=\>"2015-07-22T03:00:15.380000+0300… --- ## [Upgrade logstash](https://discuss.elastic.co/t/upgrade-logstash/26089)
**Author:** [@Smasell](https://discuss.elastic.co/u/Smasell)\ **Replies:** 5\ **Last updated:** [July 23, 2015, 1:16am UTC](https://discuss.elastic.co/t/upgrade-logstash/26089 "2015-07-23T01:16:34Z")
I currently use logstash-1.4.2 and want to upgrade it to the last stable version. But can't find any information about - How to upgrade logstash. Show me, please, any information about? --- ## [Issue parsing nested JSON](https://discuss.elastic.co/t/issue-parsing-nested-json/26097)
**Author:** [@Jakauppila](https://discuss.elastic.co/u/Jakauppila)\ **Replies:** 6\ **Last updated:** [July 22, 2015, 10:40pm UTC](https://discuss.elastic.co/t/issue-parsing-nested-json/26097 "2015-07-22T22:40:23Z")
I am having issues parsing the second nested json event message coming from NXLog using Logstash 1.5.3. I have configured NXLog to ship my Log4Net app logs to a Logstash collector via TCP. From that collector, I ship th… --- ## [ELK Stack for 1TB logs per day from multiple services](https://discuss.elastic.co/t/elk-stack-for-1tb-logs-per-day-from-multiple-services/26111)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 1\ **Last updated:** [July 23, 2015, 1:11am UTC](https://discuss.elastic.co/t/elk-stack-for-1tb-logs-per-day-from-multiple-services/26111 "2015-07-23T01:11:59Z")
We are trying to set up an ELK stack for two of our services where each service dumps about 1TB logs per day. The logs are well structured. There will hardly be any expensive groking or filtering in logstash servers. The… --- ## [Logstash 1.5 plugin compatibility with "logstash/time\_addon" class](https://discuss.elastic.co/t/logstash-1-5-plugin-compatibility-with-logstash-time-addon-class/26071)
**Author:** [@barakSpoj](https://discuss.elastic.co/u/barakSpoj)\ **Replies:** 1\ **Last updated:** [July 22, 2015, 1:51pm UTC](https://discuss.elastic.co/t/logstash-1-5-plugin-compatibility-with-logstash-time-addon-class/26071 "2015-07-22T13:51:45Z")
Hey, I am trying to upgrade our logstash version and plugins to the new 1.5.2. On a clean installation it works without problem, but when I'm trying to upgrade our custom plugins I get into some trouble. My current m… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1248) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1250)