# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1245 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1246 --- ## [Beginner question: Verifying that a file has successfully been entered in ES](https://discuss.elastic.co/t/beginner-question-verifying-that-a-file-has-successfully-been-entered-in-es/27151)
**Author:** [@Didier](https://discuss.elastic.co/u/Didier)\ **Replies:** 5\ **Last updated:** [August 12, 2015, 5:37am UTC](https://discuss.elastic.co/t/beginner-question-verifying-that-a-file-has-successfully-been-entered-in-es/27151 "2015-08-12T05:37:41Z")
Greetings Logstash Community, I am very new to the Logstash/ElasticSearch application and I have a very basic question: I have the following configuration file where my goal is to take a log file and insert it in El… --- ## [Logstash is processing logs too slow](https://discuss.elastic.co/t/logstash-is-processing-logs-too-slow/25477)
**Author:** [@scukonick](https://discuss.elastic.co/u/scukonick)\ **Replies:** 3\ **Last updated:** [August 12, 2015, 3:12am UTC](https://discuss.elastic.co/t/logstash-is-processing-logs-too-slow/25477 "2015-08-12T03:12:31Z")
Hello, I have the next configuration. ES cluster with 5 servers, each with Intel Xeon 192.99.19.55 and 64GB RAM (3 of the with 128GB). Nginx which is load balancing http requests to ES is on one of them. And I have 3… --- ## ["IO/console not supported" when LS is started on Windows](https://discuss.elastic.co/t/io-console-not-supported-when-ls-is-started-on-windows/27221)
**Author:** [@Didier](https://discuss.elastic.co/u/Didier)\ **Replies:** 1\ **Last updated:** [August 11, 2015, 11:40pm UTC](https://discuss.elastic.co/t/io-console-not-supported-when-ls-is-started-on-windows/27221 "2015-08-11T23:40:23Z")
Hello, I receive the following error whenever I launch Logstash on a Windows 7, 64 bit VM: "IO/console not supported; tty will not be manipulated" This error always occurs, whether I define or not a Config file (us… --- ## [Logstash keeps hanging](https://discuss.elastic.co/t/logstash-keeps-hanging/27214)
**Author:** [@theologian](https://discuss.elastic.co/u/theologian)\ **Replies:** 1\ **Last updated:** [August 11, 2015, 11:29pm UTC](https://discuss.elastic.co/t/logstash-keeps-hanging/27214 "2015-08-11T23:29:44Z")
Hello, We are having an issue where logstash just hangs. When we strace -f the PID it starts working again. We tried upping the memory, but that did not fix it. We also tried kill -3 (see output below) and jstack, but… --- ## [Logstash-input-jmx-0.1.5.gem Plugin Install error](https://discuss.elastic.co/t/logstash-input-jmx-0-1-5-gem-plugin-install-error/27209)
**Author:** [@Dilip2610](https://discuss.elastic.co/u/Dilip2610)\ **Replies:** 1\ **Last updated:** [August 11, 2015, 11:27pm UTC](https://discuss.elastic.co/t/logstash-input-jmx-0-1-5-gem-plugin-install-error/27209 "2015-08-11T23:27:17Z")
Hi, I am getting below error while installing JMX plugin C:\\Elasticsearch\\logstash-1.5.1\\logstash-1.5.1\\bin plugin install logstash-input-jmx-0.1.5.gem io/console not supported; tty will not be manipulated Validat… --- ## [How to stop message from being sent after grok](https://discuss.elastic.co/t/how-to-stop-message-from-being-sent-after-grok/27211)
**Author:** [@jclose](https://discuss.elastic.co/u/jclose)\ **Replies:** 2\ **Last updated:** [August 11, 2015, 8:00pm UTC](https://discuss.elastic.co/t/how-to-stop-message-from-being-sent-after-grok/27211 "2015-08-11T20:00:22Z")
I have a logstash agent on a box. It gets data (from redis), does a grok and parses things apart, and then sends the JSON to another box, where elastic brings it in. The message is grok'd, and then gets sent along wit… --- ## [Error While loading mysql db](https://discuss.elastic.co/t/error-while-loading-mysql-db/27098)
**Author:** [@Dan](https://discuss.elastic.co/u/Dan)\ **Replies:** 3\ **Last updated:** [August 11, 2015, 6:17pm UTC](https://discuss.elastic.co/t/error-while-loading-mysql-db/27098 "2015-08-11T18:17:12Z")
Hi All, i am try to load mysql data into elastic search by using logstash. when i create a index i am getting below error. \[2015-08-10 09:52:18,417\]\[INFO \]\[cluster.service \] \[Allison Blaire\] added {\[Robert … --- ## [Input jdbc scheduler](https://discuss.elastic.co/t/input-jdbc-scheduler/27201)
**Author:** [@michaellizhou](https://discuss.elastic.co/u/michaellizhou)\ **Replies:** 2\ **Last updated:** [August 11, 2015, 6:11pm UTC](https://discuss.elastic.co/t/input-jdbc-scheduler/27201 "2015-08-11T18:11:03Z")
Is there a specific method to running logstash with jdbc input that has a schedule? What I have noticed for the paste 1-2 hours is that my schedule is not actually running! I have the schedule set to "\* \* \* \* \*" but it l… --- ## [Can't parse field](https://discuss.elastic.co/t/cant-parse-field/26557)
**Author:** [@Smasell](https://discuss.elastic.co/u/Smasell)\ **Replies:** 3\ **Last updated:** [August 11, 2015, 5:26pm UTC](https://discuss.elastic.co/t/cant-parse-field/26557 "2015-08-11T17:26:38Z")
Hey, I have message: "message": "\[Fri Jul 24 23:34:09 2015\] \[error\] \[client 217.118.78.107\] device-model=Fly+IQ4415+Quad&ram=456&build-type=etc1", All I want is to parse 3 fields: "device\_model": "Fly IQ4415 Quad" "… --- ## [File input not working in Windows](https://discuss.elastic.co/t/file-input-not-working-in-windows/27199)
**Author:** [@DavidL](https://discuss.elastic.co/u/DavidL)\ **Replies:** 0\ **Last updated:** [August 11, 2015, 3:52pm UTC](https://discuss.elastic.co/t/file-input-not-working-in-windows/27199 "2015-08-11T15:52:48Z")
So I know this has been a bug, but it seems still is one now I first tested everything on Mac it works just fine. but on Windows, this doesn't work. file{ path=\>"Users/Desktop/logs/\*.txt"} it won't read in anything… --- ## [GROK filter for JBOSS](https://discuss.elastic.co/t/grok-filter-for-jboss/26917)
**Author:** [@mgirndt](https://discuss.elastic.co/u/mgirndt)\ **Replies:** 7\ **Last updated:** [August 11, 2015, 2:08pm UTC](https://discuss.elastic.co/t/grok-filter-for-jboss/26917 "2015-08-11T14:08:05Z")
I'm new to the ELK stack and I'm trying to setup a GROK filter with multi-line pattern but I'm not having any luck. The pattern formatter I am needing is "%d{HH:mm:ss,SSS} %-5p \[%c\] {%t) %s%E%n"/ I am also needing for th… --- ## [Trying setting up ELK stack](https://discuss.elastic.co/t/trying-setting-up-elk-stack/26894)
**Author:** [@lukas\_meier](https://discuss.elastic.co/u/lukas_meier)\ **Replies:** 12\ **Last updated:** [August 11, 2015, 1:45pm UTC](https://discuss.elastic.co/t/trying-setting-up-elk-stack/26894 "2015-08-11T13:45:12Z")
hi im new to this, so many guides are available, but every single is special in part, i installed elasticsearch, logstash and the forwarder, then when i start logstash on the server, with simple direct output and saving … --- ## [Need support in parsing Syslog messages](https://discuss.elastic.co/t/need-support-in-parsing-syslog-messages/27149)
**Author:** [@Sumanth\_Damarla](https://discuss.elastic.co/u/Sumanth_Damarla)\ **Replies:** 10\ **Last updated:** [August 11, 2015, 1:27pm UTC](https://discuss.elastic.co/t/need-support-in-parsing-syslog-messages/27149 "2015-08-11T13:27:17Z")
I want to parse the below syslog message. Jul 23 11:39:11 cheerwine CEF: 0|OWASP|appsensor|1.0|IE1|Input Validation|7|cat=attack\_detection deviceExternalId=localhostme suser=bob cn1Label=thresholdCount cn1=3 cn2Labe… --- ## [Monitoring connection between syslog and ELK stack](https://discuss.elastic.co/t/monitoring-connection-between-syslog-and-elk-stack/27190)
**Author:** [@jkumar\_99](https://discuss.elastic.co/u/jkumar_99)\ **Replies:** 1\ **Last updated:** [August 11, 2015, 12:55pm UTC](https://discuss.elastic.co/t/monitoring-connection-between-syslog-and-elk-stack/27190 "2015-08-11T12:55:32Z")
I am new to ELK. I have my ELK stack working and polling logs using rsyslog. How do I monitor connection from several servers(using rsyslog) to logstash. I am looking for an alert when xxx host stops sending logs to ELK… --- ## [\_discover\_file\_glob: glob is: \[\]{:level=\>:debug, :file=\>"", :line=\>"117"}](https://discuss.elastic.co/t/-discover-file-glob-glob-is-level-debug-file-line-117/26965)
**Author:** [@vhdevera](https://discuss.elastic.co/u/vhdevera)\ **Replies:** 6\ **Last updated:** [August 11, 2015, 12:08pm UTC](https://discuss.elastic.co/t/-discover-file-glob-glob-is-level-debug-file-line-117/26965 "2015-08-11T12:08:39Z")
hi, i'm new with ELK and is to be able to configure it to receive syslog messages. Ultimately we would like logstash to receive cloudtrail files, to do this I tried to follow Parsing Amazon CloudTrail JSON Logs with a … --- ## [Logstash file input ,message columns reads one line at atime](https://discuss.elastic.co/t/logstash-file-input-message-columns-reads-one-line-at-atime/27041)
**Author:** [@Elastic\_POC](https://discuss.elastic.co/u/Elastic_POC)\ **Replies:** 4\ **Last updated:** [August 11, 2015, 11:49am UTC](https://discuss.elastic.co/t/logstash-file-input-message-columns-reads-one-line-at-atime/27041 "2015-08-11T11:49:56Z")
I am reading one.pdf file ,it reads it multiple events ,but i want to read whole file in one event .is it possible. Also my file content does not appear plain text . it has test as below.how can i get .pdf text as is it… --- ## [Processing binary data files, not processing the end lines](https://discuss.elastic.co/t/processing-binary-data-files-not-processing-the-end-lines/27174)
**Author:** [@Manjunath](https://discuss.elastic.co/u/Manjunath)\ **Replies:** 3\ **Last updated:** [August 11, 2015, 6:22am UTC](https://discuss.elastic.co/t/processing-binary-data-files-not-processing-the-end-lines/27174 "2015-08-11T06:22:58Z")
I tried processing a binary data file (Format application/octet-stream; charset=binary). Logstash is not processing the end lines, instead it starts processing from the almost middle of the file. Please help. I have to p… --- ## [Is logstash forwarder expected to be slower than logstash?](https://discuss.elastic.co/t/is-logstash-forwarder-expected-to-be-slower-than-logstash/26885)
**Author:** [@zpp](https://discuss.elastic.co/u/zpp)\ **Replies:** 4\ **Last updated:** [August 11, 2015, 3:50am UTC](https://discuss.elastic.co/t/is-logstash-forwarder-expected-to-be-slower-than-logstash/26885 "2015-08-11T03:50:52Z")
At the beginning, I set up a logstash service on windows to monitor all files in one folder. The service runs fine, data feeding to elasticsearch through redis is up to date and good. The only drawback is the cpu and mem… --- ## [Ingesting Geospatial data with Logstash](https://discuss.elastic.co/t/ingesting-geospatial-data-with-logstash/27154)
**Author:** [@Freddie](https://discuss.elastic.co/u/Freddie)\ **Replies:** 1\ **Last updated:** [August 11, 2015, 12:05am UTC](https://discuss.elastic.co/t/ingesting-geospatial-data-with-logstash/27154 "2015-08-11T00:05:06Z")
Basic logstash conf ... input { jdbc { jdbc\_driver\_library =\> "services/ows/webapps/ows/WEB-INF/lib/postgresql-8.4-701.jdbc3.jar" jdbc\_driver\_class =\> "org.postgresql.Driver" jdbc\_connection\_string =\> "jdb… --- ## [Make all columns not analyzed when i give jdbc input by logstash](https://discuss.elastic.co/t/make-all-columns-not-analyzed-when-i-give-jdbc-input-by-logstash/27112)
**Author:** [@Dan](https://discuss.elastic.co/u/Dan)\ **Replies:** 1\ **Last updated:** [August 10, 2015, 11:14pm UTC](https://discuss.elastic.co/t/make-all-columns-not-analyzed-when-i-give-jdbc-input-by-logstash/27112 "2015-08-10T23:14:10Z")
Hi All, I am using jdbc-input for logstash.By using this jdbc-input i am able to create index and i am able to load data into elastic search. But when i open this index in kibana to analyse getting issue that colu… --- ## [\[1.5.0\] elasticsearch output error](https://discuss.elastic.co/t/1-5-0-elasticsearch-output-error/2105)
**Author:** [@Bezalel\_Lim](https://discuss.elastic.co/u/Bezalel_Lim)\ **Replies:** 2\ **Last updated:** [August 10, 2015, 6:44pm UTC](https://discuss.elastic.co/t/1-5-0-elasticsearch-output-error/2105 "2015-08-10T18:44:23Z")
I've got such error messages and cannot send log data to elasticsearch server maybe after updating java from Java 7 to Java 8.. {:timestamp=\>"2015-06-05T10:18:17.134000+0000", :message=\>"Got error to send bulk of act… --- ## [Reading template in logstash](https://discuss.elastic.co/t/reading-template-in-logstash/27123)
**Author:** [@Dan](https://discuss.elastic.co/u/Dan)\ **Replies:** 1\ **Last updated:** [August 10, 2015, 5:28pm UTC](https://discuss.elastic.co/t/reading-template-in-logstash/27123 "2015-08-10T17:28:50Z")
Hi All, i am using logstash jdbc-input plugin to load data.I want all string columns should be analyzed. I fallowed bellow steps:: i have placed my own template at "C:\\logstash-1.5.3\\vendor\\bundle\\jruby\\1.9\\gems\\l… --- ## [Logstash-forwarder Debian repository?](https://discuss.elastic.co/t/logstash-forwarder-debian-repository/26866)
**Author:** [@michaelzoet](https://discuss.elastic.co/u/michaelzoet)\ **Replies:** 2\ **Last updated:** [August 10, 2015, 8:21am UTC](https://discuss.elastic.co/t/logstash-forwarder-debian-repository/26866 "2015-08-10T08:21:30Z")
Hi all, I have one simple question: is the logstash-forwarder Debian repository useable or not? I read a lot of discussions about this topic but they are all several months old. I also miss some final statement from El… --- ## [Is there any redis input plugin supports "lpop" command?](https://discuss.elastic.co/t/is-there-any-redis-input-plugin-supports-lpop-command/27103)
**Author:** [@MichaelScofield](https://discuss.elastic.co/u/MichaelScofield)\ **Replies:** 0\ **Last updated:** [August 10, 2015, 7:15am UTC](https://discuss.elastic.co/t/is-there-any-redis-input-plugin-supports-lpop-command/27103 "2015-08-10T07:15:13Z")
The last time I checked the logstash doc said that the official redis input plugin uses "blpop" command to get messages from redis. (Correct me if I'm wrong.) However, our redis cluster does not allow command "blpop". … --- ## [Identify new log entries during the last hour](https://discuss.elastic.co/t/identify-new-log-entries-during-the-last-hour/27083)
**Author:** [@Markus\_Korn](https://discuss.elastic.co/u/Markus_Korn)\ **Replies:** 1\ **Last updated:** [August 9, 2015, 10:23pm UTC](https://discuss.elastic.co/t/identify-new-log-entries-during-the-last-hour/27083 "2015-08-09T22:23:11Z")
Hi, is there a easy way to identify log messages which are new entries during the last hour? something similar to significant for last hour, but for a more "generalized" message, so without values in the message lik… --- ## [Logstash load of geo data from lat, long - Kibana not recognising geo](https://discuss.elastic.co/t/logstash-load-of-geo-data-from-lat-long-kibana-not-recognising-geo/26928)
**Author:** [@karijd](https://discuss.elastic.co/u/karijd)\ **Replies:** 2\ **Last updated:** [August 9, 2015, 3:26pm UTC](https://discuss.elastic.co/t/logstash-load-of-geo-data-from-lat-long-kibana-not-recognising-geo/26928 "2015-08-09T15:26:10Z")
Hi, I am having trouble getting Kibana to recognise my geo data as proper geo data which it can plot. I have done lots of searching for the answer but I cannot seem to get the logstash.conf file to work. The time colum… --- ## [Replacement across all fields with single rule](https://discuss.elastic.co/t/replacement-across-all-fields-with-single-rule/27081)
**Author:** [@KrishnaPG](https://discuss.elastic.co/u/KrishnaPG)\ **Replies:** 2\ **Last updated:** [August 9, 2015, 11:39am UTC](https://discuss.elastic.co/t/replacement-across-all-fields-with-single-rule/27081 "2015-08-09T11:39:59Z")
I have around 40 fields of numeric data in csv format and occasionally multiple fields in a row could be invalid values (indicated with, say, hyphen -). In the logstash is there a way to define a single generic mutate … --- ## [Logstash stopping unexpectedly](https://discuss.elastic.co/t/logstash-stopping-unexpectedly/27026)
**Author:** [@ksvagarwal](https://discuss.elastic.co/u/ksvagarwal)\ **Replies:** 2\ **Last updated:** [August 8, 2015, 5:55am UTC](https://discuss.elastic.co/t/logstash-stopping-unexpectedly/27026 "2015-08-08T05:55:53Z")
I have set up a logstash with redis architecture to handle my logs. The way I have organized it is: logstash ---\> redis ---\> logstash ---\> elasticsearch but the problem that occurred is that after parsing nearly 1.25 … --- ## [Logstash 1.5.3 crashes with moderate load](https://discuss.elastic.co/t/logstash-1-5-3-crashes-with-moderate-load/27015)
**Author:** [@Justin\_Schumacher](https://discuss.elastic.co/u/Justin_Schumacher)\ **Replies:** 3\ **Last updated:** [August 8, 2015, 1:32am UTC](https://discuss.elastic.co/t/logstash-1-5-3-crashes-with-moderate-load/27015 "2015-08-08T01:32:05Z")
We've set up a (r)elk stack in AWS. Everything seems to work without issue until we hit around 10k (100MB) of documents indexed at elastic search per second (noticed in Kopf). At about that point, all of our log stash in… --- ## [Correct method for geospatial mapping from postgres -\> logstash -\> Elasticsearch](https://discuss.elastic.co/t/correct-method-for-geospatial-mapping-from-postgres-logstash-elasticsearch/27010)
**Author:** [@Freddie](https://discuss.elastic.co/u/Freddie)\ **Replies:** 1\ **Last updated:** [August 7, 2015, 11:28pm UTC](https://discuss.elastic.co/t/correct-method-for-geospatial-mapping-from-postgres-logstash-elasticsearch/27010 "2015-08-07T23:28:27Z")
I'm getting the following error, on the mapping template "boundingArea": { "type": "geo\_shape", "tree": "quadtree", "precision": "1m" }, Does any… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1244) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1246)