# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1096 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1097 --- ## [Logstash input jdbc plugin with informix database not working with timestamp](https://discuss.elastic.co/t/logstash-input-jdbc-plugin-with-informix-database-not-working-with-timestamp/62004)
**Author:** [@praskatti](https://discuss.elastic.co/u/praskatti)\ **Replies:** 1\ **Last updated:** [October 3, 2016, 6:09pm UTC](https://discuss.elastic.co/t/logstash-input-jdbc-plugin-with-informix-database-not-working-with-timestamp/62004 "2016-10-03T18:09:29Z")
Hello, I am using the JDBC input plugin to perform the sync between informix and Elasticsearch data store. I am using the "sql\_last\_value" criteria to distinguish old data and new data. I have a created\_date field in th… --- ## [Logstash pooling data from kafka much faster with multiple processes](https://discuss.elastic.co/t/logstash-pooling-data-from-kafka-much-faster-with-multiple-processes/62014)
**Author:** [@rpuserh](https://discuss.elastic.co/u/rpuserh)\ **Replies:** 2\ **Last updated:** [October 3, 2016, 4:50pm UTC](https://discuss.elastic.co/t/logstash-pooling-data-from-kafka-much-faster-with-multiple-processes/62014 "2016-10-03T16:50:10Z")
I run logstash like this /opt/logstash/bin/logstash agent -f /opt/logstash/config/logstash.conf -w 48 this is config input { kafka { type =\> "nginx" zk\_connect =\> "zk1:2181,zk2:2181,zk3:2181" codec =\> "pla… --- ## [Logstash and MongoDB using logstash-input-mongodb](https://discuss.elastic.co/t/logstash-and-mongodb-using-logstash-input-mongodb/62081)
**Author:** [@DooGZ](https://discuss.elastic.co/u/DooGZ)\ **Replies:** 0\ **Last updated:** [October 3, 2016, 2:31pm UTC](https://discuss.elastic.co/t/logstash-and-mongodb-using-logstash-input-mongodb/62081 "2016-10-03T14:31:55Z")
Hi, tried using the unofficial logstash-input-mongodb, but im having problem importing MongoDB to ES. Is there something that I am missing in the config file? TIA MongoDB Name: test Table: restaurants Configuration: i… --- ## [Logstash - Elasticsearch filter unable to fetch start events](https://discuss.elastic.co/t/logstash-elasticsearch-filter-unable-to-fetch-start-events/62075)
**Author:** [@Sahana\_Shetty](https://discuss.elastic.co/u/Sahana_Shetty)\ **Replies:** 0\ **Last updated:** [October 3, 2016, 1:54pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch-filter-unable-to-fetch-start-events/62075 "2016-10-03T13:54:11Z")
I'm trying to replicate the exact use case for elasticsearch filter detailed in the docs https://www.elastic.co/guide/en/logstash/current/plugins-filters-elasticsearch.html My output is also the same elasticsearch ser… --- ## [Attempted to send a bulk request to Elasticsearch configured at '\["http://localhost:9200"\]', but Elasticsearch appears to be unreachable or down! {:error\_message=\>"Connexion refusée",](https://discuss.elastic.co/t/attempted-to-send-a-bulk-request-to-elasticsearch-configured-at-http-localhost-9200-but-elasticsearch-appears-to-be-unreachable-or-down-error-message-connexion-refusee/61359)
**Author:** [@Izana](https://discuss.elastic.co/u/Izana)\ **Replies:** 2\ **Last updated:** [October 3, 2016, 12:38pm UTC](https://discuss.elastic.co/t/attempted-to-send-a-bulk-request-to-elasticsearch-configured-at-http-localhost-9200-but-elasticsearch-appears-to-be-unreachable-or-down-error-message-connexion-refusee/61359 "2016-10-03T12:38:57Z")
Hello everyone, I am a beginner on ELK. I apologize first for my bad English, I'm French. I have 2 different error messages when launching the command "./logstash windows.conf -f". The first being: {Connection refuse… --- ## [Converting string to date](https://discuss.elastic.co/t/converting-string-to-date/26748)
**Author:** [@FrankC](https://discuss.elastic.co/u/FrankC)\ **Replies:** 7\ **Last updated:** [October 3, 2016, 12:12pm UTC](https://discuss.elastic.co/t/converting-string-to-date/26748 "2016-10-03T12:12:31Z")
Hi, I am getting started with logstash and I am looking for some help. I loaded the log file to ES but the logtimestamp field is a string. I want it to be a date. I understood how to convert to numeric data, but hav… --- ## [Real time data how processing in elastic search](https://discuss.elastic.co/t/real-time-data-how-processing-in-elastic-search/61977)
**Author:** [@sathish](https://discuss.elastic.co/u/sathish)\ **Replies:** 2\ **Last updated:** [October 3, 2016, 12:08pm UTC](https://discuss.elastic.co/t/real-time-data-how-processing-in-elastic-search/61977 "2016-10-03T12:08:57Z")
my project aim real time sensor data live demo on kibana. data come some ip 192.168.1.23 port:1212 how to capture and how to push eslastic search ....any idea tell i try logstash cannot load but logstash configuration m… --- ## [Separate log message and transaction message](https://discuss.elastic.co/t/separate-log-message-and-transaction-message/61101)
**Author:** [@vinoossk](https://discuss.elastic.co/u/vinoossk)\ **Replies:** 8\ **Last updated:** [October 3, 2016, 10:20am UTC](https://discuss.elastic.co/t/separate-log-message-and-transaction-message/61101 "2016-10-03T10:20:21Z")
"#### \<\[ACTIVE\] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'\> \<\> \<\> \<0000LT25JRt1baV0U3R5Fs1NrwFW000002\> \<1474282472208\> " \<\[ACTIVE\] ExecuteThread: '0' for queue: 'weblogic.kernel.De… --- ## [Logstash: convert lambert to latitude and logitude](https://discuss.elastic.co/t/logstash-convert-lambert-to-latitude-and-logitude/58915)
**Author:** [@sen](https://discuss.elastic.co/u/sen)\ **Replies:** 9\ **Last updated:** [October 3, 2016, 10:37am UTC](https://discuss.elastic.co/t/logstash-convert-lambert-to-latitude-and-logitude/58915 "2016-10-03T10:37:50Z")
Hello folks, I am working on a project where I have in my input data some coordinates in lambert. i would like to convert these coordinates in latitude and longitude. I found on internet a function in ruby to do it: ht… --- ## [Logstash NSQ support](https://discuss.elastic.co/t/logstash-nsq-support/24269)
**Author:** [@mschn](https://discuss.elastic.co/u/mschn)\ **Replies:** 3\ **Last updated:** [October 3, 2016, 9:39am UTC](https://discuss.elastic.co/t/logstash-nsq-support/24269 "2016-10-03T09:39:46Z")
Hello, I just read the new Blog about Kafka integration, thats really nice! Are there any plans to integrate support also for nsq.io ? --- ## [Regex for path command](https://discuss.elastic.co/t/regex-for-path-command/61952)
**Author:** [@Tim\_James](https://discuss.elastic.co/u/Tim_James)\ **Replies:** 2\ **Last updated:** [October 3, 2016, 9:25am UTC](https://discuss.elastic.co/t/regex-for-path-command/61952 "2016-10-03T09:25:17Z")
Hi, Apologies for a newbie question. I want to store data from a log file withe a name like ctc-2016-09-30.0.log but in the same directory there are many other log files I don't want, including one that is called ctc… --- ## [Logstash GROK for single letter](https://discuss.elastic.co/t/logstash-grok-for-single-letter/62018)
**Author:** [@Senz79](https://discuss.elastic.co/u/Senz79)\ **Replies:** 11\ **Last updated:** [October 3, 2016, 5:53am UTC](https://discuss.elastic.co/t/logstash-grok-for-single-letter/62018 "2016-10-03T05:53:23Z")
i have the below log please help me to parse it as I am not able to go beyond, date and time \[Fri Aug 05 11:32:10 2016\] \[D\] \[17819(139987138922464)\] checking \[/libs/granite/csrf/token.json\] --- ## [How should I configure the date filter?](https://discuss.elastic.co/t/how-should-i-configure-the-date-filter/61985)
**Author:** [@espogian](https://discuss.elastic.co/u/espogian)\ **Replies:** 10\ **Last updated:** [October 1, 2016, 8:38pm UTC](https://discuss.elastic.co/t/how-should-i-configure-the-date-filter/61985 "2016-10-01T20:38:08Z")
Hi there. I have a .csv file in which my @timestamp field is formatted like this: 0043838407D89D6773491A20160918215104.8191+020000 How should I configure Logstash to make it ignore the first part and correctly represe… --- ## [\[Solved\] Netflow input in Logstash](https://discuss.elastic.co/t/solved-netflow-input-in-logstash/61990)
**Author:** [@Saurabh\_Jambhule](https://discuss.elastic.co/u/Saurabh_Jambhule)\ **Replies:** 1\ **Last updated:** [October 1, 2016, 5:27pm UTC](https://discuss.elastic.co/t/solved-netflow-input-in-logstash/61990 "2016-10-01T17:27:50Z")
I am getting an error. Please look into this. Following is my config file: input { udp { port =\> 2055 codec =\> netflow type =\> "netflow" } } output { stdout { codec =\> rubydebug } } Followin… --- ## [How should i setup logstash to collect from multiple machines?](https://discuss.elastic.co/t/how-should-i-setup-logstash-to-collect-from-multiple-machines/52750)
**Author:** [@dal](https://discuss.elastic.co/u/dal)\ **Replies:** 8\ **Last updated:** [October 1, 2016, 3:38pm UTC](https://discuss.elastic.co/t/how-should-i-setup-logstash-to-collect-from-multiple-machines/52750 "2016-10-01T15:38:05Z")
I am new to ES and Logstash and I was trying to setup logstash to collect logs from specific directories and forward them to my Elasticsearch instance. My ES node runs on my local machine and the logs are located in diff… --- ## [5 Beta install java.lang.reflect.InaccessibleObjectException error](https://discuss.elastic.co/t/5-beta-install-java-lang-reflect-inaccessibleobjectexception-error/61986)
**Author:** [@DigiAngel](https://discuss.elastic.co/u/DigiAngel)\ **Replies:** 2\ **Last updated:** [October 1, 2016, 3:21pm UTC](https://discuss.elastic.co/t/5-beta-install-java-lang-reflect-inaccessibleobjectexception-error/61986 "2016-10-01T15:21:34Z")
Bah: Java HotSpot(TM) 64-Bit Server VM warning: Option UseParNewGC was deprecated in version 9.0 and will likely be removed in a future release. LoadError: load error: jruby/java/java\_ext/java.lang -- java.lang.reflect… --- ## [How to benchmark Grok?](https://discuss.elastic.co/t/how-to-benchmark-grok/61966)
**Author:** [@Corey\_Cole](https://discuss.elastic.co/u/Corey_Cole)\ **Replies:** 0\ **Last updated:** [September 30, 2016, 9:17pm UTC](https://discuss.elastic.co/t/how-to-benchmark-grok/61966 "2016-09-30T21:17:28Z")
The recent blog post here links to a script for benchmarking but I can't figure out how to get it working with the vendored JRuby that ships with Logstash. Does someone have an ELI5 set of steps for setting up and runni… --- ## [File Locking in Windows logstash 2.2.0](https://discuss.elastic.co/t/file-locking-in-windows-logstash-2-2-0/45979)
**Author:** [@Anantapol](https://discuss.elastic.co/u/Anantapol)\ **Replies:** 1\ **Last updated:** [September 30, 2016, 6:24pm UTC](https://discuss.elastic.co/t/file-locking-in-windows-logstash-2-2-0/45979 "2016-09-30T18:24:47Z")
The logstash process locks file on windows. This was happened and solved in the previous I believe. Here is my setup. "aaa.txt" is locked by logstash. input { file { type =\> "apache" path =\> \["c:/elk/test/a… --- ## [Indexes get assigned new fields from other indexes ?!](https://discuss.elastic.co/t/indexes-get-assigned-new-fields-from-other-indexes/61891)
**Author:** [@chrisribe](https://discuss.elastic.co/u/chrisribe)\ **Replies:** 3\ **Last updated:** [September 30, 2016, 12:52pm UTC](https://discuss.elastic.co/t/indexes-get-assigned-new-fields-from-other-indexes/61891 "2016-09-30T12:52:00Z")
Hello, I am currently pushing mysql data to elastic search via the logstash jdbc plugin. The index gets created and the proper field names (the column names) and data types. But as soon as I create another .conf file… --- ## [Add filed inside of array](https://discuss.elastic.co/t/add-filed-inside-of-array/61899)
**Author:** [@dsever](https://discuss.elastic.co/u/dsever)\ **Replies:** 1\ **Last updated:** [September 30, 2016, 12:27pm UTC](https://discuss.elastic.co/t/add-filed-inside-of-array/61899 "2016-09-30T12:27:32Z")
Hi, I've run into situation that we need to insert new filed into json array, let say for instance: json alert:\[ {attrib1:"something",attrib2:"something"}, {attrib1:"somethingddd",attrib2:"somethingsss"}, … --- ## [Logstash multiple tcp inputs with different ports](https://discuss.elastic.co/t/logstash-multiple-tcp-inputs-with-different-ports/61911)
**Author:** [@ANU\_SARA\_VARGHESE](https://discuss.elastic.co/u/ANU_SARA_VARGHESE)\ **Replies:** 1\ **Last updated:** [September 30, 2016, 10:39am UTC](https://discuss.elastic.co/t/logstash-multiple-tcp-inputs-with-different-ports/61911 "2016-09-30T10:39:12Z")
Hi, Is it possible to use 2 tcp ports in the input of the logstash for different types? input { tcp{ port =\> 5000 type =\> "syslog" } … --- ## [Logstash 2.4 "Flushing buffer at interval" after write a few records to es after start/restart](https://discuss.elastic.co/t/logstash-2-4-flushing-buffer-at-interval-after-write-a-few-records-to-es-after-start-restart/61892)
**Author:** [@jangochu](https://discuss.elastic.co/u/jangochu)\ **Replies:** 2\ **Last updated:** [September 30, 2016, 7:29am UTC](https://discuss.elastic.co/t/logstash-2-4-flushing-buffer-at-interval-after-write-a-few-records-to-es-after-start-restart/61892 "2016-09-30T07:29:38Z")
Hi,there: I use logstash 2.4.0 to read file log and write to elasticsearch 2.3.3. logstash had been installed as: sudo yum install logstash My es was install and run on another server on port 9200. And the … --- ## [message=\>”Failed to send event to Redis”](https://discuss.elastic.co/t/message-failed-to-send-event-to-redis/61799)
**Author:** [@gayathri](https://discuss.elastic.co/u/gayathri)\ **Replies:** 3\ **Last updated:** [September 30, 2016, 7:24am UTC](https://discuss.elastic.co/t/message-failed-to-send-event-to-redis/61799 "2016-09-30T07:24:54Z")
Hi Team, I am getting below error in logstash.log: :message=\>”Failed to send event to Redis” And below lines on appendonly.aof file of Redis: local batchsize = tonumber(ARGV\[1\]) local result = … --- ## [LogStash Conditional IN (Check values from a List)](https://discuss.elastic.co/t/logstash-conditional-in-check-values-from-a-list/61865)
**Author:** [@ELK\_User](https://discuss.elastic.co/u/ELK_User)\ **Replies:** 1\ **Last updated:** [September 30, 2016, 5:49am UTC](https://discuss.elastic.co/t/logstash-conditional-in-check-values-from-a-list/61865 "2016-09-30T05:49:54Z")
Hi, I am trying to find out if there's a way for me to generate a Conditional IN based output from incoming Apache Log response codes. I want to compare the Codes from a Declared List/Array of Codes My config is; input… --- ## [Field name \[server.example.com\] cannot contain '.'](https://discuss.elastic.co/t/field-name-server-example-com-cannot-contain/61868)
**Author:** [@Ryan\_Groten](https://discuss.elastic.co/u/Ryan_Groten)\ **Replies:** 2\ **Last updated:** [September 30, 2016, 5:47am UTC](https://discuss.elastic.co/t/field-name-server-example-com-cannot-contain/61868 "2016-09-30T05:47:35Z")
I have an application that sends JSON messages to logstash. The JSON looks like this: { "status": "Successful", "hosts": { "server.example.com": { "ok": 2, "failed": "false" … --- ## [Mutate Add\_field](https://discuss.elastic.co/t/mutate-add-field/61791)
**Author:** [@13koushik](https://discuss.elastic.co/u/13koushik)\ **Replies:** 1\ **Last updated:** [September 30, 2016, 5:26am UTC](https://discuss.elastic.co/t/mutate-add-field/61791 "2016-09-30T05:26:10Z")
I'm new to Logstash and I would be thankful if you could help me out. Is it possible to create an array using add\_field of mutate. Below is my config file, input { file { path =\> "/opt/logAnalyzer/source/log\_/.txt" sta… --- ## [How to change sub field type in logstash](https://discuss.elastic.co/t/how-to-change-sub-field-type-in-logstash/61836)
**Author:** [@srikanth\_ramineni](https://discuss.elastic.co/u/srikanth_ramineni)\ **Replies:** 4\ **Last updated:** [September 29, 2016, 8:55pm UTC](https://discuss.elastic.co/t/how-to-change-sub-field-type-in-logstash/61836 "2016-09-29T20:55:33Z")
Hi, I have one property is coming from filebeat. fields{ properties{ ID:String } } i am trying to change the ID field to integer but it is giving error. I tried mutate with fields.ID and "\[fields\]\[ID\]" b… --- ## [Salt - Grok](https://discuss.elastic.co/t/salt-grok/61864)
**Author:** [@idokaplan](https://discuss.elastic.co/u/idokaplan)\ **Replies:** 0\ **Last updated:** [September 29, 2016, 8:35pm UTC](https://discuss.elastic.co/t/salt-grok/61864 "2016-09-29T20:35:59Z")
Hi, 'pkg\_|-wget\_|-wget\_|-installed': { 'comment': u'Package wget is already installed', 'name': 'wget', 'start\_time': '19:22:47.084891', 'result': True, 'duration': u'352.292 ms', '\_\_run\_num\_\_': 0, 'chang… --- ## [Grok mis-function on logstash 5.0](https://discuss.elastic.co/t/grok-mis-function-on-logstash-5-0/61763)
**Author:** [@Allie\_Yang](https://discuss.elastic.co/u/Allie_Yang)\ **Replies:** 3\ **Last updated:** [September 29, 2016, 7:13pm UTC](https://discuss.elastic.co/t/grok-mis-function-on-logstash-5-0/61763 "2016-09-29T19:13:27Z")
When I tried to grok parse my log like below, logstash doesn't give me error but bunch of adding patterns everytime before it parses the data. Is it right? My Grok: grok{ match =\> { "message" =\> "%{SYSLOGBASE} %… --- ## [Logstash 2.4 install not working](https://discuss.elastic.co/t/logstash-2-4-install-not-working/61468)
**Author:** [@ddjembi](https://discuss.elastic.co/u/ddjembi)\ **Replies:** 9\ **Last updated:** [September 29, 2016, 5:14pm UTC](https://discuss.elastic.co/t/logstash-2-4-install-not-working/61468 "2016-09-29T17:14:31Z")
Hi, Just install Logstash on mac following install instruction. First example works fine (bin/logstash -e 'input { stdin { } } output { stdout {} }') second one fails with the following error Pipeline aborted due to er… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1095) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1097)