# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=760 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 761 --- ## [Dateparsefailure in date filter](https://discuss.elastic.co/t/dateparsefailure-in-date-filter/131696)
**Author:** [@pgprb](https://discuss.elastic.co/u/pgprb)\ **Replies:** 4\ **Last updated:** [May 15, 2018, 8:15am UTC](https://discuss.elastic.co/t/dateparsefailure-in-date-filter/131696 "2018-05-15T08:15:08Z")
Hi there, I'm always having dateparsefailure while doing a simple date filter to convert a string to date. The date format that I am passing is this: 2018-05-10 11:36:15 And right now in the conf file I have: date { … --- ## [Convert to timestamp](https://discuss.elastic.co/t/convert-to-timestamp/131707)
**Author:** [@Pinno\_Lin](https://discuss.elastic.co/u/Pinno_Lin)\ **Replies:** 4\ **Last updated:** [May 15, 2018, 8:11am UTC](https://discuss.elastic.co/t/convert-to-timestamp/131707 "2018-05-15T08:11:12Z")
Hi, I have time record in syslog and want to convert to timestamp Agent\_Local\_Time="2018/5/14 上午 09:58:59" Agent\_Local\_Time="2018/5/11 下午 09:52:20" It's 12-hour system. The "上午" is A.M and "下午" is P.M How to get c… --- ## [Logstash make DLL and Jruby](https://discuss.elastic.co/t/logstash-make-dll-and-jruby/131865)
**Author:** [@Fatemeh](https://discuss.elastic.co/u/Fatemeh)\ **Replies:** 0\ **Last updated:** [May 15, 2018, 7:16am UTC](https://discuss.elastic.co/t/logstash-make-dll-and-jruby/131865 "2018-05-15T07:16:58Z")
why does logstash make too many DLL and jruby files in windows / temp? that makes my memory space full ... --- ## [Logstash jdbc\_streaming filter with Cubrid DB](https://discuss.elastic.co/t/logstash-jdbc-streaming-filter-with-cubrid-db/131847)
**Author:** [@imbyungjun](https://discuss.elastic.co/u/imbyungjun)\ **Replies:** 0\ **Last updated:** [May 15, 2018, 5:26am UTC](https://discuss.elastic.co/t/logstash-jdbc-streaming-filter-with-cubrid-db/131847 "2018-05-15T05:26:13Z")
input { stdin { } } jdbc\_streaming { jdbc\_driver\_library =\> "/Users/user/Downloads/JDBC-9.2.29.0001-cubrid.jar" jdbc\_driver\_class =\> "cubrid.jdbc.driver.CUBRIDDriver" jdbc\_connection\_string =\>… --- ## [Logstash Grok filter for parsing particular log record](https://discuss.elastic.co/t/logstash-grok-filter-for-parsing-particular-log-record/131838)
**Author:** [@Dhanashree](https://discuss.elastic.co/u/Dhanashree)\ **Replies:** 2\ **Last updated:** [May 15, 2018, 4:48am UTC](https://discuss.elastic.co/t/logstash-grok-filter-for-parsing-particular-log-record/131838 "2018-05-15T04:48:32Z")
Hi, I am trying to parse mule logs using logtsash grok filter the mule logs basically contains a logger in which i am printing nested json format.Using if else condition i have used drop filter to remove the unnecessary… --- ## [How much concurrency can logstash TCP input support?](https://discuss.elastic.co/t/how-much-concurrency-can-logstash-tcp-input-support/131698)
**Author:** [@lipc](https://discuss.elastic.co/u/lipc)\ **Replies:** 2\ **Last updated:** [May 15, 2018, 1:01am UTC](https://discuss.elastic.co/t/how-much-concurrency-can-logstash-tcp-input-support/131698 "2018-05-15T01:01:30Z")
With the recent logstash releases, 5.\* or 6.\*, how much concurrency can it support? We run logstash on Linux, the CentOS 7 series, and use TCP input. Which factors affect the concurrency number? Memory, file descriptor… --- ## [Get raw twitter message](https://discuss.elastic.co/t/get-raw-twitter-message/131784)
**Author:** [@Fernando\_Macho](https://discuss.elastic.co/u/Fernando_Macho)\ **Replies:** 1\ **Last updated:** [May 14, 2018, 10:25pm UTC](https://discuss.elastic.co/t/get-raw-twitter-message/131784 "2018-05-14T22:25:28Z")
Hi, I'm trying to get the raw message that the twitter plugin processes. This is possible? The message field is empty and the plugin does not accept anything similar to metadata\_enabled =\> true. Thanks in advance --- ## [Setting "xpack.management.enabled" hasn't been registered](https://discuss.elastic.co/t/setting-xpack-management-enabled-hasnt-been-registered/131817)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 1\ **Last updated:** [May 14, 2018, 10:15pm UTC](https://discuss.elastic.co/t/setting-xpack-management-enabled-hasnt-been-registered/131817 "2018-05-14T22:15:13Z")
I am going to answer my own question, but this took me quite a long time to figure out, and the other person who asked this was never answered, so... I upgraded to 6.2.4 and started getting this error as soon as I start … --- ## [Drop Event older than 24 hours](https://discuss.elastic.co/t/drop-event-older-than-24-hours/131569)
**Author:** [@Nikhil\_Jaiswal](https://discuss.elastic.co/u/Nikhil_Jaiswal)\ **Replies:** 7\ **Last updated:** [May 14, 2018, 7:48pm UTC](https://discuss.elastic.co/t/drop-event-older-than-24-hours/131569 "2018-05-14T19:48:38Z")
Hi All, I am using age filter to drop the event if time stamp is older than 24 hours, perhaps filter is not working properly because i am not able to see any output . Any help regarding this will be appriciated . plea… --- ## [Scheduling Logstash Failed](https://discuss.elastic.co/t/scheduling-logstash-failed/131558)
**Author:** [@Meghla\_Chakravorty](https://discuss.elastic.co/u/Meghla_Chakravorty)\ **Replies:** 5\ **Last updated:** [May 14, 2018, 7:03pm UTC](https://discuss.elastic.co/t/scheduling-logstash-failed/131558 "2018-05-14T19:03:21Z")
I am running a logstash pipeline to read logs from all files in a directory. I want my logstash conf file to run every 30 minutes in a day. Is there any command which I have to write in the conf file. Below is the snipp… --- ## [How to get the value of fields that not string type](https://discuss.elastic.co/t/how-to-get-the-value-of-fields-that-not-string-type/131737)
**Author:** [@floyd\_fan](https://discuss.elastic.co/u/floyd_fan)\ **Replies:** 3\ **Last updated:** [May 14, 2018, 7:01pm UTC](https://discuss.elastic.co/t/how-to-get-the-value-of-fields-that-not-string-type/131737 "2018-05-14T19:01:03Z")
I want to add a non-string type field A( long type or json type) to logstash output, and set it's value by another field B . so i need to access the value of B. almost all examples related to accessing field value are… --- ## [Logstash throwing error for filter portion when trying to convert csv to elastic search](https://discuss.elastic.co/t/logstash-throwing-error-for-filter-portion-when-trying-to-convert-csv-to-elastic-search/131584)
**Author:** [@Nithin\_Nk](https://discuss.elastic.co/u/Nithin_Nk)\ **Replies:** 5\ **Last updated:** [May 14, 2018, 3:42pm UTC](https://discuss.elastic.co/t/logstash-throwing-error-for-filter-portion-when-trying-to-convert-csv-to-elastic-search/131584 "2018-05-14T15:42:11Z")
Fixed so deleting --- ## [How to parse data with fixed length but no separators](https://discuss.elastic.co/t/how-to-parse-data-with-fixed-length-but-no-separators/131772)
**Author:** [@tjwang](https://discuss.elastic.co/u/tjwang)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 5:08pm UTC](https://discuss.elastic.co/t/how-to-parse-data-with-fixed-length-but-no-separators/131772 "2018-05-14T17:08:08Z")
My data is a big plain text file with multiple sections with definite lengths but no separators like below "aabb111222Test ABC20080502 ccdd333444Test EFG20080503 ......" The first section has length 4, such as "aabb"… --- ## [Error when i will start logstash](https://discuss.elastic.co/t/error-when-i-will-start-logstash/131664)
**Author:** [@TheOnlyOne](https://discuss.elastic.co/u/TheOnlyOne)\ **Replies:** 5\ **Last updated:** [May 14, 2018, 3:55pm UTC](https://discuss.elastic.co/t/error-when-i-will-start-logstash/131664 "2018-05-14T15:55:29Z")
Hello, im new at Elastic Stack. When i will start logstash i get a error Message: Logstash, Kibana, Elasticsearch everything on the newest Version. PS C:\\ELK-Stack\\logstash\> C:\\ELK-Stack\\logstash\\bin\\logstash.bat Se… --- ## [New plugin: a filter to validate event data schema](https://discuss.elastic.co/t/new-plugin-a-filter-to-validate-event-data-schema/131779)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 0\ **Last updated:** [May 14, 2018, 3:39pm UTC](https://discuss.elastic.co/t/new-plugin-a-filter-to-validate-event-data-schema/131779 "2018-05-14T15:39:37Z")
\--\> https://github.com/ebuildy/logstash-filter-schema\_validation Usage info here https://github.com/ebuildy/logstash-filter-schema\_validation/wiki/Usage Works with logstash 6.x, it uses json-schema to validate the even… --- ## [Logstash -\> Elastic Cloud](https://discuss.elastic.co/t/logstash-elastic-cloud/131269)
**Author:** [@MrNerd](https://discuss.elastic.co/u/MrNerd)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 3:27pm UTC](https://discuss.elastic.co/t/logstash-elastic-cloud/131269 "2018-05-14T15:27:36Z")
How can I know if my logstash is sending the packest received from port 5000 to elastic cloud, i mean, i make a curl and apparently there is no index created how can i send those, or I have to create an Index in elastic¿… --- ## [Logstash does not transform IP](https://discuss.elastic.co/t/logstash-does-not-transform-ip/131567)
**Author:** [@AdamJade](https://discuss.elastic.co/u/AdamJade)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 12:36pm UTC](https://discuss.elastic.co/t/logstash-does-not-transform-ip/131567 "2018-05-14T12:36:51Z")
Hi there, i just begin using ELK 6.0.0 and i m very happy with. I would like to minitor my webserver and i installed filebeat. Logstash receives informations from webserver and kibana displays it. Here is kibana displ… --- ## [Logstash mutate not replacing varible](https://discuss.elastic.co/t/logstash-mutate-not-replacing-varible/131515)
**Author:** [@eperry](https://discuss.elastic.co/u/eperry)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 11:39am UTC](https://discuss.elastic.co/t/logstash-mutate-not-replacing-varible/131515 "2018-05-14T11:39:53Z")
I am on 6.2.4 and other variables seem to be working fine but my log\_message is not Anyone have a clue why logstash is ignoring %{log\_message} ? { "\_index": "dbinfra-2018.05.11", "\_type": "logs", "\_id": "AWNP9c… --- ## [Grokparsing UUID](https://discuss.elastic.co/t/grokparsing-uuid/131700)
**Author:** [@No\_Executable](https://discuss.elastic.co/u/No_Executable)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 11:20am UTC](https://discuss.elastic.co/t/grokparsing-uuid/131700 "2018-05-14T11:20:00Z")
We are trying to extract information from logs depending on the UUID of the command that was used. At the moment our grok match looks like this. match =\> {"\[doc\]\[Message\]\[0\]" =\> "(?\\[A-Fa-f0-9\]{8}-(?:\[A-Fa-f0-… --- ## [Logstash takes wrong pipeline.yml when startin on CLI](https://discuss.elastic.co/t/logstash-takes-wrong-pipeline-yml-when-startin-on-cli/131677)
**Author:** [@MarcusCaepio](https://discuss.elastic.co/u/MarcusCaepio)\ **Replies:** 4\ **Last updated:** [May 14, 2018, 10:37am UTC](https://discuss.elastic.co/t/logstash-takes-wrong-pipeline-yml-when-startin-on-cli/131677 "2018-05-14T10:37:38Z")
Hi all, I am testing Logstash with mutliple pipelines. So I have set my pipelines in /etc/logstash/pipelines.yml. When I start logstash in foreground with /usr/share/logstash/bin/logstash I got the error: ERROR: Fai… --- ## [Grok\_help](https://discuss.elastic.co/t/grok-help/131661)
**Author:** [@anush\_jayan](https://discuss.elastic.co/u/anush_jayan)\ **Replies:** 7\ **Last updated:** [May 14, 2018, 10:13am UTC](https://discuss.elastic.co/t/grok-help/131661 "2018-05-14T10:13:36Z")
{"@timestamp":"2018-03-31T04:00:00.237Z","@version":"1","message":"2018-03-31 03:59:22,12.106.8.702,ABC33&&000012345678,03/31/2018 03:59:59,23.47893,92.38397,0,6,ON,0,0,79.06,0,3395,588,2,0,40430,-71,12,17","tags":\["\_gro… --- ## [S3 input plugin - pull the files from only specific folder](https://discuss.elastic.co/t/s3-input-plugin-pull-the-files-from-only-specific-folder/131331)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 4\ **Last updated:** [May 14, 2018, 8:56am UTC](https://discuss.elastic.co/t/s3-input-plugin-pull-the-files-from-only-specific-folder/131331 "2018-05-14T08:56:34Z")
I want to index the files from S3 to elasticsearch. I am not able to see the option of specifying the folder in the bucket for s3 input plugin. Is there any option to mention only the specific path instead of pulling the… --- ## [Filtering binary data from an ASCII string](https://discuss.elastic.co/t/filtering-binary-data-from-an-ascii-string/131392)
**Author:** [@p4w4n](https://discuss.elastic.co/u/p4w4n)\ **Replies:** 1\ **Last updated:** [May 14, 2018, 8:41am UTC](https://discuss.elastic.co/t/filtering-binary-data-from-an-ascii-string/131392 "2018-05-14T08:41:50Z")
Hi, I have a mainframe log with message containing some binary data. I would like to trim that binary data in Logstash before sending it to elasticsearch. I am not able to find a way. Below is the sample data that I am … --- ## [Maintain \_id while Filtering from ES to ES via Logstash](https://discuss.elastic.co/t/maintain-id-while-filtering-from-es-to-es-via-logstash/131687)
**Author:** [@yckoh](https://discuss.elastic.co/u/yckoh)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 8:17am UTC](https://discuss.elastic.co/t/maintain-id-while-filtering-from-es-to-es-via-logstash/131687 "2018-05-14T08:17:16Z")
Hi, I would like to filter an ES index to another ES index via logstash but currently the \_id isn't maintained. How an I get this done? input { elasticsearch { hosts =\> "someip" user =\> password =\> "" index =\> "som… --- ## [Give events without timestamp the timestamp from the last event](https://discuss.elastic.co/t/give-events-without-timestamp-the-timestamp-from-the-last-event/131149)
**Author:** [@Petersiemens](https://discuss.elastic.co/u/Petersiemens)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 7:12am UTC](https://discuss.elastic.co/t/give-events-without-timestamp-the-timestamp-from-the-last-event/131149 "2018-05-14T07:12:44Z")
Hi, i'm currently trying to give events from the initialization dialog (they have no timestamp) the timestamp from the next possible event which has a timestamp. the list is upside down which means the latest entry is a… --- ## [Logstash Support for EXCEL](https://discuss.elastic.co/t/logstash-support-for-excel/131454)
**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\ **Replies:** 4\ **Last updated:** [May 14, 2018, 6:07am UTC](https://discuss.elastic.co/t/logstash-support-for-excel/131454 "2018-05-14T06:07:46Z")
Hello Team I've an excel sheet having data of tickets. Now I'm converting the Excel to CSV and feeding to logstash as input. But to convert to csv, it requires a manual intervention which we don't want. Is there anyw… --- ## [How to configure server logs in Logstash?](https://discuss.elastic.co/t/how-to-configure-server-logs-in-logstash/131571)
**Author:** [@Raja\_Pandian](https://discuss.elastic.co/u/Raja_Pandian)\ **Replies:** 2\ **Last updated:** [May 14, 2018, 6:05am UTC](https://discuss.elastic.co/t/how-to-configure-server-logs-in-logstash/131571 "2018-05-14T06:05:43Z")
I need to display logs which is in Unix server.How to connect Unix server and get the latest logs through Logstash configure? How to define server credentials and host details in Logstash configuration? --- ## [Logstash plugin attachment](https://discuss.elastic.co/t/logstash-plugin-attachment/131490)
**Author:** [@rouchad\_rouchad](https://discuss.elastic.co/u/rouchad_rouchad)\ **Replies:** 1\ **Last updated:** [May 14, 2018, 6:05am UTC](https://discuss.elastic.co/t/logstash-plugin-attachment/131490 "2018-05-14T06:05:05Z")
hello everyone I have a very small problem I can not find the emails that contain the reachable files in kibana ..meme if I installed the ingest attachment plugin : when i inqtall the plugin i have : C:\\Program Files\\El… --- ## [Simpe input/output plugin](https://discuss.elastic.co/t/simpe-input-output-plugin/131496)
**Author:** [@nujojo](https://discuss.elastic.co/u/nujojo)\ **Replies:** 1\ **Last updated:** [May 14, 2018, 6:02am UTC](https://discuss.elastic.co/t/simpe-input-output-plugin/131496 "2018-05-14T06:02:58Z")
Hi Guys, I am new to Logstash. I want to make simple input and output plugin which will not change format of the message. I have done the config, but output plugin is not working:/ For the input plugin I have a separa… --- ## [Parse CSV file through logstasj](https://discuss.elastic.co/t/parse-csv-file-through-logstasj/131291)
**Author:** [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\ **Replies:** 6\ **Last updated:** [May 14, 2018, 5:37am UTC](https://discuss.elastic.co/t/parse-csv-file-through-logstasj/131291 "2018-05-14T05:37:33Z")
I have some csv format data .how to parse that data as i am missing some fields from the data [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=759) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=761)