# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=356 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 357 --- ## [Colonnes do not creat in elastic](https://discuss.elastic.co/t/colonnes-do-not-creat-in-elastic/233119)
**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 1:47pm UTC](https://discuss.elastic.co/t/colonnes-do-not-creat-in-elastic/233119 "2020-05-18T13:47:11Z")
I use logsth and filebeat for ingestion in elastic my conf logstash is input { beats { port =\> "5044" } } filter { if "fraicheur\_devgroupe" in \[tags\] { csv{ separator =\> ";" columns =\> \["NM\_APPLIC\_DECIS", "NM\_SO… --- ## [Need help for writting Nested Parser](https://discuss.elastic.co/t/need-help-for-writting-nested-parser/233007)
**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\ **Replies:** 7\ **Last updated:** [May 18, 2020, 3:11pm UTC](https://discuss.elastic.co/t/need-help-for-writting-nested-parser/233007 "2020-05-18T15:11:36Z")
Hey , I need some help for writing Nested Parser for following log, its has the same type , field of logs from beginning in the middle of current log. see yourself 174\>ABC Firewall: 17May2020 23:09:18 5 N/A 5 IP… --- ## [Logstash send data to php](https://discuss.elastic.co/t/logstash-send-data-to-php/232916)
**Author:** [@katara](https://discuss.elastic.co/u/katara)\ **Replies:** 9\ **Last updated:** [May 18, 2020, 3:10pm UTC](https://discuss.elastic.co/t/logstash-send-data-to-php/232916 "2020-05-18T15:10:38Z")
Hi, Im trying to send my data to a php input, but i have a few questions: Here's my config: \> input { \> tcp { \> port =\> 8443 \> codec =\> json\_lines { charset =\> CP1252 } \> … --- ## [Logstash pipeline output based on field](https://discuss.elastic.co/t/logstash-pipeline-output-based-on-field/233112)
**Author:** [@hameno](https://discuss.elastic.co/u/hameno)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 2:54pm UTC](https://discuss.elastic.co/t/logstash-pipeline-output-based-on-field/233112 "2020-05-18T14:54:15Z")
Hello, I'm trying to setup a pipeline output based on a dynamic field. I found the same question in https://discuss.elastic.co/t/unexpected-behavior-when-accessing-field-data-in-a-pipeline-to-pipeline-configuration/184… --- ## [No suitable driver found error when using logstash-input-jdbc](https://discuss.elastic.co/t/no-suitable-driver-found-error-when-using-logstash-input-jdbc/232957)
**Author:** [@csaket](https://discuss.elastic.co/u/csaket)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 2:11pm UTC](https://discuss.elastic.co/t/no-suitable-driver-found-error-when-using-logstash-input-jdbc/232957 "2020-05-18T14:11:32Z")
I am running redhat 7.8 and have done a fresh installation of logstash 7.7 When trying to use the logstash-input-jdbc plugin to read from a database I get a No suitable driver found error. I was able to set it up to wo… --- ## [Oracle spatial data to ELS with logstash](https://discuss.elastic.co/t/oracle-spatial-data-to-els-with-logstash/233123)
**Author:** [@citrus](https://discuss.elastic.co/u/citrus)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 2:02pm UTC](https://discuss.elastic.co/t/oracle-spatial-data-to-els-with-logstash/233123 "2020-05-18T14:02:26Z")
Hello there, I will install ElasticSearch and Logstash in order to index and spatial data from Oracle (v.11g). My Oracle DB use Oracle Spatial extension to manage spatial data. I couldn't find anythink about Oracle s… --- ## [How to push file from github to logstash](https://discuss.elastic.co/t/how-to-push-file-from-github-to-logstash/232844)
**Author:** [@dheeru11](https://discuss.elastic.co/u/dheeru11)\ **Replies:** 6\ **Last updated:** [May 18, 2020, 10:59am UTC](https://discuss.elastic.co/t/how-to-push-file-from-github-to-logstash/232844 "2020-05-18T10:59:06Z")
I have file which will be uploaded to github daily. I want push the same file to logstash. How can i do that ? --- ## [How can i create WSS client connection in logstash 7.4?](https://discuss.elastic.co/t/how-can-i-create-wss-client-connection-in-logstash-7-4/233069)
**Author:** [@talbehat](https://discuss.elastic.co/u/talbehat)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 9:17am UTC](https://discuss.elastic.co/t/how-can-i-create-wss-client-connection-in-logstash-7-4/233069 "2020-05-18T09:17:08Z")
please let me know? --- ## [Grok fails on a valid regex](https://discuss.elastic.co/t/grok-fails-on-a-valid-regex/231781)
**Author:** [@konart](https://discuss.elastic.co/u/konart)\ **Replies:** 1\ **Last updated:** [May 9, 2020, 4:50pm UTC](https://discuss.elastic.co/t/grok-fails-on-a-valid-regex/231781 "2020-05-09T16:50:57Z")
Log: \[logstash.javapipeline \]\[main\] Pipeline aborted due to error {:pipeline\_id=\>"main", :exception=\>#\DBG|INF|WRN)(?(?=(?:.\*(?:X-Request-Id|CorrelationId)))… --- ## [Nested Logstash Config files](https://discuss.elastic.co/t/nested-logstash-config-files/232657)
**Author:** [@karthik3](https://discuss.elastic.co/u/karthik3)\ **Replies:** 4\ **Last updated:** [May 18, 2020, 8:42am UTC](https://discuss.elastic.co/t/nested-logstash-config-files/232657 "2020-05-18T08:42:52Z")
Hi , I like to pass payload to another logstash config file and post the payload fields to ES once it successfully it will post other fields to ES. filter { if "START \[\[" in \[message\] { grok { match =\> { "message… --- ## [Querying hosts from a file](https://discuss.elastic.co/t/querying-hosts-from-a-file/233062)
**Author:** [@Claireshan](https://discuss.elastic.co/u/Claireshan)\ **Replies:** 1\ **Last updated:** [May 18, 2020, 8:26am UTC](https://discuss.elastic.co/t/querying-hosts-from-a-file/233062 "2020-05-18T08:26:31Z")
Hello am getting laser from devices using snmp and so far with one device am getting the data very well. I have many hosts and their ips are in a file, how can i query through the file pick ip by ip and for each ip i pic… --- ## [Parse a Null Pointer Exception Logs in Logstash](https://discuss.elastic.co/t/parse-a-null-pointer-exception-logs-in-logstash/233058)
**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 8:06am UTC](https://discuss.elastic.co/t/parse-a-null-pointer-exception-logs-in-logstash/233058 "2020-05-18T08:06:54Z")
Hi Everyone, I am using One java application that throws null pointer exception and I want to parse the Java stack trace logs in logstash and I am got confused how to parse the logs generated by application. Here are t… --- ## [Deleting an event](https://discuss.elastic.co/t/deleting-an-event/232923)
**Author:** [@Claireshan](https://discuss.elastic.co/u/Claireshan)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 7:59am UTC](https://discuss.elastic.co/t/deleting-an-event/232923 "2020-05-18T07:59:16Z")
hello am trying to delete an every event with jnxDomCurrentRxLaserPower == 0. but i keep getting the same output. Now my router has 8 interfaces with only one port active and the others are not enabled but their jnxDomCu… --- ## [JMS Plug In stop](https://discuss.elastic.co/t/jms-plug-in-stop/233053)
**Author:** [@Loris](https://discuss.elastic.co/u/Loris)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 7:45am UTC](https://discuss.elastic.co/t/jms-plug-in-stop/233053 "2020-05-18T07:45:10Z")
Hi, I implemented a Logstash (7.5.2) pipeline with the following configration: input { jms { include\_header =\> true include\_properties =\> true include\_body =\> true … --- ## [Failed to parse date field in ELK stack 7.0](https://discuss.elastic.co/t/failed-to-parse-date-field-in-elk-stack-7-0/232984)
**Author:** [@janmichae.reyes4](https://discuss.elastic.co/u/janmichae.reyes4)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 6:45am UTC](https://discuss.elastic.co/t/failed-to-parse-date-field-in-elk-stack-7-0/232984 "2020-05-18T06:45:26Z")
hi, Seeking your help on the issue that i've encountered. see logstash logs \[2020-05-17T18:08:04,561\]\[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[7a2e4f1adfc06df81621c72c479da896bcfd3869a4bb01f7a4d4115bed9c9c96\] Could… --- ## [Logstash gzip\_pattern matching](https://discuss.elastic.co/t/logstash-gzip-pattern-matching/233026)
**Author:** [@ckough](https://discuss.elastic.co/u/ckough)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 3:29am UTC](https://discuss.elastic.co/t/logstash-gzip-pattern-matching/233026 "2020-05-18T03:29:51Z")
Hi there, I'm using ELK 7.7. I need to ingest s3 objects with description exactly like this We are using S3 input plugin to pull data from S3, we are using kinesis firehose to push data to S3, which does not adds 'g… --- ## [Parse and extract json fields using logstash](https://discuss.elastic.co/t/parse-and-extract-json-fields-using-logstash/233017)
**Author:** [@jawadak](https://discuss.elastic.co/u/jawadak)\ **Replies:** 2\ **Last updated:** [May 17, 2020, 11:13pm UTC](https://discuss.elastic.co/t/parse-and-extract-json-fields-using-logstash/233017 "2020-05-17T23:13:09Z")
Hi, I have the below log after using the JSON filter. I need to take all the fields out of the JSON field "log". For example: instead of all the fields like log.user or log.allow, I need just user or allow. I need to tak… --- ## [Grokparsefailure! wtf?](https://discuss.elastic.co/t/grokparsefailure-wtf/232938)
**Author:** [@francescouk](https://discuss.elastic.co/u/francescouk)\ **Replies:** 7\ **Last updated:** [May 17, 2020, 10:30pm UTC](https://discuss.elastic.co/t/grokparsefailure-wtf/232938 "2020-05-17T22:30:18Z")
Hi there, After using grokdebug and make sure the grok filter as working, just find out that was not enough to avoid the tag \_grokparsefailure!! arggggggg!!! Follow my conf: ###################################### INPU… --- ## [Using numbers in conditionals leads to fatal "java.lang.ClassCastException: class org.jruby.RubyFixnum cannot be cast to class java.lang.Long"](https://discuss.elastic.co/t/using-numbers-in-conditionals-leads-to-fatal-java-lang-classcastexception-class-org-jruby-rubyfixnum-cannot-be-cast-to-class-java-lang-long/231962)
**Author:** [@DavidFineboym](https://discuss.elastic.co/u/DavidFineboym)\ **Replies:** 3\ **Last updated:** [May 17, 2020, 2:00pm UTC](https://discuss.elastic.co/t/using-numbers-in-conditionals-leads-to-fatal-java-lang-classcastexception-class-org-jruby-rubyfixnum-cannot-be-cast-to-class-java-lang-long/231962 "2020-05-17T14:00:06Z")
Hi, I'm having trouble with conditional statements that include numbers in them in Logstash 7.6. The same pipeline configuration worked well in Logstash 6.8. I'm using Windows Server 2019 Datacenter, version 1809, and … --- ## [How to uninstall logstash service?](https://discuss.elastic.co/t/how-to-uninstall-logstash-service/232660)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 3\ **Last updated:** [May 17, 2020, 12:18pm UTC](https://discuss.elastic.co/t/how-to-uninstall-logstash-service/232660 "2020-05-17T12:18:29Z")
Hi, I have installed multiple instances of logstash on a single machine. Installation was done via system-install script provided with logstash package. Each instance has its own configuration folder. But how can I unin… --- ## [Logstash Aggregate with multiple end tags](https://discuss.elastic.co/t/logstash-aggregate-with-multiple-end-tags/232972)
**Author:** [@Nani\_20](https://discuss.elastic.co/u/Nani_20)\ **Replies:** 5\ **Last updated:** [May 17, 2020, 10:45am UTC](https://discuss.elastic.co/t/logstash-aggregate-with-multiple-end-tags/232972 "2020-05-17T10:45:12Z")
Hi All, I am trying to aggregate elapsed time value for a specific event. But, the event end tags are either one of the two tags (either Saved or Modified) as specified below in the sample data. Sample Data with colu… --- ## [error=\>Worker loop initialization error, "Missing Filter End Vertex"](https://discuss.elastic.co/t/error-worker-loop-initialization-error-missing-filter-end-vertex/232928)
**Author:** [@Stefan\_Sabolowitsch](https://discuss.elastic.co/u/Stefan_Sabolowitsch)\ **Replies:** 3\ **Last updated:** [May 17, 2020, 10:25am UTC](https://discuss.elastic.co/t/error-worker-loop-initialization-error-missing-filter-end-vertex/232928 "2020-05-17T10:25:13Z")
Hi there, Run the latest version of Logstash in Kube here. logstash crashes when starting due to pipline problem. apiVersion: v1 kind: ConfigMap metadata: name: sample-logstash-configmap namespace: elastic-monitoring … --- ## [Jdbc one to many relationship to logstash](https://discuss.elastic.co/t/jdbc-one-to-many-relationship-to-logstash/232976)
**Author:** [@Mike\_Storm](https://discuss.elastic.co/u/Mike_Storm)\ **Replies:** 0\ **Last updated:** [May 17, 2020, 9:21am UTC](https://discuss.elastic.co/t/jdbc-one-to-many-relationship-to-logstash/232976 "2020-05-17T09:21:29Z")
Hi Guys, I'm little bit confused about how to use the aggregate filter, I've followed the documentation and read some articles, I used a sample database in MySQL (Sakila Database) and created a view in mysql sakila dat… --- ## [Multiline patterns](https://discuss.elastic.co/t/multiline-patterns/232632)
**Author:** [@Satyajeet\_Singh](https://discuss.elastic.co/u/Satyajeet_Singh)\ **Replies:** 4\ **Last updated:** [May 16, 2020, 6:42pm UTC](https://discuss.elastic.co/t/multiline-patterns/232632 "2020-05-16T18:42:05Z")
Hi Trying to create a config for logstash which can aggregate multiple lines with different pattern example loglines: 2020-05-14 13:43:05.222 SSL accepted cipher=ECDHE-RSA-AES128-SHA256 2020-05-14 13:43:05.222 Connect… --- ## [AWS ELBv2 extract latitude, longitude and requests subparts](https://discuss.elastic.co/t/aws-elbv2-extract-latitude-longitude-and-requests-subparts/232919)
**Author:** [@jensolsson.se](https://discuss.elastic.co/u/jensolsson.se)\ **Replies:** 1\ **Last updated:** [May 16, 2020, 6:25pm UTC](https://discuss.elastic.co/t/aws-elbv2-extract-latitude-longitude-and-requests-subparts/232919 "2020-05-16T18:25:56Z")
Hi I just for the first time set up kibana, elasticsearch and logstash to index logs from ELBv2 on AWS. It looks like this in the configuration and works quite well: input { file { path =\> "/home/jensolsson… --- ## [Logstash configuring error in windows](https://discuss.elastic.co/t/logstash-configuring-error-in-windows/232904)
**Author:** [@Dv\_Thiyanesh](https://discuss.elastic.co/u/Dv_Thiyanesh)\ **Replies:** 9\ **Last updated:** [May 16, 2020, 10:02am UTC](https://discuss.elastic.co/t/logstash-configuring-error-in-windows/232904 "2020-05-16T10:02:37Z")
Hi, I am using elk stack to fetch logs from client machine. i have done using these version elasticsearch- 6.5.3 logstash- 6.5.3 after 6 months Today for testing i just started watching logs running elasticseach and logs… --- ## [Is Logstash SNMP used for traps or only for traps?](https://discuss.elastic.co/t/is-logstash-snmp-used-for-traps-or-only-for-traps/232649)
**Author:** [@PraveenKT](https://discuss.elastic.co/u/PraveenKT)\ **Replies:** 4\ **Last updated:** [May 16, 2020, 7:09am UTC](https://discuss.elastic.co/t/is-logstash-snmp-used-for-traps-or-only-for-traps/232649 "2020-05-16T07:09:53Z")
Can i use logstash input snmp for traps? Which below vendor MIBs works without coverting to .dic format? Cisco, Fortigate, juniper, paloalto . --- ## [Logstash xml filter help](https://discuss.elastic.co/t/logstash-xml-filter-help/232358)
**Author:** [@sunny1](https://discuss.elastic.co/u/sunny1)\ **Replies:** 7\ **Last updated:** [May 16, 2020, 3:09am UTC](https://discuss.elastic.co/t/logstash-xml-filter-help/232358 "2020-05-16T03:09:28Z")
Hello Team, Hope all are doing good with stay home stay safe. Lately i tried playing with logstash to parse an xml file, using grok but did not had any luck. I am able to do text file but xml is giving me very hard time.… --- ## [Loop through json arrays](https://discuss.elastic.co/t/loop-through-json-arrays/232336)
**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\ **Replies:** 9\ **Last updated:** [May 15, 2020, 10:00pm UTC](https://discuss.elastic.co/t/loop-through-json-arrays/232336 "2020-05-15T22:00:41Z")
Hi, My JSON file looks like this : { "bookings": \[ { "bookingId": 553267, "bookingRef": "VO20200108460", "statusId": 1, "status": "Confirmed", "rooms": \[ { "board": "Demi pension", "paxes": { "adults": 2, "… --- ## [Json input and splitting](https://discuss.elastic.co/t/json-input-and-splitting/232677)
**Author:** [@tcaetano1995](https://discuss.elastic.co/u/tcaetano1995)\ **Replies:** 11\ **Last updated:** [May 15, 2020, 9:53pm UTC](https://discuss.elastic.co/t/json-input-and-splitting/232677 "2020-05-15T21:53:30Z")
Hello, I'm new to the elastic ecosystem. I'm trying to use logstash to take a json file as input and then use a filter to split into different events but I'm drowned by all of the info there is online. This is a short… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=355) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=357)