# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=539 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 540 --- ## [Creating indices from multiple inputs](https://discuss.elastic.co/t/creating-indices-from-multiple-inputs/183239)
**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\ **Replies:** 1\ **Last updated:** [May 29, 2019, 12:45pm UTC](https://discuss.elastic.co/t/creating-indices-from-multiple-inputs/183239 "2019-05-29T12:45:47Z")
I am trying to fetch the logs from multiple location and would like to create a single index for those multiple logs...is there anyway via which I can configure in input filter in .conf file??? input { file { path =\> … --- ## [Enabling beats to logstash flow for a secure elastic cluster](https://discuss.elastic.co/t/enabling-beats-to-logstash-flow-for-a-secure-elastic-cluster/183240)
**Author:** [@Arpit\_Khanna](https://discuss.elastic.co/u/Arpit_Khanna)\ **Replies:** 1\ **Last updated:** [May 29, 2019, 12:39pm UTC](https://discuss.elastic.co/t/enabling-beats-to-logstash-flow-for-a-secure-elastic-cluster/183240 "2019-05-29T12:39:16Z")
Hi , Thanks in advance for helping. I am trying to setup a secure ELK infra with a beats to push logs to it. This ELK infra has 1 Master and 2 data nodes, 1 kibana, 1 logstash and 1 filebeats. This Elastic cluster is se… --- ## [Unable to run this command bin/logstash -e "input { http { port =\> 9200 } } output { stdout { codec =\> rubydebug} }](https://discuss.elastic.co/t/unable-to-run-this-command-bin-logstash-e-input-http-port-9200-output-stdout-codec-rubydebug/183298)
**Author:** [@Vishnu\_mk](https://discuss.elastic.co/u/Vishnu_mk)\ **Replies:** 2\ **Last updated:** [May 29, 2019, 12:33pm UTC](https://discuss.elastic.co/t/unable-to-run-this-command-bin-logstash-e-input-http-port-9200-output-stdout-codec-rubydebug/183298 "2019-05-29T12:33:46Z")
While running the following command I am getting this error bin/logstash -e "input { http { port =\> 9200 } } output { stdout { codec =\> rubydebug} }" \[ 2019-05-29T15:39:04,236\]\[INFO \]\[logstash.inputs.http \] Star… --- ## [I got the this error=\>#\ **Author:** [@santoshbhagat](https://discuss.elastic.co/u/santoshbhagat)\ **Replies:** 1\ **Last updated:** [May 29, 2019, 12:12pm UTC](https://discuss.elastic.co/t/i-got-the-this-error-argumenterror-setting-pipeline-batch-hasnt-been-registered/183305 "2019-05-29T12:12:06Z") Sending Logstash logs to E:/Software/ELK/logstash-7.0.1/logstash-7.0.1/logs which is now configured via log4j2.properties 15:53:13.943 \[main\] DEBUG logstash.modules.scaffold - Found module {:module\_name=\>"fb\_apache", :d… --- ## [Unknown setting ‘ssl\_certificate\_verification’ for elasticsearch error](https://discuss.elastic.co/t/unknown-setting-ssl-certificate-verification-for-elasticsearch-error/183108)
**Author:** [@swapnali](https://discuss.elastic.co/u/swapnali)\ **Replies:** 2\ **Last updated:** [May 29, 2019, 5:24am UTC](https://discuss.elastic.co/t/unknown-setting-ssl-certificate-verification-for-elasticsearch-error/183108 "2019-05-29T05:24:42Z")
Hello, I am getting below error Unknown setting 'ssl\_certificate\_verification' for elasticsearch May 28 18:35:12 logstashdv logstash: \[2019-05-28T18:35:12,308\]\[ERROR\]\[logstash.agent \] Failed to execute action {:action… --- ## [Heap dump exception in wmi](https://discuss.elastic.co/t/heap-dump-exception-in-wmi/183288)
**Author:** [@swapnali](https://discuss.elastic.co/u/swapnali)\ **Replies:** 0\ **Last updated:** [May 29, 2019, 9:14am UTC](https://discuss.elastic.co/t/heap-dump-exception-in-wmi/183288 "2019-05-29T09:14:25Z")
Hi, I am using WMI beat, i parsed it data using split function because data is in json array format. for single event it generates larger number of message. please tell me how to tackle with this. split =\>{"filed\_name… --- ## [Azure Blob Filter](https://discuss.elastic.co/t/azure-blob-filter/183283)
**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\ **Replies:** 0\ **Last updated:** [May 29, 2019, 9:03am UTC](https://discuss.elastic.co/t/azure-blob-filter/183283 "2019-05-29T09:03:04Z")
Hi all, I have been using the logstash-filter-azureblob to ingest azure iis logs for a while now - but i've just noticed that logstash is erroring saying that it can't find the azure blob filter. I went to reinstall it… --- ## [Global field in all logs](https://discuss.elastic.co/t/global-field-in-all-logs/183271)
**Author:** [@dinesh1](https://discuss.elastic.co/u/dinesh1)\ **Replies:** 2\ **Last updated:** [May 29, 2019, 8:29am UTC](https://discuss.elastic.co/t/global-field-in-all-logs/183271 "2019-05-29T08:29:08Z")
Ho to get particular field global to all documents. Below is my Xml logs content of cbt (date) should be there in every document I am using filebeat multi pattern multiline.pattern: "^\[\[:space:\]\]" multiline.negate… --- ## [Csv load with logstash not working](https://discuss.elastic.co/t/csv-load-with-logstash-not-working/183139)
**Author:** [@soufiane1](https://discuss.elastic.co/u/soufiane1)\ **Replies:** 2\ **Last updated:** [May 29, 2019, 8:12am UTC](https://discuss.elastic.co/t/csv-load-with-logstash-not-working/183139 "2019-05-29T08:12:16Z")
Hello everyone, I am trying to load a csv file with logstash with the following conf : ############################################################################################################################ input … --- ## [Translation in 7.0.0 no longer possible!? Please help](https://discuss.elastic.co/t/translation-in-7-0-0-no-longer-possible-please-help/183238)
**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\ **Replies:** 1\ **Last updated:** [May 29, 2019, 7:57am UTC](https://discuss.elastic.co/t/translation-in-7-0-0-no-longer-possible-please-help/183238 "2019-05-29T07:57:52Z")
Hi there, I upgraded from ELK 6.5.4 to 7.0.0 due to some reasons. Logstash 6.5.4 works like a charme and all Data translated as expected with this entry in my config: translate { field =\> "getkArticle" destination… --- ## [Field based filter](https://discuss.elastic.co/t/field-based-filter/181955)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 4\ **Last updated:** [May 29, 2019, 7:14am UTC](https://discuss.elastic.co/t/field-based-filter/181955 "2019-05-29T07:14:25Z")
Hi I'm just trying to use logstash for filtering events. I wish to filter events based on event id. Event log format looks like below "field\_name":"field\_value", "field2\_name" : "field2\_value", "event\_id":1234,........… --- ## [Bug in Logstash updated automaticaly my database](https://discuss.elastic.co/t/bug-in-logstash-updated-automaticaly-my-database/183215)
**Author:** [@Ricky\_Tokdis](https://discuss.elastic.co/u/Ricky_Tokdis)\ **Replies:** 0\ **Last updated:** [May 29, 2019, 4:01am UTC](https://discuss.elastic.co/t/bug-in-logstash-updated-automaticaly-my-database/183215 "2019-05-29T04:01:29Z")
input{ jdbc{ jdbc\_driver\_library =\> "/etc/mysql-connector/mysql-connector-java-5.1.46/mysql-connector-java-5.1.46-bin.jar" jdbc\_driver\_class =\> "com.mysql.jdbc.Driver" jdbc\_connection\_string =\> "jdbc:mysql://.......a… --- ## [S3 input logs are not being parsed line by line](https://discuss.elastic.co/t/s3-input-logs-are-not-being-parsed-line-by-line/183186)
**Author:** [@JaMz\_Jack\_GN](https://discuss.elastic.co/u/JaMz_Jack_GN)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 8:24pm UTC](https://discuss.elastic.co/t/s3-input-logs-are-not-being-parsed-line-by-line/183186 "2019-05-28T20:24:22Z")
Hello, I'm trying to ingest EMR logs from S3, but we have noticed that the message field is being populated with the whole log contents, not line by line as we would expect. input { s3 { aws\_credentials\_file =\> "… --- ## [Elapsed filter and performance](https://discuss.elastic.co/t/elapsed-filter-and-performance/183132)
**Author:** [@bigster](https://discuss.elastic.co/u/bigster)\ **Replies:** 3\ **Last updated:** [May 28, 2019, 4:31pm UTC](https://discuss.elastic.co/t/elapsed-filter-and-performance/183132 "2019-05-28T16:31:01Z")
Hi, I'm using elapsed filter to do the math between the time a event start and a event end. This occur between 2 documents, like the elapsed filter work. The problem is that i only can have 1 worker treating all the m… --- ## [Joining of results from elecsticsearch filter](https://discuss.elastic.co/t/joining-of-results-from-elecsticsearch-filter/183125)
**Author:** [@marksparrish](https://discuss.elastic.co/u/marksparrish)\ **Replies:** 1\ **Last updated:** [May 28, 2019, 4:28pm UTC](https://discuss.elastic.co/t/joining-of-results-from-elecsticsearch-filter/183125 "2019-05-28T16:28:27Z")
I am trying to join the results of an elasticsearch filter query. The history index has two fields - id and result. I want to create a field in the new index called results that contains both the id and the result e.g … --- ## [SNMP input (how to configure)](https://discuss.elastic.co/t/snmp-input-how-to-configure/183105)
**Author:** [@inter07](https://discuss.elastic.co/u/inter07)\ **Replies:** 7\ **Last updated:** [May 28, 2019, 4:27pm UTC](https://discuss.elastic.co/t/snmp-input-how-to-configure/183105 "2019-05-28T16:27:48Z")
Hi! Could You please help to configure SNMP input in the Logstash. I 've tried to use the official documentation, but got some problems.( My input configuration is: { input { snmp { get =\> \["1.3.6.1.4.… --- ## [Logstash 7.1 indexing to elasticsearch problem](https://discuss.elastic.co/t/logstash-7-1-indexing-to-elasticsearch-problem/182975)
**Author:** [@wcpoon](https://discuss.elastic.co/u/wcpoon)\ **Replies:** 1\ **Last updated:** [May 28, 2019, 2:31pm UTC](https://discuss.elastic.co/t/logstash-7-1-indexing-to-elasticsearch-problem/182975 "2019-05-28T14:31:57Z")
Hi guys, I got a problem on logstash 7.1 Before that in logstash 6.7, i do not have this problem. My indexing name is logstash-2019.x.x My logstash 7.1 index to elasticsearch is only one index file instead of everyday… --- ## [Keep getting this error indexing into Elastic](https://discuss.elastic.co/t/keep-getting-this-error-indexing-into-elastic/182603)
**Author:** [@bigster](https://discuss.elastic.co/u/bigster)\ **Replies:** 6\ **Last updated:** [May 28, 2019, 2:31pm UTC](https://discuss.elastic.co/t/keep-getting-this-error-indexing-into-elastic/182603 "2019-05-28T14:31:05Z")
Hi all, I've got this logstash conf of consuming a JMS channel, do some transformations, and indexing into an Elastic Cluster. But i keep getting this error: \[2019-05-24T10:29:43,516\]\[WARN \]\[logstash.outputs.elasticse… --- ## [Ruby - Ruby exception occurred: invalid date: "2019-04-18+06:23:35.919"](https://discuss.elastic.co/t/ruby-ruby-exception-occurred-invalid-date-2019-04-18-0635-919/183044)
**Author:** [@Yoav\_Ben\_Moha](https://discuss.elastic.co/u/Yoav_Ben_Moha)\ **Replies:** 1\ **Last updated:** [May 28, 2019, 1:48pm UTC](https://discuss.elastic.co/t/ruby-ruby-exception-occurred-invalid-date-2019-04-18-0635-919/183044 "2019-05-28T13:48:44Z")
I am trying to find a diff betweentwo dates. I have wrote the following con file which use Ruby in order to caculate the date diff. I recived : ruby - Ruby exception occurred: invalid date: "2019-04-18+06:23:35.919" T… --- ## [Deleting the data in Index before indexing the new data from input](https://discuss.elastic.co/t/deleting-the-data-in-index-before-indexing-the-new-data-from-input/183103)
**Author:** [@sjabiulla](https://discuss.elastic.co/u/sjabiulla)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 1:11pm UTC](https://discuss.elastic.co/t/deleting-the-data-in-index-before-indexing-the-new-data-from-input/183103 "2019-05-28T13:11:38Z")
I have a batch monitoring log files which will keep logging the job status and I'm indexing that data from logs to ElasticSearch using FileBeats & Logstash. Here is the data : Run 1: job="job\_one" status="Not Started" … --- ## [Logstash not parsing every file](https://discuss.elastic.co/t/logstash-not-parsing-every-file/182372)
**Author:** [@jamesp220291](https://discuss.elastic.co/u/jamesp220291)\ **Replies:** 4\ **Last updated:** [May 28, 2019, 12:32pm UTC](https://discuss.elastic.co/t/logstash-not-parsing-every-file/182372 "2019-05-28T12:32:15Z")
Hi All. I have logstash set up to parse/ingest a local directory on my server. The directory is for a CDN log files which are fetched every 10 minutes. Unfortuantly the CDN produces a new log file multiple times a min… --- ## [Logstash-input-jdbc does not work with java11](https://discuss.elastic.co/t/logstash-input-jdbc-does-not-work-with-java11/183085)
**Author:** [@fang](https://discuss.elastic.co/u/fang)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 11:43am UTC](https://discuss.elastic.co/t/logstash-input-jdbc-does-not-work-with-java11/183085 "2019-05-28T11:43:40Z")
logstash-input-jdbc seems does not work with java11 (or maybe 9 and later) due to jdk ClassLoading strategy changed after java 9. Enviroment: logstash 7.1.0 windows7-64 oracle jdk11.0.3 when run logstash by ./log… --- ## [Printing logs in JSON format](https://discuss.elastic.co/t/printing-logs-in-json-format/183072)
**Author:** [@Sneha\_Prabhu\_Samant](https://discuss.elastic.co/u/Sneha_Prabhu_Samant)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 11:03am UTC](https://discuss.elastic.co/t/printing-logs-in-json-format/183072 "2019-05-28T11:03:30Z")
In our product we were using JSONEventLayoutV1 for pushing logs in kibana with log4j.properties file. JSONEventLayoutV1 is a class present in net.logstash.log4j package. Now we want to switch from log4j2.properties. JS… --- ## [Openstack log filter](https://discuss.elastic.co/t/openstack-log-filter/182487)
**Author:** [@DavideG](https://discuss.elastic.co/u/DavideG)\ **Replies:** 3\ **Last updated:** [May 28, 2019, 11:02am UTC](https://discuss.elastic.co/t/openstack-log-filter/182487 "2019-05-28T11:02:58Z")
Hello guys, I'm having a problem where I have been stuck for the past 3 days if you would be able to help me I would appreciate very much :smiley: I'm trying to filter logs coming from openstack more precisely from the… --- ## [Logstash http\_poller - fetching big files](https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052)
**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 9:57am UTC](https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052 "2019-05-28T09:57:42Z")
Hello. I have 1GB json file that changes and it is on the remote server. I am able to do the fetch with the file size approx 500 MB, but not 1GB. input { http\_poller { urls =\> { url1 =\> "https://externalser… --- ## [Logstash with grok patterns applied on logs coming out of docker containers](https://discuss.elastic.co/t/logstash-with-grok-patterns-applied-on-logs-coming-out-of-docker-containers/181683)
**Author:** [@cmon\_sig](https://discuss.elastic.co/u/cmon_sig)\ **Replies:** 3\ **Last updated:** [May 28, 2019, 8:22am UTC](https://discuss.elastic.co/t/logstash-with-grok-patterns-applied-on-logs-coming-out-of-docker-containers/181683 "2019-05-28T08:22:14Z")
Hi everyone, I'm using docker labels to filter for certain messages and to apply the appropriate grok patterns. The patterns work when I test them with the grok debugger but I'm getting \_grokparsefailure when I use the… --- ## [Last\_run\_metadata\_path file not getting created](https://discuss.elastic.co/t/last-run-metadata-path-file-not-getting-created/183012)
**Author:** [@Abhinav\_Manoj](https://discuss.elastic.co/u/Abhinav_Manoj)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 7:55am UTC](https://discuss.elastic.co/t/last-run-metadata-path-file-not-getting-created/183012 "2019-05-28T07:55:08Z")
I'm trying to run logstash using JDBC plugin. I have given a custom path for the file but still it is not reflecting and its getting created in the default path. My config is as shown below input { jdbc { jdbc\_driver… --- ## [Multiple matches in Grok filter](https://discuss.elastic.co/t/multiple-matches-in-grok-filter/182667)
**Author:** [@f4fe5bb60e3686943680](https://discuss.elastic.co/u/f4fe5bb60e3686943680)\ **Replies:** 3\ **Last updated:** [May 28, 2019, 7:08am UTC](https://discuss.elastic.co/t/multiple-matches-in-grok-filter/182667 "2019-05-28T07:08:34Z")
Hello! I trying to parse search requests to one of my elastic database and i don\`t know what to do when a two- or more-word search come. Config: input { beats { port =\> 5044 } } filter { if "bulk" in \[url\]\[path\]… --- ## [How to create mapping fields using logstash](https://discuss.elastic.co/t/how-to-create-mapping-fields-using-logstash/182989)
**Author:** [@arunkvinam](https://discuss.elastic.co/u/arunkvinam)\ **Replies:** 1\ **Last updated:** [May 28, 2019, 6:01am UTC](https://discuss.elastic.co/t/how-to-create-mapping-fields-using-logstash/182989 "2019-05-28T06:01:08Z")
Iam try to synch mysql data with elasticsearch using logstash . But I can't define field type as "keyword" and asign normalizer in logstash.How I solve this issue. I have to perform somany wildcard query,that's why ia… --- ## [Logstash not sending data to elasticsearch throwing exception in logs](https://discuss.elastic.co/t/logstash-not-sending-data-to-elasticsearch-throwing-exception-in-logs/182987)
**Author:** [@r.ganeshbabu](https://discuss.elastic.co/u/r.ganeshbabu)\ **Replies:** 0\ **Last updated:** [May 28, 2019, 5:38am UTC](https://discuss.elastic.co/t/logstash-not-sending-data-to-elasticsearch-throwing-exception-in-logs/182987 "2019-05-28T05:38:10Z")
Hi All, We are trying to send data elasticsearch via logstash and we are keep getting the below error and warning in the logs, \[WARN \] 2019-05-28 05:27:52.152 \[Ruby-0-Thread-9: /usr/share/logstash/vendor/bundle/jruby/… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=538) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=540)