# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=432 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 433 --- ## [Insertting fields to other index](https://discuss.elastic.co/t/insertting-fields-to-other-index/211787)
**Author:** [@namali](https://discuss.elastic.co/u/namali)\ **Replies:** 0\ **Last updated:** [December 13, 2019, 12:02pm UTC](https://discuss.elastic.co/t/insertting-fields-to-other-index/211787 "2019-12-13T12:02:23Z")
two configs run in logstash server. both pushing data to same structured indexes. column names are same. 1st config is s3 input and 2nd one elasticsearch input, get data from 1st config index. when 2nd config triggerin… --- ## [Logstash jdbc input plugin pagination not working on version 7.4.2](https://discuss.elastic.co/t/logstash-jdbc-input-plugin-pagination-not-working-on-version-7-4-2/211783)
**Author:** [@Rafa](https://discuss.elastic.co/u/Rafa)\ **Replies:** 0\ **Last updated:** [December 13, 2019, 11:29am UTC](https://discuss.elastic.co/t/logstash-jdbc-input-plugin-pagination-not-working-on-version-7-4-2/211783 "2019-12-13T11:29:53Z")
Using jdbc input plugin, pagination is not working on version 7.4.2. Using version 7.0.0 it works fine. Any ideas what's missing? Logstash config: input { jdbc { jdbc\_driver\_library =\> "${LOGSTASH\_LIB\_DIR}/mysql… --- ## [Error when installing Java Plugin from Offline Packs](https://discuss.elastic.co/t/error-when-installing-java-plugin-from-offline-packs/210897)
**Author:** [@rgomez](https://discuss.elastic.co/u/rgomez)\ **Replies:** 2\ **Last updated:** [December 13, 2019, 10:18am UTC](https://discuss.elastic.co/t/error-when-installing-java-plugin-from-offline-packs/210897 "2019-12-13T10:18:08Z")
I am experiencing the same issue that Cory\_Huebner reported in July: I am attempting to install a custom output Logstash plugin on Logstash 7.2; the plugin is written in Java based on the instructions found on this Log… --- ## [Logstash crashed randomly (XML plugin)](https://discuss.elastic.co/t/logstash-crashed-randomly-xml-plugin/211767)
**Author:** [@Ged](https://discuss.elastic.co/u/Ged)\ **Replies:** 0\ **Last updated:** [December 13, 2019, 8:55am UTC](https://discuss.elastic.co/t/logstash-crashed-randomly-xml-plugin/211767 "2019-12-13T08:55:14Z")
Hi Team, It happens from time to time (i cannot find a rule) that Logstash (v. 7.4.0) crashes with error below. In previously used version (6.3.1) i didn't notice such a problem. Could you please help ? Why this excep… --- ## [Jdbc mariadb works in logstash 6.8, but not in logstash 7.5](https://discuss.elastic.co/t/jdbc-mariadb-works-in-logstash-6-8-but-not-in-logstash-7-5/211261)
**Author:** [@ErikWarming](https://discuss.elastic.co/u/ErikWarming)\ **Replies:** 2\ **Last updated:** [December 13, 2019, 8:48am UTC](https://discuss.elastic.co/t/jdbc-mariadb-works-in-logstash-6-8-but-not-in-logstash-7-5/211261 "2019-12-13T08:48:29Z")
We have updated our ES to 7.5 and therefore I am also updating our logstash'es. I know that Logstash 6.8 works with ES 7.5, so this is not a crisis. BUT... When I run these two config files, 6.8 works, but 7.5 don't. T… --- ## [How to split column which has multpiple values](https://discuss.elastic.co/t/how-to-split-column-which-has-multpiple-values/211744)
**Author:** [@saravana\_hariharan](https://discuss.elastic.co/u/saravana_hariharan)\ **Replies:** 2\ **Last updated:** [December 13, 2019, 8:27am UTC](https://discuss.elastic.co/t/how-to-split-column-which-has-multpiple-values/211744 "2019-12-13T08:27:41Z")
im using it in logfile fields time,sessionid,requestid, fieldvalue columns and my question is inside of fieldvalue column these terms are placed. how to split the createdtime value to individual field (createdby,createdt… --- ## [Log Timezone Question](https://discuss.elastic.co/t/log-timezone-question/211160)
**Author:** [@ElkLogs](https://discuss.elastic.co/u/ElkLogs)\ **Replies:** 12\ **Last updated:** [December 13, 2019, 6:53am UTC](https://discuss.elastic.co/t/log-timezone-question/211160 "2019-12-13T06:53:33Z")
I have been searching through the threads, but I haven't been able to fins a solution. Essentially, I have a log source that ships logs in UTC. I need to adjust them for my timezone, but changing the zone in the logstash… --- ## [Logstash http\_poller ssl issue](https://discuss.elastic.co/t/logstash-http-poller-ssl-issue/211725)
**Author:** [@RunningSmurf](https://discuss.elastic.co/u/RunningSmurf)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 9:34pm UTC](https://discuss.elastic.co/t/logstash-http-poller-ssl-issue/211725 "2019-12-12T21:34:01Z")
Hello, I create an input that queries a APi end point. The URL requires SSL. I downloaded the .jks file for the domain and included it in the input section as follows: input { http\_poller { urls =\> { test1 =\> { met… --- ## [Unable to get namespace as index name](https://discuss.elastic.co/t/unable-to-get-namespace-as-index-name/211578)
**Author:** [@sandeepk1210](https://discuss.elastic.co/u/sandeepk1210)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 7:12am UTC](https://discuss.elastic.co/t/unable-to-get-namespace-as-index-name/211578 "2019-12-12T07:12:16Z")
Hi Guys, Requirement : Have INDEX name as FILEBEAT-NAMESPACE-YYYYMMDD Issue: I am unable to get NAMESPACE resolved to be the kubernetes namespace, with whatever option I try. Application: Logstash 7.4.1 is deployed … --- ## [Replacing New Relic plugin with new version in Github](https://discuss.elastic.co/t/replacing-new-relic-plugin-with-new-version-in-github/208742)
**Author:** [@Seth\_Schwartzman](https://discuss.elastic.co/u/Seth_Schwartzman)\ **Replies:** 1\ **Last updated:** [December 12, 2019, 6:09pm UTC](https://discuss.elastic.co/t/replacing-new-relic-plugin-with-new-version-in-github/208742 "2019-12-12T18:09:21Z")
Hi Logstash folks! New Relic has developed a new version of logstash-output-newrelic, and have replaced the Ruby Gem associated with it. We were hoping to replace the repo in your org with our own, or have that one poi… --- ## [Dissect not parsing](https://discuss.elastic.co/t/dissect-not-parsing/211698)
**Author:** [@imaad](https://discuss.elastic.co/u/imaad)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 5:06pm UTC](https://discuss.elastic.co/t/dissect-not-parsing/211698 "2019-12-12T17:06:12Z")
Hello everyone, I'm trying to parse this two log lines : 2019-12-12T10:35:42.625+0100 ERROR log/input.go:501 Harvester could not be started on new file: /apps/tomcat/srvr\_inf\_tom80\_dxccloud\_dev\_01/prod/logs/ju.log, Err… --- ## [Fields splitting from kv filter not containing blank values](https://discuss.elastic.co/t/fields-splitting-from-kv-filter-not-containing-blank-values/211613)
**Author:** [@Vaibhav\_Gupta2](https://discuss.elastic.co/u/Vaibhav_Gupta2)\ **Replies:** 2\ **Last updated:** [December 12, 2019, 4:54pm UTC](https://discuss.elastic.co/t/fields-splitting-from-kv-filter-not-containing-blank-values/211613 "2019-12-12T16:54:00Z")
I am using 'kv' filter in logstash like this kv { source =\> "request" field\_split =\> "&?" } I have a message like "key=value&key1=&key2=value2" the logstash output is coming like this "key" : "value" "key1" : "&k… --- ## [No events emitted - CPU & Memory is fine](https://discuss.elastic.co/t/no-events-emitted-cpu-memory-is-fine/211688)
**Author:** [@ntran](https://discuss.elastic.co/u/ntran)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 4:26pm UTC](https://discuss.elastic.co/t/no-events-emitted-cpu-memory-is-fine/211688 "2019-12-12T16:26:34Z")
My logstash instance is not emitting events that it is receiving to Elasticsearch. CPU across my hot nodes are very low (highest CPU usage is 12%) and my JVM memory percentage seems to be ok (highest one is 54%). What … --- ## [JDBC static filter plugin: creating new subfield with value - getting unexpected array object](https://discuss.elastic.co/t/jdbc-static-filter-plugin-creating-new-subfield-with-value-getting-unexpected-array-object/211385)
**Author:** [@tomj](https://discuss.elastic.co/u/tomj)\ **Replies:** 3\ **Last updated:** [December 12, 2019, 3:46pm UTC](https://discuss.elastic.co/t/jdbc-static-filter-plugin-creating-new-subfield-with-value-getting-unexpected-array-object/211385 "2019-12-12T15:46:46Z")
I am using Logstash 7.1.1 with Elasticsearch 7.1.1 I have been able to query an external MSSQL DB and populate the internal Derby database just fine. I'm populating the fields with the proper names, but the resultant v… --- ## [Help in logstash parsing by using GROK](https://discuss.elastic.co/t/help-in-logstash-parsing-by-using-grok/211671)
**Author:** [@elkparser](https://discuss.elastic.co/u/elkparser)\ **Replies:** 1\ **Last updated:** [December 12, 2019, 2:56pm UTC](https://discuss.elastic.co/t/help-in-logstash-parsing-by-using-grok/211671 "2019-12-12T14:56:53Z")
Below is the sample Log: Worlkflow MainJobName Start\_time Job status dependencies ABCDS19F #QSDF\_workflow 1705 10/29 QSDF\_JOB READY ----- ----- … --- ## [How to split single field values in to multipleterms in logstash](https://discuss.elastic.co/t/how-to-split-single-field-values-in-to-multipleterms-in-logstash/211666)
**Author:** [@saravana\_hariharan](https://discuss.elastic.co/u/saravana_hariharan)\ **Replies:** 2\ **Last updated:** [December 12, 2019, 2:54pm UTC](https://discuss.elastic.co/t/how-to-split-single-field-values-in-to-multipleterms-in-logstash/211666 "2019-12-12T14:54:51Z")
(Fieldvalue =\> createdby,createdtime,updatedby,updatedtime) i need a individual field for createdtime in my kibana option thanks saravanan.R --- ## [Spring message grok pattern](https://discuss.elastic.co/t/spring-message-grok-pattern/210862)
**Author:** [@Antoine\_GODEAU](https://discuss.elastic.co/u/Antoine_GODEAU)\ **Replies:** 3\ **Last updated:** [December 12, 2019, 1:43pm UTC](https://discuss.elastic.co/t/spring-message-grok-pattern/210862 "2019-12-12T13:43:31Z")
Hello everyone, I try to create a grok for my spring log message but it seems to not work. Anyone can me help to resolve my grok error ? You can find here an example of the log file : 2019-12-06 09:36:24,254 INFO com… --- ## [Time in IST for log-rotation - Logstash](https://discuss.elastic.co/t/time-in-ist-for-log-rotation-logstash/211612)
**Author:** [@singhankit.iem](https://discuss.elastic.co/u/singhankit.iem)\ **Replies:** 2\ **Last updated:** [December 12, 2019, 1:28pm UTC](https://discuss.elastic.co/t/time-in-ist-for-log-rotation-logstash/211612 "2019-12-12T13:28:44Z")
I have configured file-beat on all the App servers and Logstash in a centralized server for the log rotation. The config file in Log rotation is input { beats { port =\> 5044 } } filter{ mutate { remove\_field =\> \[… --- ## [Configured logstash multiple pipelines but not working. Need help](https://discuss.elastic.co/t/configured-logstash-multiple-pipelines-but-not-working-need-help/211361)
**Author:** [@shylendran](https://discuss.elastic.co/u/shylendran)\ **Replies:** 4\ **Last updated:** [December 12, 2019, 1:10pm UTC](https://discuss.elastic.co/t/configured-logstash-multiple-pipelines-but-not-working-need-help/211361 "2019-12-12T13:10:15Z")
Hello, I am facing an issue with the Logstash. Tried different ways but no luck. Any help is really appreciated. The version that I am using is, 7.3 Already went thru https://www.elastic.co/guide/en/logstash/7.x/multip… --- ## [Unable to create a new index applying ILM policy](https://discuss.elastic.co/t/unable-to-create-a-new-index-applying-ilm-policy/211640)
**Author:** [@joseantonio.arroba](https://discuss.elastic.co/u/joseantonio.arroba)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 11:49am UTC](https://discuss.elastic.co/t/unable-to-create-a-new-index-applying-ilm-policy/211640 "2019-12-12T11:49:16Z")
Hi all, We have set up the elasticsearch output plugin in Logstash 7.5 to write to a index name and we see that the index is created correctly in ElasticSearch 7.5 if it does not exist. Now we would like to test how can… --- ## [Http\_poller error when building XML/SOAP request](https://discuss.elastic.co/t/http-poller-error-when-building-xml-soap-request/210698)
**Author:** [@sgreszcz](https://discuss.elastic.co/u/sgreszcz)\ **Replies:** 6\ **Last updated:** [December 12, 2019, 10:30am UTC](https://discuss.elastic.co/t/http-poller-error-when-building-xml-soap-request/210698 "2019-12-12T10:30:44Z")
Hi there, I'm trying to use the http\_poller input to periodically generate an HTTP/XML/SOAP requests but I'm getting "Invalid URL post" back - Logstash doesn't even seem to be building the request: Pipeline aborted due… --- ## [Logstash Error - causing shutdown and restart](https://discuss.elastic.co/t/logstash-error-causing-shutdown-and-restart/209232)
**Author:** [@skyluke.1987](https://discuss.elastic.co/u/skyluke.1987)\ **Replies:** 19\ **Last updated:** [December 12, 2019, 8:51am UTC](https://discuss.elastic.co/t/logstash-error-causing-shutdown-and-restart/209232 "2019-12-12T08:51:47Z")
Hi may I know how to resolve this? I am unable to identify which file is causing this error. --- ## [Fields not working in Syslog output](https://discuss.elastic.co/t/fields-not-working-in-syslog-output/211389)
**Author:** [@grimshad](https://discuss.elastic.co/u/grimshad)\ **Replies:** 5\ **Last updated:** [December 12, 2019, 7:52am UTC](https://discuss.elastic.co/t/fields-not-working-in-syslog-output/211389 "2019-12-12T07:52:09Z")
I'm attempting to convert netflow data from the netflow codec into syslog data using the syslog output plugin. The issue i'm having is that no matter what I set the syslog plugin "message" to, it only ever outputs the d… --- ## [Logstash 6.8.3 not exporting its metrics](https://discuss.elastic.co/t/logstash-6-8-3-not-exporting-its-metrics/209353)
**Author:** [@Mohit\_Kunjir](https://discuss.elastic.co/u/Mohit_Kunjir)\ **Replies:** 10\ **Last updated:** [December 12, 2019, 5:49am UTC](https://discuss.elastic.co/t/logstash-6-8-3-not-exporting-its-metrics/209353 "2019-12-12T05:49:29Z")
I am running the rpm version of Logstash 6.8.3 on full GUI based CentOS 7 running locally on VM Player on my desktop. Downloaded the rpm version from official site. This version does not export its metrics via xpack.m… --- ## [Input-jdbc transform row with all columns to json](https://discuss.elastic.co/t/input-jdbc-transform-row-with-all-columns-to-json/211553)
**Author:** [@Ashutosh\_Pandey](https://discuss.elastic.co/u/Ashutosh_Pandey)\ **Replies:** 0\ **Last updated:** [December 12, 2019, 3:13am UTC](https://discuss.elastic.co/t/input-jdbc-transform-row-with-all-columns-to-json/211553 "2019-12-12T03:13:09Z")
I have a jdbc input plugin. My intention is to read a row and transform all the data into a kafka payload object and send it to kafka. { .... "payload" : " All the data from one row of jdbc input should come here" "t… --- ## ["message" is empty or non-existent](https://discuss.elastic.co/t/message-is-empty-or-non-existent/211535)
**Author:** [@grimshad](https://discuss.elastic.co/u/grimshad)\ **Replies:** 5\ **Last updated:** [December 11, 2019, 11:19pm UTC](https://discuss.elastic.co/t/message-is-empty-or-non-existent/211535 "2019-12-11T23:19:02Z")
using this input: input { udp { port =\> 2055 codec =\> netflow } } and stdout: "@timestamp" =\> 2019-12-10T11:48:02.921Z, "netflow" =\> { "input\_snmp" =\> 0, "ipv4\_dst\_addr" =\> "77.12.190.94", "output\_… --- ## [How to enrich static data in metricbeat events](https://discuss.elastic.co/t/how-to-enrich-static-data-in-metricbeat-events/211421)
**Author:** [@SunilSMenon](https://discuss.elastic.co/u/SunilSMenon)\ **Replies:** 1\ **Last updated:** [December 11, 2019, 10:59pm UTC](https://discuss.elastic.co/t/how-to-enrich-static-data-in-metricbeat-events/211421 "2019-12-11T22:59:51Z")
Hi, We have metricbeat installed and it provides the metric events, we would like to enrich the metricbeat events with information which is available in MSSQL DB, can you kindly guide me how to achieve this. I understan… --- ## [Datetime from MySQL via JDBC --\> @timestamp assignment fails with \_dateparsefailure](https://discuss.elastic.co/t/datetime-from-mysql-via-jdbc-timestamp-assignment-fails-with-dateparsefailure/211531)
**Author:** [@Chris1234](https://discuss.elastic.co/u/Chris1234)\ **Replies:** 2\ **Last updated:** [December 11, 2019, 10:37pm UTC](https://discuss.elastic.co/t/datetime-from-mysql-via-jdbc-timestamp-assignment-fails-with-dateparsefailure/211531 "2019-12-11T22:37:28Z")
I'm using the jdbc plugin to grab table data from a MySQL database. One of the fields in the MySQL database ("created\_at") is of type DATETIME which I need to assign to the @timestamp. Here's part of my logstash.conf: … --- ## [Logstash code 503](https://discuss.elastic.co/t/logstash-code-503/211436)
**Author:** [@typzea](https://discuss.elastic.co/u/typzea)\ **Replies:** 1\ **Last updated:** [December 11, 2019, 9:58pm UTC](https://discuss.elastic.co/t/logstash-code-503/211436 "2019-12-11T21:58:42Z")
Bonjour à tous, J'ai besoin d'aide car depuis quelques jours j'ai le souci suivant : Dec 11 08:54:12 s-log-p-i02-fr logstash\[1011\]: \[2019-12-11T08:54:12,757\]\[INFO \]\[logstash.outputs.elasticsearch\]\[main\] retrying failed… --- ## [While inserting data from logstash to mongo, receieving socket error](https://discuss.elastic.co/t/while-inserting-data-from-logstash-to-mongo-receieving-socket-error/211505)
**Author:** [@psandhir](https://discuss.elastic.co/u/psandhir)\ **Replies:** 0\ **Last updated:** [December 11, 2019, 5:36pm UTC](https://discuss.elastic.co/t/while-inserting-data-from-logstash-to-mongo-receieving-socket-error/211505 "2019-12-11T17:36:13Z")
I am inserting logs to mongo using logstash & filebeat. Logs are received by logstash but while inserting to mongo, receiving below error on kubernetes. Can somebody please help on this. \[WARN \] 2019-12-11 14:55:32.772 … [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=431) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=433)