# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=351 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 352 --- ## [Sprintf with undefined field](https://discuss.elastic.co/t/sprintf-with-undefined-field/234628)
**Author:** [@steevhise](https://discuss.elastic.co/u/steevhise)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 11:55pm UTC](https://discuss.elastic.co/t/sprintf-with-undefined-field/234628 "2020-05-27T23:55:04Z")
I'm setting the document\_id in a logstash to elasticsearch output module to a string made up of 2 of my fields, but i'm finding that when one field is null or undefined the name of the field just gets included in the str… --- ## [Logstash Parsing takes too much time for processing](https://discuss.elastic.co/t/logstash-parsing-takes-too-much-time-for-processing/234488)
**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 8:55pm UTC](https://discuss.elastic.co/t/logstash-parsing-takes-too-much-time-for-processing/234488 "2020-05-27T20:55:42Z")
Hey, My logstash has multiple lookups and various grok parsing too The normal logs count without parsing is 500-600 eps but with filter plugin in is 100-150 eps Please Help needed Thanks in advance --- ## [Logstash does not update logs Elasticsearch input plugin](https://discuss.elastic.co/t/logstash-does-not-update-logs-elasticsearch-input-plugin/234617)
**Author:** [@Oleh\_Smahliuk](https://discuss.elastic.co/u/Oleh_Smahliuk)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 8:53pm UTC](https://discuss.elastic.co/t/logstash-does-not-update-logs-elasticsearch-input-plugin/234617 "2020-05-27T20:53:12Z")
Hi guys! I have an issue with Logstash Elasticsearch input plugin. I try to transfer data from one ES cluster to other ES cluster, but Logstash transfer data only to time when pipeline starting. For example, pipeline st… --- ## [Java heapspace issue while running logstash](https://discuss.elastic.co/t/java-heapspace-issue-while-running-logstash/234601)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 8:51pm UTC](https://discuss.elastic.co/t/java-heapspace-issue-while-running-logstash/234601 "2020-05-27T20:51:00Z")
Hi All, I'm using logstash to ingest data into elasticsearch, while executing logstash its throwing up java heap space error. There is almost 5450 documents i'm trying to ingest. Any ideas or suggestions where i should… --- ## [How to run Logstash with batch file through Task scheduler](https://discuss.elastic.co/t/how-to-run-logstash-with-batch-file-through-task-scheduler/234599)
**Author:** [@chandra\_kunisetti](https://discuss.elastic.co/u/chandra_kunisetti)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 6:34pm UTC](https://discuss.elastic.co/t/how-to-run-logstash-with-batch-file-through-task-scheduler/234599 "2020-05-27T18:34:03Z")
I have created a bacth file and tried to call it through Task scheduler. It is giving an error unable to launch. but am able to run manually(Without Scheduler) Its perfectly working . Below is code for Batch : @echo of… --- ## [How to write a multi-line SQL in logstash pipelines](https://discuss.elastic.co/t/how-to-write-a-multi-line-sql-in-logstash-pipelines/234182)
**Author:** [@tenet\_testuser1](https://discuss.elastic.co/u/tenet_testuser1)\ **Replies:** 8\ **Last updated:** [May 27, 2020, 4:28pm UTC](https://discuss.elastic.co/t/how-to-write-a-multi-line-sql-in-logstash-pipelines/234182 "2020-05-27T16:28:07Z")
Hello, So far, I am able to write a single line SQL in logstash pipelines and it's working fine. However, How do I write multiline SQL with single-quotes (') in the SQL? I tried with a backslash for continuation, but t… --- ## [SNMP input plugin - SNMP V3 still Not Working](https://discuss.elastic.co/t/snmp-input-plugin-snmp-v3-still-not-working/234539)
**Author:** [@Thelmo\_Henrique\_Sant](https://discuss.elastic.co/u/Thelmo_Henrique_Sant)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 3:17pm UTC](https://discuss.elastic.co/t/snmp-input-plugin-snmp-v3-still-not-working/234539 "2020-05-27T15:17:58Z")
Hi , I am new with ELK and I'm trying to configure my logstash to get SNMP V3 information from my devices, but unfortunately, I don't know what I am doing wrong. I followed the procedures from the SNMP input plugin pag… --- ## [Grok part of message](https://discuss.elastic.co/t/grok-part-of-message/234534)
**Author:** [@GedeoN](https://discuss.elastic.co/u/GedeoN)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 2:59pm UTC](https://discuss.elastic.co/t/grok-part-of-message/234534 "2020-05-27T14:59:52Z")
Hi, I'm trying to parse a part of message. My general grok is working, but this one doesn't. I have message like that: Login failed for user 'USR\_DELTA'. Reason: The account is disabled. \[CLIENT: xxx.xxx.xxx.xxx\] In… --- ## [Logstash Offline Plugin SocketError](https://discuss.elastic.co/t/logstash-offline-plugin-socketerror/234562)
**Author:** [@sonnenteich](https://discuss.elastic.co/u/sonnenteich)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 2:21pm UTC](https://discuss.elastic.co/t/logstash-offline-plugin-socketerror/234562 "2020-05-27T14:21:44Z")
I try to build and install a logstash plugin, so I run bin/logstash-plugin prepare-offline-pack logstash-filter-http . When I run bin/logstash-plugin install logstash-offline-plugins-7.7.0.zip in an offline in environme… --- ## [Is it possible to control which field to index in Logstash?](https://discuss.elastic.co/t/is-it-possible-to-control-which-field-to-index-in-logstash/234546)
**Author:** [@tomeri](https://discuss.elastic.co/u/tomeri)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 2:16pm UTC](https://discuss.elastic.co/t/is-it-possible-to-control-which-field-to-index-in-logstash/234546 "2020-05-27T14:16:21Z")
Hi, I'm trying to apply some naming validation to each field that passes through Logstash, to match some predefined naming convention using regex. Assuming that I can distinguish within Logstash which field is eligible… --- ## [Variables in SQL statements, running only after first statement](https://discuss.elastic.co/t/variables-in-sql-statements-running-only-after-first-statement/233893)
**Author:** [@Alex\_Korn](https://discuss.elastic.co/u/Alex_Korn)\ **Replies:** 5\ **Last updated:** [May 27, 2020, 2:13pm UTC](https://discuss.elastic.co/t/variables-in-sql-statements-running-only-after-first-statement/233893 "2020-05-27T14:13:09Z")
Hello all I'm new to logstash, and at the moment I'm playing around with my sql-requests, the almost all of them are using temp variable. It I'm running sql-request like select my\_id from table1 where date \> $start and… --- ## [How comparing an UTC datetime to a CET 'YYYY-mm-dd' date using jdbc\_static?](https://discuss.elastic.co/t/how-comparing-an-utc-datetime-to-a-cet-yyyy-mm-dd-date-using-jdbc-static/234173)
**Author:** [@Rom1](https://discuss.elastic.co/u/Rom1)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 2:01pm UTC](https://discuss.elastic.co/t/how-comparing-an-utc-datetime-to-a-cet-yyyy-mm-dd-date-using-jdbc-static/234173 "2020-05-27T14:01:58Z")
Hi all, I'm trying to explain my problem here and hope you'll provide a solution to me... I've a jdbc input that reads occurrences in a database, especially a datetime field in UTC: evtUtcDate I need to enrich the ev… --- ## [Can't use maps with geoip](https://discuss.elastic.co/t/cant-use-maps-with-geoip/234530)
**Author:** [@Dariko77](https://discuss.elastic.co/u/Dariko77)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 1:22pm UTC](https://discuss.elastic.co/t/cant-use-maps-with-geoip/234530 "2020-05-27T13:22:43Z")
Hello, I am trying to use the maps visualization in kibana with the geo\_ip but the maps dashboard dont know where are the fields of geo\_ip. In logstash I use the geo\_ip in filter like: geoip{ … --- ## [Multiple Http\_poller inputs with basic authentication](https://discuss.elastic.co/t/multiple-http-poller-inputs-with-basic-authentication/234542)
**Author:** [@ferdinandb](https://discuss.elastic.co/u/ferdinandb)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 1:08pm UTC](https://discuss.elastic.co/t/multiple-http-poller-inputs-with-basic-authentication/234542 "2020-05-27T13:08:42Z")
Hi, I am trying to pull API data from several endpoints all using the same Username and Password. Example: input { http\_poller { schedule =\> { every =\> "20s" } request\_timeout =\> 60 urls =\> { "Path1" =\> … --- ## [Encountered a retryable error. Will Retry with exponential backoff code=\>413](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-413/234331)
**Author:** [@avneshkumar98](https://discuss.elastic.co/u/avneshkumar98)\ **Replies:** 3\ **Last updated:** [May 27, 2020, 12:41pm UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-413/234331 "2020-05-27T12:41:25Z")
please help, How to solve this error, \[2020-05-26T17:59:29,435\]\[ERROR\]\[logstash.outputs.elasticsearch\]\[main\]\[6286b14da4febadbf6b521991fe9dc9d011c6f3bdb1ee16e9be4527536d2d765\] Encountered a retryable error. Will Retry wi… --- ## [Logstash HTTP Output Failure](https://discuss.elastic.co/t/logstash-http-output-failure/234533)
**Author:** [@chitreshg](https://discuss.elastic.co/u/chitreshg)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 11:21am UTC](https://discuss.elastic.co/t/logstash-http-output-failure/234533 "2020-05-27T11:21:00Z")
I'm using logstash 6.5.4 in centos7 for collecting the information from system and sending it to node server through http output plugin. following is my code. input { stdin{} } output{ http { url =\> "${URL\_SET\_CL… --- ## [Logstash: ERROR Manticore::ClientProtocolException](https://discuss.elastic.co/t/logstash-error-manticore-clientprotocolexception/234481)
**Author:** [@aannee](https://discuss.elastic.co/u/aannee)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 8:00am UTC](https://discuss.elastic.co/t/logstash-error-manticore-clientprotocolexception/234481 "2020-05-27T08:00:33Z")
Hi, I'm getting this error when I'm running my logstash pipeline. Is it because I have no valid ssl cert? Here's my conf filter { elasticsearch { ssl =\> false hosts =\> \["localhos… --- ## [Logstash snmp output](https://discuss.elastic.co/t/logstash-snmp-output/233486)
**Author:** [@PraveenKT](https://discuss.elastic.co/u/PraveenKT)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 8:25am UTC](https://discuss.elastic.co/t/logstash-snmp-output/233486 "2020-05-27T08:25:10Z")
i am successfully SNMP polling the network device. But fields in output are OID. how do i get proper fields. Below is example output. ++++++++++++++++++++++++++++++++++++++++ "host" =\> "x.x.x.x", "iso.org.dod.internet… --- ## [Insert multiple jdbc rows into the same ES document under nested field](https://discuss.elastic.co/t/insert-multiple-jdbc-rows-into-the-same-es-document-under-nested-field/234486)
**Author:** [@Xophis](https://discuss.elastic.co/u/Xophis)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 8:21am UTC](https://discuss.elastic.co/t/insert-multiple-jdbc-rows-into-the-same-es-document-under-nested-field/234486 "2020-05-27T08:21:33Z")
Hi, I would like to insert in the same elasticsearch document, all jdbc rows with the same ID into a nested field called "logs". Can someone explain me how to convert jdbc input rows of logs into the following JSON str… --- ## [Time of the log is 10 hours ahead in Kibana](https://discuss.elastic.co/t/time-of-the-log-is-10-hours-ahead-in-kibana/234464)
**Author:** [@shadid](https://discuss.elastic.co/u/shadid)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 6:20am UTC](https://discuss.elastic.co/t/time-of-the-log-is-10-hours-ahead-in-kibana/234464 "2020-05-27T06:20:02Z")
Hi, I have created a logstash filter to parse palo alto syslog. Below is the configuration. filter { if \[fields\]\[node\_type\] == "firewall" { if \[message\] =~ /-- MARK --/ { drop {}} if \[message\] =~ /last messag… --- ## [Problem with csv filter](https://discuss.elastic.co/t/problem-with-csv-filter/233880)
**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\ **Replies:** 6\ **Last updated:** [May 27, 2020, 5:02am UTC](https://discuss.elastic.co/t/problem-with-csv-filter/233880 "2020-05-27T05:02:03Z")
Hi I have a csv file, in order to index it in elasticsearch I am using logstash. I am using CSV filter and my conf file is: '''input { file { sincedb\_path =\> "/null" path =\> "/home/kagamee/Downloads/time\_logs.csv" s… --- ## [\[logstash.agent \] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :exception=\>"LogStash::ConfigurationError",](https://discuss.elastic.co/t/logstash-agent-failed-to-execute-action-action-logstash-create-pipeline-id-main-exception-logstash-configurationerror/233802)
**Author:** [@Hanneu](https://discuss.elastic.co/u/Hanneu)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 2:37am UTC](https://discuss.elastic.co/t/logstash-agent-failed-to-execute-action-action-logstash-create-pipeline-id-main-exception-logstash-configurationerror/233802 "2020-05-27T02:37:37Z")
Hello experts, Getting below error on logstash (LS) logs for all of the nodes. \[2020-05-21T12:08:42,231\]\[ERROR\]\[logstash.agent \] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id… --- ## [Can logstash be debug through in tool (eclipse or idea)?](https://discuss.elastic.co/t/can-logstash-be-debug-through-in-tool-eclipse-or-idea/234283)
**Author:** [@shengl](https://discuss.elastic.co/u/shengl)\ **Replies:** 3\ **Last updated:** [May 27, 2020, 1:56am UTC](https://discuss.elastic.co/t/can-logstash-be-debug-through-in-tool-eclipse-or-idea/234283 "2020-05-27T01:56:55Z")
I hope I can debug source code of logstash, I should how to do it. --- ## [Different logstash with the same id](https://discuss.elastic.co/t/different-logstash-with-the-same-id/234417)
**Author:** [@Rafael\_G\_de\_Matos](https://discuss.elastic.co/u/Rafael_G_de_Matos)\ **Replies:** 0\ **Last updated:** [May 26, 2020, 8:51pm UTC](https://discuss.elastic.co/t/different-logstash-with-the-same-id/234417 "2020-05-26T20:51:19Z")
Hi need help with the problem. I have two nodes I think cloning machine, then: How resolve this issue? On monitoring have conflict machine dashboard. --- ## [reason"=\>"Limit of total fields \[1000\] in index](https://discuss.elastic.co/t/reason-limit-of-total-fields-1000-in-index/234415)
**Author:** [@PraveenKT](https://discuss.elastic.co/u/PraveenKT)\ **Replies:** 3\ **Last updated:** [May 26, 2020, 9:37pm UTC](https://discuss.elastic.co/t/reason-limit-of-total-fields-1000-in-index/234415 "2020-05-26T21:37:26Z")
I am getting below error. but found the events in kibana discovery. Increesed the fileds limit by below. PUT issqnet-2020.05.26/\_settings { "index.mapping.total\_fields.limit": 10000 } \`\`\`\`\`\`\`\`\`\`\`\`\`\`\`\`\`\`\` incresed and … --- ## [Logstash error - java.lang.illegalstateexception: logstash stopped processing because of an error: no such file to load -- bundler](https://discuss.elastic.co/t/logstash-error-java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-no-such-file-to-load-bundler/234410)
**Author:** [@Grace\_Rashmi](https://discuss.elastic.co/u/Grace_Rashmi)\ **Replies:** 0\ **Last updated:** [May 26, 2020, 7:50pm UTC](https://discuss.elastic.co/t/logstash-error-java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-no-such-file-to-load-bundler/234410 "2020-05-26T19:50:23Z")
Hi team , I am new ELK. Kindly help on the error --- ## [Indices not showing on Kibana and data type does not change](https://discuss.elastic.co/t/indices-not-showing-on-kibana-and-data-type-does-not-change/234402)
**Author:** [@himalc](https://discuss.elastic.co/u/himalc)\ **Replies:** 0\ **Last updated:** [May 26, 2020, 7:25pm UTC](https://discuss.elastic.co/t/indices-not-showing-on-kibana-and-data-type-does-not-change/234402 "2020-05-26T19:25:13Z")
Hi, This is my logstash.conf file. I cannot see the index on kibana and data type does not convert. Any help? input { beats { port =\> 5044 } } filter { grok { match =\> { "message" =\> '%{TIME:timex} %{WORD:Ix} %{… --- ## [Failed to parse string date field](https://discuss.elastic.co/t/failed-to-parse-string-date-field/234235)
**Author:** [@psteh](https://discuss.elastic.co/u/psteh)\ **Replies:** 1\ **Last updated:** [May 26, 2020, 4:19pm UTC](https://discuss.elastic.co/t/failed-to-parse-string-date-field/234235 "2020-05-26T16:19:27Z")
Here is my logstash filter Given created\_at, updated\_at, deleted\_at is string, I would like to convert these fields to date Gotten error when trying to insert documents. Could not index event to Elasticsearch. {:statu… --- ## [Http\_request\_failure](https://discuss.elastic.co/t/http-request-failure/234303)
**Author:** [@swarali\_vartak](https://discuss.elastic.co/u/swarali_vartak)\ **Replies:** 1\ **Last updated:** [May 26, 2020, 3:34pm UTC](https://discuss.elastic.co/t/http-request-failure/234303 "2020-05-26T15:34:47Z")
Hi, I need some support regarding http\_request\_failure when ssl is configured. I have a URL to be used as input of logstash and I have 3 Elastic Nodes , 2 Logstash node and 1 Kibana Node and ssl is configured on all n… --- ## [Filter multiple logs from same file to different index](https://discuss.elastic.co/t/filter-multiple-logs-from-same-file-to-different-index/234330)
**Author:** [@Dariko77](https://discuss.elastic.co/u/Dariko77)\ **Replies:** 1\ **Last updated:** [May 26, 2020, 3:28pm UTC](https://discuss.elastic.co/t/filter-multiple-logs-from-same-file-to-different-index/234330 "2020-05-26T15:28:36Z")
Hello, I have a syslog file that aggregate logs from multiples sources (and I cant separate the logs to different files) and I have a filebeat monitoring that single file that send to logstash. That file has the follow… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=350) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=352)