# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=550 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 551 --- ## [Logstash JDBC Static filter plugin failing with postgres DB](https://discuss.elastic.co/t/logstash-jdbc-static-filter-plugin-failing-with-postgres-db/180592)
**Author:** [@kumar-pratyaksh](https://discuss.elastic.co/u/kumar-pratyaksh)\ **Replies:** 0\ **Last updated:** [May 10, 2019, 4:37pm UTC](https://discuss.elastic.co/t/logstash-jdbc-static-filter-plugin-failing-with-postgres-db/180592 "2019-05-10T16:37:55Z")
Hi There, We are getting an exception while using logstash-filter-jdbc\_static. We are using postgres db with driver version 42.1.4(as specified in usage in documentation). However its failing to register because of th… --- ## [Unable to receive logs from multiple data sources](https://discuss.elastic.co/t/unable-to-receive-logs-from-multiple-data-sources/180463)
**Author:** [@ThorntonStasher](https://discuss.elastic.co/u/ThorntonStasher)\ **Replies:** 6\ **Last updated:** [May 10, 2019, 4:21pm UTC](https://discuss.elastic.co/t/unable-to-receive-logs-from-multiple-data-sources/180463 "2019-05-10T16:21:26Z")
I'm trying to get Logstash to receive logs from multiple servers. My attempt at configuring that failed. The UDP input plugin requires a string but I don't know how to implement that. I get the following error with the c… --- ## [Can't make Logstash monitoring work](https://discuss.elastic.co/t/cant-make-logstash-monitoring-work/180582)
**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 4:21pm UTC](https://discuss.elastic.co/t/cant-make-logstash-monitoring-work/180582 "2019-05-10T16:21:23Z")
I can't get Logstash monitoring to work. I have a (one node) monitoring cluster already set up to which a production Elasticsearch cluster is sending monitoring information and I want to send Logstash monitoring stuff t… --- ## [How to send a specific index to a different ES cluster?](https://discuss.elastic.co/t/how-to-send-a-specific-index-to-a-different-es-cluster/180412)
**Author:** [@hadi](https://discuss.elastic.co/u/hadi)\ **Replies:** 4\ **Last updated:** [May 10, 2019, 3:58pm UTC](https://discuss.elastic.co/t/how-to-send-a-specific-index-to-a-different-es-cluster/180412 "2019-05-10T15:58:59Z")
Hello, I am planning to send Kafka logs to a separate ES cluster, kafka.xxx.com:9200, by the following configuration but unfortunately, it doesn't work. input { kafka { bootstrap\_servers =\> "aaa:9092" topics … --- ## [Controlling the amount of data sent via Logstash](https://discuss.elastic.co/t/controlling-the-amount-of-data-sent-via-logstash/180580)
**Author:** [@youngsteven101](https://discuss.elastic.co/u/youngsteven101)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 3:20pm UTC](https://discuss.elastic.co/t/controlling-the-amount-of-data-sent-via-logstash/180580 "2019-05-10T15:20:59Z")
Hi, I am trying to find a solution to a potential problem that I have. I want to limit the amount of data that Logstash can send onto Splunk. Does Logstash have any functionality that will allow me to set a threshold of… --- ## [How to post the http request with Authorization header , header content type and Body using logstash HTTP poller input plugin?](https://discuss.elastic.co/t/how-to-post-the-http-request-with-authorization-header-header-content-type-and-body-using-logstash-http-poller-input-plugin/180544)
**Author:** [@saroja](https://discuss.elastic.co/u/saroja)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 3:10pm UTC](https://discuss.elastic.co/t/how-to-post-the-http-request-with-authorization-header-header-content-type-and-body-using-logstash-http-poller-input-plugin/180544 "2019-05-10T15:10:29Z")
Hi, I have to post a request with different attributes of Authorization header , header content type and Body part . can anybody try to help out this. input { http\_poller { urls =\> { request1 =\> { method =\> "po… --- ## [How to extract date from some field containing Date and time in logstash](https://discuss.elastic.co/t/how-to-extract-date-from-some-field-containing-date-and-time-in-logstash/180550)
**Author:** [@Simran\_Kaur](https://discuss.elastic.co/u/Simran_Kaur)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 3:07pm UTC](https://discuss.elastic.co/t/how-to-extract-date-from-some-field-containing-date-and-time-in-logstash/180550 "2019-05-10T15:07:26Z")
hello there, I'm trying to dump data from My Sql to elastic search but i have one field called "eventTime" which contains both date and time. eg. 04/05/2019 15:23:45 now I want to extract this date from the field and … --- ## [Logstash not indexing csv to elasticsearch 6.7.1](https://discuss.elastic.co/t/logstash-not-indexing-csv-to-elasticsearch-6-7-1/180483)
**Author:** [@nareshlingam](https://discuss.elastic.co/u/nareshlingam)\ **Replies:** 2\ **Last updated:** [May 10, 2019, 2:55pm UTC](https://discuss.elastic.co/t/logstash-not-indexing-csv-to-elasticsearch-6-7-1/180483 "2019-05-10T14:55:30Z")
I have ELK setup in Win7. when i try to index a csv file using logstash to elasticsearch, its not indexing any data. please help me. logstash.conf: input { file { path =\> "C:\\Users\\260210\\Naresh\\ELK\\data\\test.csv" s… --- ## [Normalize the logs with ELK](https://discuss.elastic.co/t/normalize-the-logs-with-elk/178684)
**Author:** [@Labidi\_Ayoub](https://discuss.elastic.co/u/Labidi_Ayoub)\ **Replies:** 40\ **Last updated:** [May 10, 2019, 2:40pm UTC](https://discuss.elastic.co/t/normalize-the-logs-with-elk/178684 "2019-05-10T14:40:48Z")
Dear ELK Team, it is my first time with ELK, in the my workplace i woud get collection , standardization, analysis, correlation, reporting the logs of Firewall palo and switch CISCO...I am in a hurry, I worked with a l… --- ## [How to let Logstash read more than one "charset" in the codec setting](https://discuss.elastic.co/t/how-to-let-logstash-read-more-than-one-charset-in-the-codec-setting/180519)
**Author:** [@samyo](https://discuss.elastic.co/u/samyo)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 2:34pm UTC](https://discuss.elastic.co/t/how-to-let-logstash-read-more-than-one-charset-in-the-codec-setting/180519 "2019-05-10T14:34:46Z")
Hello Folks, i am wundering , if it is possibly, to write more than one "charset" in the codec setting in my Input , in order to let Logstash choose on of those "charset". Cause my Data files wich i want to index into … --- ## [Converting a JSON array into object key pairs](https://discuss.elastic.co/t/converting-a-json-array-into-object-key-pairs/180547)
**Author:** [@saiteja\_c](https://discuss.elastic.co/u/saiteja_c)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 2:31pm UTC](https://discuss.elastic.co/t/converting-a-json-array-into-object-key-pairs/180547 "2019-05-10T14:31:53Z")
What I'm trying to achieve is I have input like "jsonBody": { "measurements": \[ { "value": 0, "statistic": "VALUE" }, { "value": 1, … --- ## [Date filter issue String to ISO Timestamp](https://discuss.elastic.co/t/date-filter-issue-string-to-iso-timestamp/180354)
**Author:** [@bigster](https://discuss.elastic.co/u/bigster)\ **Replies:** 8\ **Last updated:** [May 10, 2019, 2:02pm UTC](https://discuss.elastic.co/t/date-filter-issue-string-to-iso-timestamp/180354 "2019-05-10T14:02:53Z")
Hi all, I've got another issue with the conversion of dates using the date filter. The main goal i'm trying to achieve is to put the date into the @timestamp field, but it seems that i'm doing something wrong. I've go… --- ## [Drop fields generated by beats](https://discuss.elastic.co/t/drop-fields-generated-by-beats/180565)
**Author:** [@Ludovic9](https://discuss.elastic.co/u/Ludovic9)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 1:53pm UTC](https://discuss.elastic.co/t/drop-fields-generated-by-beats/180565 "2019-05-10T13:53:29Z")
Hello, I'm using filebeats on windows to sent a csv file. It's working well but, in Kibana, I see a lot of fields I don't use so I would like to drop them. The fields are : host.os.build, host.os.name, host.os.family … --- ## [Logstash taking Time to process all files](https://discuss.elastic.co/t/logstash-taking-time-to-process-all-files/180567)
**Author:** [@Mayurbiw](https://discuss.elastic.co/u/Mayurbiw)\ **Replies:** 0\ **Last updated:** [May 10, 2019, 1:23pm UTC](https://discuss.elastic.co/t/logstash-taking-time-to-process-all-files/180567 "2019-05-10T13:23:40Z")
I have 105160 log files in a directory. I am processing each file using Logstash. Logstash is taking to much time to process all files. Is there any way to reduce the time taken? Should I use Filebeat? --- ## [Net flow error](https://discuss.elastic.co/t/net-flow-error/180485)
**Author:** [@Haresh\_Perera](https://discuss.elastic.co/u/Haresh_Perera)\ **Replies:** 2\ **Last updated:** [May 10, 2019, 10:59am UTC](https://discuss.elastic.co/t/net-flow-error/180485 "2019-05-10T10:59:46Z")
failed to parse field \[netflow.application\_id\] of type \[integer\] in document with id ''", "caused\_by"=\>{"type"=\>"number\_format\_exception", "reason"=\>"multiple points"} i am having this error --- ## [Event get method does not return a json array](https://discuss.elastic.co/t/event-get-method-does-not-return-a-json-array/180108)
**Author:** [@saiteja\_c](https://discuss.elastic.co/u/saiteja_c)\ **Replies:** 2\ **Last updated:** [May 10, 2019, 10:40am UTC](https://discuss.elastic.co/t/event-get-method-does-not-return-a-json-array/180108 "2019-05-10T10:40:55Z")
I'm using the event api to filter the data collected from various beats. response object: { "a" : "random", "b": \[ { "a1" : "aone" } , … --- ## [Error while installing jdbc static logstash plug-in](https://discuss.elastic.co/t/error-while-installing-jdbc-static-logstash-plug-in/177094)
**Author:** [@rohitjejurikar](https://discuss.elastic.co/u/rohitjejurikar)\ **Replies:** 11\ **Last updated:** [May 10, 2019, 10:27am UTC](https://discuss.elastic.co/t/error-while-installing-jdbc-static-logstash-plug-in/177094 "2019-05-10T10:27:21Z")
Hi, I'm not able to install logstash jdbc static plug-in... While installing it gives message.. fetching specs from http://rubygems.org does 10 attempts and then fails. I even downloaded the plug-in,built it and then tri… --- ## [Envío de archivo CSV a elasticsearch](https://discuss.elastic.co/t/envio-de-archivo-csv-a-elasticsearch/178989)
**Author:** [@Camilo\_Franco](https://discuss.elastic.co/u/Camilo_Franco)\ **Replies:** 1\ **Last updated:** [May 10, 2019, 9:56am UTC](https://discuss.elastic.co/t/envio-de-archivo-csv-a-elasticsearch/178989 "2019-05-10T09:56:37Z")
Hello I have a CSV file separated by:, I send it to elasticsearch in this way elasticsearch { hosts =\> \[""\] sniffing =\> true manage\_template =\> false index =\> "csv\_indice" user =\> "" password =\> "" } the data i… --- ## [Unable to connect to SQL Server 2008 R2 on Windows 7](https://discuss.elastic.co/t/unable-to-connect-to-sql-server-2008-r2-on-windows-7/179607)
**Author:** [@rudraroy](https://discuss.elastic.co/u/rudraroy)\ **Replies:** 9\ **Last updated:** [May 10, 2019, 9:53am UTC](https://discuss.elastic.co/t/unable-to-connect-to-sql-server-2008-r2-on-windows-7/179607 "2019-05-10T09:53:56Z")
I am running logstash 7.0 on Windows 7 with below configuration SQL Server 2008 R2 (Remote) jdbc verson 6.0. I have also used jdbc 4.0 same error is received. java version "1.8.0\_211" Java(TM) SE Runtime Environment… --- ## [Logstash syslog rfc 5424 and rfc 3164 input](https://discuss.elastic.co/t/logstash-syslog-rfc-5424-and-rfc-3164-input/180520)
**Author:** [@mkain](https://discuss.elastic.co/u/mkain)\ **Replies:** 0\ **Last updated:** [May 10, 2019, 9:04am UTC](https://discuss.elastic.co/t/logstash-syslog-rfc-5424-and-rfc-3164-input/180520 "2019-05-10T09:04:20Z")
Hi, I want to handle syslogs of both RFC in ELK 6.7. So far my working config is: input { tcp { port =\> 514 type =\> syslog } udp { port =\> 514 type =\> syslog … --- ## [\[Resolved\]Logstash - what filter can transform the customer behaviors in a httpsession(1 behavior is 1 log event) into different fields of 1 event?](https://discuss.elastic.co/t/resolved-logstash-what-filter-can-transform-the-customer-behaviors-in-a-httpsession-1-behavior-is-1-log-event-into-different-fields-of-1-event/180374)
**Author:** [@cheriemilk](https://discuss.elastic.co/u/cheriemilk)\ **Replies:** 5\ **Last updated:** [May 10, 2019, 8:25am UTC](https://discuss.elastic.co/t/resolved-logstash-what-filter-can-transform-the-customer-behaviors-in-a-httpsession-1-behavior-is-1-log-event-into-different-fields-of-1-event/180374 "2019-05-10T08:25:40Z")
Hi Team, I have a new data transforming requirement for making a Sankey Diagram to visualize the user's behavior(action) flow. source CSV data: when,httpsessionId,module,page,userId,actionType 2019-02-13 10:01:29,sid… --- ## [Need help with Kafka and Logstash with elastic Search cluster](https://discuss.elastic.co/t/need-help-with-kafka-and-logstash-with-elastic-search-cluster/180280)
**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\ **Replies:** 3\ **Last updated:** [May 10, 2019, 5:01am UTC](https://discuss.elastic.co/t/need-help-with-kafka-and-logstash-with-elastic-search-cluster/180280 "2019-05-10T05:01:30Z")
HI Guys, I need a help on my setup mentioned below. Can someone please share some insight \[ I tried searching a lot through previous discussions but unable to get the exact details hence posting it here\] I have around … --- ## [Snmp\_walk doesn't work everytime](https://discuss.elastic.co/t/snmp-walk-doesnt-work-everytime/180480)
**Author:** [@fabueno](https://discuss.elastic.co/u/fabueno)\ **Replies:** 0\ **Last updated:** [May 10, 2019, 4:39am UTC](https://discuss.elastic.co/t/snmp-walk-doesnt-work-everytime/180480 "2019-05-10T04:39:26Z")
Hi guys, If i put this in my input file : snmp { id =\> "tester" walk =\> \["1.3.6.1.2.1.16.9.2.1.4"\] hosts =\> \[{host =\> "udp:10.19.253.1/161" community =\> "cg974snmp"}\] } It doesn't work, i got nothing in output, bu… --- ## [Clear metric filter count value](https://discuss.elastic.co/t/clear-metric-filter-count-value/180458)
**Author:** [@rafaelsampaio](https://discuss.elastic.co/u/rafaelsampaio)\ **Replies:** 0\ **Last updated:** [May 10, 2019, 12:21am UTC](https://discuss.elastic.co/t/clear-metric-filter-count-value/180458 "2019-05-10T00:21:13Z")
The pipeline is reading more then 9 millions/day of logs and I'm using the meter filter to get the rate of some events. I don't need the count value but and I'm not sure how for long logstash can sustain its increment. I… --- ## [Failed to install template logstash error](https://discuss.elastic.co/t/failed-to-install-template-logstash-error/176646)
**Author:** [@xabush](https://discuss.elastic.co/u/xabush)\ **Replies:** 4\ **Last updated:** [May 9, 2019, 8:29pm UTC](https://discuss.elastic.co/t/failed-to-install-template-logstash-error/176646 "2019-05-09T20:29:00Z")
I am trying to send data from MySQL to Elasticsearch using Logstash. However, after it starts Logstash fails with the following error: Failed to install template. {:message=\>"undefined method update' for nil:NilClass",… --- ## [How to pass mutate filter field value to Ruby filter](https://discuss.elastic.co/t/how-to-pass-mutate-filter-field-value-to-ruby-filter/180413)
**Author:** [@saroja](https://discuss.elastic.co/u/saroja)\ **Replies:** 3\ **Last updated:** [May 9, 2019, 7:30pm UTC](https://discuss.elastic.co/t/how-to-pass-mutate-filter-field-value-to-ruby-filter/180413 "2019-05-09T19:30:13Z")
input { http\_poller { urls =\> { request1 =\> { method =\> get url =\> "http://localhost:8888/getAuthToken?uid=${uid}&password=${password}" headers =\>… --- ## [Logstash Metrics Shipper](https://discuss.elastic.co/t/logstash-metrics-shipper/180196)
**Author:** [@kishorerv93](https://discuss.elastic.co/u/kishorerv93)\ **Replies:** 1\ **Last updated:** [May 9, 2019, 5:48pm UTC](https://discuss.elastic.co/t/logstash-metrics-shipper/180196 "2019-05-09T17:48:22Z")
Hi, I have a quick question. I have three remote machines (Windows ) with filebeats installed, and these three are connected to another remote machine ( Windows ) with logstash. Now all these remote machines are in iso… --- ## [Logstash Attempted to resurrect connection to dead ES instance, but got an error](https://discuss.elastic.co/t/logstash-attempted-to-resurrect-connection-to-dead-es-instance-but-got-an-error/180371)
**Author:** [@hari.v](https://discuss.elastic.co/u/hari.v)\ **Replies:** 4\ **Last updated:** [May 9, 2019, 5:26pm UTC](https://discuss.elastic.co/t/logstash-attempted-to-resurrect-connection-to-dead-es-instance-but-got-an-error/180371 "2019-05-09T17:26:11Z")
Hi, i am getting below error, after enable firewall on the logstash server. i opened the port 5044 & 9600 on the both elasticsearch and logstash server. \[ERROR\]\[logstash.monitoring.internal pipeline source\] Failed to … --- ## [Logstash output elasticsearch Error code 504](https://discuss.elastic.co/t/logstash-output-elasticsearch-error-code-504/180400)
**Author:** [@alfonso.viso](https://discuss.elastic.co/u/alfonso.viso)\ **Replies:** 1\ **Last updated:** [May 9, 2019, 5:24pm UTC](https://discuss.elastic.co/t/logstash-output-elasticsearch-error-code-504/180400 "2019-05-09T17:24:15Z")
Hi all, Recently, in our logs of logstash instance we have this error: ERROR\]\[logstash.outputs.elasticsearch\] Encountered a retryable error. Will Retry with exponential backoff {:code=\>504, :url=\>"https://\ **Author:** [@thadc](https://discuss.elastic.co/u/thadc)\ **Replies:** 1\ **Last updated:** [May 9, 2019, 3:34pm UTC](https://discuss.elastic.co/t/how-to-get-logstash-to-parse-multi-line-fields-into-multiple-lines/180376 "2019-05-09T15:34:41Z") Hi, we have messages input into logstash from filebeat where some fields are multi-line (e.g., like a stack trace message field). By default, after grok-parsing a field that was multi-line in the original log file , the… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=549) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=551)