# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=528 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 529 --- ## [Proxy settings for http\_poller](https://discuss.elastic.co/t/proxy-settings-for-http-poller/185762)
**Author:** [@sjabiulla](https://discuss.elastic.co/u/sjabiulla)\ **Replies:** 0\ **Last updated:** [June 14, 2019, 5:46am UTC](https://discuss.elastic.co/t/proxy-settings-for-http-poller/185762 "2019-06-14T05:46:03Z")
Hi, I am using http\_poller input plugin in Logstash to monitor few url's. I am able to monitor the url's that are hosted on my local. I mean, anything with localhost, I'm able to connect using http\_poller. Anything on i… --- ## [How to sync database changes to Elastic search using logstash](https://discuss.elastic.co/t/how-to-sync-database-changes-to-elastic-search-using-logstash/184682)
**Author:** [@Prashant\_Shirsath](https://discuss.elastic.co/u/Prashant_Shirsath)\ **Replies:** 5\ **Last updated:** [June 14, 2019, 3:45am UTC](https://discuss.elastic.co/t/how-to-sync-database-changes-to-elastic-search-using-logstash/184682 "2019-06-14T03:45:11Z")
I am completely naive to ELK stack. My requirement is I am creating indexes on ES using logstash via JDBC plugin. I am indexing DB table to ES. If DB tables modified or new data inserted then only modified and inserted … --- ## [Kinesis plugin and google\_pubsub plugin conflict when logstash configured with both conf's](https://discuss.elastic.co/t/kinesis-plugin-and-google-pubsub-plugin-conflict-when-logstash-configured-with-both-confs/185740)
**Author:** [@asrinivasan](https://discuss.elastic.co/u/asrinivasan)\ **Replies:** 1\ **Last updated:** [June 14, 2019, 1:12am UTC](https://discuss.elastic.co/t/kinesis-plugin-and-google-pubsub-plugin-conflict-when-logstash-configured-with-both-confs/185740 "2019-06-14T01:12:50Z")
When i have logstash configured for both kinesis and google pub sub, logstash does not start gives this error java.lang.NoClassDefFoundError: com/google/protobuf/GeneratedMessageV3 When i remove the kinesis conf file … --- ## [Ending logstash after csv parsing](https://discuss.elastic.co/t/ending-logstash-after-csv-parsing/185232)
**Author:** [@juanc37](https://discuss.elastic.co/u/juanc37)\ **Replies:** 5\ **Last updated:** [June 14, 2019, 12:14am UTC](https://discuss.elastic.co/t/ending-logstash-after-csv-parsing/185232 "2019-06-14T00:14:25Z")
I have a csv file that I need to index in my ES instance and I only need for logstash to read through to the file end and then stop the service. Is this possible in Elastic Stack 7? My config file looks like this: inpu… --- ## [Logstash couldn't index date field for few log lines](https://discuss.elastic.co/t/logstash-couldnt-index-date-field-for-few-log-lines/185726)
**Author:** [@chandukreddi](https://discuss.elastic.co/u/chandukreddi)\ **Replies:** 3\ **Last updated:** [June 14, 2019, 12:04am UTC](https://discuss.elastic.co/t/logstash-couldnt-index-date-field-for-few-log-lines/185726 "2019-06-14T00:04:06Z")
Hello Experts, I am getting below error while logstashing log file, but I do see only few of them are failing with this error and remaining logstashed with out any issues, why failing only few even there is no change in… --- ## [Logstash encoding issue for csv file](https://discuss.elastic.co/t/logstash-encoding-issue-for-csv-file/185426)
**Author:** [@kamaleshwar](https://discuss.elastic.co/u/kamaleshwar)\ **Replies:** 3\ **Last updated:** [June 13, 2019, 9:26pm UTC](https://discuss.elastic.co/t/logstash-encoding-issue-for-csv-file/185426 "2019-06-13T21:26:36Z")
I am facing the encoding issue,when i run the logstash ,the fields are displaying in unreadable format Logstash.conf input { file { path =\>"C:/db2mon\_v105/v105/db2mon\_reports.csv" start\_position =\> "beginning" sin… --- ## [Run logstash command on in the background on ec2](https://discuss.elastic.co/t/run-logstash-command-on-in-the-background-on-ec2/185514)
**Author:** [@Mohit\_Ruke](https://discuss.elastic.co/u/Mohit_Ruke)\ **Replies:** 3\ **Last updated:** [June 13, 2019, 9:25pm UTC](https://discuss.elastic.co/t/run-logstash-command-on-in-the-background-on-ec2/185514 "2019-06-13T21:25:23Z")
Hi Everyone, I am currently trying to dump all my data from s3 to Elasticsearch. I run this from ec2. for that I have my logstash config file at /etc/logstash/conf.d/awses.conf I run the command /usr/share/logstash/b… --- ## [Having issues importing logs to elasticsearch, Grok Issue?](https://discuss.elastic.co/t/having-issues-importing-logs-to-elasticsearch-grok-issue/185459)
**Author:** [@k.m.graybill](https://discuss.elastic.co/u/k.m.graybill)\ **Replies:** 6\ **Last updated:** [June 13, 2019, 7:41pm UTC](https://discuss.elastic.co/t/having-issues-importing-logs-to-elasticsearch-grok-issue/185459 "2019-06-13T19:41:50Z")
I'm trying to import log files from kiwi to elasticsearch using logstash. These log files are ANSI encoded with each log entry separated by a newline. 2019-05-24 11:23:25 Daemon.Notice WIN-DLI9AO07ERU May 24 11:23:24 WI… --- ## [Losgtash no genera salida desde input file](https://discuss.elastic.co/t/losgtash-no-genera-salida-desde-input-file/185715)
**Author:** [@feevv](https://discuss.elastic.co/u/feevv)\ **Replies:** 4\ **Last updated:** [June 13, 2019, 7:31pm UTC](https://discuss.elastic.co/t/losgtash-no-genera-salida-desde-input-file/185715 "2019-06-13T19:31:25Z")
Buenas tardes, Estoy tratando de configurar la lectura de un archivo .gz con Logstash y al ver que no me generaba ninguna salida intenté leer un archivo txt, encontrando que tampoco me genera la salida estandar. Mi arc… --- ## [Directions for installing gssapi to use logstash webhdfs plugin with kerberos](https://discuss.elastic.co/t/directions-for-installing-gssapi-to-use-logstash-webhdfs-plugin-with-kerberos/185049)
**Author:** [@preddy75](https://discuss.elastic.co/u/preddy75)\ **Replies:** 4\ **Last updated:** [June 13, 2019, 6:34pm UTC](https://discuss.elastic.co/t/directions-for-installing-gssapi-to-use-logstash-webhdfs-plugin-with-kerberos/185049 "2019-06-13T18:34:50Z")
Hi, I am running logstash 6.4.2 (no modifications). I am getting gssapi not found in my scenario below. I am research now how to install gssapi. I would appreciate any information at all on doing this. I have found the … --- ## [Logstash grok plugin is considering number as text](https://discuss.elastic.co/t/logstash-grok-plugin-is-considering-number-as-text/185558)
**Author:** [@prataprajasekhar](https://discuss.elastic.co/u/prataprajasekhar)\ **Replies:** 5\ **Last updated:** [June 13, 2019, 5:05pm UTC](https://discuss.elastic.co/t/logstash-grok-plugin-is-considering-number-as-text/185558 "2019-06-13T17:05:21Z")
Dear Team, We are using logstash that will receive logs from filebeat for sending tomcat access logs. We have configured grok to map message's column data to respective fields in elasticsearch. We have configured respon… --- ## [Logstash won't pick up logs over port 514](https://discuss.elastic.co/t/logstash-wont-pick-up-logs-over-port-514/185477)
**Author:** [@johnbchron](https://discuss.elastic.co/u/johnbchron)\ **Replies:** 2\ **Last updated:** [June 13, 2019, 4:38pm UTC](https://discuss.elastic.co/t/logstash-wont-pick-up-logs-over-port-514/185477 "2019-06-13T16:38:05Z")
Hello All, So my logstash installation (full elastic stack running on one machine, ubuntu 19) is configured to accept syslogs from our firewall over UDP on port 514. I can use tcpdump to see that there is indeed traffic… --- ## [Logstash-postgreSQL](https://discuss.elastic.co/t/logstash-postgresql/185696)
**Author:** [@amandrell1](https://discuss.elastic.co/u/amandrell1)\ **Replies:** 1\ **Last updated:** [June 13, 2019, 4:19pm UTC](https://discuss.elastic.co/t/logstash-postgresql/185696 "2019-06-13T16:19:59Z")
Hi! I am having trouble with an error with the jdbc\_driver\_library. I receive this error upload starting Logstash: "Error: org.postgresql.Driver not loaded. Are you sure you've included the correct jdbc driver in :jdbc… --- ## [Detect a message containing characters and digits](https://discuss.elastic.co/t/detect-a-message-containing-characters-and-digits/185230)
**Author:** [@WarriorHarb](https://discuss.elastic.co/u/WarriorHarb)\ **Replies:** 9\ **Last updated:** [June 13, 2019, 4:17pm UTC](https://discuss.elastic.co/t/detect-a-message-containing-characters-and-digits/185230 "2019-06-13T16:17:43Z")
Hello, i'd like to detect a part from a message matching a specific sentence . When the searched part doesn't contain numbers it works fine with this grok filter : match =\> \["Message" , "(^|\\W+)(?\parsing fail… --- ## [Parse a file as a whole having key value pairs](https://discuss.elastic.co/t/parse-a-file-as-a-whole-having-key-value-pairs/185563)
**Author:** [@Abhilash\_B](https://discuss.elastic.co/u/Abhilash_B)\ **Replies:** 1\ **Last updated:** [June 13, 2019, 4:12pm UTC](https://discuss.elastic.co/t/parse-a-file-as-a-whole-having-key-value-pairs/185563 "2019-06-13T16:12:09Z")
I have file which looks like this. I want ship the whole file as an event because I want all the key value pairs (here delimiter is "=") of each file to be part of a single record in Elasticsearch. I am confused about ho… --- ## [Is it possible to setup secure access to Logstash monitoring and log API](https://discuss.elastic.co/t/is-it-possible-to-setup-secure-access-to-logstash-monitoring-and-log-api/185694)
**Author:** [@Sunil\_Chadha](https://discuss.elastic.co/u/Sunil_Chadha)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 3:46pm UTC](https://discuss.elastic.co/t/is-it-possible-to-setup-secure-access-to-logstash-monitoring-and-log-api/185694 "2019-06-13T15:46:28Z")
Hi, Is it possible to setup access to Logstash Monitoring API & Logging API https://www.elastic.co/guide/en/logstash/6.6/logging.html#\_logging\_apis access over SSL. Or how do I make access to these API restricted or mo… --- ## [Logstash output incorrect time value](https://discuss.elastic.co/t/logstash-output-incorrect-time-value/185675)
**Author:** [@chw4626](https://discuss.elastic.co/u/chw4626)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 2:39pm UTC](https://discuss.elastic.co/t/logstash-output-incorrect-time-value/185675 "2019-06-13T14:39:07Z")
Hi everyone, I am try to use logstash 7.1.1 to get data from my sqlite3 db. I found an issue about the time. The time data was stored correctly in my database while it is not when using logstash. For example, the time … --- ## [Logstash - line string - Geoshape](https://discuss.elastic.co/t/logstash-line-string-geoshape/184585)
**Author:** [@Raj\_Kumar](https://discuss.elastic.co/u/Raj_Kumar)\ **Replies:** 7\ **Last updated:** [June 13, 2019, 3:43pm UTC](https://discuss.elastic.co/t/logstash-line-string-geoshape/184585 "2019-06-13T15:43:28Z")
Hi There, Could anyone help me to add a new field called geolocalisation which includes source and destination coordinates . like "coordinates" : \[\[-77.03653, 38.897676\], \[-77.009051, 38.889939\]\] Write now I use this… --- ## [Convert\_datatype with dissect filter \> error: "data conversion uncoercible"](https://discuss.elastic.co/t/convert-datatype-with-dissect-filter-error-data-conversion-uncoercible/185633)
**Author:** [@zebu14](https://discuss.elastic.co/u/zebu14)\ **Replies:** 1\ **Last updated:** [June 13, 2019, 3:39pm UTC](https://discuss.elastic.co/t/convert-datatype-with-dissect-filter-error-data-conversion-uncoercible/185633 "2019-06-13T15:39:50Z")
Hello, I have some squid access-log that I want to integrate in my Elastic indexes. I am using the dissect filter to filter the different fields and then I use "convert\_datatype" to convert the needed fields into integ… --- ## [DIsable Logstash Console Logs](https://discuss.elastic.co/t/disable-logstash-console-logs/185669)
**Author:** [@Mohit\_Ruke](https://discuss.elastic.co/u/Mohit_Ruke)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 2:31pm UTC](https://discuss.elastic.co/t/disable-logstash-console-logs/185669 "2019-06-13T14:31:22Z")
Hi everyone, I am trying to disable the logstash from writing all the console logs because due to a lot off i/o activity the ec2 throws error too much work for irq4 output { amazon\_es { hosts =\> \[""\] region =\> "us-e… --- ## [Logstash Not sending Data to Elastic Search only for jdbc input](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic-search-only-for-jdbc-input/185662)
**Author:** [@VIPS](https://discuss.elastic.co/u/VIPS)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 2:09pm UTC](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic-search-only-for-jdbc-input/185662 "2019-06-13T14:09:41Z")
Hi, I am trying to get data from SQL server and push it into elastic search... Logstash and elastic search both are up and running .. I can send sample data with below configuration and i can see index is created inpu… --- ## [Keystore not working properly](https://discuss.elastic.co/t/keystore-not-working-properly/185278)
**Author:** [@bkasrai](https://discuss.elastic.co/u/bkasrai)\ **Replies:** 2\ **Last updated:** [June 13, 2019, 1:13pm UTC](https://discuss.elastic.co/t/keystore-not-working-properly/185278 "2019-06-13T13:13:20Z")
Good afternoon, I have been combing the threads here and following the documentation on setting up keystore however nothing in the threads seem to have a resolution and for whatever reason, even with the steps I am foll… --- ## [Receive SIGTERM on logstash startup version 7.1.1](https://discuss.elastic.co/t/receive-sigterm-on-logstash-startup-version-7-1-1/185654)
**Author:** [@procyclinsur](https://discuss.elastic.co/u/procyclinsur)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 1:39pm UTC](https://discuss.elastic.co/t/receive-sigterm-on-logstash-startup-version-7-1-1/185654 "2019-06-13T13:39:24Z")
I am trying to use logstash to send data from kafka to s3 via logstash, and I am getting an SIGTERM in the logstash process with no apparent error messages. I am using the following helm template override.yaml file. # … --- ## [Logstash won't parse tomcat file](https://discuss.elastic.co/t/logstash-wont-parse-tomcat-file/185648)
**Author:** [@Andreasky](https://discuss.elastic.co/u/Andreasky)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 1:00pm UTC](https://discuss.elastic.co/t/logstash-wont-parse-tomcat-file/185648 "2019-06-13T13:00:34Z")
I'm trying to parse a tomcat file, but the docs count in Kibana shows 0. It seems like there is something wrong with the filter I have added. input { file { type =\> 'tomcat' path =\> "C:\\Users\\me\\Downloads\\access\_log.… --- ## [JDBC Streaming](https://discuss.elastic.co/t/jdbc-streaming/185487)
**Author:** [@jonathan01](https://discuss.elastic.co/u/jonathan01)\ **Replies:** 2\ **Last updated:** [June 13, 2019, 12:49pm UTC](https://discuss.elastic.co/t/jdbc-streaming/185487 "2019-06-13T12:49:37Z")
I am trying to use the jdbc streaming plugin to add data to metricbeats logs that are coming in. But I am getting an error that I do not understand. If I take the JDBC part out it works fine. I can connect to the datab… --- ## [Logstash is not showing me any output even after clearing the .since db file](https://discuss.elastic.co/t/logstash-is-not-showing-me-any-output-even-after-clearing-the-since-db-file/185613)
**Author:** [@deepanshu\_goel](https://discuss.elastic.co/u/deepanshu_goel)\ **Replies:** 4\ **Last updated:** [June 13, 2019, 12:19pm UTC](https://discuss.elastic.co/t/logstash-is-not-showing-me-any-output-even-after-clearing-the-since-db-file/185613 "2019-06-13T12:19:55Z")
configuration file: input { file { path=\>"\\E:\\kibana\\logstash-7.1.1\\logstash-7.1.1\\data\\event-data\\apache\_access.log" type =\> "apache-access" start\_position=\> "beginning" } … --- ## [Ruby code Help](https://discuss.elastic.co/t/ruby-code-help/185639)
**Author:** [@Amit\_Sambrekar](https://discuss.elastic.co/u/Amit_Sambrekar)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 12:20pm UTC](https://discuss.elastic.co/t/ruby-code-help/185639 "2019-06-13T12:20:53Z")
How do I add a Ruby filter in my logstash conf file. fieldvalue1 fieldvalue2 field valu3 ASD1 Dummy1 DummyValue1 ASD2 Dummy2 DummyValue2 ASD1 Dummy3 DummyValue3 this is ho… --- ## [Output Beats](https://discuss.elastic.co/t/output-beats/185360)
**Author:** [@Arethusa](https://discuss.elastic.co/u/Arethusa)\ **Replies:** 1\ **Last updated:** [June 13, 2019, 12:14pm UTC](https://discuss.elastic.co/t/output-beats/185360 "2019-06-13T12:14:44Z")
Hello, This is my architecture: For Windows, I have this logstash configuration: input { beats { port =\> 5000 tags =\> \["windows"\] } } output { if "windows" in \[tags\] { gelf { host =\> "192.168.1.… --- ## [Delete elasticsearch index using logstash output/filter plugin](https://discuss.elastic.co/t/delete-elasticsearch-index-using-logstash-output-filter-plugin/185632)
**Author:** [@Lakshmanan\_Karthik](https://discuss.elastic.co/u/Lakshmanan_Karthik)\ **Replies:** 0\ **Last updated:** [June 13, 2019, 12:00pm UTC](https://discuss.elastic.co/t/delete-elasticsearch-index-using-logstash-output-filter-plugin/185632 "2019-06-13T12:00:01Z")
i need to delete elasticsearch index before insert data. any option is available for logstsah output/filter plugin. i tried some error occur. please help me // output { http { http\_method =\> "delete" url =\> "http://… --- ## [java.lang.IllegalStateException while running logstash](https://discuss.elastic.co/t/java-lang-illegalstateexception-while-running-logstash/185343)
**Author:** [@s23deepak](https://discuss.elastic.co/u/s23deepak)\ **Replies:** 2\ **Last updated:** [June 13, 2019, 11:04am UTC](https://discuss.elastic.co/t/java-lang-illegalstateexception-while-running-logstash/185343 "2019-06-13T11:04:29Z")
I have tried to run logstash using the following command on Centos: sudo -u logstash /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/indexing.conf --path.settings /etc/logstash After running the above comman… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=527) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=529)