# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=637 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 638 --- ## [Failed to read multiple pipeline](https://discuss.elastic.co/t/failed-to-read-multiple-pipeline/159494)
**Author:** [@Vineeth\_Ananthula](https://discuss.elastic.co/u/Vineeth_Ananthula)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 11:26am UTC](https://discuss.elastic.co/t/failed-to-read-multiple-pipeline/159494 "2018-12-05T11:26:05Z")
I have installed logstash though yum by installing the public key. I have configured the pipelines.yml for multiple pipelines and the configuration is below. Location of pipelines.yml: /usr/share/logstash/config/pipelin… --- ## [Elasticsearch - Failed to install template](https://discuss.elastic.co/t/elasticsearch-failed-to-install-template/159469)
**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 6:49am UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-install-template/159469 "2018-12-05T06:49:27Z")
\[ERROR\] 2018-12-05 12:15:05.132 \[Ruby-0-Thread-5: :1\] elasticsearch - Failed to install template. {:message=\>"Got response code '400' contacting Elasticsearch at URL 'http://localhost:9200/\_template/datamobi'", :class=\>"… --- ## [Convert column to JSON](https://discuss.elastic.co/t/convert-column-to-json/158848)
**Author:** [@nash](https://discuss.elastic.co/u/nash)\ **Replies:** 2\ **Last updated:** [December 5, 2018, 10:25am UTC](https://discuss.elastic.co/t/convert-column-to-json/158848 "2018-12-05T10:25:52Z")
Hi, I am new to ELK. I am trying to import a CSV file into elasticsearch using Logstash.I have got all the fields into elasticSearch and it is of type doc. I can see it in both Table and json formats. My problem is, … --- ## [Unable to parse pipe separated data in nifi logs using logstash(This data is being generated due to a Controller Status Reporting Task)](https://discuss.elastic.co/t/unable-to-parse-pipe-separated-data-in-nifi-logs-using-logstash-this-data-is-being-generated-due-to-a-controller-status-reporting-task/159507)
**Author:** [@PoonamMishra](https://discuss.elastic.co/u/PoonamMishra)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 10:19am UTC](https://discuss.elastic.co/t/unable-to-parse-pipe-separated-data-in-nifi-logs-using-logstash-this-data-is-being-generated-due-to-a-controller-status-reporting-task/159507 "2018-12-05T10:19:42Z")
Below is the sample log that is being generated due to Controller Status Reporting Task. 2018-12-05 10:06:38,061 INFO \[Timer-Driven Process Thread-12\] o.a.n.c.C.Connections Connection Statuses: | Connection ID … --- ## [Unknown error - when using config file](https://discuss.elastic.co/t/unknown-error-when-using-config-file/159506)
**Author:** [@Linlin](https://discuss.elastic.co/u/Linlin)\ **Replies:** 3\ **Last updated:** [December 5, 2018, 10:11am UTC](https://discuss.elastic.co/t/unknown-error-when-using-config-file/159506 "2018-12-05T10:11:05Z")
Hi there, I'm having trouble with my config file that I want to use. I'm using windows 10 and the 6.5.1 version of elastic, kibana and logstash. I've encountered quite a few errors but until now I've been able to solv… --- ## [409, 403 Error code?](https://discuss.elastic.co/t/409-403-error-code/159470)
**Author:** [@Ahmetkumas](https://discuss.elastic.co/u/Ahmetkumas)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 9:56am UTC](https://discuss.elastic.co/t/409-403-error-code/159470 "2018-12-05T09:56:19Z")
Hello everyone, I'm having a problem like that; C:/Users/akumas/logstash-6.5.1/logstash-core/lib/logstash/pipeline.rb:409:in inputworker' C:/Users/akumas/logstash-6.5.1/logstash-core/lib/logstash/pipeline.rb:403:inblock… --- ## [File input not working](https://discuss.elastic.co/t/file-input-not-working/159016)
**Author:** [@cowensel](https://discuss.elastic.co/u/cowensel)\ **Replies:** 6\ **Last updated:** [December 5, 2018, 9:53am UTC](https://discuss.elastic.co/t/file-input-not-working/159016 "2018-12-05T09:53:31Z")
I am looking to use logstash to ingest a csv file that contains some stats and then graph them. I have setup a file input but I am unable to get it to work. My logstash config is input { file { path =\> "C:\\logstash-6… --- ## [Quick way to test logstash config file?](https://discuss.elastic.co/t/quick-way-to-test-logstash-config-file/159270)
**Author:** [@jamespb](https://discuss.elastic.co/u/jamespb)\ **Replies:** 2\ **Last updated:** [December 5, 2018, 9:46am UTC](https://discuss.elastic.co/t/quick-way-to-test-logstash-config-file/159270 "2018-12-05T09:46:37Z")
I just started with logstash. I am tune with the config fie. I wonder if I must run following everytime with any change? It takes a long time to start. Any grammar checker or a quick way to test what the config file go… --- ## [Logstash date issue](https://discuss.elastic.co/t/logstash-date-issue/158465)
**Author:** [@aabababba](https://discuss.elastic.co/u/aabababba)\ **Replies:** 9\ **Last updated:** [December 5, 2018, 9:40am UTC](https://discuss.elastic.co/t/logstash-date-issue/158465 "2018-12-05T09:40:44Z")
date { match =\> \["logtime","HH:mm:ss,SSS","ISO8601"\] target =\> "logtime1" locale =\> "cn" timezone =\> "Asia/Shanghai" } now result become logtime 13:43:12,009 logtime1 2018-01-01T05:4… --- ## [Multiple pipeline in logstash listening to different beats input ports](https://discuss.elastic.co/t/multiple-pipeline-in-logstash-listening-to-different-beats-input-ports/159500)
**Author:** [@bhharan](https://discuss.elastic.co/u/bhharan)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 9:39am UTC](https://discuss.elastic.co/t/multiple-pipeline-in-logstash-listening-to-different-beats-input-ports/159500 "2018-12-05T09:39:10Z")
Hi, I am currently using filebeat to ship my app logs from say Server A to logstash server which is listening for beats input on custom port 52001. On the logstash side, I am using certain grok filters to parse the log… --- ## [Logstash importing .csv data in Elasticsearch](https://discuss.elastic.co/t/logstash-importing-csv-data-in-elasticsearch/159492)
**Author:** [@saeed](https://discuss.elastic.co/u/saeed)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 9:06am UTC](https://discuss.elastic.co/t/logstash-importing-csv-data-in-elasticsearch/159492 "2018-12-05T09:06:17Z")
Hi I use logstash to import data from a csv file. It was successful but makes over plus columns that not exists in my data. my config file is indent preformatted text by 4 spaces input { file { path =\> "C:/Data/boo… --- ## [A plugin had an unrecoverable error: Logstash File start\_position](https://discuss.elastic.co/t/a-plugin-had-an-unrecoverable-error-logstash-file-start-position/157441)
**Author:** [@wheelq](https://discuss.elastic.co/u/wheelq)\ **Replies:** 2\ **Last updated:** [December 5, 2018, 9:26am UTC](https://discuss.elastic.co/t/a-plugin-had-an-unrecoverable-error-logstash-file-start-position/157441 "2018-12-05T09:26:06Z")
I have run into the following error (apart from large log files, all the data is being imported without any issues): C:/XXX/logstash-6.4.0/logstash-6.4.0/vendor/bundle/jruby/2.3.0/gems/logstash-input-file-4.1.5/lib/file… --- ## [Logstash input codec charset not working](https://discuss.elastic.co/t/logstash-input-codec-charset-not-working/159375)
**Author:** [@Francois1](https://discuss.elastic.co/u/Francois1)\ **Replies:** 0\ **Last updated:** [December 4, 2018, 2:03pm UTC](https://discuss.elastic.co/t/logstash-input-codec-charset-not-working/159375 "2018-12-04T14:03:44Z")
Hi, I send a message to Logstash (6.1.1) in json format and in ISO-8859-1 encoding (unfortunatly I can't change the encoding). Logstash is configured with an http input with a codec option like that : input { http… --- ## [Array datatype limit size?](https://discuss.elastic.co/t/array-datatype-limit-size/158654)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 4\ **Last updated:** [December 5, 2018, 8:28am UTC](https://discuss.elastic.co/t/array-datatype-limit-size/158654 "2018-12-05T08:28:50Z")
Hi all, I'm trying to collect information about login of accounts on a website. Currently I'm able to save, for instance, the last 10 login attempts using the array datatype. To do that I use Filebeat that sends messag… --- ## [Logstash error for cassandra database](https://discuss.elastic.co/t/logstash-error-for-cassandra-database/159367)
**Author:** [@vishruti](https://discuss.elastic.co/u/vishruti)\ **Replies:** 0\ **Last updated:** [December 4, 2018, 1:47pm UTC](https://discuss.elastic.co/t/logstash-error-for-cassandra-database/159367 "2018-12-04T13:47:51Z")
i am trying to get my cassandra data into the logstash, this is the logstash log file that I am getting after trying to execute logstash. my simple-out.conf file is as follows # cassandra jdbc connection string to ou… --- ## [java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit](https://discuss.elastic.co/t/java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-systemexit-exit/159478)
**Author:** [@srinivasa\_rao](https://discuss.elastic.co/u/srinivasa_rao)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 7:39am UTC](https://discuss.elastic.co/t/java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-systemexit-exit/159478 "2018-12-05T07:39:45Z")
I am getting the fallowing error after i start the logstash,but before the day it was worked perfectly.Now it is giving the error. please help me on this logs. Sending Logstash logs to C:/Users/1596377/Desktop/ELK/kiba… --- ## [SMS via Logstash on mobile](https://discuss.elastic.co/t/sms-via-logstash-on-mobile/159472)
**Author:** [@Atulya\_Sharma](https://discuss.elastic.co/u/Atulya_Sharma)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 7:34am UTC](https://discuss.elastic.co/t/sms-via-logstash-on-mobile/159472 "2018-12-05T07:34:22Z")
Hi All, Can anyone tell me how to send alert message on mobile number using logstash .conf file. Kindly help. Thanks in Advance. --- ## [How does logstash publish data to the nanomsg subscription service?](https://discuss.elastic.co/t/how-does-logstash-publish-data-to-the-nanomsg-subscription-service/159471)
**Author:** [@sun\_changlong](https://discuss.elastic.co/u/sun_changlong)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 7:00am UTC](https://discuss.elastic.co/t/how-does-logstash-publish-data-to-the-nanomsg-subscription-service/159471 "2018-12-05T07:00:48Z")
I want to use logstash to send data to my nanomsg service to implement the Pub/Sub mode. What middleware should I use to achieve this? Can I borrow the kafka plugin to implement it? --- ## [Not able to access the filebeat custom fields in logstash output](https://discuss.elastic.co/t/not-able-to-access-the-filebeat-custom-fields-in-logstash-output/159342)
**Author:** [@Ramalingam\_Chandran](https://discuss.elastic.co/u/Ramalingam_Chandran)\ **Replies:** 6\ **Last updated:** [December 5, 2018, 6:22am UTC](https://discuss.elastic.co/t/not-able-to-access-the-filebeat-custom-fields-in-logstash-output/159342 "2018-12-05T06:22:04Z")
I am trying to access an filebeat field in the logstash output. For some reason this is not working. Can someone help on this please? Filebeat & logstash versions: filebeat-6.4.1-1.x86\_64 logstash-6.3.2-1.noarch file… --- ## [Add another logstash instance](https://discuss.elastic.co/t/add-another-logstash-instance/159212)
**Author:** [@koocaroo](https://discuss.elastic.co/u/koocaroo)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 3:25am UTC](https://discuss.elastic.co/t/add-another-logstash-instance/159212 "2018-12-05T03:25:29Z")
So currently i have an all in one setup with elastic, logstash, and kibana all sitting on the same host. I would like to add another logstash instance in our office network to take some of the parsing load. Is there anyt… --- ## [What does this filter do?](https://discuss.elastic.co/t/what-does-this-filter-do/159351)
**Author:** [@przemolb](https://discuss.elastic.co/u/przemolb)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 3:22am UTC](https://discuss.elastic.co/t/what-does-this-filter-do/159351 "2018-12-05T03:22:25Z")
Hello, can anybody explain me what does the following filter do ? filter { if \[@metadata\]\[input-http\] { date { match =\> \[ "date", "UNIX" \] remove\_field =\> \[ "date" \] } mutate { remove\_fi… --- ## [Save first lines of data and make it sharable for all file lines in logstash](https://discuss.elastic.co/t/save-first-lines-of-data-and-make-it-sharable-for-all-file-lines-in-logstash/159187)
**Author:** [@joubeh](https://discuss.elastic.co/u/joubeh)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 3:20am UTC](https://discuss.elastic.co/t/save-first-lines-of-data-and-make-it-sharable-for-all-file-lines-in-logstash/159187 "2018-12-05T03:20:12Z")
Hello, I've the following snapshot from a file that I'm using filebeat and logstash to send it to ES Service Endpoint: http://1.1.1.1:8080/ECM TestSuite : JenkinsDeploy SuccessCount:4 FailureCount:0 TestCases:1 Ad… --- ## [Logstash installation questions](https://discuss.elastic.co/t/logstash-installation-questions/154928)
**Author:** [@vnallamothu](https://discuss.elastic.co/u/vnallamothu)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 2:34am UTC](https://discuss.elastic.co/t/logstash-installation-questions/154928 "2018-12-05T02:34:03Z")
Hi, I have a Elasticsearch 6.2 cluster (3 master, 6 data nodes) up and running. I'd like to send data from my S3 bucket to elasticsearch so that I can view them on Kibana dashboards. I know I can do this via logstash or… --- ## [Unable to load CVS file ( OS Windows)](https://discuss.elastic.co/t/unable-to-load-cvs-file-os-windows/159002)
**Author:** [@ChiaraLP](https://discuss.elastic.co/u/ChiaraLP)\ **Replies:** 2\ **Last updated:** [December 5, 2018, 2:59am UTC](https://discuss.elastic.co/t/unable-to-load-cvs-file-os-windows/159002 "2018-12-05T02:59:54Z")
Hi, I'm new on the Elastic Stack. I try to load a cvs file on Elasticsearch using Logstash. I'm a Windows user. Thisi is my config file input { file { path =\> \["g:/file/articoli.cvs"\] start\_position =\> "beginning… --- ## [Logstash \[filewatch.readmode.handlers.readfile\] opening OPEN\_WARN\_INTERVAL is '300' error in File Input Plugin](https://discuss.elastic.co/t/logstash-filewatch-readmode-handlers-readfile-opening-open-warn-interval-is-300-error-in-file-input-plugin/159443)
**Author:** [@dx123](https://discuss.elastic.co/u/dx123)\ **Replies:** 0\ **Last updated:** [December 5, 2018, 2:48am UTC](https://discuss.elastic.co/t/logstash-filewatch-readmode-handlers-readfile-opening-open-warn-interval-is-300-error-in-file-input-plugin/159443 "2018-12-05T02:48:53Z")
Below is my Logstash File Input Plugin code. input { file { path =\> \[ "/Desktop/logstash\_input\_folder/\*.json" \] mode =\> "read" file\_completed\_action =\> "log\_and\_delete" file\_completed\_log\_path =\> "/Desktop/l… --- ## [Separating request URI path and query in logstash](https://discuss.elastic.co/t/separating-request-uri-path-and-query-in-logstash/159441)
**Author:** [@vkhaa](https://discuss.elastic.co/u/vkhaa)\ **Replies:** 1\ **Last updated:** [December 5, 2018, 2:27am UTC](https://discuss.elastic.co/t/separating-request-uri-path-and-query-in-logstash/159441 "2018-12-05T02:27:00Z")
All, I'm new with Logstash so forgive me for this basic question. I'm trying to create a GROK filter to parse the following log lines. GET /rest/api/latest/user/search?username=xxxxxx&etag=331231 HTTP/1.1 GET /status H… --- ## [Logstash logstash-filter-cipher plugin](https://discuss.elastic.co/t/logstash-logstash-filter-cipher-plugin/159336)
**Author:** [@jmkim](https://discuss.elastic.co/u/jmkim)\ **Replies:** 0\ **Last updated:** [December 4, 2018, 10:27am UTC](https://discuss.elastic.co/t/logstash-logstash-filter-cipher-plugin/159336 "2018-12-04T10:27:48Z")
Hi. logstash-filter-cipher plugin is error. It does not decrypt normally. What is the problem? case1. I want hex to bin! ruby { code =\> " event.set('binary\_ip', Array(event.get('encrypt\_ip')).pack('H\*')) " }… --- ## [How to implement Logstash filters to handle different logfile formats/types](https://discuss.elastic.co/t/how-to-implement-logstash-filters-to-handle-different-logfile-formats-types/159424)
**Author:** [@RussellBateman](https://discuss.elastic.co/u/RussellBateman)\ **Replies:** 0\ **Last updated:** [December 4, 2018, 10:09pm UTC](https://discuss.elastic.co/t/how-to-implement-logstash-filters-to-handle-different-logfile-formats-types/159424 "2018-12-04T22:09:45Z")
I am ingesting a number of logs including /var/log/syslog, /var/log/messages, but also some proprietary logs in Common Event Format (CEF) and still other proprietary logs in various other formats. The entries of these lo… --- ## [Display hostname instead of 127.0.0.1](https://discuss.elastic.co/t/display-hostname-instead-of-127-0-0-1/159246)
**Author:** [@runiter](https://discuss.elastic.co/u/runiter)\ **Replies:** 1\ **Last updated:** [December 4, 2018, 9:49pm UTC](https://discuss.elastic.co/t/display-hostname-instead-of-127-0-0-1/159246 "2018-12-04T21:49:05Z")
Currently the "host" field in our logs always is "127.0.0.1". We want it to be either the "hostname" or the actual ip of the current machine. How can I achieve that? --- ## [Logstash filter matching Kibana Dashboard filter functionality](https://discuss.elastic.co/t/logstash-filter-matching-kibana-dashboard-filter-functionality/159422)
**Author:** [@mgolubov55](https://discuss.elastic.co/u/mgolubov55)\ **Replies:** 0\ **Last updated:** [December 4, 2018, 8:59pm UTC](https://discuss.elastic.co/t/logstash-filter-matching-kibana-dashboard-filter-functionality/159422 "2018-12-04T20:59:53Z")
I am using the following filter to limit the number of windows services displayed on a Kibana Dashboard: { "query": { "bool": { "should": \[ { "match\_phrase": { "windows.service.name": "lmhosts" } }, { "match\_p… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=636) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=638)