# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=808 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 809 --- ## [Logstash does not start on windows 10](https://discuss.elastic.co/t/logstash-does-not-start-on-windows-10/121583)
**Author:** [@srini724](https://discuss.elastic.co/u/srini724)\ **Replies:** 3\ **Last updated:** [March 6, 2018, 10:36am UTC](https://discuss.elastic.co/t/logstash-does-not-start-on-windows-10/121583 "2018-03-06T10:36:19Z")
Hi - I have logstash installed on windows 10 laptop.When I try to execute logstash using the command below , nothing happens and all see is the message below. logstash -f logstash.conf --config.test\_and\_exit warning: … --- ## [Import csv file into elasticsearch using Logstash both version 6.2.2](https://discuss.elastic.co/t/import-csv-file-into-elasticsearch-using-logstash-both-version-6-2-2/122226)
**Author:** [@Karthik\_Saravanan](https://discuss.elastic.co/u/Karthik_Saravanan)\ **Replies:** 2\ **Last updated:** [March 6, 2018, 10:19am UTC](https://discuss.elastic.co/t/import-csv-file-into-elasticsearch-using-logstash-both-version-6-2-2/122226 "2018-03-06T10:19:15Z")
my csv file like this: lon,lat,number,street,unit,city,district,region,postcode,id,hash -149.362137,61.4558721,26101,OLD GLENN HWY,TOWER,,,,99567,,95223943e9d286f2 my conf file: input { file … --- ## [Ruby filter help](https://discuss.elastic.co/t/ruby-filter-help/122464)
**Author:** [@Adren](https://discuss.elastic.co/u/Adren)\ **Replies:** 7\ **Last updated:** [March 6, 2018, 8:36am UTC](https://discuss.elastic.co/t/ruby-filter-help/122464 "2018-03-06T08:36:57Z")
Hello guys, I've been struggling a lot with trying to put script in a logstash's pipeline. This script works on windows but not in CentOs 6.9. When I start logstash I have this error: An unexpected error occurred! {:er… --- ## [Indexing unstructured data](https://discuss.elastic.co/t/indexing-unstructured-data/122665)
**Author:** [@akml\_kk](https://discuss.elastic.co/u/akml_kk)\ **Replies:** 1\ **Last updated:** [March 6, 2018, 8:22am UTC](https://discuss.elastic.co/t/indexing-unstructured-data/122665 "2018-03-06T08:22:31Z")
Hello,i've already indexed semi\_structured data (Csv Files) to elasticsearch using logstash. is it possible to index unstructured data to elasticsearch using logstash too ? if yes could you bring the documentation for … --- ## [Sentiment analysis - twitter data](https://discuss.elastic.co/t/sentiment-analysis-twitter-data/122320)
**Author:** [@angeliczka](https://discuss.elastic.co/u/angeliczka)\ **Replies:** 1\ **Last updated:** [March 6, 2018, 8:05am UTC](https://discuss.elastic.co/t/sentiment-analysis-twitter-data/122320 "2018-03-06T08:05:24Z")
Hello I am doing a twitter analysis using the elastic stack and I would like to add the sentiment analysis to the data, from what I understand the sentiment would have to be added at the time of data ingestion which mea… --- ## [Logstash is missing real time logs](https://discuss.elastic.co/t/logstash-is-missing-real-time-logs/122653)
**Author:** [@Naqib\_Faiyaz](https://discuss.elastic.co/u/Naqib_Faiyaz)\ **Replies:** 6\ **Last updated:** [March 6, 2018, 8:03am UTC](https://discuss.elastic.co/t/logstash-is-missing-real-time-logs/122653 "2018-03-06T08:03:35Z")
hello!! I'm reading logs with file input plugin. When I'm reading older logs logstash is performing very good. But while reading live logs it is missing aroung 2% of the logs. My files are coming through ftp in a solar… --- ## [Twitter plugin not catching tweets](https://discuss.elastic.co/t/twitter-plugin-not-catching-tweets/122663)
**Author:** [@Jolanen](https://discuss.elastic.co/u/Jolanen)\ **Replies:** 0\ **Last updated:** [March 6, 2018, 7:59am UTC](https://discuss.elastic.co/t/twitter-plugin-not-catching-tweets/122663 "2018-03-06T07:59:33Z")
I have a persistent problem with the twitter plugin on streaming tweets: Logstash instance runs correctly with no logged errors, but it does not catch tweets only on a specific network. It works on any other machine wit… --- ## [Error parsing logs in Logstash](https://discuss.elastic.co/t/error-parsing-logs-in-logstash/122262)
**Author:** [@edmx](https://discuss.elastic.co/u/edmx)\ **Replies:** 2\ **Last updated:** [March 6, 2018, 7:47am UTC](https://discuss.elastic.co/t/error-parsing-logs-in-logstash/122262 "2018-03-06T07:47:35Z")
Hey guys, I'm doing the 'Getting started with Logstash' tutorial at this moment. link to tutorial While I'm following all steps, I'm stuck at an error: It's this error: sudo bin/logstash -f first-pipeline.conf --con… --- ## [How to send log to windows event by using logstash ELK?](https://discuss.elastic.co/t/how-to-send-log-to-windows-event-by-using-logstash-elk/122656)
**Author:** [@Yusuf\_Karatoprak](https://discuss.elastic.co/u/Yusuf_Karatoprak)\ **Replies:** 0\ **Last updated:** [March 6, 2018, 7:13am UTC](https://discuss.elastic.co/t/how-to-send-log-to-windows-event-by-using-logstash-elk/122656 "2018-03-06T07:13:52Z")
I am working in a big company, we have lots of responsibility. one of them is to inform Network team. But they are can not understand ELK structure. They have a alert monitoring system that is working when our system is … --- ## [Logs can not stream properly after logstash service restart](https://discuss.elastic.co/t/logs-can-not-stream-properly-after-logstash-service-restart/122642)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 2\ **Last updated:** [March 6, 2018, 7:06am UTC](https://discuss.elastic.co/t/logs-can-not-stream-properly-after-logstash-service-restart/122642 "2018-03-06T07:06:24Z")
hi there I run logstash as a service in window server. I use tcp input, grok filter, amazon\_es output in my logstash config. I stream .net application logs using Log4netSocketAppender to logstash host. strange thing … --- ## [Single input and multiple output](https://discuss.elastic.co/t/single-input-and-multiple-output/122632)
**Author:** [@kalla](https://discuss.elastic.co/u/kalla)\ **Replies:** 2\ **Last updated:** [March 6, 2018, 6:54am UTC](https://discuss.elastic.co/t/single-input-and-multiple-output/122632 "2018-03-06T06:54:14Z")
Hi, It is possible to create multiple index with different column values (In elastic search) with 1 input (beats) ? My logstash.conf is: input { beats { port =\> 5044 } } filter { csv { separator =\> "," … --- ## [Logstash dynamic id](https://discuss.elastic.co/t/logstash-dynamic-id/122627)
**Author:** [@1243user](https://discuss.elastic.co/u/1243user)\ **Replies:** 8\ **Last updated:** [March 6, 2018, 6:40am UTC](https://discuss.elastic.co/t/logstash-dynamic-id/122627 "2018-03-06T06:40:31Z")
i am using elasticsearch + logstash + kibana . i have i question , i get log data like this : 2018-03-01 18:03:13.504 INFO 30613 --- \[nio-8040-exec-3\] com.gh.controller.LogController : log/SearchIndex … --- ## [Parsing CSV file to Logstash and Elastic Search which is in the server](https://discuss.elastic.co/t/parsing-csv-file-to-logstash-and-elastic-search-which-is-in-the-server/119444)
**Author:** [@bpk](https://discuss.elastic.co/u/bpk)\ **Replies:** 7\ **Last updated:** [March 6, 2018, 6:28am UTC](https://discuss.elastic.co/t/parsing-csv-file-to-logstash-and-elastic-search-which-is-in-the-server/119444 "2018-03-06T06:28:31Z")
Hi, I am a Beginner. Hardly 10 days of experience in Logstash. I have a csv file (Unstructured). I have copied it to the server, where Logstash is been configured. I am trying to parse CSV file into Logstash, But I am… --- ## [Logstach Aggregate Plugin installed, but cannot be found](https://discuss.elastic.co/t/logstach-aggregate-plugin-installed-but-cannot-be-found/122641)
**Author:** [@sara\_noori\_hekmat](https://discuss.elastic.co/u/sara_noori_hekmat)\ **Replies:** 0\ **Last updated:** [March 6, 2018, 6:20am UTC](https://discuss.elastic.co/t/logstach-aggregate-plugin-installed-but-cannot-be-found/122641 "2018-03-06T06:20:42Z")
Hi, I installed aggregate filter plugin (using offline-packed) and now I can see it in the list of installed plugins: /usr/share/logstash/bin/logstash-plugin list --verbose logstash-codec-cef (4.1.4) logstash-codec-co… --- ## [Split CSV data from beats](https://discuss.elastic.co/t/split-csv-data-from-beats/122607)
**Author:** [@millerb1](https://discuss.elastic.co/u/millerb1)\ **Replies:** 1\ **Last updated:** [March 6, 2018, 5:46am UTC](https://discuss.elastic.co/t/split-csv-data-from-beats/122607 "2018-03-06T05:46:42Z")
We are new to ELK and need help with our Log Stash filter. We don’t need to filter any rows, just separate the data into their respective columns and use the Timestamp column as a Timestamp \*.log  File Beats  Log Stas… --- ## [Logstash's Pipeline has terminated](https://discuss.elastic.co/t/logstashs-pipeline-has-terminated/121772)
**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\ **Replies:** 11\ **Last updated:** [March 6, 2018, 2:18am UTC](https://discuss.elastic.co/t/logstashs-pipeline-has-terminated/121772 "2018-03-06T02:18:47Z")
I'm Running Logstash on Docker, yet running into following issue: logstash\_1 | Sending Logstash's logs to /usr/share/logstash/logs which is now configured via log4j2.properties logstash\_1 | \[2018-02-28T04:02:06,811\]\[I… --- ## [Logstash sql\_last\_run took last record twice](https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617)
**Author:** [@Timotius\_Pamungkas](https://discuss.elastic.co/u/Timotius_Pamungkas)\ **Replies:** 0\ **Last updated:** [March 6, 2018, 1:15am UTC](https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617 "2018-03-06T01:15:23Z")
I use logstash to parse log data from SQL Server, using jdbc input. The jdbc runs every hour. However, every last log entry on previous hour sometimes taken twice by logstash. For example, the following sequence: \[1. l… --- ## [Importing JSON readings from file to ElasticSearch](https://discuss.elastic.co/t/importing-json-readings-from-file-to-elasticsearch/122168)
**Author:** [@itzik16](https://discuss.elastic.co/u/itzik16)\ **Replies:** 1\ **Last updated:** [March 5, 2018, 9:10pm UTC](https://discuss.elastic.co/t/importing-json-readings-from-file-to-elasticsearch/122168 "2018-03-05T21:10:59Z")
Hello, I have script that logs temperature + humidity from diffrent sensors and stores the data from each sensor to his directory and every day a new log is made in this format YYYY-MM-DD.log. ${data\_root}/A/0/\*.log ${… --- ## [CSV file is not getting uploaded to Kibana](https://discuss.elastic.co/t/csv-file-is-not-getting-uploaded-to-kibana/122424)
**Author:** [@Prakash\_Punj](https://discuss.elastic.co/u/Prakash_Punj)\ **Replies:** 1\ **Last updated:** [March 5, 2018, 8:58pm UTC](https://discuss.elastic.co/t/csv-file-is-not-getting-uploaded-to-kibana/122424 "2018-03-05T20:58:27Z")
I am trying to upload a CSV file to Kibana using LogStash. I am not getting any error but data is not getting uploaded. Below is the output of logstash command: Sending Logstash's logs to /home/ppunj/logstash-6.1.1/… --- ## [How to create .raw field through logstash](https://discuss.elastic.co/t/how-to-create-raw-field-through-logstash/122540)
**Author:** [@Honda\_fred\_elk](https://discuss.elastic.co/u/Honda_fred_elk)\ **Replies:** 2\ **Last updated:** [March 5, 2018, 8:21pm UTC](https://discuss.elastic.co/t/how-to-create-raw-field-through-logstash/122540 "2018-03-05T20:21:55Z")
Hello, I have been using ELK to see our application logs. I achieved this by feeding application generated logs as JSON string through Logstash --\> Elasticsearch --\> Kibana. All the objects in my JSON stings are anal… --- ## [Referencing a URL for Elasticsearch Template/Kibana Dashboards](https://discuss.elastic.co/t/referencing-a-url-for-elasticsearch-template-kibana-dashboards/122434)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 1\ **Last updated:** [March 5, 2018, 8:03pm UTC](https://discuss.elastic.co/t/referencing-a-url-for-elasticsearch-template-kibana-dashboards/122434 "2018-03-05T20:03:12Z")
Wondering if it's possible to reference a URL for the ElasticSearch Output Template option? The same with pulling down Kibana Dashboards, similar to the example dashboards used by the Beats agents. --- ## [Pipeline with Persistent Queues stops working after some hours](https://discuss.elastic.co/t/pipeline-with-persistent-queues-stops-working-after-some-hours/121841)
**Author:** [@gghdr](https://discuss.elastic.co/u/gghdr)\ **Replies:** 2\ **Last updated:** [March 5, 2018, 6:38pm UTC](https://discuss.elastic.co/t/pipeline-with-persistent-queues-stops-working-after-some-hours/121841 "2018-03-05T18:38:56Z")
Hello, i have a pipeline with the following plugins: input: Kafka,Heartbeat filters: Metric,Sleep,Clone,Mutate outputs: File,Kafka,Jms (Websphere MQ Queue) after working fine for some hours, logstash stops to proces… --- ## [Elasticsearch input plugin is not working](https://discuss.elastic.co/t/elasticsearch-input-plugin-is-not-working/121974)
**Author:** [@sureshsubramaniyan](https://discuss.elastic.co/u/sureshsubramaniyan)\ **Replies:** 3\ **Last updated:** [March 5, 2018, 4:33pm UTC](https://discuss.elastic.co/t/elasticsearch-input-plugin-is-not-working/121974 "2018-03-05T16:33:20Z")
getting below while using elasticsearch input plugin , \[2018--03-01T02:52:00,652\]\[DEBUG\]\[logstash.pipeline \] Pushing flush onto pipeline {:pipeline\_id=\>"main", :thread=\>"#\"} \[2018-03-01T0… --- ## [How to use pipelines.yml](https://discuss.elastic.co/t/how-to-use-pipelines-yml/122545)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 1\ **Last updated:** [March 5, 2018, 3:18pm UTC](https://discuss.elastic.co/t/how-to-use-pipelines-yml/122545 "2018-03-05T15:18:09Z")
Hi, I wanted to try to use multiple pipelines. Starting from plain logstash 6.2.2 out from tar.gz file. Unzipped and chown for all files to logstash:logstash made following changes to pure logstash.yml: node.name: t… --- ## [Ruby filter processes events in incorrect order](https://discuss.elastic.co/t/ruby-filter-processes-events-in-incorrect-order/122369)
**Author:** [@Heckler\_GlobalOperat](https://discuss.elastic.co/u/Heckler_GlobalOperat)\ **Replies:** 7\ **Last updated:** [March 5, 2018, 3:03pm UTC](https://discuss.elastic.co/t/ruby-filter-processes-events-in-incorrect-order/122369 "2018-03-05T15:03:08Z")
Here is my test configuration I create a simple list of events like below, the events are numbered according to their order of appearance 2016-12-06 07:00:00,251 event1 2016-12-06 07:00:10,651 event2 2016-12-06 07:0… --- ## [error=\>#\](https://discuss.elastic.co/t/error-nomethoderror-undefined-method-for-nil-nilclass/122513)
**Author:** [@nilNilClass](https://discuss.elastic.co/u/nilNilClass)\ **Replies:** 2\ **Last updated:** [March 5, 2018, 1:22pm UTC](https://discuss.elastic.co/t/error-nomethoderror-undefined-method-for-nil-nilclass/122513 "2018-03-05T13:22:08Z")
Hello, I test all in windows and run well, now try move to CentOS7 and get this error. I create a "Squid" dir in "/usr/share/logstash" with the files: access.log and config file. execute: bin/logstash -f Squid/logstas… --- ## [Replace the empty fields in csv](https://discuss.elastic.co/t/replace-the-empty-fields-in-csv/122396)
**Author:** [@TechGeek](https://discuss.elastic.co/u/TechGeek)\ **Replies:** 4\ **Last updated:** [March 5, 2018, 1:19pm UTC](https://discuss.elastic.co/t/replace-the-empty-fields-in-csv/122396 "2018-03-05T13:19:25Z")
While ingesting data (which include 20+ columns in csv), it throwing an error while creating pipeline to solve this I convert the file in .txt and ingest. It did well, though certain columns information overlap or exchan… --- ## [Logstash slowlog for Elasticsearch output](https://discuss.elastic.co/t/logstash-slowlog-for-elasticsearch-output/119503)
**Author:** [@Jon\_D](https://discuss.elastic.co/u/Jon_D)\ **Replies:** 1\ **Last updated:** [March 5, 2018, 1:09pm UTC](https://discuss.elastic.co/t/logstash-slowlog-for-elasticsearch-output/119503 "2018-03-05T13:09:39Z")
Hello, I'm trying to get the slowlog to work in order to obtain more information about the bulk API requests from Logstash to Elasticsearch. I added this to my logstash.yml file : slowlog.threshold.warn: 2s slowlog.th… --- ## [NoMethodError: undefined method \`map\_cleanup' for nil:NilClass](https://discuss.elastic.co/t/nomethoderror-undefined-method-map-cleanup-for-nil-nilclass/122514)
**Author:** [@Honda\_fred\_elk](https://discuss.elastic.co/u/Honda_fred_elk)\ **Replies:** 0\ **Last updated:** [March 5, 2018, 1:07pm UTC](https://discuss.elastic.co/t/nomethoderror-undefined-method-map-cleanup-for-nil-nilclass/122514 "2018-03-05T13:07:19Z")
Hello, I'm getting below error in logstash and then logstash crashes. NoMethodError: undefined method \`map\_cleanup' for nil:NilClass start at /appl/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-multiline-2.0.11… --- ## [Multiple pipelines in one logstash and kafka](https://discuss.elastic.co/t/multiple-pipelines-in-one-logstash-and-kafka/122507)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 0\ **Last updated:** [March 5, 2018, 12:36pm UTC](https://discuss.elastic.co/t/multiple-pipelines-in-one-logstash-and-kafka/122507 "2018-03-05T12:36:47Z")
Hi, currently we are using following chain: logfile -\> filebeat -\> logstash -\> elasticsearch. Sometimes I see in our logs, that filebeat cannot connect or is rejected by logstash. Thats why I am considering introduci… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=807) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=809)