# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1159

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1160

---

## [ELK Stack upgraded, and logstash is not sending data to elasticsearch](https://discuss.elastic.co/t/elk-stack-upgraded-and-logstash-is-not-sending-data-to-elasticsearch/48993)

<div class="topic-metadata">

**Author:** [@bsmitty111](https://discuss.elastic.co/u/bsmitty111)\
**Replies:** 4\
**Last updated:** [May 3, 2016, 2:33pm UTC](https://discuss.elastic.co/t/elk-stack-upgraded-and-logstash-is-not-sending-data-to-elasticsearch/48993 "2016-05-03T14:33:02Z")

</div>

Hello, I am very new to ELK, and inherited this environment. this is not rolled out to production. I have the following servers: logstash index server version 2.3 logstash shipping server version 2.3 elasticserach cl…

---

## [Logstash Pipeline Fails (LF/CR)](https://discuss.elastic.co/t/logstash-pipeline-fails-lf-cr/49056)

<div class="topic-metadata">

**Author:** [@pg13](https://discuss.elastic.co/u/pg13)\
**Replies:** 1\
**Last updated:** [May 3, 2016, 12:52pm UTC](https://discuss.elastic.co/t/logstash-pipeline-fails-lf-cr/49056 "2016-05-03T12:52:47Z")

</div>

When processing log files that end with a line feed/carriage return, the pipeline is unable to process the file. The work around is to open the file in some sort of text editor (Notepad++) and manually backspace the res…

---

## [Extracting values from log body](https://discuss.elastic.co/t/extracting-values-from-log-body/48781)

<div class="topic-metadata">

**Author:** [@dandrestor](https://discuss.elastic.co/u/dandrestor)\
**Replies:** 6\
**Last updated:** [May 3, 2016, 12:24pm UTC](https://discuss.elastic.co/t/extracting-values-from-log-body/48781 "2016-05-03T12:24:15Z")

</div>

Hi there, Suppose I am getting a log message through logstash, with some custom format of the form FIELD1=VALUE1 etc. I am still quite a bit in the dark here, but I've been playing a little with visualizations. What I …

---

## [Can logstash farwarder send logs to mulitple servers](https://discuss.elastic.co/t/can-logstash-farwarder-send-logs-to-mulitple-servers/48543)

<div class="topic-metadata">

**Author:** [@sreenivasu](https://discuss.elastic.co/u/sreenivasu)\
**Replies:** 2\
**Last updated:** [May 3, 2016, 11:53am UTC](https://discuss.elastic.co/t/can-logstash-farwarder-send-logs-to-mulitple-servers/48543 "2016-05-03T11:53:34Z")

</div>

Can logstash farwarder send logs to mulitple servers, If then can you please share me the steps. Thanks In Advance Regards Sreeniavsu

---

## [How Can I parse why I got the error tag : \_grokparsefailure](https://discuss.elastic.co/t/how-can-i-parse-why-i-got-the-error-tag--grokparsefailure/29610)

<div class="topic-metadata">

**Author:** [@jianfeng\_ye](https://discuss.elastic.co/u/jianfeng_ye)\
**Replies:** 3\
**Last updated:** [May 3, 2016, 11:07am UTC](https://discuss.elastic.co/t/how-can-i-parse-why-i-got-the-error-tag--grokparsefailure/29610 "2016-05-03T11:07:25Z")

</div>

I know that my be my grok error, but when I try my grok in this website: http://grokconstructor.appspot.com/do/match#result it return ok. my grok pattern is: %{WORD:http\_host} %{URIHOST:api\_domain} %{IP:inner\_ip} …

---

## [How to create a field include elk server name inside](https://discuss.elastic.co/t/how-to-create-a-field-include-elk-server-name-inside/48368)

<div class="topic-metadata">

**Author:** [@macymin](https://discuss.elastic.co/u/macymin)\
**Replies:** 4\
**Last updated:** [May 3, 2016, 9:23am UTC](https://discuss.elastic.co/t/how-to-create-a-field-include-elk-server-name-inside/48368 "2016-05-03T09:23:47Z")

</div>

we have 2 nodes elk cluster running. on the client server side, we point some of the servers to node 1, some to node 2, so far I dont have way to see whether the distribution is balanced or not. I am thinking to creat…

---

## [Parse csv log](https://discuss.elastic.co/t/parse-csv-log/48226)

<div class="topic-metadata">

**Author:** [@josuehenrique](https://discuss.elastic.co/u/josuehenrique)\
**Replies:** 1\
**Last updated:** [May 3, 2016, 8:24am UTC](https://discuss.elastic.co/t/parse-csv-log/48226 "2016-05-03T08:24:31Z")

</div>

Hello guys. I'm beginner in ELK stack. I try parse the following log into logstash "639119","1","documentos","{texto}","{""\<p style=\\""text-align: justify;\\""\>\<span style=\\""font-size: x-small;\\""\>ATRAV&Eacute;S DESTE IN…

---

## [Logstash @timestamp field wrong?](https://discuss.elastic.co/t/logstash-timestamp-field-wrong/48627)

<div class="topic-metadata">

**Author:** [@stefansaye](https://discuss.elastic.co/u/stefansaye)\
**Replies:** 3\
**Last updated:** [April 29, 2016, 5:28am UTC](https://discuss.elastic.co/t/logstash-timestamp-field-wrong/48627 "2016-04-29T05:28:59Z")

</div>

when i using syslog plugin to run logstash with my configuration , get the wrong @timestamp , it's show 2000 ??? "@timestamp" =\> "2000-04-28T08:08:24.000Z" Any help here?

---

## [Logstash log output config and location](https://discuss.elastic.co/t/logstash-log-output-config-and-location/48902)

<div class="topic-metadata">

**Author:** [@gregoryo](https://discuss.elastic.co/u/gregoryo)\
**Replies:** 3\
**Last updated:** [May 3, 2016, 6:09am UTC](https://discuss.elastic.co/t/logstash-log-output-config-and-location/48902 "2016-05-03T06:09:30Z")

</div>

Continuing the discussion from \`service logstash start\` doesn't work: I can't find where logstash writes its own logs. I created /var/log/logstash with temporary 0777 permissions, and restarted logstash. Nothing is wri…

---

## [Does Logstash has a output plugin for mysql?](https://discuss.elastic.co/t/does-logstash-has-a-output-plugin-for-mysql/48658)

<div class="topic-metadata">

**Author:** [@gfafei](https://discuss.elastic.co/u/gfafei)\
**Replies:** 2\
**Last updated:** [May 3, 2016, 5:11am UTC](https://discuss.elastic.co/t/does-logstash-has-a-output-plugin-for-mysql/48658 "2016-05-03T05:11:46Z")

</div>

Like the title.

---

## [Creating single index only](https://discuss.elastic.co/t/creating-single-index-only/48949)

<div class="topic-metadata">

**Author:** [@Gaurav\_Harsola](https://discuss.elastic.co/u/Gaurav_Harsola)\
**Replies:** 3\
**Last updated:** [May 3, 2016, 3:40am UTC](https://discuss.elastic.co/t/creating-single-index-only/48949 "2016-05-03T03:40:12Z")

</div>

Hi , I have following conf file. It create only one index (auth1) in my elastisearch not the other one . input { file { type =\> "Apache" path =\> "/home/test/test1.log" start…

---

## [Input Plugin for Semantic Logging events](https://discuss.elastic.co/t/input-plugin-for-semantic-logging-events/48742)

<div class="topic-metadata">

**Author:** [@Sameer\_Panicker](https://discuss.elastic.co/u/Sameer_Panicker)\
**Replies:** 5\
**Last updated:** [May 2, 2016, 10:03pm UTC](https://discuss.elastic.co/t/input-plugin-for-semantic-logging-events/48742 "2016-05-02T22:03:03Z")

</div>

Is there any input plugin for capturing Semantic Logging events? I have used a file plugin. But it has many custom log formats. I am looking for something which is already built to serve this functionality.

---

## [Muliline logstash](https://discuss.elastic.co/t/muliline-logstash/41617)

<div class="topic-metadata">

**Author:** [@l1carter](https://discuss.elastic.co/u/l1carter)\
**Replies:** 3\
**Last updated:** [May 2, 2016, 7:01pm UTC](https://discuss.elastic.co/t/muliline-logstash/41617 "2016-05-02T19:01:26Z")

</div>

general question here as I'm not sure I understand the multiline filter quite yet. sorry if this has been answered many times before. I tried searching a bit but didn't find a clear example. what I'm looking to do is com…

---

## [Logstash 2.3.1 and Kafka offset issue](https://discuss.elastic.co/t/logstash-2-3-1-and-kafka-offset-issue/48331)

<div class="topic-metadata">

**Author:** [@crazyphil](https://discuss.elastic.co/u/crazyphil)\
**Replies:** 3\
**Last updated:** [May 2, 2016, 6:14pm UTC](https://discuss.elastic.co/t/logstash-2-3-1-and-kafka-offset-issue/48331 "2016-05-02T18:14:55Z")

</div>

I have finally built a proper pipeline for logstash to pull data from Kafka, and insert into elasticsearch. However I seem to be having an issue, or possibly self induced configuration problem: I need to pull from 8…

---

## [How can i validate a field is indexed in elasticsearch](https://discuss.elastic.co/t/how-can-i-validate-a-field-is-indexed-in-elasticsearch/48929)

<div class="topic-metadata">

**Author:** [@Sudeesh](https://discuss.elastic.co/u/Sudeesh)\
**Replies:** 1\
**Last updated:** [May 2, 2016, 7:35am UTC](https://discuss.elastic.co/t/how-can-i-validate-a-field-is-indexed-in-elasticsearch/48929 "2016-05-02T07:35:23Z")

</div>

I got Mapping issue in kibana4. From my logstash configuration below are the two fields renamed to time\_stamp. Before it was working fine and it type is 'String'. Now I am getting conflict message in field 'time\_stamp…

---

## [.sincedb is not updated properly](https://discuss.elastic.co/t/sincedb-is-not-updated-properly/48923)

<div class="topic-metadata">

**Author:** [@ktomu](https://discuss.elastic.co/u/ktomu)\
**Replies:** 0\
**Last updated:** [May 2, 2016, 6:25am UTC](https://discuss.elastic.co/t/sincedb-is-not-updated-properly/48923 "2016-05-02T06:25:24Z")

</div>

Hello, I have a problem with update .sincedb database. Sometimes (not always, but the input files always the same), a new record of last processed file appears in .sincedb only after logstash has restarted by me. My en…

---

## [Lumberjack Beats Connection ConnectionClosed in logstash 2.2](https://discuss.elastic.co/t/lumberjack-beats-connection-connectionclosed-in-logstash-2-2/48660)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 6:07am UTC](https://discuss.elastic.co/t/lumberjack-beats-connection-connectionclosed-in-logstash-2-2/48660 "2016-05-02T06:07:52Z")

</div>

Hi , I am running the LS-shipper on 5000 port. input { beats { port=\>"5000" ssl\_certificate =\> "/opt/logstash-elk/SSL/hostName.lij.fi.cer" ssl\_key =\> "/opt/logstash-elk/SSL/logstash.key" } } When I conect using…

---

## [How to collect chinese windows 2012 evenglog?](https://discuss.elastic.co/t/how-to-collect-chinese-windows-2012-evenglog/36342)

<div class="topic-metadata">

**Author:** [@woodkan](https://discuss.elastic.co/u/woodkan)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 4:58am UTC](https://discuss.elastic.co/t/how-to-collect-chinese-windows-2012-evenglog/36342 "2016-05-02T04:58:42Z")

</div>

I am using LS and ES 2.1 . I want to to use LS eventlog plugin to collect my windows server's eventlog. My Windows server was Windows 2012 R2 chinese. I configure eventlog as below: input { eventlog { type =\> 'w…

---

## [Use dynamic Index name based on nested field](https://discuss.elastic.co/t/use-dynamic-index-name-based-on-nested-field/36362)

<div class="topic-metadata">

**Author:** [@alexander.rabenstein](https://discuss.elastic.co/u/alexander.rabenstein)\
**Replies:** 4\
**Last updated:** [May 2, 2016, 4:36am UTC](https://discuss.elastic.co/t/use-dynamic-index-name-based-on-nested-field/36362 "2016-05-02T04:36:06Z")

</div>

Hi, I am using the current versions of logstash, elasticsearch and filebeat. In my beats configuration I create a custom field: fields: type: wildfly product: lisa enviroment: test In logstash I wa…

---

## [Timezone problem with date filter plugin](https://discuss.elastic.co/t/timezone-problem-with-date-filter-plugin/48899)

<div class="topic-metadata">

**Author:** [@no\_jihun](https://discuss.elastic.co/u/no_jihun)\
**Replies:** 1\
**Last updated:** [May 2, 2016, 12:56am UTC](https://discuss.elastic.co/t/timezone-problem-with-date-filter-plugin/48899 "2016-05-02T00:56:44Z")

</div>

Hi. With this configuration, $ cat test.conf input { stdin { codec =\> "json" } } filter { date { locale =\> "en" match =\> \["stat\_time", "YYYY-MM-dd'T'HH:mm:ss.SSSZ"\] …

---

## [How to create an alerting using the ELK stack(email alerting only)](https://discuss.elastic.co/t/how-to-create-an-alerting-using-the-elk-stack-email-alerting-only/48662)

<div class="topic-metadata">

**Author:** [@ashutosh25apr](https://discuss.elastic.co/u/ashutosh25apr)\
**Replies:** 5\
**Last updated:** [May 1, 2016, 6:22pm UTC](https://discuss.elastic.co/t/how-to-create-an-alerting-using-the-elk-stack-email-alerting-only/48662 "2016-05-01T18:22:13Z")

</div>

Please provide me with steps to add email alerting in ELK . Alerting with Logstash.

---

## [Unable to update existing index even though sincedb is deleted](https://discuss.elastic.co/t/unable-to-update-existing-index-even-though-sincedb-is-deleted/48306)

<div class="topic-metadata">

**Author:** [@Gunjan\_Gupta](https://discuss.elastic.co/u/Gunjan_Gupta)\
**Replies:** 4\
**Last updated:** [May 1, 2016, 10:37am UTC](https://discuss.elastic.co/t/unable-to-update-existing-index-even-though-sincedb-is-deleted/48306 "2016-05-01T10:37:53Z")

</div>

Step : Initial Logstash.conf file: input { file { path =\> "C:\\Users\\Downloads\\logstash-tutorial.log\\logstash-tutorial-dataset" start\_position =\> beginning ignore\_older =\> 0 } } fi…

---

## [Copy ssl certificate from centOS 7 to windows for beats](https://discuss.elastic.co/t/copy-ssl-certificate-from-centos-7-to-windows-for-beats/48756)

<div class="topic-metadata">

**Author:** [@Kennedy\_Kan1](https://discuss.elastic.co/u/Kennedy_Kan1)\
**Replies:** 4\
**Last updated:** [May 1, 2016, 2:20am UTC](https://discuss.elastic.co/t/copy-ssl-certificate-from-centos-7-to-windows-for-beats/48756 "2016-05-01T02:20:12Z")

</div>

I have copied ssl certificate from te ELK server, set up on cent OS 7, with this command scp /etc/pki/tls/certs/logstash-forwarder.crt user@client\_server\_private\_address:/tmp but then how should I place it into the Win…

---

## [Elasticsearch filter plugin query failure](https://discuss.elastic.co/t/elasticsearch-filter-plugin-query-failure/48838)

<div class="topic-metadata">

**Author:** [@jchoinski](https://discuss.elastic.co/u/jchoinski)\
**Replies:** 1\
**Last updated:** [May 1, 2016, 1:38am UTC](https://discuss.elastic.co/t/elasticsearch-filter-plugin-query-failure/48838 "2016-05-01T01:38:16Z")

</div>

Hello, I'm trying to query for an instrument in elasticsearch and calculate the time difference between the events. I'm running into an error trying to query elasticsearch. Here is the config. filter { if \[type\] …

---

## [The circuit breaker has detected a slowdown or stall in the pipeline](https://discuss.elastic.co/t/the-circuit-breaker-has-detected-a-slowdown-or-stall-in-the-pipeline/41988)

<div class="topic-metadata">

**Author:** [@Augustin\_Chen](https://discuss.elastic.co/u/Augustin_Chen)\
**Replies:** 1\
**Last updated:** [April 30, 2016, 11:27pm UTC](https://discuss.elastic.co/t/the-circuit-breaker-has-detected-a-slowdown-or-stall-in-the-pipeline/41988 "2016-04-30T23:27:21Z")

</div>

We migrate to filebeat: 1.1.1 + logstash: 2.1.1 + elasticsearch: 2.1.0, I keep seeing the following errors in the logstash logs. {:timestamp=\>"2016-02-17T03:49:58.845000-0500", :message=\>"CircuitBreaker::Close", :name=\>…

---

## [Send network traffic data to logstash and elasticsearch](https://discuss.elastic.co/t/send-network-traffic-data-to-logstash-and-elasticsearch/48791)

<div class="topic-metadata">

**Author:** [@Kennedy\_Kan](https://discuss.elastic.co/u/Kennedy_Kan)\
**Replies:** 2\
**Last updated:** [April 30, 2016, 5:28pm UTC](https://discuss.elastic.co/t/send-network-traffic-data-to-logstash-and-elasticsearch/48791 "2016-04-30T17:28:22Z")

</div>

I have been browsing for different sites on how to send network traffic data to logstash and elasticsearch; nevertheless, could not find an effective way to do so. Wonder could anyone give me some steps and guidelines …

---

## [Match beats "source"](https://discuss.elastic.co/t/match-beats-source/48821)

<div class="topic-metadata">

**Author:** [@Zfs](https://discuss.elastic.co/u/Zfs)\
**Replies:** 2\
**Last updated:** [April 30, 2016, 4:43pm UTC](https://discuss.elastic.co/t/match-beats-source/48821 "2016-04-30T16:43:10Z")

</div>

match =\> { "source" =\> "C\\:\\Progra~1\\worker\\engine\\work\\%{INT:logID}" } I have grok matching "message" but I'm trying to match the source from where beats reads in the file. Adding a match for source under grok doesn't…

---

## [V2.3 and Output pipeline](https://discuss.elastic.co/t/v2-3-and-output-pipeline/48689)

<div class="topic-metadata">

**Author:** [@phr0gz](https://discuss.elastic.co/u/phr0gz)\
**Replies:** 2\
**Last updated:** [April 30, 2016, 3:41pm UTC](https://discuss.elastic.co/t/v2-3-and-output-pipeline/48689 "2016-04-30T15:41:49Z")

</div>

Hello, is it possible to modify an output and reload the config without losing all events in main memory ? e.g. In case of having this configuration: Input: tcp Output: elasticsearch, file, tcp Problem: Disk full, …

---

## [Elasticsearch template created by logstash uses wrong name](https://discuss.elastic.co/t/elasticsearch-template-created-by-logstash-uses-wrong-name/48594)

<div class="topic-metadata">

**Author:** [@mattnworb](https://discuss.elastic.co/u/mattnworb)\
**Replies:** 1\
**Last updated:** [April 30, 2016, 3:26pm UTC](https://discuss.elastic.co/t/elasticsearch-template-created-by-logstash-uses-wrong-name/48594 "2016-04-30T15:26:18Z")

</div>

My logstash config (version 2.3.1) has an output section like elasticsearch { hosts =\> ... index =\> 'foobar-%{+YYYY.MM.dd}' template\_name =\> 'foobar' } However the template created with this name does…

---

## [Logstash Jdbc question](https://discuss.elastic.co/t/logstash-jdbc-question/48819)

<div class="topic-metadata">

**Author:** [@maher](https://discuss.elastic.co/u/maher)\
**Replies:** 1\
**Last updated:** [April 30, 2016, 3:00pm UTC](https://discuss.elastic.co/t/logstash-jdbc-question/48819 "2016-04-30T15:00:06Z")

</div>

Hi, using logstash I could read data from Mysql. -I am just asking if logstash reads the new data automaticly from data base? -is there a way to memorize the state of the data base to prevent logstash from loading ol…

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1158)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1160)
