# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1151

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1152

---

## [Multiple Logstash Instances on Single Server](https://discuss.elastic.co/t/multiple-logstash-instances-on-single-server/28947)

<div class="topic-metadata">

**Author:** [@Kryten](https://discuss.elastic.co/u/Kryten)\
**Replies:** 6\
**Last updated:** [May 24, 2016, 6:16am UTC](https://discuss.elastic.co/t/multiple-logstash-instances-on-single-server/28947 "2016-05-24T06:16:01Z")

</div>

Hi, I would like to have several distinct logstash instances running on the same server. What is the best way to accomplish this? I already have a single instance of logstash running, it monitors a large number of fi…

---

## [Running logstash in docker, not outputting to file or console :](https://discuss.elastic.co/t/running-logstash-in-docker-not-outputting-to-file-or-console/50400)

<div class="topic-metadata">

**Author:** [@Sergey\_Manukyan](https://discuss.elastic.co/u/Sergey_Manukyan)\
**Replies:** 4\
**Last updated:** [May 24, 2016, 6:05am UTC](https://discuss.elastic.co/t/running-logstash-in-docker-not-outputting-to-file-or-console/50400 "2016-05-24T06:05:35Z")

</div>

Running logstash 2.3 with the following conf file : input { file { path =\> "/var/log/logstash/access\_nginx.log" codec =\> "line" sincedb\_path =\> "null" start\_position =\> "beginning" …

---

## [Logstash starts and stops within seconds while running it as a service](https://discuss.elastic.co/t/logstash-starts-and-stops-within-seconds-while-running-it-as-a-service/24998)

<div class="topic-metadata">

**Author:** [@shriyansh\_jain](https://discuss.elastic.co/u/shriyansh_jain)\
**Replies:** 3\
**Last updated:** [May 24, 2016, 5:39am UTC](https://discuss.elastic.co/t/logstash-starts-and-stops-within-seconds-while-running-it-as-a-service/24998 "2016-05-24T05:39:55Z")

</div>

The logstash.err file spits out the following error Faraday::ConnectionFailed: Connection refused - Connection refused call at /opt/logstash/vendor/bundle/jruby/1.9/gems/faraday-0.9.0/lib/faraday/adapter…

---

## [Monitor inactivity in log files](https://discuss.elastic.co/t/monitor-inactivity-in-log-files/50597)

<div class="topic-metadata">

**Author:** [@vikas\_J](https://discuss.elastic.co/u/vikas_J)\
**Replies:** 14\
**Last updated:** [May 23, 2016, 11:03pm UTC](https://discuss.elastic.co/t/monitor-inactivity-in-log-files/50597 "2016-05-23T23:03:15Z")

</div>

I have certain log files being monitored through ELK stack using filbebeat to send files to log stash. Suppose if the server is down and the logs are no longer being written, i want to monitor the same. Is there some way…

---

## [Trying to grok ClassCastException](https://discuss.elastic.co/t/trying-to-grok-classcastexception/50273)

<div class="topic-metadata">

**Author:** [@laidig](https://discuss.elastic.co/u/laidig)\
**Replies:** 1\
**Last updated:** [May 23, 2016, 10:01pm UTC](https://discuss.elastic.co/t/trying-to-grok-classcastexception/50273 "2016-05-23T22:01:37Z")

</div>

I am trying out the v5 stack and punching my way through a field of errors my logstash.conf has two grok statements, which pass the configtest: match =\> {"message"=\>\[ "%{TIMESTAMP\_ISO8601…

---

## [Problems Migrating to Multiline Codec from Multiline Filter](https://discuss.elastic.co/t/problems-migrating-to-multiline-codec-from-multiline-filter/48727)

<div class="topic-metadata">

**Author:** [@Maxwell\_Flanders](https://discuss.elastic.co/u/Maxwell_Flanders)\
**Replies:** 7\
**Last updated:** [May 23, 2016, 3:02pm UTC](https://discuss.elastic.co/t/problems-migrating-to-multiline-codec-from-multiline-filter/48727 "2016-05-23T15:02:01Z")

</div>

I am currently trying to migrate to the multiline codec from the multiline filter because the filter is not thread-safe (I had been experiencing problems with lost log lines due to this). However I've been having a pro…

---

## [Logstash service with queue](https://discuss.elastic.co/t/logstash-service-with-queue/50715)

<div class="topic-metadata">

**Author:** [@jcome](https://discuss.elastic.co/u/jcome)\
**Replies:** 2\
**Last updated:** [May 23, 2016, 2:15pm UTC](https://discuss.elastic.co/t/logstash-service-with-queue/50715 "2016-05-23T14:15:41Z")

</div>

Hello everybody, I have a little configuration with logstash running as a service on a VPS sending logs to elasticsearch, and receiving informations from an external filebeat. My elasticsearch configuration is not po…

---

## [Issues with ssl\_certificate\_validation in logstash output elasticsearch plugin](https://discuss.elastic.co/t/issues-with-ssl-certificate-validation-in-logstash-output-elasticsearch-plugin/50585)

<div class="topic-metadata">

**Author:** [@ankur.aggarwal](https://discuss.elastic.co/u/ankur.aggarwal)\
**Replies:** 1\
**Last updated:** [May 23, 2016, 1:19pm UTC](https://discuss.elastic.co/t/issues-with-ssl-certificate-validation-in-logstash-output-elasticsearch-plugin/50585 "2016-05-23T13:19:24Z")

</div>

@magnusbaeck @andrewvc - Please suggest Logstash Version : 2.3.2 Using below configuration in logstash conf file : elasticsearch { hosts =\> \["https://es-XXXXX:443"\] ssl\_certificate\_verification =\> false index =\> "X…

---

## [Running logstash and elasticsearch on two machine](https://discuss.elastic.co/t/running-logstash-and-elasticsearch-on-two-machine/26270)

<div class="topic-metadata">

**Author:** [@DavidL](https://discuss.elastic.co/u/DavidL)\
**Replies:** 6\
**Last updated:** [February 19, 2016, 1:47pm UTC](https://discuss.elastic.co/t/running-logstash-and-elasticsearch-on-two-machine/26270 "2016-02-19T13:47:40Z")

</div>

I have worked out everything on my local machine, parsed my logs in logstash, stored them in kibana, and built dashboards for my data on Kibana. Now I trying to mock a production scenario where logstash is installed on …

---

## [Pushing the data from Perfmon to elasticsearch](https://discuss.elastic.co/t/pushing-the-data-from-perfmon-to-elasticsearch/50685)

<div class="topic-metadata">

**Author:** [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Replies:** 3\
**Last updated:** [May 23, 2016, 10:14am UTC](https://discuss.elastic.co/t/pushing-the-data-from-perfmon-to-elasticsearch/50685 "2016-05-23T10:14:16Z")

</div>

Hi All, I need to post the perfmon data for visualization. Currently I am saving perfmon data collector data set as CSV and then sending it to elasticsearch for visualization. So every time when I restart perfmon data …

---

## [Logstash grok vs. grok debugger](https://discuss.elastic.co/t/logstash-grok-vs-grok-debugger/50656)

<div class="topic-metadata">

**Author:** [@aalaie](https://discuss.elastic.co/u/aalaie)\
**Replies:** 7\
**Last updated:** [May 23, 2016, 9:31am UTC](https://discuss.elastic.co/t/logstash-grok-vs-grok-debugger/50656 "2016-05-23T09:31:38Z")

</div>

Hi, I have got a grok : filter { grok { match =\> \[ "message", "%{SYSLOGTIMESTAMP:date}%{SPACE}%{IPV4:clientip}%{SPACE}%{SYSLOGTIMESTAMP}%{SPACE}\[%{WORD:onLocation}\\:%{WORD:onComponent}.%{WORD:onVolume}.%{WORD…

---

## [Installing logstash on MAC OS X](https://discuss.elastic.co/t/installing-logstash-on-mac-os-x/50661)

<div class="topic-metadata">

**Author:** [@tglasgow](https://discuss.elastic.co/u/tglasgow)\
**Replies:** 2\
**Last updated:** [May 23, 2016, 7:35am UTC](https://discuss.elastic.co/t/installing-logstash-on-mac-os-x/50661 "2016-05-23T07:35:14Z")

</div>

I want to install Logstash, Elastic, Kibana on my Macbook, but most of the documentation on GITHUB and the elastic site seem to revolve around windows. Does anyone know of good documentation for installing on OS X.

---

## [How to send multiple log files to Kibana through logstash?](https://discuss.elastic.co/t/how-to-send-multiple-log-files-to-kibana-through-logstash/50101)

<div class="topic-metadata">

**Author:** [@tashinfrus](https://discuss.elastic.co/u/tashinfrus)\
**Replies:** 18\
**Last updated:** [May 23, 2016, 6:33am UTC](https://discuss.elastic.co/t/how-to-send-multiple-log-files-to-kibana-through-logstash/50101 "2016-05-23T06:33:53Z")

</div>

I am new to ELK and I want to send multiple files to Kibana using Logstash like apache access logs of different servers. How can I do that?

---

## [Grok Pattern Help with message parsing](https://discuss.elastic.co/t/grok-pattern-help-with-message-parsing/50279)

<div class="topic-metadata">

**Author:** [@snipervelli](https://discuss.elastic.co/u/snipervelli)\
**Replies:** 4\
**Last updated:** [May 23, 2016, 5:38am UTC](https://discuss.elastic.co/t/grok-pattern-help-with-message-parsing/50279 "2016-05-23T05:38:48Z")

</div>

Hi all i am fairly new to Elasticsearch. I have Elasticsearc running and i have some information in my logs that i need to graph and i just don't know how filter it. So here are the contents in my message field that i ne…

---

## [How to convert a json field to string](https://discuss.elastic.co/t/how-to-convert-a-json-field-to-string/49898)

<div class="topic-metadata">

**Author:** [@changxy](https://discuss.elastic.co/u/changxy)\
**Replies:** 2\
**Last updated:** [May 23, 2016, 3:12am UTC](https://discuss.elastic.co/t/how-to-convert-a-json-field-to-string/49898 "2016-05-23T03:12:37Z")

</div>

my log (json) content is： {"release\_time": "1998-01-01", "home\_url": "http://www.777.com/show\_page/id\_001.html", "isVip": "", "channel": "777"} {"release\_time": "2009", "home\_url": "http://www.666.com/show\_page/i…

---

## [Date field format in Logstash](https://discuss.elastic.co/t/date-field-format-in-logstash/50267)

<div class="topic-metadata">

**Author:** [@aalaie](https://discuss.elastic.co/u/aalaie)\
**Replies:** 6\
**Last updated:** [May 22, 2016, 7:27pm UTC](https://discuss.elastic.co/t/date-field-format-in-logstash/50267 "2016-05-22T19:27:37Z")

</div>

Hi, I am new to ELK; I am trying to get my first example working but Logstash doesn't seem to like my date format. stock.conf input { file { path =\> \["/Users/alialaie/Desktop/Examples/Data/Intro/stock.csv…

---

## [Neo4j - logstash-output-neo4j](https://discuss.elastic.co/t/neo4j-logstash-output-neo4j/50648)

<div class="topic-metadata">

**Author:** [@Andrew\_Shved](https://discuss.elastic.co/u/Andrew_Shved)\
**Replies:** 1\
**Last updated:** [May 22, 2016, 2:46pm UTC](https://discuss.elastic.co/t/neo4j-logstash-output-neo4j/50648 "2016-05-22T14:46:42Z")

</div>

I found and installed this plugin but can not find the documentation on it. Can anyone point me to how to use it ... Basically I want to store node text data to be searchable in ES but use neo4j as a graph database for …

---

## [Query process](https://discuss.elastic.co/t/query-process/50566)

<div class="topic-metadata">

**Author:** [@Carmine\_Fabrizio](https://discuss.elastic.co/u/Carmine_Fabrizio)\
**Replies:** 2\
**Last updated:** [May 22, 2016, 10:15am UTC](https://discuss.elastic.co/t/query-process/50566 "2016-05-22T10:15:20Z")

</div>

Hi guys, I have a big question, when i send a query in my kibana page and after that i close my browser or the browser crash, is the query/process running on the core? Thanks a lot.

---

## [Getting Below ecxception in logstash please help](https://discuss.elastic.co/t/getting-below-ecxception-in-logstash-please-help/50419)

<div class="topic-metadata">

**Author:** [@ashutosh25apr](https://discuss.elastic.co/u/ashutosh25apr)\
**Replies:** 2\
**Last updated:** [May 22, 2016, 6:59am UTC](https://discuss.elastic.co/t/getting-below-ecxception-in-logstash-please-help/50419 "2016-05-22T06:59:11Z")

</div>

{:timestamp=\>"2016-05-19T15:08:33.744000+0530", :message=\>"Beats input: The circuit breaker has detected a slowdown or stall in the pipeline, the input is closing the current connection and rejecting new connection until…

---

## [Overcome 2600 msg/seconds with Logstash/Filebeat](https://discuss.elastic.co/t/overcome-2600-msg-seconds-with-logstash-filebeat/50626)

<div class="topic-metadata">

**Author:** [@carrot](https://discuss.elastic.co/u/carrot)\
**Replies:** 2\
**Last updated:** [May 22, 2016, 3:52am UTC](https://discuss.elastic.co/t/overcome-2600-msg-seconds-with-logstash-filebeat/50626 "2016-05-22T03:52:46Z")

</div>

I'm currently testing performance of file ingest but I'm not getting much right now. About 2500-2600 msg/secs. filebeat (1.2.3) -\> logstash (2.3.2) -\> elastic (2.3.3) with default configurations. I've got a directory w…

---

## [Logstach 2.3.2 hang while run with .conf file](https://discuss.elastic.co/t/logstach-2-3-2-hang-while-run-with-conf-file/49348)

<div class="topic-metadata">

**Author:** [@dhyeem](https://discuss.elastic.co/u/dhyeem)\
**Replies:** 10\
**Last updated:** [May 21, 2016, 11:29pm UTC](https://discuss.elastic.co/t/logstach-2-3-2-hang-while-run-with-conf-file/49348 "2016-05-21T23:29:23Z")

</div>

Dears , there is an issue with the logstash i have , I try to run it with the .conf file i created but it hang after pipeline , this is one of the .conf i try to run : \`input { stdin {} file { …

---

## [Not able to check the Input Data Status](https://discuss.elastic.co/t/not-able-to-check-the-input-data-status/50304)

<div class="topic-metadata">

**Author:** [@karuneshupadhyay](https://discuss.elastic.co/u/karuneshupadhyay)\
**Replies:** 1\
**Last updated:** [May 21, 2016, 5:16pm UTC](https://discuss.elastic.co/t/not-able-to-check-the-input-data-status/50304 "2016-05-21T17:16:19Z")

</div>

Hi, How can I see the files which are transferred from filebeat to logstash? I am not able to figure it that filebeat is sending data to Logstash or not ? How can I confirm and how can I read the same files in logst…

---

## [Which node(s) in my ES cluster do I point Logstash to?](https://discuss.elastic.co/t/which-node-s-in-my-es-cluster-do-i-point-logstash-to/50609)

<div class="topic-metadata">

**Author:** [@nateuni](https://discuss.elastic.co/u/nateuni)\
**Replies:** 1\
**Last updated:** [May 21, 2016, 4:37am UTC](https://discuss.elastic.co/t/which-node-s-in-my-es-cluster-do-i-point-logstash-to/50609 "2016-05-21T04:37:23Z")

</div>

I have ES 4 servers running as such: Client Node (also hosting Kibana) Default setting (By default a node is both a master-eligible node and a data node) Default setting Default setting In Logstash's output setting …

---

## [Comments between hash entries cause parse error](https://discuss.elastic.co/t/comments-between-hash-entries-cause-parse-error/50592)

<div class="topic-metadata">

**Author:** [@Kelvin\_L](https://discuss.elastic.co/u/Kelvin_L)\
**Replies:** 0\
**Last updated:** [May 20, 2016, 6:01pm UTC](https://discuss.elastic.co/t/comments-between-hash-entries-cause-parse-error/50592 "2016-05-20T18:01:20Z")

</div>

This should be self-explanatory: On logstash 2.3.2 filter { mutate { rename =\> { # comment OK here "field\_1a" =\> "field\_1b" # comment not OK here - causes parse error "field\_2a" =\> "field\_…

---

## [Logstash not parsing data thats not brand new](https://discuss.elastic.co/t/logstash-not-parsing-data-thats-not-brand-new/50484)

<div class="topic-metadata">

**Author:** [@Ambrose](https://discuss.elastic.co/u/Ambrose)\
**Replies:** 2\
**Last updated:** [May 20, 2016, 2:38pm UTC](https://discuss.elastic.co/t/logstash-not-parsing-data-thats-not-brand-new/50484 "2016-05-20T14:38:20Z")

</div>

Hello, My Logstash to Elasticsearch workflow works fine, but only if I take the logs I am sending to Elasticsearch, open them in a text editor, delete them in the original location, and save them back to the area where …

---

## [Capitalize first letter of each word in a field](https://discuss.elastic.co/t/capitalize-first-letter-of-each-word-in-a-field/50564)

<div class="topic-metadata">

**Author:** [@devjr](https://discuss.elastic.co/u/devjr)\
**Replies:** 0\
**Last updated:** [May 20, 2016, 1:54pm UTC](https://discuss.elastic.co/t/capitalize-first-letter-of-each-word-in-a-field/50564 "2016-05-20T13:54:34Z")

</div>

Hello, I'm looking for a way to capitalize the first letter of each word in a field. Example : my-server-name =\> My-Server-Name I looked into mutate doc, but I can't figure out how to do that. Anyone has an idea ? T…

---

## [\[SOLVED\] - Snmp trap source : 127.0.0.1](https://discuss.elastic.co/t/solved-snmp-trap-source-127-0-0-1/50405)

<div class="topic-metadata">

**Author:** [@def](https://discuss.elastic.co/u/def)\
**Replies:** 1\
**Last updated:** [May 20, 2016, 8:15am UTC](https://discuss.elastic.co/t/solved-snmp-trap-source-127-0-0-1/50405 "2016-05-20T08:15:02Z")

</div>

Hi all, I have a question about my configuration : snmptrapd.conf authCommunity log,execute,net public forward default localhost:1062 logstash input { snmptrap { type =\> snmptrap port =\> 1062 } } filter{ r…

---

## [Io/console not supported when starting logstash 2.3.2 on Win 10](https://discuss.elastic.co/t/io-console-not-supported-when-starting-logstash-2-3-2-on-win-10/50382)

<div class="topic-metadata">

**Author:** [@bhawanaus](https://discuss.elastic.co/u/bhawanaus)\
**Replies:** 3\
**Last updated:** [May 20, 2016, 5:32am UTC](https://discuss.elastic.co/t/io-console-not-supported-when-starting-logstash-2-3-2-on-win-10/50382 "2016-05-20T05:32:50Z")

</div>

C:\\Users\\bhagupta\\elk\_poc\\logstash-2.3.2\\logstash-2.3.2\\bin\>logstash -f logstash.conf io/console not supported; tty will not be manipulated Settings: Default pipeline workers: 4 Note : After this nothing get displayed…

---

## [Types Multiple Inputs / Filters / Outputs](https://discuss.elastic.co/t/types-multiple-inputs-filters-outputs/50487)

<div class="topic-metadata">

**Author:** [@esoulkitchen](https://discuss.elastic.co/u/esoulkitchen)\
**Replies:** 1\
**Last updated:** [May 19, 2016, 9:48pm UTC](https://discuss.elastic.co/t/types-multiple-inputs-filters-outputs/50487 "2016-05-19T21:48:40Z")

</div>

My inputs are a couple windows server, a linux server, and a Fortinet router. I am using Beats for the windows and linux servers. The Fortinet is forwarding it's logs. I am assigning a different type for each input (type…

---

## [Logstash data not seen in ElasticSearch](https://discuss.elastic.co/t/logstash-data-not-seen-in-elasticsearch/50472)

<div class="topic-metadata">

**Author:** [@tomfranc](https://discuss.elastic.co/u/tomfranc)\
**Replies:** 0\
**Last updated:** [May 19, 2016, 4:22pm UTC](https://discuss.elastic.co/t/logstash-data-not-seen-in-elasticsearch/50472 "2016-05-19T16:22:15Z")

</div>

I am trying to get syslog from Palo Alto to ElasticSearch. I found that when I use a filter I do not get any line feed and carriage returns and no data gets sent to Elastic Search. This code does not send any data to E…

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1150)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1152)
