# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1236

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1237

---

## [Displaying Geo data on Tile Map](https://discuss.elastic.co/t/displaying-geo-data-on-tile-map/29528)

<div class="topic-metadata">

**Author:** [@ashwintumma](https://discuss.elastic.co/u/ashwintumma)\
**Replies:** 1\
**Last updated:** [September 18, 2015, 1:34am UTC](https://discuss.elastic.co/t/displaying-geo-data-on-tile-map/29528 "2015-09-18T01:34:35Z")

</div>

I have the following logstash filter configuration, wherein the input is a JSON file which already has latitude and longitude data. When I index the data, in the document, I do find attributes of longitude, and latitude.…

---

## [Using logstash to reindex Elasticsearch](https://discuss.elastic.co/t/using-logstash-to-reindex-elasticsearch/29493)

<div class="topic-metadata">

**Author:** [@Ramdev\_Wudali](https://discuss.elastic.co/u/Ramdev_Wudali)\
**Replies:** 1\
**Last updated:** [September 17, 2015, 10:32pm UTC](https://discuss.elastic.co/t/using-logstash-to-reindex-elasticsearch/29493 "2015-09-17T22:32:43Z")

</div>

I recently read DavidPilato's blog post : http://david.pilato.fr/blog/2015/05/20/reindex-elasticsearch-with-logstash/ Its a cool thing you can do, and for the most part it works just like David mentioned except for some …

---

## [Stalled pipeline breaks source file with logrotation](https://discuss.elastic.co/t/stalled-pipeline-breaks-source-file-with-logrotation/28642)

<div class="topic-metadata">

**Author:** [@lane](https://discuss.elastic.co/u/lane)\
**Replies:** 3\
**Last updated:** [September 17, 2015, 6:46pm UTC](https://discuss.elastic.co/t/stalled-pipeline-breaks-source-file-with-logrotation/28642 "2015-09-17T18:46:05Z")

</div>

This system is running in a Production environment so I wont cause the error but if it happens again I'll try to get more info. This is what I do have. I am running logstash 1.5 on Redhat 6 with the a file input and Re…

---

## [AVAYA CDR analyses with ELK](https://discuss.elastic.co/t/avaya-cdr-analyses-with-elk/29374)

<div class="topic-metadata">

**Author:** [@Karl\_Trasschaert](https://discuss.elastic.co/u/Karl_Trasschaert)\
**Replies:** 9\
**Last updated:** [September 17, 2015, 2:01pm UTC](https://discuss.elastic.co/t/avaya-cdr-analyses-with-elk/29374 "2015-09-17T14:01:22Z")

</div>

Hi, I've setup log stash to receive CDR from a avaya pabx. Iv'e used the filter bellow: filter { if \[type\] == "cdr" { csv { separator =\> "," columns =\> \[ "call Start", "Connected Time…

---

## [Specify routing in Logstash](https://discuss.elastic.co/t/specify-routing-in-logstash/29458)

<div class="topic-metadata">

**Author:** [@ashwintumma](https://discuss.elastic.co/u/ashwintumma)\
**Replies:** 2\
**Last updated:** [September 17, 2015, 9:59am UTC](https://discuss.elastic.co/t/specify-routing-in-logstash/29458 "2015-09-17T09:59:58Z")

</div>

I wanted to store my data on different shards based on some field value. For example, geo-sharding is something which I am looking for. All my records with continent value 'NA' should go to shard-1, North America; 'EU' s…

---

## [Logstash ruby event question?](https://discuss.elastic.co/t/logstash-ruby-event-question/28738)

<div class="topic-metadata">

**Author:** [@thoma](https://discuss.elastic.co/u/thoma)\
**Replies:** 2\
**Last updated:** [September 17, 2015, 8:04am UTC](https://discuss.elastic.co/t/logstash-ruby-event-question/28738 "2015-09-17T08:04:23Z")

</div>

hi,everyone have a question? How to use logstash filter ruby event , is required to understand the ruby language? thanks

---

## [\[ANN\] Logstash 2.0.0-beta1 Released](https://discuss.elastic.co/t/ann-logstash-2-0-0-beta1-released/29444)

<div class="topic-metadata">

**Author:** [@andrewvc](https://discuss.elastic.co/u/andrewvc)\
**Replies:** 0\
**Last updated:** [September 16, 2015, 9:16pm UTC](https://discuss.elastic.co/t/ann-logstash-2-0-0-beta1-released/29444 "2015-09-16T21:16:45Z")

</div>

We're glad to announce #Logstash 2.0.0-beta1. Better performance and easier to work with #Elasticsearch than ever! http://go.es.io/1JciXlZ We've got some large changes to the way Elasticsearch integration works, as we…

---

## [Tcp output not working](https://discuss.elastic.co/t/tcp-output-not-working/29425)

<div class="topic-metadata">

**Author:** [@trekr5](https://discuss.elastic.co/u/trekr5)\
**Replies:** 1\
**Last updated:** [September 16, 2015, 5:56pm UTC](https://discuss.elastic.co/t/tcp-output-not-working/29425 "2015-09-16T17:56:43Z")

</div>

Hello, I'd like to send http logs through tcp from one logstash A (output) to another (logstash B) (input) with the following configuration:- logstash A output { tcp { host =\> "xx.xx.xx.xx…

---

## [Using Elasticsearch output for Logstash to send logs to elasticsearch](https://discuss.elastic.co/t/using-elasticsearch-output-for-logstash-to-send-logs-to-elasticsearch/29337)

<div class="topic-metadata">

**Author:** [@Kaufusihm](https://discuss.elastic.co/u/Kaufusihm)\
**Replies:** 7\
**Last updated:** [September 16, 2015, 4:17pm UTC](https://discuss.elastic.co/t/using-elasticsearch-output-for-logstash-to-send-logs-to-elasticsearch/29337 "2015-09-16T16:17:46Z")

</div>

I have a logstash central linux machine and an Elastsearch linux machine. I am trying to send logstash files to elasticsearch using the elasticsearch output... Here is the configuration file in logstash using the ES ou…

---

## [Logstash not getting "message" from log file input](https://discuss.elastic.co/t/logstash-not-getting-message-from-log-file-input/29333)

<div class="topic-metadata">

**Author:** [@Jtc](https://discuss.elastic.co/u/Jtc)\
**Replies:** 6\
**Last updated:** [September 16, 2015, 3:52pm UTC](https://discuss.elastic.co/t/logstash-not-getting-message-from-log-file-input/29333 "2015-09-16T15:52:01Z")

</div>

If I start Logstash with -f /etc/logstash/conf.d then one of my conf files (windowslogs.conf; whose job it is to read and parse Windows log files forwarded by NXlog on Windows hosts) does not work. Logstash recognizes t…

---

## [\[ANN\] Logstash HTTP Poller Input Released!](https://discuss.elastic.co/t/ann-logstash-http-poller-input-released/26522)

<div class="topic-metadata">

**Author:** [@andrewvc](https://discuss.elastic.co/u/andrewvc)\
**Replies:** 2\
**Last updated:** [September 16, 2015, 3:35pm UTC](https://discuss.elastic.co/t/ann-logstash-http-poller-input-released/26522 "2015-09-16T15:35:52Z")

</div>

Hi all, we've just released a new logstash input plugin: HTTP Poller. This plugin makes it easy to repeatedly hit URLs and turn their output into events, as well as provide performance and other data about URLs. Full A…

---

## [JMX input plugin](https://discuss.elastic.co/t/jmx-input-plugin/29417)

<div class="topic-metadata">

**Author:** [@tmo\_bgc](https://discuss.elastic.co/u/tmo_bgc)\
**Replies:** 0\
**Last updated:** [September 16, 2015, 2:51pm UTC](https://discuss.elastic.co/t/jmx-input-plugin/29417 "2015-09-16T14:51:31Z")

</div>

Hi Everyone, My apologies as I am new to Logstash. I am attempting to use the JMX input plugin and hoping to get some help. The JMX plugin produces a LogStash Event object. Is there a filter, or a solution out of …

---

## [Severity\_label not available with tcp input](https://discuss.elastic.co/t/severity-label-not-available-with-tcp-input/25720)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 4\
**Last updated:** [September 16, 2015, 2:40pm UTC](https://discuss.elastic.co/t/severity-label-not-available-with-tcp-input/25720 "2015-09-16T14:40:17Z")

</div>

Hello, I'm having an issue with an Infoblox filter I'm working on. As I can't use the default syslog filter, I have to use tcp input. This is working fine except for one part and that is the severity\_label not being av…

---

## [Output from logstash A into input of logstash B over tcp](https://discuss.elastic.co/t/output-from-logstash-a-into-input-of-logstash-b-over-tcp/29161)

<div class="topic-metadata">

**Author:** [@trekr5](https://discuss.elastic.co/u/trekr5)\
**Replies:** 3\
**Last updated:** [September 16, 2015, 2:06pm UTC](https://discuss.elastic.co/t/output-from-logstash-a-into-input-of-logstash-b-over-tcp/29161 "2015-09-16T14:06:04Z")

</div>

Hello, I'm hoping someone can help me. I'm trying to output data over tcp from one logstash (logstash A) into the input of another (logstash B). These are my config files from logstash A:- output { tcp { …

---

## [Speed up LSF](https://discuss.elastic.co/t/speed-up-lsf/29328)

<div class="topic-metadata">

**Author:** [@vmcano](https://discuss.elastic.co/u/vmcano)\
**Replies:** 2\
**Last updated:** [September 16, 2015, 1:59pm UTC](https://discuss.elastic.co/t/speed-up-lsf/29328 "2015-09-16T13:59:19Z")

</div>

I am using LSF to send logs that are written in a file. The amount of data written is very large (around 5 millions) and I'd like to send it quickly. The problem I am facing is that LSF sends information quite slowly and…

---

## [Parse verbose GC log](https://discuss.elastic.co/t/parse-verbose-gc-log/2714)

<div class="topic-metadata">

**Author:** [@MalcyB](https://discuss.elastic.co/u/MalcyB)\
**Replies:** 1\
**Last updated:** [September 16, 2015, 12:35pm UTC](https://discuss.elastic.co/t/parse-verbose-gc-log/2714 "2015-09-16T12:35:18Z")

</div>

I'm looking for assistance in attempting to parse a verbose Java GC log file using Logstash. My JVM parameters are: -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintTenuringDistribut…

---

## [How to duplicate message in 2 elasticsearch index](https://discuss.elastic.co/t/how-to-duplicate-message-in-2-elasticsearch-index/29403)

<div class="topic-metadata">

**Author:** [@Clood](https://discuss.elastic.co/u/Clood)\
**Replies:** 0\
**Last updated:** [September 16, 2015, 12:24pm UTC](https://discuss.elastic.co/t/how-to-duplicate-message-in-2-elasticsearch-index/29403 "2015-09-16T12:24:47Z")

</div>

I have one input and i want to output it in 2 differents elasticsearch indexes The fields in the 2 indexes must be different : input field1 field2 field3 field3 output index1 : field1, field2 index2 : field1, field…

---

## [File path config file for logstash](https://discuss.elastic.co/t/file-path-config-file-for-logstash/29396)

<div class="topic-metadata">

**Author:** [@Navneet\_Mathpal](https://discuss.elastic.co/u/Navneet_Mathpal)\
**Replies:** 1\
**Last updated:** [September 16, 2015, 12:06pm UTC](https://discuss.elastic.co/t/file-path-config-file-for-logstash/29396 "2015-09-16T12:06:14Z")

</div>

Hi , Is it possible in logstash that, instead of giving the hard-coded file path , I can create a config file where I will have all my paths stored , and if I need to change the file path I can change it in that config…

---

## [Specify data type IP in logstash](https://discuss.elastic.co/t/specify-data-type-ip-in-logstash/29384)

<div class="topic-metadata">

**Author:** [@Hayder\_Abbass](https://discuss.elastic.co/u/Hayder_Abbass)\
**Replies:** 1\
**Last updated:** [September 16, 2015, 11:40am UTC](https://discuss.elastic.co/t/specify-data-type-ip-in-logstash/29384 "2015-09-16T11:40:44Z")

</div>

Hello, We are pushing data in ElasticSearch via logstash. The issue is that for the IP address, it is being stored as a string rather as an IP data type. Is it possible to specify it via grok? I have tried the follow c…

---

## [Parsing xml document using xpath](https://discuss.elastic.co/t/parsing-xml-document-using-xpath/29320)

<div class="topic-metadata">

**Author:** [@ushadatt](https://discuss.elastic.co/u/ushadatt)\
**Replies:** 5\
**Last updated:** [September 16, 2015, 11:23am UTC](https://discuss.elastic.co/t/parsing-xml-document-using-xpath/29320 "2015-09-16T11:23:30Z")

</div>

I am trying to parse the following xml data using logstash.. I am able to do it for a single document..But when I am increasing number of documents, its not working.. \<Book:Body\> \<Book:Head\> \<bookname\>Book:…

---

## [Create monthly indexes based on event attribute](https://discuss.elastic.co/t/create-monthly-indexes-based-on-event-attribute/29372)

<div class="topic-metadata">

**Author:** [@karasmeitar](https://discuss.elastic.co/u/karasmeitar)\
**Replies:** 2\
**Last updated:** [September 16, 2015, 9:31am UTC](https://discuss.elastic.co/t/create-monthly-indexes-based-on-event-attribute/29372 "2015-09-16T09:31:43Z")

</div>

Hi All, can i perform JODA functions in the output section on other attributes then timestamp(%{+YYYY.MM})? i need to create indexes base on couple of attributes in my event and i can't use only the timestamp.

---

## [LOGSTASH / Kibana4 - Question](https://discuss.elastic.co/t/logstash-kibana4-question/29348)

<div class="topic-metadata">

**Author:** [@Luis\_Lacayo](https://discuss.elastic.co/u/Luis_Lacayo)\
**Replies:** 6\
**Last updated:** [September 16, 2015, 4:36am UTC](https://discuss.elastic.co/t/logstash-kibana4-question/29348 "2015-09-16T04:36:07Z")

</div>

I have a question, I am trying to graph application response times on NGINX logs. I am trying to graph the response time base on a field called request\_duration. My logs look like this: 216.165.152.226 - - \[09/Sep…

---

## [How to install http\_pollar plugin manually?](https://discuss.elastic.co/t/how-to-install-http-pollar-plugin-manually/29306)

<div class="topic-metadata">

**Author:** [@RohanKumbhar](https://discuss.elastic.co/u/RohanKumbhar)\
**Replies:** 2\
**Last updated:** [September 15, 2015, 10:17pm UTC](https://discuss.elastic.co/t/how-to-install-http-pollar-plugin-manually/29306 "2015-09-15T22:17:17Z")

</div>

How to install http\_pollar plugin manually in Logstash?

---

## [Performance grok vs mutate on finding message level](https://discuss.elastic.co/t/performance-grok-vs-mutate-on-finding-message-level/29259)

<div class="topic-metadata">

**Author:** [@michaellizhou](https://discuss.elastic.co/u/michaellizhou)\
**Replies:** 1\
**Last updated:** [September 15, 2015, 9:56pm UTC](https://discuss.elastic.co/t/performance-grok-vs-mutate-on-finding-message-level/29259 "2015-09-15T21:56:41Z")

</div>

I have a log that is filled with nonsense data. So I am keeping it simple with a grok match only date than greedydata everything else. Halfway into the message I am given a message level i.e. info, error, ... that I need…

---

## [Logstash File Input not setting 'type'](https://discuss.elastic.co/t/logstash-file-input-not-setting-type/29237)

<div class="topic-metadata">

**Author:** [@Luke\_Anderson](https://discuss.elastic.co/u/Luke_Anderson)\
**Replies:** 1\
**Last updated:** [September 15, 2015, 9:54pm UTC](https://discuss.elastic.co/t/logstash-file-input-not-setting-type/29237 "2015-09-15T21:54:22Z")

</div>

Hi, I am using a file input filter in logstash, and setting the 'type' to a custom value, however when logs are sent to elasticsearch the type is displaying as "logs" and not the value that I am setting. This in turn…

---

## [JSON \> Logstash \> ElasticSearch](https://discuss.elastic.co/t/json-logstash-elasticsearch/25544)

<div class="topic-metadata">

**Author:** [@taylorsuk](https://discuss.elastic.co/u/taylorsuk)\
**Replies:** 5\
**Last updated:** [September 15, 2015, 8:32pm UTC](https://discuss.elastic.co/t/json-logstash-elasticsearch/25544 "2015-09-15T20:32:27Z")

</div>

I have had some good info from a user in answer to my question here and am having issues with my config. Basically I would like to import / index my pretty JSON file map one field to not\_analized to my remote ElasticS…

---

## [Logstash 1.5.4 hangs@Logstash startup completed](https://discuss.elastic.co/t/logstash-1-5-4-hangs-logstash-startup-completed/29343)

<div class="topic-metadata">

**Author:** [@Sriram\_Narayanan](https://discuss.elastic.co/u/Sriram_Narayanan)\
**Replies:** 1\
**Last updated:** [September 15, 2015, 7:53pm UTC](https://discuss.elastic.co/t/logstash-1-5-4-hangs-logstash-startup-completed/29343 "2015-09-15T19:53:17Z")

</div>

I am trying to post my log details via logstash. This is how my filter looks input { file { path =\>"/opt/projects/logs/Marketplace.log" start\_position =\> "beginning" } } filter { grok { match =\> \[ "m…

---

## [Filtering data in logstash config file for couchdb](https://discuss.elastic.co/t/filtering-data-in-logstash-config-file-for-couchdb/29144)

<div class="topic-metadata">

**Author:** [@imad](https://discuss.elastic.co/u/imad)\
**Replies:** 4\
**Last updated:** [September 15, 2015, 6:10pm UTC](https://discuss.elastic.co/t/filtering-data-in-logstash-config-file-for-couchdb/29144 "2015-09-15T18:10:45Z")

</div>

I have views in my couchdb databases. WIth logstash config file, can I filter to get only valid documents in my indices in ElasticSearch and not the the views? I have multiple databases in couchdb and I have created indi…

---

## [Finding Difficulties with SSL Certificate verification with Lumberjack,Logstash version 1.5.4](https://discuss.elastic.co/t/finding-difficulties-with-ssl-certificate-verification-with-lumberjack-logstash-version-1-5-4/28219)

<div class="topic-metadata">

**Author:** [@KarthikaAr](https://discuss.elastic.co/u/KarthikaAr)\
**Replies:** 3\
**Last updated:** [September 15, 2015, 12:45pm UTC](https://discuss.elastic.co/t/finding-difficulties-with-ssl-certificate-verification-with-lumberjack-logstash-version-1-5-4/28219 "2015-09-15T12:45:49Z")

</div>

Hi Greetings!! I am trying to connect one Log stash agent to another(Using Logstash 1.5.4). java version: java version "1.8.0\_51" Java(TM) SE Runtime Environment (build 1.8.0\_51-b16) Java HotSpot(TM) 64-Bit S…

---

## [Have couple questions about Logstash configuration](https://discuss.elastic.co/t/have-couple-questions-about-logstash-configuration/28794)

<div class="topic-metadata">

**Author:** [@AlekMarkus](https://discuss.elastic.co/u/AlekMarkus)\
**Replies:** 26\
**Last updated:** [September 15, 2015, 11:36am UTC](https://discuss.elastic.co/t/have-couple-questions-about-logstash-configuration/28794 "2015-09-15T11:36:21Z")

</div>

Hello , i have 1 main server that ElasticSearch+kibana+logstash installed on. and i want to monitor 2 apache servers and 1 firewall with this server, is it possible ? on each server i will install Logstash-Forward…

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1235)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1237)
