# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1161

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1162

---

## [Import data from Teradata using logstash jdbc plugin](https://discuss.elastic.co/t/import-data-from-teradata-using-logstash-jdbc-plugin/39881)

<div class="topic-metadata">

**Author:** [@Himanshu\_Jain1](https://discuss.elastic.co/u/Himanshu_Jain1)\
**Replies:** 1\
**Last updated:** [April 28, 2016, 12:53am UTC](https://discuss.elastic.co/t/import-data-from-teradata-using-logstash-jdbc-plugin/39881 "2016-04-28T00:53:55Z")

</div>

Hi, Could some body please tell me how to use logstash jdbc plugin for teradata? The problem with teradat is it requires two java\_driver\_files to be listed. How to specify two files terajdbc4.jar and tdgssconfig.jar

---

## [Logstash metrics don't make sense](https://discuss.elastic.co/t/logstash-metrics-dont-make-sense/48350)

<div class="topic-metadata">

**Author:** [@Sol\_Lederman](https://discuss.elastic.co/u/Sol_Lederman)\
**Replies:** 4\
**Last updated:** [April 27, 2016, 9:09pm UTC](https://discuss.elastic.co/t/logstash-metrics-dont-make-sense/48350 "2016-04-27T21:09:23Z")

</div>

I have a 1,000 line sample web log file that I run through logstash and I time the run. $ time cat apache\_combined\_log.20160420.1000-lines | ../logstash-2.3.1/bin/logstash -f apache\_logstash.3.conf \> foo real 0m25.6…

---

## [Nest fields more than 2 levels?](https://discuss.elastic.co/t/nest-fields-more-than-2-levels/48585)

<div class="topic-metadata">

**Author:** [@iamthealex](https://discuss.elastic.co/u/iamthealex)\
**Replies:** 2\
**Last updated:** [April 27, 2016, 7:17pm UTC](https://discuss.elastic.co/t/nest-fields-more-than-2-levels/48585 "2016-04-27T19:17:46Z")

</div>

Can logstash nest fields more than two levels? I wanted to use \[http\]\[response\]\[content-length\], but the output field becomes \[response\]\[content-length\] when I do that in a grok filter.

---

## [Output elascticsearch ( no ssl ) behind nginx SSL](https://discuss.elastic.co/t/output-elascticsearch-no-ssl-behind-nginx-ssl/48418)

<div class="topic-metadata">

**Author:** [@kib](https://discuss.elastic.co/u/kib)\
**Replies:** 1\
**Last updated:** [April 27, 2016, 5:52pm UTC](https://discuss.elastic.co/t/output-elascticsearch-no-ssl-behind-nginx-ssl/48418 "2016-04-27T17:52:46Z")

</div>

hi, i 'm using elasticsearch 2.3.1 and logstash 2.3.1-1 from rpm under rh es 5.5 1/ server data nginx SSL=\> elasticsearch 9200 ( without auth or ssl ) 2/ client logstash crash curl https://xxx.xxx.xxx.xxx -k { "n…

---

## [How to tune and check the status of the logstash config execution](https://discuss.elastic.co/t/how-to-tune-and-check-the-status-of-the-logstash-config-execution/48469)

<div class="topic-metadata">

**Author:** [@pandith\_asrar](https://discuss.elastic.co/u/pandith_asrar)\
**Replies:** 2\
**Last updated:** [April 27, 2016, 3:52pm UTC](https://discuss.elastic.co/t/how-to-tune-and-check-the-status-of-the-logstash-config-execution/48469 "2016-04-27T15:52:05Z")

</div>

Hi Magnus, I have just started exploring Logstash. Currently trying to load a log file to elasticsearch, but it's taking a long time to create index. Please help me understand how can we tune the config of the logstash. …

---

## [Lovebeat installation](https://discuss.elastic.co/t/lovebeat-installation/48440)

<div class="topic-metadata">

**Author:** [@Luke3](https://discuss.elastic.co/u/Luke3)\
**Replies:** 2\
**Last updated:** [April 27, 2016, 1:27pm UTC](https://discuss.elastic.co/t/lovebeat-installation/48440 "2016-04-27T13:27:13Z")

</div>

Hi. My intent is monitoring the health of logstash using heartbeat and lovebeat. The environment is under proxy and the npm is alredy set to work under proxy. Are the following commands correct? At the end I'm unable to…

---

## [Logstash, SNMP don't receive traps](https://discuss.elastic.co/t/logstash-snmp-dont-receive-traps/48429)

<div class="topic-metadata">

**Author:** [@Vincent\_Vost](https://discuss.elastic.co/u/Vincent_Vost)\
**Replies:** 1\
**Last updated:** [April 27, 2016, 12:29pm UTC](https://discuss.elastic.co/t/logstash-snmp-dont-receive-traps/48429 "2016-04-27T12:29:02Z")

</div>

Hi everybody :slight\_smile: I try to use SNMP with logstash, but my configuration or something is wrong and I don't find any information who can help me :frowning: First : I don't understand how it should work, snmptr…

---

## [Can't show geopoint in a tile map](https://discuss.elastic.co/t/cant-show-geopoint-in-a-tile-map/48432)

<div class="topic-metadata">

**Author:** [@Josep\_Bacardit](https://discuss.elastic.co/u/Josep_Bacardit)\
**Replies:** 3\
**Last updated:** [April 27, 2016, 10:57am UTC](https://discuss.elastic.co/t/cant-show-geopoint-in-a-tile-map/48432 "2016-04-27T10:57:58Z")

</div>

Hello, I'm using logstash 2.3.1, elasticsearch 2.3.1 and kibi 0.3.2. I have problems visualizing locations in a map with kibi. I have the following configuration in logstash: input { file { path =\> "/opt/logstash-2…

---

## [How to change the fields to 'not-analyzed'?](https://discuss.elastic.co/t/how-to-change-the-fields-to-not-analyzed/48506)

<div class="topic-metadata">

**Author:** [@PKA](https://discuss.elastic.co/u/PKA)\
**Replies:** 6\
**Last updated:** [April 27, 2016, 10:05am UTC](https://discuss.elastic.co/t/how-to-change-the-fields-to-not-analyzed/48506 "2016-04-27T10:05:36Z")

</div>

I am a newbie, pls help me with doing this. In Kibana, all my strings are getting split on the blank space character, whenever I choose 'Terms' option. Reading some threads on forums I understood that we need to change…

---

## [Logstash all plugins](https://discuss.elastic.co/t/logstash-all-plugins/48419)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 4\
**Last updated:** [April 27, 2016, 8:54am UTC](https://discuss.elastic.co/t/logstash-all-plugins/48419 "2016-04-27T08:54:34Z")

</div>

Hi, I found Logstash 2.2.0 All Plugins. However there is no relase notes. https://www.elastic.co/downloads/past-releases/logstash-2-2-0-all-plugins Can anybody tell me the usage of this? Is it the logstash with all plu…

---

## [Logstash not showing out put again](https://discuss.elastic.co/t/logstash-not-showing-out-put-again/48279)

<div class="topic-metadata">

**Author:** [@sarbjeet](https://discuss.elastic.co/u/sarbjeet)\
**Replies:** 12\
**Last updated:** [April 27, 2016, 7:44am UTC](https://discuss.elastic.co/t/logstash-not-showing-out-put-again/48279 "2016-04-27T07:44:18Z")

</div>

hi... when i run logstash config file .it display output but when we run it again then no output displayed. its new for me. i installed logstash 2.2,elasticsearch 2.2 and kibana 1.4. plz reply soon .its urgent.

---

## [Exception\_access\_violation](https://discuss.elastic.co/t/exception-access-violation/46496)

<div class="topic-metadata">

**Author:** [@diwertowski](https://discuss.elastic.co/u/diwertowski)\
**Replies:** 3\
**Last updated:** [April 27, 2016, 6:55am UTC](https://discuss.elastic.co/t/exception-access-violation/46496 "2016-04-27T06:55:29Z")

</div>

Hi, I get this error, after Logstash (Shipper) runs for a while: A fatal error has been detected by the Java Runtime Environment: EXCEPTION\_ACCESS\_VIOLATION (0xc0000005) at pc=0x000000006e4c2105, pid=9052, tid=29460 …

---

## [Error: starting logstash after installation](https://discuss.elastic.co/t/error-starting-logstash-after-installation/48407)

<div class="topic-metadata">

**Author:** [@Dilip\_Dwivedi](https://discuss.elastic.co/u/Dilip_Dwivedi)\
**Replies:** 1\
**Last updated:** [April 27, 2016, 6:03am UTC](https://discuss.elastic.co/t/error-starting-logstash-after-installation/48407 "2016-04-27T06:03:00Z")

</div>

bin/logstash -e 'input { stdin { } } output { stdout {} }' /bin/which: invalid option -- 'X' /bin/which: invalid option -- 'X' /bin/which: invalid option -- ':' /bin/which: invalid option -- '+' /bin/which: invalid optio…

---

## [Creating logstash config file for csv with multiple date fields](https://discuss.elastic.co/t/creating-logstash-config-file-for-csv-with-multiple-date-fields/48315)

<div class="topic-metadata">

**Author:** [@PKA](https://discuss.elastic.co/u/PKA)\
**Replies:** 8\
**Last updated:** [April 27, 2016, 5:56am UTC](https://discuss.elastic.co/t/creating-logstash-config-file-for-csv-with-multiple-date-fields/48315 "2016-04-27T05:56:47Z")

</div>

I have a csv file (UTF-8), which I have stored as .txt. It has multiple date fields. I want to view the date field types in Kibana as well as 'dates'. However, I am always getting "Error parsing csv" message. Pls help. N…

---

## [Logstash csv upload not working](https://discuss.elastic.co/t/logstash-csv-upload-not-working/48378)

<div class="topic-metadata">

**Author:** [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Replies:** 9\
**Last updated:** [April 27, 2016, 4:05am UTC](https://discuss.elastic.co/t/logstash-csv-upload-not-working/48378 "2016-04-27T04:05:19Z")

</div>

Using below config file input { file { path =\> "C:\\logstash\\bin\\saptest1.csv" type =\> "core2" start\_position =\> "beginning" } } filter { csv { columns =\> \["Material",…

---

## [Cannot flush pipeline logstash hangs](https://discuss.elastic.co/t/cannot-flush-pipeline-logstash-hangs/48487)

<div class="topic-metadata">

**Author:** [@wmcdonald](https://discuss.elastic.co/u/wmcdonald)\
**Replies:** 1\
**Last updated:** [April 26, 2016, 10:58pm UTC](https://discuss.elastic.co/t/cannot-flush-pipeline-logstash-hangs/48487 "2016-04-26T22:58:55Z")

</div>

I am running logstash 2.3.1 on solaris 10 with java version "1.7.0\_55". $ bin/logstash -f config.txt -w 16 --log ./logs/logstash.log -vv It loads the config file fine, reads in a lot of data but then tries to put a flush…

---

## [Cant assign an nested ip from a json input to geoip](https://discuss.elastic.co/t/cant-assign-an-nested-ip-from-a-json-input-to-geoip/48292)

<div class="topic-metadata">

**Author:** [@avisri](https://discuss.elastic.co/u/avisri)\
**Replies:** 2\
**Last updated:** [April 26, 2016, 8:56pm UTC](https://discuss.elastic.co/t/cant-assign-an-nested-ip-from-a-json-input-to-geoip/48292 "2016-04-26T20:56:25Z")

</div>

Run this command $echo '{ "columns" : { "remote\_address": "8.8.8.8"} }' | /opt/logstash/bin/logstash --debug -e 'filter { json{ source =\>message } geoip { source =\> "%{\[columns\]\[remote\_address\]}" } } snipped de…

---

## [Logstash plugin development](https://discuss.elastic.co/t/logstash-plugin-development/25476)

<div class="topic-metadata">

**Author:** [@karthikbox](https://discuss.elastic.co/u/karthikbox)\
**Replies:** 4\
**Last updated:** [April 26, 2016, 8:05pm UTC](https://discuss.elastic.co/t/logstash-plugin-development/25476 "2016-04-26T20:05:28Z")

</div>

Hi all, I'm trying to develop a filter plugin for logstash-1.5. I've a cloned a community plugin repo(elapsed) from github. Then i execute "bundle install" to install dependencies, at which point i get an error message…

---

## [How do you break up long lines in logstash.conf? \[answered\]](https://discuss.elastic.co/t/how-do-you-break-up-long-lines-in-logstash-conf-answered/48270)

<div class="topic-metadata">

**Author:** [@kwmullet](https://discuss.elastic.co/u/kwmullet)\
**Replies:** 3\
**Last updated:** [April 26, 2016, 7:07pm UTC](https://discuss.elastic.co/t/how-do-you-break-up-long-lines-in-logstash-conf-answered/48270 "2016-04-26T19:07:41Z")

</div>

I'm trying to use logstash to pull some data from a REST endpoint. Some of the GET queries will have lines that are quite long. I'd like to break up really long lines like in this example... input { http\_poller {…

---

## [Logstash grok](https://discuss.elastic.co/t/logstash-grok/44795)

<div class="topic-metadata">

**Author:** [@lester015](https://discuss.elastic.co/u/lester015)\
**Replies:** 11\
**Last updated:** [April 26, 2016, 6:17pm UTC](https://discuss.elastic.co/t/logstash-grok/44795 "2016-04-26T18:17:02Z")

</div>

hi everyone, my test.log contents like bellow:"AsynExecutor.contractSyncScheduler\>\>\>\> 2016-03-17 04:00:03,247 INFO \[cn.cmri.pds.neusoft.ContractSyncService\] - \<【PageInquiryAccountBalanceContectSrv】,success\>" my …

---

## [Get latest log file](https://discuss.elastic.co/t/get-latest-log-file/48089)

<div class="topic-metadata">

**Author:** [@impiyush](https://discuss.elastic.co/u/impiyush)\
**Replies:** 7\
**Last updated:** [April 26, 2016, 4:47pm UTC](https://discuss.elastic.co/t/get-latest-log-file/48089 "2016-04-26T16:47:55Z")

</div>

I am trying to get logs from a SQL Server DB into ElasticSearch using LogStash. All the setup works fine and I am also able to see the logs in ES. As the DB is updated periodically, so I want to get the latest logs on an…

---

## [\[SOLVED\] Strange grokparsefailure behavior](https://discuss.elastic.co/t/solved-strange-grokparsefailure-behavior/48402)

<div class="topic-metadata">

**Author:** [@axelfelix](https://discuss.elastic.co/u/axelfelix)\
**Replies:** 3\
**Last updated:** [April 26, 2016, 3:51pm UTC](https://discuss.elastic.co/t/solved-strange-grokparsefailure-behavior/48402 "2016-04-26T15:51:06Z")

</div>

Hi all, Just to share with you a strange grokparsefailure behavior and I try to understand why... Logstash Input: input { file { path =\> "/etc/logstash/test-2016-04-17-05.log" start\_position =\> beginni…

---

## [Logstash ignoring parts of RabbitMQ message](https://discuss.elastic.co/t/logstash-ignoring-parts-of-rabbitmq-message/48438)

<div class="topic-metadata">

**Author:** [@simonl](https://discuss.elastic.co/u/simonl)\
**Replies:** 0\
**Last updated:** [April 26, 2016, 2:08pm UTC](https://discuss.elastic.co/t/logstash-ignoring-parts-of-rabbitmq-message/48438 "2016-04-26T14:08:23Z")

</div>

Hello, I'm new to elastic and logstash and I'm, not sure what's happening here. I have multiple JSON documents in one Rabbit MQ message. Logstash pops the queue sees the first document and ignores anything following…

---

## [How to add dependency for existing gems](https://discuss.elastic.co/t/how-to-add-dependency-for-existing-gems/48343)

<div class="topic-metadata">

**Author:** [@BINLEI\_XUE](https://discuss.elastic.co/u/BINLEI_XUE)\
**Replies:** 1\
**Last updated:** [April 26, 2016, 12:13pm UTC](https://discuss.elastic.co/t/how-to-add-dependency-for-existing-gems/48343 "2016-04-26T12:13:34Z")

</div>

Hi All, I am new to jruby I want to add gssapi support for logstash-output-elasticsearch so I modify some code on elasticsearch-transport gem export GEM\_HOME=$LOGSTASH\_HOME/vendor/bundle/jruby/1.9 export GEM\_PAT…

---

## [I'd like to add tag related to the incoming subnet](https://discuss.elastic.co/t/id-like-to-add-tag-related-to-the-incoming-subnet/48173)

<div class="topic-metadata">

**Author:** [@gboucha](https://discuss.elastic.co/u/gboucha)\
**Replies:** 2\
**Last updated:** [April 26, 2016, 9:17am UTC](https://discuss.elastic.co/t/id-like-to-add-tag-related-to-the-incoming-subnet/48173 "2016-04-26T09:17:45Z")

</div>

We have many network appliances that send syslog to Logstash. We'd like to add a tag describing the appliance's subnet name or other string concerning the source appliance. Is there a way to do that?

---

## [XML filter](https://discuss.elastic.co/t/xml-filter/48133)

<div class="topic-metadata">

**Author:** [@meons](https://discuss.elastic.co/u/meons)\
**Replies:** 2\
**Last updated:** [April 26, 2016, 8:56am UTC](https://discuss.elastic.co/t/xml-filter/48133 "2016-04-26T08:56:25Z")

</div>

Hello, I have to parse some xml files (with xml filter) and store each child item (car) as a document in Elasticsearch but I don't see how I can do that. My xml file could containt n child items (around 100-200 per x…

---

## [Logstash not working on Windows](https://discuss.elastic.co/t/logstash-not-working-on-windows/47022)

<div class="topic-metadata">

**Author:** [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Replies:** 24\
**Last updated:** [April 26, 2016, 8:46am UTC](https://discuss.elastic.co/t/logstash-not-working-on-windows/47022 "2016-04-26T08:46:04Z")

</div>

Sorry if I'm asking a very basic question. I have setup ELK on windows 7. I am trying to get twitter feed using below config file input { twitter { # add your data consumer\_key =\> "" consumer\_secret =\>"" oauth\_toke…

---

## [Additional field with special data](https://discuss.elastic.co/t/additional-field-with-special-data/48304)

<div class="topic-metadata">

**Author:** [@darkelf](https://discuss.elastic.co/u/darkelf)\
**Replies:** 2\
**Last updated:** [April 26, 2016, 6:48am UTC](https://discuss.elastic.co/t/additional-field-with-special-data/48304 "2016-04-26T06:48:46Z")

</div>

Hello, I'm new with elk and want set up an elk stack for varnish logs. My logstash filter setup looks like this: filter { if \[type\] == "varnish" { grok { patterns\_dir =\> \["/etc/logstash/patterns"\] match =\> { "me…

---

## [Parsing Console Logs](https://discuss.elastic.co/t/parsing-console-logs/48380)

<div class="topic-metadata">

**Author:** [@maher](https://discuss.elastic.co/u/maher)\
**Replies:** 1\
**Last updated:** [April 26, 2016, 5:34am UTC](https://discuss.elastic.co/t/parsing-console-logs/48380 "2016-04-26T05:34:02Z")

</div>

Hi, i need to parse some logs from a console. and as it is shown next the log message is not uniforme. and what i need to grok is the last message for example: " --\> Wrapper Started as Console". STATUS | wrapper |…

---

## [Nxlog can not connet to logstash](https://discuss.elastic.co/t/nxlog-can-not-connet-to-logstash/48377)

<div class="topic-metadata">

**Author:** [@Inbeo\_Beo](https://discuss.elastic.co/u/Inbeo_Beo)\
**Replies:** 1\
**Last updated:** [April 26, 2016, 5:31am UTC](https://discuss.elastic.co/t/nxlog-can-not-connet-to-logstash/48377 "2016-04-26T05:31:35Z")

</div>

Hi, I have problem below: i have 02 Servers with - IP Ser1: 10.151.130.119 --\> installed ELK - IP Ser2: 10.151.130.110 --\> OS is Win Server 2008r2 and nxlog is installed in there I have a file nxlog configure …

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1160)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1162)
