# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1033

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1034

---

## [Kibana has no results](https://discuss.elastic.co/t/kibana-has-no-results/75554)

<div class="topic-metadata">

**Author:** [@kmrychl](https://discuss.elastic.co/u/kmrychl)\
**Replies:** 5\
**Last updated:** [February 20, 2017, 8:49pm UTC](https://discuss.elastic.co/t/kibana-has-no-results/75554 "2017-02-20T20:49:18Z")

</div>

My kibana has no results and I can't figure out why. I'm not sure if my filebeat is not forwarding to logstash or if my logstash is not going to elastic search. Everything is configured correctly from what I can tell. Th…

---

## [Logstash stopped logging, but I don't see errors](https://discuss.elastic.co/t/logstash-stopped-logging-but-i-dont-see-errors/75538)

<div class="topic-metadata">

**Author:** [@ZillaG](https://discuss.elastic.co/u/ZillaG)\
**Replies:** 5\
**Last updated:** [February 20, 2017, 8:22pm UTC](https://discuss.elastic.co/t/logstash-stopped-logging-but-i-dont-see-errors/75538 "2017-02-20T20:22:46Z")

</div>

I have an ELK stack. Logstash v.2.3.4 and Kibana v4.5.4 services are running on one server. I have another box running Elasticsearch v2.4.1 in client mode, and then a 3-box Elasticsearch v2.4.1 cluster running in master …

---

## [Issues when enabling TLS on Logstash](https://discuss.elastic.co/t/issues-when-enabling-tls-on-logstash/75566)

<div class="topic-metadata">

**Author:** [@prodrg](https://discuss.elastic.co/u/prodrg)\
**Replies:** 2\
**Last updated:** [February 20, 2017, 8:09pm UTC](https://discuss.elastic.co/t/issues-when-enabling-tls-on-logstash/75566 "2017-02-20T20:09:43Z")

</div>

Greetings, I am configuring the stack to work on TLS/SSL. I configured SSL on both ES and Kibana and it works fine. Now, when I try to configure Logstash, I cannot get it to connect to ES. The following error appears: …

---

## [Grokparsefailure on parsing date time field](https://discuss.elastic.co/t/grokparsefailure-on-parsing-date-time-field/75488)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 1\
**Last updated:** [February 20, 2017, 7:39pm UTC](https://discuss.elastic.co/t/grokparsefailure-on-parsing-date-time-field/75488 "2017-02-20T19:39:10Z")

</div>

I have a timefield like; \[08/Feb/2017:07:09:47 +0000\] and I use the pattern in grok match like; \\\[(?\<date\_and\_time\>%{MONTHDAY}/%{MONTH}/20%{YEAR}:%{HOUR}:?%{MINUTE}(?::?%{SECOND}) ZZZ)\\\] which is giving me a grokpa…

---

## [Aggregate Function not working in Logstash version 5.0](https://discuss.elastic.co/t/aggregate-function-not-working-in-logstash-version-5-0/75714)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 1\
**Last updated:** [February 20, 2017, 12:15pm UTC](https://discuss.elastic.co/t/aggregate-function-not-working-in-logstash-version-5-0/75714 "2017-02-20T12:15:41Z")

</div>

Hi, In previous i was using the version 2.3 for logstash in that aggregation was worked fine. Few days back i changed my ELK into latest version. Now im using logstash 5.0.0 in that aggregate(2.5.1) is not working anyone…

---

## [Do Logstash monitors the folders?](https://discuss.elastic.co/t/do-logstash-monitors-the-folders/75730)

<div class="topic-metadata">

**Author:** [@rlv\_praveen](https://discuss.elastic.co/u/rlv_praveen)\
**Replies:** 4\
**Last updated:** [February 20, 2017, 1:47pm UTC](https://discuss.elastic.co/t/do-logstash-monitors-the-folders/75730 "2017-02-20T13:47:23Z")

</div>

Hi All, I have a special scenario in my application i am using log4j for logging purpose. The maximum size of the log file which i configured is 5 MB , if the file reached to 5 MB it renames the file and take a back up…

---

## [Convert @timestamp to epoch](https://discuss.elastic.co/t/convert-timestamp-to-epoch/64522)

<div class="topic-metadata">

**Author:** [@rivaanbechan](https://discuss.elastic.co/u/rivaanbechan)\
**Replies:** 4\
**Last updated:** [February 20, 2017, 1:34pm UTC](https://discuss.elastic.co/t/convert-timestamp-to-epoch/64522 "2017-02-20T13:34:41Z")

</div>

Hi, I need to convert @timestamp to epoch and add this new field to the event. So far I can only add a new field with the content of "@timestamp". filter { mutate { add\_field =\> \["epochtime", "%{@ti…

---

## [Consuming data with logstash kafka plugin](https://discuss.elastic.co/t/consuming-data-with-logstash-kafka-plugin/62991)

<div class="topic-metadata">

**Author:** [@jstar](https://discuss.elastic.co/u/jstar)\
**Replies:** 6\
**Last updated:** [February 20, 2017, 12:18pm UTC](https://discuss.elastic.co/t/consuming-data-with-logstash-kafka-plugin/62991 "2017-02-20T12:18:10Z")

</div>

Hi I have a logstash configuration file which is not consume data that I produce with kafka. Basically, here is my configuration input { kafka { topics =\> "mytopic" bootstrap\_servers =\> "zookeeper\_i…

---

## [Logstash don't read conf.d settings file when running as daemon](https://discuss.elastic.co/t/logstash-dont-read-conf-d-settings-file-when-running-as-daemon/50423)

<div class="topic-metadata">

**Author:** [@Giulio](https://discuss.elastic.co/u/Giulio)\
**Replies:** 7\
**Last updated:** [February 20, 2017, 11:22am UTC](https://discuss.elastic.co/t/logstash-dont-read-conf-d-settings-file-when-running-as-daemon/50423 "2017-02-20T11:22:29Z")

</div>

I have alredy read all the previous thread that I found about this problem but they didn't help me so much. Until now, I have always used the -f option to launch logstash but now I must use it as daemon so I have copie…

---

## [Logstash-input-rss Plugin not connect with url](https://discuss.elastic.co/t/logstash-input-rss-plugin-not-connect-with-url/75698)

<div class="topic-metadata">

**Author:** [@jamal](https://discuss.elastic.co/u/jamal)\
**Replies:** 0\
**Last updated:** [February 20, 2017, 9:43am UTC](https://discuss.elastic.co/t/logstash-input-rss-plugin-not-connect-with-url/75698 "2017-02-20T09:43:35Z")

</div>

rss-input plugin have another problem with rss link which start with feeds, here is many link which is start with feed it give me Connection refused error here is the rss link that i use feeds.washingtonpost.com/rss/worl…

---

## [Es\_bulk unique uid creates multiple duplicates](https://discuss.elastic.co/t/es-bulk-unique-uid-creates-multiple-duplicates/75351)

<div class="topic-metadata">

**Author:** [@ISMAELMARTINEZ](https://discuss.elastic.co/u/ISMAELMARTINEZ)\
**Replies:** 9\
**Last updated:** [February 20, 2017, 9:11am UTC](https://discuss.elastic.co/t/es-bulk-unique-uid-creates-multiple-duplicates/75351 "2017-02-20T09:11:43Z")

</div>

Hi, I have run the following logstash and found out it creates duplicates. input { jdbc { jdbc\_connection\_string =\> "jdbc:postgresql://myURLToTheDB" jdbc\_user =\> "myuser" jdbc\_password =\> "mypassw…

---

## [Using logstash-output-email plugin](https://discuss.elastic.co/t/using-logstash-output-email-plugin/75074)

<div class="topic-metadata">

**Author:** [@vdsm](https://discuss.elastic.co/u/vdsm)\
**Replies:** 16\
**Last updated:** [February 20, 2017, 8:38am UTC](https://discuss.elastic.co/t/using-logstash-output-email-plugin/75074 "2017-02-20T08:38:45Z")

</div>

Hi everyone, Before all, sorry for my English, it's not my native language. I try to configure Logstash for sending mail when some specific events coming with the logstash-output-email plugin. I'm using SMTPS mail ser…

---

## [My Newbie questions](https://discuss.elastic.co/t/my-newbie-questions/75636)

<div class="topic-metadata">

**Author:** [@Oliver\_Marshall](https://discuss.elastic.co/u/Oliver_Marshall)\
**Replies:** 1\
**Last updated:** [February 20, 2017, 7:32am UTC](https://discuss.elastic.co/t/my-newbie-questions/75636 "2017-02-20T07:32:11Z")

</div>

Hi all I need an open source solution to allow us to store logs generated by multiple routers, switches and windows servers and workstations. The logs need to be searchable in the event of a compliance query. Is…

---

## [Logstash for cyberoam filtering](https://discuss.elastic.co/t/logstash-for-cyberoam-filtering/75644)

<div class="topic-metadata">

**Author:** [@Ibrahim](https://discuss.elastic.co/u/Ibrahim)\
**Replies:** 8\
**Last updated:** [February 20, 2017, 7:16am UTC](https://discuss.elastic.co/t/logstash-for-cyberoam-filtering/75644 "2017-02-20T07:16:35Z")

</div>

Dear All I have an elk stack used with cyberoam, and I want to parse this message with logstash can you help me please: "\<30\>date=2017-02-19 time=21:59:15 timezone=\\"IST\\" device\_name=\\"CR200iNG\\" device\_id=C20313272882…

---

## [Logstash started but not processing anything](https://discuss.elastic.co/t/logstash-started-but-not-processing-anything/75671)

<div class="topic-metadata">

**Author:** [@Vishnu\_Vijayan](https://discuss.elastic.co/u/Vishnu_Vijayan)\
**Replies:** 3\
**Last updated:** [February 20, 2017, 6:45am UTC](https://discuss.elastic.co/t/logstash-started-but-not-processing-anything/75671 "2017-02-20T06:45:45Z")

</div>

I started Logstash(version 5.2) as service in ubuntu 14.04.When I check Logstash status, it is showing as running.But no messages are appended in Logstash log file(/var/log/logstash/logstash-plain.log saying that it is s…

---

## [Logstash not stopping/restarting](https://discuss.elastic.co/t/logstash-not-stopping-restarting/45249)

<div class="topic-metadata">

**Author:** [@mikeface](https://discuss.elastic.co/u/mikeface)\
**Replies:** 3\
**Last updated:** [February 20, 2017, 6:10am UTC](https://discuss.elastic.co/t/logstash-not-stopping-restarting/45249 "2017-02-20T06:10:36Z")

</div>

I did some searching first, apologies if this has been already covered but I couldn't find it. Running Logstash v2.2.2, on Ubuntu 14.04.3 LT, m3.medium in EC2. When I try to stop or restart, I get: Killing logstash (pi…

---

## [Java Path on logstash but not ES or Kibana (SOLVED)](https://discuss.elastic.co/t/java-path-on-logstash-but-not-es-or-kibana-solved/25169)

<div class="topic-metadata">

**Author:** [@michaellizhou](https://discuss.elastic.co/u/michaellizhou)\
**Replies:** 2\
**Last updated:** [February 20, 2017, 3:11am UTC](https://discuss.elastic.co/t/java-path-on-logstash-but-not-es-or-kibana-solved/25169 "2017-02-20T03:11:36Z")

</div>

Randomly my logstash is not running although my ES and Kibana are. When I run ./bin/logstash just to check I get Could not find any executable java binary. Please install java in your PATH or set JAVA\_HOME. Though I c…

---

## [JDBC Input "sequel\_opts" settings](https://discuss.elastic.co/t/jdbc-input-sequel-opts-settings/75645)

<div class="topic-metadata">

**Author:** [@ggp](https://discuss.elastic.co/u/ggp)\
**Replies:** 0\
**Last updated:** [February 19, 2017, 5:57pm UTC](https://discuss.elastic.co/t/jdbc-input-sequel-opts-settings/75645 "2017-02-19T17:57:01Z")

</div>

can someone share some examples on how to use connection pool settings with "sequel\_opts" for a postgresql database

---

## [Run multiple logstash process with same config?](https://discuss.elastic.co/t/run-multiple-logstash-process-with-same-config/75505)

<div class="topic-metadata">

**Author:** [@ggp](https://discuss.elastic.co/u/ggp)\
**Replies:** 2\
**Last updated:** [February 19, 2017, 5:52pm UTC](https://discuss.elastic.co/t/run-multiple-logstash-process-with-same-config/75505 "2017-02-19T17:52:41Z")

</div>

can we run two process of the same logstash config (input=jdbc, output=es) ? if so how do we manage the coordination and the last\_run\_metadata\_path?

---

## [Connect the agent and agent running task in Logstash (help for parsing)](https://discuss.elastic.co/t/connect-the-agent-and-agent-running-task-in-logstash-help-for-parsing/74786)

<div class="topic-metadata">

**Author:** [@Cap\_Ho](https://discuss.elastic.co/u/Cap_Ho)\
**Replies:** 4\
**Last updated:** [February 19, 2017, 7:08am UTC](https://discuss.elastic.co/t/connect-the-agent-and-agent-running-task-in-logstash-help-for-parsing/74786 "2017-02-19T07:08:56Z")

</div>

Hi all, i am new to logstash and ask for the help in the following condition. i will use a engine to run different java programs. each engine will have a session id and trigger the java program sequentiall…

---

## [Logstash time stamp error](https://discuss.elastic.co/t/logstash-time-stamp-error/75476)

<div class="topic-metadata">

**Author:** [@sabyasachi\_mallick](https://discuss.elastic.co/u/sabyasachi_mallick)\
**Replies:** 1\
**Last updated:** [February 18, 2017, 5:31pm UTC](https://discuss.elastic.co/t/logstash-time-stamp-error/75476 "2017-02-18T17:31:10Z")

</div>

my logstash in utc time zone. when it is loading data timestamp is in below format "@timestamp" =\> "2017-02-17T05:17:51.289Z", but when i am just extracting date from @timestamp field with a ruby code as below ts…

---

## [Upgrade Logstash from 2.3 to 5.2, while still using Elasticsearch 2.x - template issues?](https://discuss.elastic.co/t/upgrade-logstash-from-2-3-to-5-2-while-still-using-elasticsearch-2-x-template-issues/75400)

<div class="topic-metadata">

**Author:** [@FlorinAndrei](https://discuss.elastic.co/u/FlorinAndrei)\
**Replies:** 1\
**Last updated:** [February 18, 2017, 5:17pm UTC](https://discuss.elastic.co/t/upgrade-logstash-from-2-3-to-5-2-while-still-using-elasticsearch-2-x-template-issues/75400 "2017-02-18T17:17:06Z")

</div>

I'm currently running a few Logstash clusters, version 2.3.x. One of the outputs for these clusters is Elasticsearch, hosted in Elastic Cloud, versions 2.3.x and 2.4.x I may have to upgrade Logstash to 5.2 to get the n…

---

## [How can I rename a dynamic nested field name](https://discuss.elastic.co/t/how-can-i-rename-a-dynamic-nested-field-name/75203)

<div class="topic-metadata">

**Author:** [@pbData](https://discuss.elastic.co/u/pbData)\
**Replies:** 1\
**Last updated:** [February 18, 2017, 5:15pm UTC](https://discuss.elastic.co/t/how-can-i-rename-a-dynamic-nested-field-name/75203 "2017-02-18T17:15:02Z")

</div>

I am currently looking at a camel project to get some stats from it. The following json response is what I get from jolokia. So I have a couple of issues I have to resolve although the most important is... I would lik…

---

## [New log file not parsed with the same config?](https://discuss.elastic.co/t/new-log-file-not-parsed-with-the-same-config/75167)

<div class="topic-metadata">

**Author:** [@Beuhlet\_Reseau](https://discuss.elastic.co/u/Beuhlet_Reseau)\
**Replies:** 1\
**Last updated:** [February 18, 2017, 5:12pm UTC](https://discuss.elastic.co/t/new-log-file-not-parsed-with-the-same-config/75167 "2017-02-18T17:12:19Z")

</div>

Hello, i would like your opinions about a strangeness. I have one log file who i have configured with filebeat & logstash. It's OK. I can show the fields i want, create graph... Next : I added a new log file in the s…

---

## [How to parse a field which have multiple patterns?](https://discuss.elastic.co/t/how-to-parse-a-field-which-have-multiple-patterns/75586)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 2\
**Last updated:** [February 18, 2017, 11:16am UTC](https://discuss.elastic.co/t/how-to-parse-a-field-which-have-multiple-patterns/75586 "2017-02-18T11:16:02Z")

</div>

Hi, I have a field in my log file, which may sometimes has an entry like 'Hello World' , and if it doesn't has data, it will show just - sign. I gave defined it as '%{GREEDYDATA:helloworld}' , which gives me grokparsef…

---

## [Conditional statement in output](https://discuss.elastic.co/t/conditional-statement-in-output/74672)

<div class="topic-metadata">

**Author:** [@andrew-waters](https://discuss.elastic.co/u/andrew-waters)\
**Replies:** 5\
**Last updated:** [February 18, 2017, 9:46am UTC](https://discuss.elastic.co/t/conditional-statement-in-output/74672 "2017-02-18T09:46:55Z")

</div>

I have a logstash configuration file (5.2:alpine) and want to use the same file for development and production environments. I have loaded in environment variables and confirmed they exist. However, when trying to ch…

---

## [Using grok instead of csv filter](https://discuss.elastic.co/t/using-grok-instead-of-csv-filter/75540)

<div class="topic-metadata">

**Author:** [@abd.wsu](https://discuss.elastic.co/u/abd.wsu)\
**Replies:** 1\
**Last updated:** [February 18, 2017, 7:22am UTC](https://discuss.elastic.co/t/using-grok-instead-of-csv-filter/75540 "2017-02-18T07:22:41Z")

</div>

I have a csv files with multiple lines as follows "Archive","Major Interval","DEV1","f328c29c-c695-11e5-addb-cc355a180000","EG1","5d56048e-5201-0000-0080-b2bb5fd9a209","TestHeartBeatFlow","3e452a8e-5201-0000-0080-a896a…

---

## [Log files not forwarded to Elasticsearch](https://discuss.elastic.co/t/log-files-not-forwarded-to-elasticsearch/75495)

<div class="topic-metadata">

**Author:** [@ArjunSISA](https://discuss.elastic.co/u/ArjunSISA)\
**Replies:** 2\
**Last updated:** [February 18, 2017, 3:40am UTC](https://discuss.elastic.co/t/log-files-not-forwarded-to-elasticsearch/75495 "2017-02-18T03:40:39Z")

</div>

Hi everyone, i have configured winlogbeat to forward windows logs to logstash and successfully receiving logs in logstash(which i can see in command prompt), but i'm not getting the logs in elasticsearch. can anyone…

---

## [How can convert field to int, float](https://discuss.elastic.co/t/how-can-convert-field-to-int-float/49702)

<div class="topic-metadata">

**Author:** [@cmorell](https://discuss.elastic.co/u/cmorell)\
**Replies:** 7\
**Last updated:** [February 17, 2017, 7:37pm UTC](https://discuss.elastic.co/t/how-can-convert-field-to-int-float/49702 "2017-02-17T19:37:31Z")

</div>

Hello, I'm starting to use ELK, but I have a problem to convert fields... always, all the fields types are string. Here an example of log line: 2016-05-10 19:44:37 123 12 199 and here logstash config file: in…

---

## [Logstash Geolocate IP Address into Elasticsearch](https://discuss.elastic.co/t/logstash-geolocate-ip-address-into-elasticsearch/75246)

<div class="topic-metadata">

**Author:** [@Bondo](https://discuss.elastic.co/u/Bondo)\
**Replies:** 13\
**Last updated:** [February 17, 2017, 6:47pm UTC](https://discuss.elastic.co/t/logstash-geolocate-ip-address-into-elasticsearch/75246 "2017-02-17T18:47:16Z")

</div>

I'm trying to get Logstash to take in an IIS web log and geo locate the IP address using something like GeoLite from MaxMind and then dump it to Elasticsearch. Has anyone done something similar before? I'm not an ELK gur…

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1032)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1034)
