# Logstash

**URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1105

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1106

---

## [Maintaining multiple versions of Logstash using Yum Repos](https://discuss.elastic.co/t/maintaining-multiple-versions-of-logstash-using-yum-repos/60011)

<div class="topic-metadata">

**Author:** [@David\_McClain](https://discuss.elastic.co/u/David_McClain)\
**Replies:** 0\
**Last updated:** [September 7, 2016, 5:33pm UTC](https://discuss.elastic.co/t/maintaining-multiple-versions-of-logstash-using-yum-repos/60011 "2016-09-07T17:33:56Z")

</div>

I am working on converting my stack installation/standup processes from using the tar files over to using the Yum repos provided, but am running into some flexibility issues. I keep a directory - /opt/logstash - as the…

---

## [Logstash jdbc plugin - nested data](https://discuss.elastic.co/t/logstash-jdbc-plugin-nested-data/33908)

<div class="topic-metadata">

**Author:** [@jrizzi1](https://discuss.elastic.co/u/jrizzi1)\
**Replies:** 8\
**Last updated:** [September 7, 2016, 5:25pm UTC](https://discuss.elastic.co/t/logstash-jdbc-plugin-nested-data/33908 "2016-09-07T17:25:31Z")

</div>

I am in process of attempting to migrate from using the old jdbc river plugin to using logstash 1.5 / logstash jdbc plugin I am however running into some difficulty, if i previously had 50 rows with 20 having unique id…

---

## [Logstash-plugin install logstash-output-elasticsearch 5.1.0 installs logstash-output-elasticsearch-java 5.1.0](https://discuss.elastic.co/t/logstash-plugin-install-logstash-output-elasticsearch-5-1-0-installs-logstash-output-elasticsearch-java-5-1-0/59921)

<div class="topic-metadata">

**Author:** [@gpaggi](https://discuss.elastic.co/u/gpaggi)\
**Replies:** 3\
**Last updated:** [September 7, 2016, 5:08pm UTC](https://discuss.elastic.co/t/logstash-plugin-install-logstash-output-elasticsearch-5-1-0-installs-logstash-output-elasticsearch-java-5-1-0/59921 "2016-09-07T17:08:47Z")

</div>

Hi, I'm in the process of upgrading to 2.4.0 and wanted to test the new version of the output plugin to elastic. On a fresh install installing logstash-output-elasticsearch 5.1.0 installs instead logstash-output-elasti…

---

## [Install local plugin using --local does not work: tries "online installation](https://discuss.elastic.co/t/install-local-plugin-using-local-does-not-work-tries-online-installation/59982)

<div class="topic-metadata">

**Author:** [@Guenhael](https://discuss.elastic.co/u/Guenhael)\
**Replies:** 0\
**Last updated:** [September 7, 2016, 1:16pm UTC](https://discuss.elastic.co/t/install-local-plugin-using-local-does-not-work-tries-online-installation/59982 "2016-09-07T13:16:29Z")

</div>

Hi, I have to make an offline installation of a plugin on a system not connected to Internet. I followed the procedure I found on elasticsearch/logstash documentation: 1) install the plugin on an "online" system, 2) …

---

## [Logstash Config error](https://discuss.elastic.co/t/logstash-config-error/59970)

<div class="topic-metadata">

**Author:** [@csr](https://discuss.elastic.co/u/csr)\
**Replies:** 2\
**Last updated:** [September 7, 2016, 10:32am UTC](https://discuss.elastic.co/t/logstash-config-error/59970 "2016-09-07T10:32:25Z")

</div>

Hi team, I am new to ELK and eploring it. But I am getting the below error, any idea. I've pasted the conf and csv data. Kidn regards csr ==== Conf file input { file { path =\> "/data/uploads/stage/pay.csv" start\_pos…

---

## [Logstash 5.0.0-alpha5: kafka not found](https://discuss.elastic.co/t/logstash-5-0-0-alpha5-kafka-not-found/57950)

<div class="topic-metadata">

**Author:** [@kaem2111](https://discuss.elastic.co/u/kaem2111)\
**Replies:** 6\
**Last updated:** [September 7, 2016, 10:01am UTC](https://discuss.elastic.co/t/logstash-5-0-0-alpha5-kafka-not-found/57950 "2016-09-07T10:01:18Z")

</div>

Hello, after upgrading 5.0.0-alpha4 to 5 using logstash-rpm I get the error: /usr/share/logstash/bin/logstash --path.settings=/etc/logstash -t --log.level debug -e 'output { kafka { topic\_id =\> "logstash" }}' ---…

---

## [Different encoding from same TCP input stream?](https://discuss.elastic.co/t/different-encoding-from-same-tcp-input-stream/59968)

<div class="topic-metadata">

**Author:** [@Xeteskian](https://discuss.elastic.co/u/Xeteskian)\
**Replies:** 0\
**Last updated:** [September 7, 2016, 10:21am UTC](https://discuss.elastic.co/t/different-encoding-from-same-tcp-input-stream/59968 "2016-09-07T10:21:16Z")

</div>

Hi, We use a cloud service that I've configured to forward it's logs to a logstash instance using the tcp input. The Logstash instance is configured to take this message and just output to Redis, which in turn will be …

---

## [Date AM/PM format - Logstash filter date parse error](https://discuss.elastic.co/t/date-am-pm-format-logstash-filter-date-parse-error/59856)

<div class="topic-metadata">

**Author:** [@hongguan\_chuah](https://discuss.elastic.co/u/hongguan_chuah)\
**Replies:** 0\
**Last updated:** [September 6, 2016, 9:04am UTC](https://discuss.elastic.co/t/date-am-pm-format-logstash-filter-date-parse-error/59856 "2016-09-06T09:04:27Z")

</div>

I am having trouble on getting the filter date pattern match with my log file date pattern. I want the date appears as EventDateTime attribute and date would be removed inside message field. Anyone can help me, having …

---

## [GROK Multiline Newby](https://discuss.elastic.co/t/grok-multiline-newby/59614)

<div class="topic-metadata">

**Author:** [@somerandomguy](https://discuss.elastic.co/u/somerandomguy)\
**Replies:** 6\
**Last updated:** [September 7, 2016, 7:44am UTC](https://discuss.elastic.co/t/grok-multiline-newby/59614 "2016-09-07T07:44:33Z")

</div>

Hi. I have to GROK a multiline log. It's around 15 lines per log. Looking at some examples online, but they are a bit hard to follow.... Anybody got any real life examples? I have installed windows filebeat and am in…

---

## [Logstash GROK Visualize](https://discuss.elastic.co/t/logstash-grok-visualize/59939)

<div class="topic-metadata">

**Author:** [@somerandomguy](https://discuss.elastic.co/u/somerandomguy)\
**Replies:** 3\
**Last updated:** [September 7, 2016, 7:37am UTC](https://discuss.elastic.co/t/logstash-grok-visualize/59939 "2016-09-07T07:37:30Z")

</div>

Hi, I am using GROK to split out my log messages into fields. Some message fields have multiple words as a result e.g. login authentication succeeded or login authentication failed. When I go to Kibana, Discover, find th…

---

## [Tcp time\_wait between logstash agent and elasticsearch cluster nodes](https://discuss.elastic.co/t/tcp-time-wait-between-logstash-agent-and-elasticsearch-cluster-nodes/59936)

<div class="topic-metadata">

**Author:** [@AllenBarra](https://discuss.elastic.co/u/AllenBarra)\
**Replies:** 2\
**Last updated:** [September 7, 2016, 5:38am UTC](https://discuss.elastic.co/t/tcp-time-wait-between-logstash-agent-and-elasticsearch-cluster-nodes/59936 "2016-09-07T05:38:00Z")

</div>

My elasticsearch cluster contains two nodes: node\_ip1,node\_ip2. When I used logstash-output-elasticsearch to connect elasticsearch cluster, there were lots of tcp time\_wait between logstash and elasticsearch nodes. Here …

---

## [Mutiple mutate filters and thier output to different elasticsearch indexs](https://discuss.elastic.co/t/mutiple-mutate-filters-and-thier-output-to-different-elasticsearch-indexs/59876)

<div class="topic-metadata">

**Author:** [@Ayush\_Rastogi](https://discuss.elastic.co/u/Ayush_Rastogi)\
**Replies:** 4\
**Last updated:** [September 7, 2016, 5:10am UTC](https://discuss.elastic.co/t/mutiple-mutate-filters-and-thier-output-to-different-elasticsearch-indexs/59876 "2016-09-07T05:10:37Z")

</div>

HI All, I have a log file like the following which I use logstash to process. FilterPerfLogging input\_count:2 ,TimeTaken:0.272 ,ConfigRate:7.35294 ,output\_count:2 SubFilterLogging ContraintSize:5, ,TimeTaken:0.501 Now…

---

## [Sending data using JDBC input](https://discuss.elastic.co/t/sending-data-using-jdbc-input/59341)

<div class="topic-metadata">

**Author:** [@ramongo](https://discuss.elastic.co/u/ramongo)\
**Replies:** 6\
**Last updated:** [September 6, 2016, 2:19pm UTC](https://discuss.elastic.co/t/sending-data-using-jdbc-input/59341 "2016-09-06T14:19:44Z")

</div>

Hi Specialists! I'm trying to send data from an JDBC input (SQLServer 2008) to a SYSLOG Server, I don't want the column names...just the result set in line mode. When I specify this , the output is shown in the followin…

---

## [How to mention parent child relation in logstash](https://discuss.elastic.co/t/how-to-mention-parent-child-relation-in-logstash/57376)

<div class="topic-metadata">

**Author:** [@spraveenjd](https://discuss.elastic.co/u/spraveenjd)\
**Replies:** 2\
**Last updated:** [September 6, 2016, 2:17pm UTC](https://discuss.elastic.co/t/how-to-mention-parent-child-relation-in-logstash/57376 "2016-09-06T14:17:06Z")

</div>

We can create parent child relation in the mapping document. How to do it in the logstash. Please help on this

---

## [Logstash Cassandra JDBC Connection CQL Error](https://discuss.elastic.co/t/logstash-cassandra-jdbc-connection-cql-error/59885)

<div class="topic-metadata">

**Author:** [@brantkev](https://discuss.elastic.co/u/brantkev)\
**Replies:** 0\
**Last updated:** [September 6, 2016, 2:12pm UTC](https://discuss.elastic.co/t/logstash-cassandra-jdbc-connection-cql-error/59885 "2016-09-06T14:12:22Z")

</div>

When executing Logstash with JDBC for Cassandra I am getting the error below Java::ComDatastaxDriverCoreExceptions::SyntaxError: line 1:174 missing EOF at ')' (....logs\_all\_3\_0\_0 where event\_id \> '1970-01-01 00:00:00.0…

---

## [Parsing a json file in logstash?](https://discuss.elastic.co/t/parsing-a-json-file-in-logstash/59597)

<div class="topic-metadata">

**Author:** [@ZillaG](https://discuss.elastic.co/u/ZillaG)\
**Replies:** 5\
**Last updated:** [September 6, 2016, 2:03pm UTC](https://discuss.elastic.co/t/parsing-a-json-file-in-logstash/59597 "2016-09-06T14:03:00Z")

</div>

I'm sending log messages from a remote client to my ELK server, and all is well. The logs come in a json format, that looks something like { "type" =\> "trm-system", "host" =\> "susralcent09", "timesta…

---

## [Compare fields in Logstash ruby filter](https://discuss.elastic.co/t/compare-fields-in-logstash-ruby-filter/59874)

<div class="topic-metadata">

**Author:** [@Gurveer\_Singh](https://discuss.elastic.co/u/Gurveer_Singh)\
**Replies:** 8\
**Last updated:** [September 6, 2016, 1:54pm UTC](https://discuss.elastic.co/t/compare-fields-in-logstash-ruby-filter/59874 "2016-09-06T13:54:28Z")

</div>

I trying following ruby code, but doesn't working for me. Can somebody help me where I am doing wrong ? ruby { code =\> ' require "csv" records = CSV.foreach("/path/to/file.csv") …

---

## [Multiplication in logstash grok filter](https://discuss.elastic.co/t/multiplication-in-logstash-grok-filter/59875)

<div class="topic-metadata">

**Author:** [@Preeti\_Sharma](https://discuss.elastic.co/u/Preeti_Sharma)\
**Replies:** 4\
**Last updated:** [September 6, 2016, 11:31am UTC](https://discuss.elastic.co/t/multiplication-in-logstash-grok-filter/59875 "2016-09-06T11:31:49Z")

</div>

I have following filter filter { if \[type\] == "apache-access" { grok { match =\> { "message" =\> "%{APACHE}" } add\_field =\> { "tym1" =\> "%{microseconds} \* 0.000001" }…

---

## [Configure types and analyzed](https://discuss.elastic.co/t/configure-types-and-analyzed/59855)

<div class="topic-metadata">

**Author:** [@eirc](https://discuss.elastic.co/u/eirc)\
**Replies:** 4\
**Last updated:** [September 6, 2016, 11:00am UTC](https://discuss.elastic.co/t/configure-types-and-analyzed/59855 "2016-09-06T11:00:12Z")

</div>

Hello, I'm new to the Elastic Stack and can't understand how to configure field types & whether strings should be analyzed or not. I've found documentation that says I should use the Elasticsearch API but the indexes …

---

## [Add field timestamp with current time](https://discuss.elastic.co/t/add-field-timestamp-with-current-time/59862)

<div class="topic-metadata">

**Author:** [@Saurabh\_Jambhule](https://discuss.elastic.co/u/Saurabh_Jambhule)\
**Replies:** 4\
**Last updated:** [September 6, 2016, 10:51am UTC](https://discuss.elastic.co/t/add-field-timestamp-with-current-time/59862 "2016-09-06T10:51:05Z")

</div>

I want to update timestamp to current time and date. So how do I add field timestamp with current date and time. And how to remove old timestamp. Thank you.

---

## [XMPP with SSL](https://discuss.elastic.co/t/xmpp-with-ssl/59871)

<div class="topic-metadata">

**Author:** [@eds](https://discuss.elastic.co/u/eds)\
**Replies:** 0\
**Last updated:** [September 6, 2016, 10:36am UTC](https://discuss.elastic.co/t/xmpp-with-ssl/59871 "2016-09-06T10:36:48Z")

</div>

Hi. I have issue with xmpp output plugin. My xmpp server configured to use ssl, how i can specify ssl settings?

---

## [Logstash how to send string as not\_analyzed into elasticsearch](https://discuss.elastic.co/t/logstash-how-to-send-string-as-not-analyzed-into-elasticsearch/28922)

<div class="topic-metadata">

**Author:** [@Navneet\_Mathpal](https://discuss.elastic.co/u/Navneet_Mathpal)\
**Replies:** 10\
**Last updated:** [September 6, 2016, 9:49am UTC](https://discuss.elastic.co/t/logstash-how-to-send-string-as-not-analyzed-into-elasticsearch/28922 "2016-09-06T09:49:26Z")

</div>

Hi , I am usng logstash 1.5.4 , while indexing the data through logstash, all the string data type indexing as analyzed , but my requirement is it should be not\_analyzed .. So I had changed the file elastic-template.j…

---

## [GROK filter cannot be applied on aggregated events](https://discuss.elastic.co/t/grok-filter-cannot-be-applied-on-aggregated-events/56113)

<div class="topic-metadata">

**Author:** [@jpry](https://discuss.elastic.co/u/jpry)\
**Replies:** 11\
**Last updated:** [September 6, 2016, 9:02am UTC](https://discuss.elastic.co/t/grok-filter-cannot-be-applied-on-aggregated-events/56113 "2016-09-06T09:02:51Z")

</div>

Hi, All is in the title; here is my Aggregate plugin configuration: aggregate { task\_id =\> "%{id}" code =\> "map\['message'\] ||= '' ; map\['message'\] += event\['message'\] + '\\n'" a…

---

## [How to import oracle Clob data in a Index of Elastic](https://discuss.elastic.co/t/how-to-import-oracle-clob-data-in-a-index-of-elastic/59837)

<div class="topic-metadata">

**Author:** [@chaudhry\_salil](https://discuss.elastic.co/u/chaudhry_salil)\
**Replies:** 3\
**Last updated:** [September 6, 2016, 5:25am UTC](https://discuss.elastic.co/t/how-to-import-oracle-clob-data-in-a-index-of-elastic/59837 "2016-09-06T05:25:15Z")

</div>

We have big tables with data stored as XML clob in Oracle. Now we need to import this data in Elastic and sure we can't import and store it as XML in elastic. instead want to store it as different field values of a docum…

---

## [Logstash 2.3.4 java.lang.InternalError](https://discuss.elastic.co/t/logstash-2-3-4-java-lang-internalerror/59839)

<div class="topic-metadata">

**Author:** [@enda](https://discuss.elastic.co/u/enda)\
**Replies:** 0\
**Last updated:** [September 6, 2016, 1:15am UTC](https://discuss.elastic.co/t/logstash-2-3-4-java-lang-internalerror/59839 "2016-09-06T01:15:44Z")

</div>

Word Count restrictions here I posted to a github https://github.com/elastic/logstash/issues/5860 please help me

---

## [Logstash ruby code to irritate through a key value map](https://discuss.elastic.co/t/logstash-ruby-code-to-irritate-through-a-key-value-map/59828)

<div class="topic-metadata">

**Author:** [@Aljaz\_Gantar](https://discuss.elastic.co/u/Aljaz_Gantar)\
**Replies:** 2\
**Last updated:** [September 5, 2016, 8:04pm UTC](https://discuss.elastic.co/t/logstash-ruby-code-to-irritate-through-a-key-value-map/59828 "2016-09-05T20:04:27Z")

</div>

I have this log: cs1Label=userAuthenticationMechanism cs1=oauth-access-token cs2Label=vcapRequestId cs2=12398012300-c876-4427-56dd-49a7c0e9c254::1dd79781-ee8a-41e6-a630-c9a20f2615e9 cs3Label=result cs3=success cs4Label=…

---

## [Logstash error JSON](https://discuss.elastic.co/t/logstash-error-json/59827)

<div class="topic-metadata">

**Author:** [@Jose\_Campos](https://discuss.elastic.co/u/Jose_Campos)\
**Replies:** 1\
**Last updated:** [September 5, 2016, 6:45pm UTC](https://discuss.elastic.co/t/logstash-error-json/59827 "2016-09-05T18:45:13Z")

</div>

Hi there Can you help me with this issue? LogStash::Json::GeneratorError: Cannot find Serializer for class: org.jruby.RubyObject Waiting for your comments.

---

## [How to ignore previous log files when using file input plugin?](https://discuss.elastic.co/t/how-to-ignore-previous-log-files-when-using-file-input-plugin/25940)

<div class="topic-metadata">

**Author:** [@nathaniel](https://discuss.elastic.co/u/nathaniel)\
**Replies:** 4\
**Last updated:** [September 5, 2016, 6:44pm UTC](https://discuss.elastic.co/t/how-to-ignore-previous-log-files-when-using-file-input-plugin/25940 "2016-09-05T18:44:21Z")

</div>

Hi guys, I am a newbie in logstash. I am trying to forward all my log files to elasticsearch using logstash. The problem is, the previously existing log files are huge and I do not need them. Is there a way to only input…

---

## [Unable to load csv file into elasticsearch using logstash](https://discuss.elastic.co/t/unable-to-load-csv-file-into-elasticsearch-using-logstash/59809)

<div class="topic-metadata">

**Author:** [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)\
**Replies:** 6\
**Last updated:** [September 5, 2016, 5:56pm UTC](https://discuss.elastic.co/t/unable-to-load-csv-file-into-elasticsearch-using-logstash/59809 "2016-09-05T17:56:54Z")

</div>

hi, I'm using ubuntu as my os. My csv file is present in downloads folder( which i later moved it to opt/logstash folder) and my config file is placed in path etc/logstash/conf.d and is as follows:- input { file { …

---

## [Logstash Input ElasticSearch "End of file" error -- Cannot reindex](https://discuss.elastic.co/t/logstash-input-elasticsearch-end-of-file-error-cannot-reindex/51072)

<div class="topic-metadata">

**Author:** [@ddidier](https://discuss.elastic.co/u/ddidier)\
**Replies:** 2\
**Last updated:** [September 5, 2016, 3:14pm UTC](https://discuss.elastic.co/t/logstash-input-elasticsearch-end-of-file-error-cannot-reindex/51072 "2016-09-05T15:14:00Z")

</div>

Hi, I'm quite new to ELK and I'm trying to re-index logs with Logstash. I'm using the ES input plugin to read from an existing index, do some transformations, then write to a new index with the ES output plugin. Ver…

[Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1104)

[Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=1106)
