# Filebeat lotstash output and 'exported fields'

**URL:** https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796
**Category:** Beats
**Tags:** filebeat
**Created:** [February 14, 2018, 12:40pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796 "2018-02-14T12:40:54Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![nathharp](https://avatars.discourse-cdn.com/v4/letter/n/f1d935/32.png) [@nathharp](https://discuss.elastic.co/u/nathharp)
#### Post date: [February 14, 2018, 12:40pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796/1 "2018-02-14T12:40:54Z")

</div>

Hi all,

I am planning our migration from our ageing rsyslog(RELP) \> logtash \> elasticsearch with a new set of infrastructure.

I have been experimenting with filebeat \> logstash \> elasticsearch but I'm not getting the message granularity that I was hoping for.

Using filebeat \> elasticsearch I get lots of wonderful exported fields with loads of useful information. However, if I set filebeat with logstash output all this appears to be lost, and I just get everything lumped into the message field.

Is this expected behaviour? I know I can grok the output, but I was hoping save that for just additional insights or filtering

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [February 14, 2018, 2:38pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796/2 "2018-02-14T14:38:15Z")

</div>

You don't mention if you were using Filebeat modules when sending Filebeat -\> Elasticsearch, but I suspect that you were based on the experience you describe.

Unfortunately FIlebeat modules don't yet work with Logstash because they use Ingest Node in Elasticsearch to parse. See the note here: [https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-modules-overview.html](https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-modules-overview.html)

An equivalent Logstash filter setup to the Filebeat system module is provided [here](https://www.elastic.co/guide/en/logstash/6.2/logstash-config-for-filebeat-modules.html#parsing-system). You can add this to your Logstash config.

---

<div class="post-metadata">

### Author: ![nathharp](https://avatars.discourse-cdn.com/v4/letter/n/f1d935/32.png) [@nathharp](https://discuss.elastic.co/u/nathharp)
#### Post date: [February 14, 2018, 2:57pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796/3 "2018-02-14T14:57:10Z")

</div>

Ah yes, I did miss that. You are correct, I am using filebeat modules.

Thank you for confirming, and particularly the logstash filter example, that will help out significantly.

---

<div class="post-metadata">

### Author: ![nathharp](https://avatars.discourse-cdn.com/v4/letter/n/f1d935/32.png) [@nathharp](https://discuss.elastic.co/u/nathharp)
#### Post date: [February 16, 2018, 3:36pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796/4 "2018-02-16T15:36:11Z")

</div>

Finally got a chance to test. This does exactly what I was after, many thanks

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 16, 2018, 3:36pm UTC](https://discuss.elastic.co/t/filebeat-lotstash-output-and-exported-fields/119796/5 "2018-03-16T15:36:12Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
