# Forwarding data from Extended log file format from using filebeat to ES

**URL:** https://discuss.elastic.co/t/forwarding-data-from-extended-log-file-format-from-using-filebeat-to-es/85900
**Category:** Beats
**Tags:** filebeat
**Created:** [May 16, 2017, 10:12am UTC](https://discuss.elastic.co/t/forwarding-data-from-extended-log-file-format-from-using-filebeat-to-es/85900 "2017-05-16T10:12:52Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![ARAVIND\_KAMATH](https://avatars.discourse-cdn.com/v4/letter/a/d78d45/32.png) [@ARAVIND\_KAMATH](https://discuss.elastic.co/u/ARAVIND_KAMATH)
#### Post date: [May 16, 2017, 10:12am UTC](https://discuss.elastic.co/t/forwarding-data-from-extended-log-file-format-from-using-filebeat-to-es/85900/1 "2017-05-16T10:12:53Z")

</div>

## I have a sample log format which looks similar the one shown below

## key1=value1, key2=value2, key3=value3 EOF

## key1=value4 key2=value5 key3=value6 EOF

....  
and so on

how can I configure file beat to harvest such log file and push data to elasticsearch  
or there is any other work arround

---

<div class="post-metadata">

### Author: ![tudor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tudor/32/3753_2.png) [@tudor](https://discuss.elastic.co/u/tudor)
#### Post date: [May 16, 2017, 10:38am UTC](https://discuss.elastic.co/t/forwarding-data-from-extended-log-file-format-from-using-filebeat-to-es/85900/2 "2017-05-16T10:38:08Z")

</div>

I'd recommend using [multiline](https://www.elastic.co/guide/en/beats/filebeat/current/configuration-filebeat-options.html#multiline) in Filebeat to group everything between the EOF lines. Then you could use the [kv](https://www.elastic.co/guide/en/logstash/current/plugins-filters-kv.html) filter in Logstash to parse the values.

If you don't want to use Logstash, and only use Elasticsearch, you can also use the [Ingest Node kv processor](https://www.elastic.co/guide/en/elasticsearch/reference/master/kv-processor.html).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 13, 2017, 10:43am UTC](https://discuss.elastic.co/t/forwarding-data-from-extended-log-file-format-from-using-filebeat-to-es/85900/3 "2017-06-13T10:43:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.