# Filebeat5 alpha 5: multiline and procesor not work as expectation

**URL:** <https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [September 19, 2016, 8:13am UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845 "2016-09-19T08:13:03Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![ptvi](https://avatars.discourse-cdn.com/v4/letter/p/b3f665/32.png) [@ptvi](https://discuss.elastic.co/u/ptvi)\
**Post date:** [September 19, 2016, 8:13am UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845/1 "2016-09-19T08:13:03Z")

</div>

Hi,  
I'm using filebeat alpha 5 installed in my Windows server to flushing log to my ELK. In filebeat.yml, I configure multiline and processor as below:  
#I only want to get log line containing ER or ERROR  
processors:

- drop\_fields:  
fields: ["IN:", "INFO:", "[IN]", "[INFO]"]

#log lines not begin with number will be join to one line  
multiline.pattern: ^[0-9]{4}  
multiline.negate: true  
multiline.match: after  
multiline.max\_lines: 5  
multiline.timeout: 5s

But the log displayed on Kibana as attached image. That are not my expectation

 ![](https://us1.discourse-cdn.com/elastic/original/2X/d/d89b377d60fbff4a4c5aa5c14384daa09638fb5f.jpg)

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [September 19, 2016, 1:01pm UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845/2 "2016-09-19T13:01:36Z")

</div>

it seems like you want to drop events, not fields. Check out `includes/exclude_lines` settings.

---

<div class="post-metadata">

**Author:** ![ptvi](https://avatars.discourse-cdn.com/v4/letter/p/b3f665/32.png) [@ptvi](https://discuss.elastic.co/u/ptvi)\
**Post date:** [September 22, 2016, 10:22am UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845/3 "2016-09-22T10:22:39Z")

</div>

It works fine as you guide. Thanks.  
Can you instruct me how to configure rotation of elastic log and data indices? For each server, I have about 600 log files to be scan. I intend to use logstash monitoring logs from many servers. This will leads the log and indices keep huge capacity. So I need configure to delete old Elastic log and indices to free up disk.

---

<div class="post-metadata">

**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\
**Post date:** [September 22, 2016, 10:59am UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845/4 "2016-09-22T10:59:53Z")

</div>

To cleanup old indices, you are probably looking for curator: [https://www.elastic.co/guide/en/elasticsearch/client/curator/4.1/index.html](https://www.elastic.co/guide/en/elasticsearch/client/curator/4.1/index.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 10, 2016, 8:13am UTC](https://discuss.elastic.co/t/filebeat5-alpha-5-multiline-and-procesor-not-work-as-expectation/60845/5 "2016-10-10T08:13:09Z")

</div>

This topic was automatically closed after 21 days. New replies are no longer allowed.