# S3 input plugin with multiline codec. Last one is always lost

**URL:** <https://discuss.elastic.co/t/s3-input-plugin-with-multiline-codec-last-one-is-always-lost/37727>\
**Category:** Logstash\
**Created:** [December 22, 2015, 3:13am UTC](https://discuss.elastic.co/t/s3-input-plugin-with-multiline-codec-last-one-is-always-lost/37727 "2015-12-22T03:13:04Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Den3](https://avatars.discourse-cdn.com/v4/letter/d/5f8ce5/32.png) [@Den3](https://discuss.elastic.co/u/Den3)\
**Post date:** [December 22, 2015, 3:13am UTC](https://discuss.elastic.co/t/s3-input-plugin-with-multiline-codec-last-one-is-always-lost/37727/1 "2015-12-22T03:13:04Z")

</div>

I have log format like this

```auto
<<<\n
Accept:application/json, text/javascript, */*; q=0.01\r\n
Content-Type:application/x-www-form-urlencoded; charset=UTF-8\r\n
Origin:https://discuss.elastic.co\r\n
Referer:https://discuss.elastic.co/c/logstash\r\n
\r\n
<soap><a><b></b></a></soap>
>>>\n

```

and my logstash.conf

```auto
input {
    s3 {
        codec => multiline {
             pattern => "<<<\n"
             negate => true
             what => "previous"
        }
    }
}

output {
    elasticsearch {
        host => "192.168.99.100:9200"
        index => "tt"
    }
}

```

With this config, I always lose last one log.  
for example, I have 450 logs but only 449 logs in Elasticsearch.

How could I solve this problem ?  
Or I should not use multiline codec ?

English is not my mother language, if any word is offensive, please tell me.

Thank you

---

<div class="post-metadata">

**Author:** ![RileyShu](https://avatars.discourse-cdn.com/v4/letter/r/f05b48/32.png) [@RileyShu](https://discuss.elastic.co/u/RileyShu)\
**Post date:** [August 16, 2016, 6:34pm UTC](https://discuss.elastic.co/t/s3-input-plugin-with-multiline-codec-last-one-is-always-lost/37727/2 "2016-08-16T18:34:13Z")

</div>

Same here!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:43am UTC](https://discuss.elastic.co/t/s3-input-plugin-with-multiline-codec-last-one-is-always-lost/37727/3 "2017-07-06T04:43:13Z")

</div>


