Multiple line with extreme long log "line"

(loc) #1

I am using multiple-line in my logstash. Logstash is receiving log from logstash-forwarder. It works fine. However, when there is extreme long multiple line log (some dump information), logstash stop processing. I can imagine that it should be ok if I can define maximum number of lines. However, there is no such option. Any one meet the same issue and any solution?


(Ed) #2

Are you using the Codec Multiline or are you using the filter. I use the filter and it tends to get over run. From my understanding the multiline codec for file input is better. I have yet to check it out.

The only solution for this that I can think of is to increase your heap space if the codec does not help

(system) #3