Split a string to array/list, greedy match

Hi all...
I have a message field that contains multiline string. Need to split it to an array for each line, because will do some logic based on a certain lines. But so far only able to catch the first line.

A simplified log sample

    JSONRestClient : GET Response details: 
    --------------------------------------------
    Response method: GET
    ETag [W/"8e-hDyRewehT0hTestTUAILD4GrqfI"]
    Access-Control-Allow-Origin [*]
    Content-Length [142]
    Date [Wed, 11 Nov 2020 11:00:13 GMT]
    Cache-control [private]
    X-Powered-By [Express]
    Content-Type [application/json; charset=utf-8]
    Response content: {"data":[{"bankCode":"494",{"bankCode":"002","bankName":"BANK XYZ"}],"responseCode":"00","responseDesc":"Success"}

I've tried this config, but only get the first line of log

grok {
match => ["message", "(?[^\r\n]*)" ]
remove_field => ["message"]
break_on_match => false
}

Need it to be

"msg": ["Access-Control-Allow-Origin [*]", " Content-Length [142]", ... ]

Already tried https://www.elastic.co/guide/en/logstash/7.x/plugins-filters-split.html but don't want to split it as individual event

Hi
I believe you should seek mutline support rather than split support as your log sample spans multiple lines.

ok...found it, ruby code

ruby {
code => "
message = event.get("message")
msg = message.split("\n")
event.set("msg", msg)
"
}

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.