Using date filter within split filter

Elastic Stack Logstash
1

Hi All
I'm receiving batch event from azure eventhub and I am using split filter to split each event into it's own record
the problem I'm facing is that each split event has it's own datetime and I would like to use the as @timestamp

here is my filter so far but the records.time is still different from the @timestamp

filter {

      json {

        source => "message"

      }

      split {

        field => "records"

      }

      date {

        match => ["records.time", "yyyy-MM-dd'T'HH:mm:ss'.'SSSZ"]

        target => "@timestamp"

      }

    }
2

That should almost certainly be "[records][time]"

3

not really I got
_dateparsefailure tag when I did that

4

That is a good sign. It means the field you are trying to match exists, it just doesn't have the right format.

What does [records][time] look like if you use

output { stdout { codec => rubydebug } }
5

Thanks you for your help
now it works after I fixed time format
date {

    match => ["[records][time]", "ISO8601"]

    target => "@timestamp"

  }
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.