Timestamp replacing with format MMM dd HH:mm:ss yyyy

[calebereis (Calebe Souza Reis)]

Hi, I'm Calebe and I'm trying to replace the timestamp with the timestamp from the log file.

I tried so many things and nothing works.

I have this kind of timestamp in my log file:
Jun 24 19:34:54 2016

The problem is that I don't know the correct configure for grok filter.

I'm using this:

filter {

grok {
match => [ "message" => %{SYSLOGBASE:timedate} ]
}
date {
match => [ "timedate" , "MMM dd HH:mm:ss yyyy" ]
}
}

It's not working. I think that's because grok is configured wrong, but I can't find the right way.

Could anyone please help me?

[calebereis (Calebe Souza Reis)]

I tride this different way and didn't work either.

filter {

grok {
match => [ "message" => "^(?%{MONTH:month} %{MONTHDAY:day} %{TIME:time} %{YEAR:year})" ]
add_field => {"timestamp" => "%{day}-%{month}-%{year} %{time}"}
remove_field => [ "day", "month", "year", "time" ]
}

date {
match => [ "timestamp" , "MMM dd HH:mm:ss yyyy" ]
remove_field => "timestamp"
}
}

[Tek_Chand]

@calebereis,

The SYSLOGBASE will add another filed and you can use that filed to check the date and time when that log was generated at source machine.

Try the below config:

filter {
grok {
match => { "message" => ["SYSLOGBASE"] }
}
} 

It will add a filed with name SYSLOGTIMESTAMP on kibana. You can refer that filed.

Thanks.

[calebereis (Calebe Souza Reis)]

Hi Tek,

I tried doing that, but I got _grokparsefailure.

Should I add the date filter refering to this new field?

[Tek_Chand]

@Calebereis, Can you please provide the output or error log?
That will be helpful to troubleshoot the issue.

Thanks.

[calebereis (Calebe Souza Reis)]

After so many tries, I found something that works.

filter {
  grok {
    match => { "message" => "^%{MONTH:mes}\s*%{MONTHDAY:dia}\s*%{TIME:hora}\s*%{YEAR:ano}:\s.*%{IP:ip}" }
  }
  mutate {
     add_field => {
        "timedate" => "%{mes} %{dia} %{hora} %{ano}"
    }
  }
}

And now I can receive my txt file and read it in the right time.

Thank you anyway, Tek.

Hope it helps someone else.

[Tek_Chand]

@calebereis, Glad to hear that.