Hi,
I was converting the filebeat pipeline to logstash since I need to use the translate filter. everything seems fine except the date filter is giving me the "_dateparsefailure" and it is not able to parse the time correctly.
In order to simplify the question, I use below command to debug:
# echo "09/Feb/2020:07:12:13 +1100" | /usr/share/logstash/bin/logstash -e 'input { stdin {} } filter {date { match => [ "message","dd/MMM/yyyy:HH:mm:ss Z" ] } } output { stdout { codec => rubydebug } }'
As you can see in the result, the time is not parsed:
{
"@version" => "1",
"message" => "09/Feb/2020:07:12:13 +1100",
"tags" => [
[0] "_dateparsefailure"
],
"@timestamp" => 2020-02-12T06:26:35.593Z,
"host" => "au1-int-elk03"
}
I don't know why this is happened and how to fix the problem.