Hello everybody,
I've got a CSV document which is imported thanks to fileabeat to logstash input, then it is filtered and then goes to ES to be saw in Kabana.
I want to parse a date from this CSV file to use it for the @timestamp.
This date is : "2018-02-28 23:00 GMT
" (incremented each day of the month..)
so my pipeline looks like this :
input
{
beats
{
port => 5044
}
}
filter
{
csv
{
separator => ";"
columns => ["jour","type","total"]
convert =>
{
"total" => "float"
}
}
if [message] =~ /^jour/
{
drop {}
}
date
{
match => [ "jour", "yyyy-MM-dd HH:mm GMT" ]
}
}
output
{
elasticsearch
{
hosts => "http://localhost:9200"
index => "ironport"
}
stdout{}
}
But when I test my pipeline before to use it, i've got this error :
[FATAL] 2018-05-04 16:06:38.656 [LogStash::Runner] runner - The given configuration is invalid. Reason: Illegal pattern component: T
Is it the "GMT" which is problematic ? If yes, how can I do to deal with this date format ?
Can somebody help me ?
Thx for all for your help.