Hello,
I'm using logstash to read some csv files and then send to elastic, but I don't know why, the logstash can't read a file completely without a error.
I'm receiving various errors like these:
":timestamp=>"2017-02-06T19:54:54.943000-0200", :message=>"Failed parsing date from field", :field=>"data", :value=>",00", :exception=>"Invalid format: ",00"", :config_parsers=>"YYYY-MM-dd-HH:mm:ss", :config_locale=>"default=en_US", :level=>:warn}
{:timestamp=>"2017-02-06T19:54:56.540000-0200", :message=>"Failed parsing date from field", :field=>"data", :value=>"nha Boardgames", :exception=>"Invalid format: "nha Boardgames"", :config_parsers=>"YYYY-MM-dd-HH:mm:ss", :config_locale=>"default=en_US", :level=>:warn}
{:timestamp=>"2017-02-06T19:54:56.557000-0200", :message=>"Failed parsing date from field", :field=>"data", :value=>"nda", :exception=>"Invalid format: "nda"", :config_parsers=>"YYYY-MM-dd-HH:mm:ss", :config_locale=>"default=en_US", :level=>:warn}"
My logstash.conf is:
input {
file {
path => "/var/odroid/Anuncios.csv*"
start_position => beginning
ignore_older => 0
}
}
filter {
csv {
separator => ";"
columns => ["data","jogo","tipo","obs","estado","preco" ]
}
date {
match => [ "data", "YYYY-MM-dd-HH:mm:ss" ]
}
}
output {
elasticsearch {
hosts => [ "localhost:9200" ]
action => "index"
index => "logstash-%{+YYYY.MM.dd}"
}
}
And a sample of the Anuncios.csv:
017-02-03-22:03:44;survive-escape-from-atlantis;Venda;Conclave;(Usado);R$ 200,00
2017-02-03-22:03:44;through-the-ages-a-new-story-of-civilization;Venda;Caixinha Boardgames;(Lacrado);R$ 376,00
2017-02-03-22:03:44;through-the-ages-a-new-story-of-civilization;Venda;Devir;(Lacrado);R$ 380,00
2017-02-03-22:03:44;through-the-ages-a-new-story-of-civilization;Venda;TudeNerd;(Lacrado);R$ 370,00
2017-02-03-22:03:44;through-the-ages-a-new-story-of-civilization;Venda;Comdado Jogos;(Lacrado);R$ 352,00
2017-02-03-22:03:44;through-the-ages-a-story-of-civilization;Venda;como novo, sleevado;(Usado);R$ 249,00
2017-02-03-22:03:44;through-the-ages-a-story-of-civilization;Venda;Cartas em Sleeves;(Usado);R$ 250,00
2017-02-03-22:03:44;tides-of-time;Venda;Comdado Black Year;(Lacrado);R$ 32,00
2017-02-03-22:03:44;tides-of-time;Venda;Caixinha Boardgames;(Lacrado);R$ 41,00
2017-02-03-22:03:44;xia-legends-of-a-drift-system;Venda;;(Lacrado);R$ 550,00
What am I missing here?