Hi everyone,
I need a solution for a similar problem.
i have a logstash configuration using the csv filter containing columns say
csv{ columns => ["A", "B", "C","D","E"] seperator => "," skip_empty_columns => true }
and say if my CSV file has values only for [B,C,D,E] ie, there is no column named "A".
when i run my Logstash with particular configuration, what happens is that Logstash puts the value of column "B" in place of Column "A" and so on. Finally there is no value for column "E". Since i have given the option of
skip_empty_columns => true
Column "E" is omitted.
I am looking for a solution where Logstash has to take values and map them to the respective Column and not in some order.