CSV file with different record types

Elastic Stack Logstash
1

Our files are in CSV format but each line can be of a different record type. For example:

f1,f2,f3
g1,g2,g3,g4,g5
h1,h2,h3,h4

Record type can be determined by examining the value of the first field. How do I write a CSV filter for this?

2

You could use a conditional to take a peek at the line and based on that choose between different csv filters.

if [message] =~ /^some pattern/ {
  csv {
    ...
  }
} else if [message] =~ /^other pattern/ {
  csv {
    ...
  }
}
3

Thanks for the elegant solution. I will give this a try