CSV file with different record types


(Khoa Nguyen) #1

Our files are in CSV format but each line can be of a different record type. For example:

f1,f2,f3
g1,g2,g3,g4,g5
h1,h2,h3,h4

Record type can be determined by examining the value of the first field. How do I write a CSV filter for this?


(Magnus B├Ąck) #2

You could use a conditional to take a peek at the line and based on that choose between different csv filters.

if [message] =~ /^some pattern/ {
  csv {
    ...
  }
} else if [message] =~ /^other pattern/ {
  csv {
    ...
  }
}

(Khoa Nguyen) #3

Thanks for the elegant solution. I will give this a try


(system) #4