Logstash Filter CSV - Multiple Header

[cmcdowell03 (Cody)]

Hello,
I am trying to parse a relatively complex .csv file with mulitple header lines. I am curious if there has been any headway on this issue or if there is a clever work around. I don't have an issue filtering the header lines into Elasticsearch, my issue is associating the following data lines to the headers that have been filtered. An example of the data goes as follows

Header1,Header2,Header3,Header4
1,2,3,4
5,6,7,8
Header11,Header12,Header13,Header14,Header15
1,2,3,4,5
6,7,8,3,1

When I utilized the autodetect_column_names => true feature only the columns are created but the following data does not relate. It would be nice if there was a way to insert these read columns into an object for the columns => filter. Any help is appreciated.. Thank you

Edit:
I understand the CSV filter is stateless from this previous discussion

Reading the heading (1st line) of CSV file through logstash

Thanks @guyboertje for you quick response.. As per your queries below: How many different CSV structures do you need to parse? > There is no limit for CSV structures, at present we have done for 2 but in future we are expecting more, so would like to generalize for all the structures. Does the filename and/or path contain a clue to the type of CSV structure? > Yes, filepath can be in one location(we can hard code the path) but filename varies.

I would assume there are many people who have run across this issue.