Customized decode_csv_fields in filebeat

Hello everyone,

I started using filebeat to send logs in csv format to elasticsearch, but I didn't find any way to configure filebeat to tell it where to take the headers of csv files, and I don't want to pass through Ingest Pipelines elasticsearch for example which will be static, I want filebeat to take these headers in the file itself (first line) or in a conf file.
for ex here is my csv logs :

firstname,lastname
chris,paul
baptiste,jean

and i want it parse like

{firstname:chris;lastname:paul}
{firstname:baptiste;lastname:jean}

, so I took over the filebeat project on github and I added a new similar processor decode_csv_fields to implement this feature, I compiled and tested it seems to work.
And so I wanted to know how to perform units on this processor and if i can make a pull request

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.