I have created my module in filebeat and my log can be ingested.
For filebeat.input, there is a feature called "include_lines", which we could only include the lines which matched the regex.
In filebeat module, I tried to add "include_lines" in modules.d/mymodule.yml but the filtering is not working.
If I use filebeat.input, the fields cannot be parsed correct because the log is in my customised format.
May I ask how could I use include_lines in my own filebeat module? Thanks.