How to print or store all skipped lines of a large log file?

Dear All,

Some times due incorrect pattern of some lines of logs inside complete log files are skipped by logstash.

It only sends all lines having pattern matched to grok syntax i have written.

Actually my team want to see which lines of logs are skipped or not read by logstash sothat we can make that pattern correct.

I have added

output {

if "_grokparsefailure" in [tags] {

stdout { 

codec => rubydebug

}

}

else

{
}
}

but it only prints the grok parse failure for lines read by logstash

So how to print or store all skipped lines in a output log file .

Where are the lines being skipped? If they do not reach Logstash it is naturally impossible for Logstash to print them.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.