Two pipelines for the same file

Do not have any two prospectors report the same file. The files state/offset is currently stored global and these two prospectors will interleave.

You can use the when.equals condition with match or regex, to check a log message starts with any of these, and then ship do to the respective pipeline. Are the logs that different, that you really need a different pipeline? e.g. in on can configure multiple patterns in the grok processor.

1 Like