this is my scenario:
one directory with two types of files that i want to proccess with one pipeline each. File types are identified by his name. I am very new to pipeline logstash, i usually go with a single logstash configuration but things are getting complex and i would like to use different pipelines for each type of file to separate logic and a better maintenance
filebeat.inputs: - type: log enabled: true paths: C:\files\*apache-log*.txt tags: ["type1"] - type: log enabled: true paths: C:\files\*ngnix-log*.txt tags: ["type2"]
How can apply one pipeline base on the file type using multiple pipelines mode?
- pipeline.id: pipeline-for-type1-files path.config: "/etc/path/to/type1-pipeline.config" - pipeline.id: pipeline-for-type2-files path.config: "/etc/different/path/type2-pipeline.config"
If logstash recieves type1 files apply pipeline-for-type1-files and if recieves type2 apply pipeline-for-type2-files. Could you give some sample code of how to handle this?