How to properly config Logstash for multiple Pipelines

Elastic Stack Logstash
1

Hello,

im currently having an issue with creating a multiple pipelines in logstash. I can't get enough information out of the documentation to get the pipelines running.

  1. Where in the logstash.yml config should i reference on the pipelines.yml file?
  2. What should the property "path.config" look like when im using multiple pipelines? When going for /etc/logstash/conf.d/*.conf it is translated as one pipeline...

right now, my pipelines.yml file is located at /etc/logstash/pipelines.yml.
Im really looking forward for your answer

Best regards
Alex

2

You do not need to reference pipelines.yml in logstash.yml. If you do not pass it any config files (e.g. -f) then logstash looks in path.settings for pipelines.yml

To the second part, you can pass either a single file or a regexp to a pipeline. Thus you might have

- pipeline.id: foo
  path.config: "/etc/logstash/conf.misc/DoFoo.conf"
# or
- pipeline.id: bar
  path.config: "/etc/logstash/conf.bar/*.conf"