im currently having an issue with creating a multiple pipelines in logstash. I can't get enough information out of the documentation to get the pipelines running.
Where in the logstash.yml config should i reference on the pipelines.yml file?
What should the property "path.config" look like when im using multiple pipelines? When going for /etc/logstash/conf.d/*.conf it is translated as one pipeline...
right now, my pipelines.yml file is located at /etc/logstash/pipelines.yml.
Im really looking forward for your answer
You do not need to reference pipelines.yml in logstash.yml. If you do not pass it any config files (e.g. -f) then logstash looks in path.settings for pipelines.yml
To the second part, you can pass either a single file or a regexp to a pipeline. Thus you might have
- pipeline.id: foo
path.config: "/etc/logstash/conf.misc/DoFoo.conf"
# or
- pipeline.id: bar
path.config: "/etc/logstash/conf.bar/*.conf"
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.