Multiple pipelines + docker

[hilt86]

After reading the docs on running logstash on docker it isn't clear how we should treat the pipelines.yml file when using docker.

I have tried bind mounting like so

   volumes:
  - /root/pipeline2/:/usr/share/logstash/pipeline/
  - /root/pipeline/pipeline.yml:/usr/share/logstash/config/pipeline.yml 

From what I can tell logstash should look for the pipelines.yml in /usr/share/logstash/config/pipeline.yml which has contents like

- pipeline.id: logstash
  path.config: "/root/pipeline2/logstash.conf"
- pipeline.id: metricbeat
  path.config: "/root/pipeline2/metricbeat.conf"

and finally /root/pipeline2/ has the logstash and metricbeat.conf files..

H

[magnusbaeck (Magnus Bäck)]

The paths inside pipeline.yml should reference the files in the Docker container's file system, i.e. /usr/share/logstash/pipeline/logstash.conf and /usr/share/logstash/pipeline/metricbeat.conf.

[hilt86]

Thanks @magnusbaeck....your solution seems obvious now that you mention it...much appreciated!