I am trying to use multiple pipelines and my pipeline.yml
is the following:
- pipeline.id: main
path.config: "/etc/logstash/conf.d/*.conf"
- pipeline.id: p_mapping_users
path.config: "/etc/logstash/mapping_pipelines/mapping_users.conf"
- pipeline.id: p_mapping_fqdnvh
path.config: "/etc/logstash/mapping_pipelines/mapping_fqdnvh.conf"
- pipeline.id: p_mapping_user_agents
pipeline.id: "/etc/logstash/mapping_pipelines/mapping_user_agents.conf"
- pipeline.id: p_mapping_hosts
pipeline.id: "/etc/logstash/mapping_pipelines/mapping_hosts.conf"
- pipeline.id: p_mapping_sldomain
path.config: "/etc/logstash/mapping_pipelines/mapping_sldomain.conf"
- pipeline.id: p_mapping_channels
path.config: "/etc/logstash/mapping_pipelines/mapping_channels.conf
The weird thing is that logstash
starts most of them (5 out of 7)
[2018-05-17T15:52:19,239][INFO ][logstash.agent ] Pipelines running {:count=>5, :pipelines=>["main", "p_mapping_channels", "p_mapping_fqdnvh", "p_mapping_sldomain", "p_mapping_users"]}
No error whatsoever in my logs.
How to debug this?
Is there a setting that limits the max pipeline number or something?