Logstash ignores some pipelines

(Pantelis Karamolegkos) #1

I am trying to use multiple pipelines and my pipeline.yml is the following:

- pipeline.id: main
  path.config: "/etc/logstash/conf.d/*.conf"
- pipeline.id: p_mapping_users
  path.config: "/etc/logstash/mapping_pipelines/mapping_users.conf"
- pipeline.id: p_mapping_fqdnvh
  path.config: "/etc/logstash/mapping_pipelines/mapping_fqdnvh.conf"
- pipeline.id: p_mapping_user_agents
  pipeline.id: "/etc/logstash/mapping_pipelines/mapping_user_agents.conf"
- pipeline.id: p_mapping_hosts
  pipeline.id: "/etc/logstash/mapping_pipelines/mapping_hosts.conf"
- pipeline.id: p_mapping_sldomain
  path.config: "/etc/logstash/mapping_pipelines/mapping_sldomain.conf"
- pipeline.id: p_mapping_channels
  path.config: "/etc/logstash/mapping_pipelines/mapping_channels.conf

The weird thing is that logstash starts most of them (5 out of 7)

[2018-05-17T15:52:19,239][INFO ][logstash.agent           ] Pipelines running {:count=>5, :pipelines=>["main", "p_mapping_channels", "p_mapping_fqdnvh", "p_mapping_sldomain", "p_mapping_users"]}

No error whatsoever in my logs.

How to debug this?

Is there a setting that limits the max pipeline number or something?

(Pantelis Karamolegkos) #2

I have erroneously used pipeline.id in the place of path.config in the 2 pipelines not running...

(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.