Multiple pipeline on single host not working as expected

Elastic Stack Logstash
1

When defining multiple pipelines on single host with output to elasticsearch in different indices (each pipeline points its own separate config file, different pipeline id and different output index name defined in config file), logstash throws errors because of parsing using different config file than specified for pipeline. Individual single pipeline with same config works fine. Is there another setting required for multiple pipeline on same host. Logstash version 8.13.4.

example pipe line defined in pipeline.yml as

- pipeline.id: client_analytics
  path.config: "/etc/logstash/conf.d/clientAnalyticsLog.conf"
- pipeline.id: client_session
  path.config: "/etc/logstash/conf.d/clientSessionLog.conf"


In the config files output section of respective config file

output {
    elasticsearch {
        ...
        index => "client_analytics_log"
        }
}

in second config file
output {
    elasticsearch {
      ...
        index => "client_session_log"
        }
}
2

Exactly what errors does it throw?

3

Please ignore the issue. Found the problem.

1 Like