Multiple Pipelines with the Logstash Helm Chart

[dbwest (David West)]

Hi, we have Logstash deployed using the Helm Chart at https://github.com/elastic/helm-charts/tree/master/logstash . We want to configure multiple pipelines.

The values.yaml has these comments in it:

## NOTE: To achieve multiple pipelines with this chart, current best practice
## is to maintain one pipeline per chart release. In this way configuration is
## simplified and pipelines are more isolated from one another.

What does that mean we have to do? Do we run multiple releases with different values to handle all the pipelines? Thanks.

[Julien_MAILLERET]

Hi @dbwest,
The comment you mention comes from Logstash chart from Helm Stable repo which is not managed by Elastic.

If you want to use multiple pipelines with Elastic Logstash Chart, you can add the content of different pipelines config files in logstashPipeline value:

logstashPipeline:
  logstash.conf: |
    input { exec { command => "uptime" interval => 30 } }
    output { elasticsearch { hosts => ["http://elasticsearch-master:9200"] index => "logstash" } }
  uptime.conf: |
    input { exec { command => "who" interval => 30 } }
    output { elasticsearch { hosts => ["http://elasticsearch-master:9200"] index => "logstash" } }