# Trouble Running a Second Pipeline in Logstash 8.x (Multiple Pipelines Not Working)

**URL:** https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956
**Category:** Logstash
**Created:** [December 10, 2025, 2:21pm UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956 "2025-12-10T14:21:46Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Grzegosz](https://avatars.discourse-cdn.com/v4/letter/g/6bbea6/32.png) [@Grzegosz](https://discuss.elastic.co/u/Grzegosz)
#### Post date: [December 10, 2025, 2:21pm UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/1 "2025-12-10T14:21:46Z")

</div>

**Hello.  
Please help me understand why the second pipeline in Logstash is not working. I have Logstash 8+ installed. I added a second pipeline path in the `pipelines.yml` file as follows:**

```auto
- pipeline.id: audit
  path.config: "/etc/logstash/conf.d/audit_log/*.conf"
- pipeline.id: main
  path.config: "/etc/logstash/conf.d/*.conf"

```

**Before that, I created the directory `audit_log`, provided the necessary permissions, and set the owner to `logstash`. I created a new pipeline `test.conf` which looks like this:**

```auto
input {
  tcp {
    port => 1515
    type => "syslog"
  }
  udp {
    port => 2515
    type => "syslog"
  }
}

filter {
  if [message] =~ /\s+audit:/ {
    mutate {
      add_tag => ["audit"]
    }
    grok {
      match => {
        "message" => "<%{INT:syslog_pri}>%{SYSLOGTIMESTAMP:syslog_timestamp}\s+%{HOSTNAME:hostname}\s+audit:\s+%{USER:command_user} \[%{INT:uid}\]:\s+%{INT:audit_pid}\s+%{TIMESTAMP_ISO8601:audit_timestamp}\s+%{DATA:command}\s+\[%{INT:result}\]\s+\(original user: %{USER:original_user}\)"
      }
    }
    ruby {
      code => "
        if event.get('result') == '0'
          event.set('result', 'Successfully')
        elsif event.get('result')
          event.set('result', 'Error. Return code: ' + event.get('result').to_s)
        end
      "
    }
  }
}

output {
  elasticsearch {
    hosts => ["https://192.168.0.1:9200", "https://192.168.0.2:9200", "https://192.168.0.3:9200"]
    index => "audit-commands-%{+YYYY.MM.dd}"
    ssl => true
    ssl_certificate_verification => true
    cacert => "/etc/logstash/root.pem"
    user => "logstash"
    password => "xxx"
  }
}

```

**This setup is not working. Could you please tell me what I am doing wrong?**

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [December 10, 2025, 2:30pm UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/2 "2025-12-10T14:30:46Z")

</div>

Hello and welcome,

> [@Grzegosz](#):
>
> This setup is not working. Could you please tell me what I am doing wrong?

You need to share what you have in your logstash logs, without the logs is not possible to understand what could be the issue.

Also, what does your other logstash looks like? You only shared one pipeline configuration.

---

<div class="post-metadata">

### Author: ![Grzegosz](https://avatars.discourse-cdn.com/v4/letter/g/6bbea6/32.png) [@Grzegosz](https://discuss.elastic.co/u/Grzegosz)
#### Post date: [December 11, 2025, 7:08am UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/3 "2025-12-11T07:08:18Z")

</div>

I found this information in the logs: "[2025-12-11T09:57:25,335][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified". This means the 'mail' pipeline is loading, but the second one is not. I don't understand why this is happening?

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [December 11, 2025, 9:15am UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/4 "2025-12-11T09:15:39Z")

</div>

> [@Grzegosz](#):
>
> understand why this is happening?

How did you start LS? As a process with -f /path/file.conf? That means it will run only a single file. Easiest way to start as a service.

> When you start Logstash without arguments, it will read the `pipelines.yml` file and instantiate all pipelines specified in the file. On the other hand, when you use `-e` or `-f` , Logstash ignores the `pipelines.yml` file and logs a warning about it.

For multiple .conf files, you can use cmds:  
logstash -f file1.conf -f file2.conf -f file3.conf

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [December 11, 2025, 1:39pm UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/5 "2025-12-11T13:39:54Z")

</div>

> [@Grzegosz](#):
>
> I found this information in the logs: "[2025-12-11T09:57:25,335][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified". This means the 'mail' pipeline is loading, but the second one is not. I don't understand why this is happening?

How are you starting logstash?

When using multiple pipelines you should run logstash as service with `systemctl start logstash`.

> [@Rios](#):
>
> For multiple .conf files, you can use cmds:  
> logstash -f file1.conf -f file2.conf -f file3.conf

This may work, but is not the same as running multiple pipelines, this will merge all configurations into one, they will not be isolated and the inputs, filters and outputs will be applied to all events.

Using `pipelines.yml` with multiple pipelines isolate the pipelines from each other.

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [December 11, 2025, 3:36pm UTC](https://discuss.elastic.co/t/trouble-running-a-second-pipeline-in-logstash-8-x-multiple-pipelines-not-working/383956/6 "2025-12-11T15:36:17Z")

</div>

> [@leandrojmp](#):
>
> This may work, but is not the same as running multiple pipelines, this will merge all configurations into one, they will not be isolated and the inputs, filters and outputs will be applied to all events.

Good point to underline. The pipeline isolate .conf files. However my point was that if you have multiple files in a directory, i.e. _audit\_log/_.conf\* than you can run as cmd by adding all files.
