# Is it possible to use multiple pipeline.yml files?

**URL:** <https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006>\
**Category:** Logstash\
**Created:** [March 22, 2024, 4:14pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006 "2024-03-22T16:14:27Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Aroque\_R](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aroque_r/32/128831_2.png) [@Aroque\_R](https://discuss.elastic.co/u/Aroque_R)\
**Post date:** [March 22, 2024, 4:14pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006/1 "2024-03-22T16:14:27Z")

</div>

I was thinking if i can set multiple pipeline.yml for multiple instances in the same machine  
like one in /etc/logstash/team\_x  
other in /etc/logstash/team\_y

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [March 22, 2024, 4:44pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006/2 "2024-03-22T16:44:44Z")

</div>

You cannot change the name of pipelines.yml, but you can change the location using --path.settings on the command line or the LS\_SETTINGS\_DIR environment variable.

---

<div class="post-metadata">

**Author:** ![tdanno](https://avatars.discourse-cdn.com/v4/letter/t/f0a364/32.png) [@tdanno](https://discuss.elastic.co/u/tdanno)\
**Post date:** [March 28, 2024, 8:24pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006/3 "2024-03-28T20:24:22Z")

</div>

You may have specific benefits or efficiencies in mind when choosing this deployment model, but prima facie it is not a good idea. The problem with this model is that one logstash application cannot have insight into the others running.

However, if you run ONE logstash with multiple pipelines (which can be broken down into multiple pipeline files, for breaking apart the config) and it can track all of them. From there you can figure out resource contention between the pipelines.

One alternate is if you ran docker with multiple logstash instances running that way- but again, they won't know about each other.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 25, 2024, 8:24pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-multiple-pipeline-yml-files/356006/4 "2024-04-25T20:24:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
