# A Failed Logstash pipeline is causing other pipelines to fail!

**URL:** <https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275>\
**Category:** Logstash\
**Created:** [September 12, 2019, 2:36pm UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275 "2019-09-12T14:36:16Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![baselai](https://avatars.discourse-cdn.com/v4/letter/b/ea666f/32.png) [@baselai](https://discuss.elastic.co/u/baselai)\
**Post date:** [September 12, 2019, 2:36pm UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275/1 "2019-09-12T14:36:16Z")

</div>

I have Logstash V 7.3.0 running with 4 pipelines:

> pipeline\_a.conf  
> pipeline\_b.conf  
> pipeline\_c.conf  
> pipeline\_d.conf

and they're all in the same folder.

**When** `pipeline_a.conf` is **failing** for some reason, which it's not my question, but having it failed **is causing the other pipelines (b, c and d) failing and all of them down!**

Note: I don't have any **`logstash.yml`** or **`pipelines.yml`** set in the logstash instance I'm running.

**Update:**  
I checked the documentation and some topics in here, but I couldn't figure it out how to start and what to add to configure one Logstash instance to run multiple pipelines!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 13, 2019, 5:46am UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275/2 "2019-09-13T05:46:07Z")

</div>

If you have multiple config files in a single directory and do not use `pipelines.yml` all files are concatenated into a single pipeline. Unless you use conditionals to control flow data from all inputs will go to all outputs, and this is also why one config failing affects the entire pipeline.

---

<div class="post-metadata">

**Author:** ![baselai](https://avatars.discourse-cdn.com/v4/letter/b/ea666f/32.png) [@baselai](https://discuss.elastic.co/u/baselai)\
**Post date:** [September 13, 2019, 3:02pm UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275/3 "2019-09-13T15:02:33Z")

</div>

@Christian_Dahlqvist thanks for the reply!  
What if i put them in a separate folders? would that help instead of having the `pipelines.yml` file because it's difficult to create it! i couldn't figure it out.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 13, 2019, 3:32pm UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275/4 "2019-09-13T15:32:57Z")

</div>

No, using the pipelines.yml file is the only way to have independent pipelines within a single Logstash process.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 11, 2019, 3:32pm UTC](https://discuss.elastic.co/t/a-failed-logstash-pipeline-is-causing-other-pipelines-to-fail/199275/5 "2019-10-11T15:32:57Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.