# Logstash Multiple Pipeline

**URL:** https://discuss.elastic.co/t/logstash-multiple-pipeline/124899
**Category:** Logstash
**Created:** [March 21, 2018, 3:53am UTC](https://discuss.elastic.co/t/logstash-multiple-pipeline/124899 "2018-03-21T03:53:49Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![satya\_sandeep](https://avatars.discourse-cdn.com/v4/letter/s/e5b9ba/32.png) [@satya\_sandeep](https://discuss.elastic.co/u/satya_sandeep)
#### Post date: [March 21, 2018, 3:53am UTC](https://discuss.elastic.co/t/logstash-multiple-pipeline/124899/1 "2018-03-21T03:53:49Z")

</div>

Hi All,  
I am curious to know running multiple pipelines in logstash  
I uncomment the path.config in logstash.yml and keep some pipeline configs in pipelines.yml, how can i add more configs without stopping existing processes and how do I stop a particular pipeline.

---

<div class="post-metadata">

### Author: ![rcowart](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rcowart/32/88091_2.png) [@rcowart](https://discuss.elastic.co/u/rcowart)
#### Post date: [March 21, 2018, 8:07am UTC](https://discuss.elastic.co/t/logstash-multiple-pipeline/124899/2 "2018-03-21T08:07:51Z")

</div>

First configure Logstash to reload its configuration when it changes with these settings in `logstash.yml`

```auto
config.reload.automatic: true
config.reload.interval: 10s

```

Whenever you add new pipelines to `pipelines.yml` they will be started automatically. When you delete (or comment out) a pipeline it will be stopped.

Since you are worried about adding/removing pipelines without restarting Logstash you might also want to consider designing your ingest method to use a queue between Logstash roles such as...

LS Collector --\> Redis or Kafka --\> LS Processor --\> Elasticsearch

The Logstash collector is very simple and almost never needs to be restarted. This gives you the flexibility to modify and restart the Logstash processor instance(s) with no loss of data. Any new data will be queued and handled once the processor is restarted.

---

<div class="post-metadata">

### Author: ![satya\_sandeep](https://avatars.discourse-cdn.com/v4/letter/s/e5b9ba/32.png) [@satya\_sandeep](https://discuss.elastic.co/u/satya_sandeep)
#### Post date: [March 28, 2018, 11:43am UTC](https://discuss.elastic.co/t/logstash-multiple-pipeline/124899/3 "2018-03-28T11:43:04Z")

</div>

Is there anyway i can have specific log for a particular pipeline

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [April 25, 2018, 11:43am UTC](https://discuss.elastic.co/t/logstash-multiple-pipeline/124899/4 "2018-04-25T11:43:56Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
