# Multiple pipelines with distributor pattern

**URL:** <https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210>\
**Category:** Logstash\
**Created:** [October 12, 2018, 9:41am UTC](https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210 "2018-10-12T09:41:44Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kamen\_MacKay](https://avatars.discourse-cdn.com/v4/letter/k/5f9b8f/32.png) [@Kamen\_MacKay](https://discuss.elastic.co/u/Kamen_MacKay)\
**Post date:** [October 12, 2018, 9:41am UTC](https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210/1 "2018-10-12T09:41:44Z")

</div>

I've just started working with multiple pipelines and the distributor pattern. Am I correct in my understanding that I have to copy'n'paste my individual logstash config contents for each pipeline into pipelines.yml in order for it to work properly. I tried the following but the errors in the logs seem to indicate what my question is asking...

```
- pipeline.id: beats-server
  config.string: |
    input { beats { port => 5200 } }
    output {
        if [type] == syslog
          {
          pipeline { send_to => syslogs }
          }
            }
- pipeline.id: syslogs
  config.string: |
    input { pipeline
    {
      address => syslogs
        }
    }
  path.config: "/etc/logstash/pipelines/syslogs/*.conf"

```

If my assumption is correct, are there any plans to allow a config like I posted above?

---

<div class="post-metadata">

**Author:** ![nico2](https://avatars.discourse-cdn.com/v4/letter/n/838e76/32.png) [@nico2](https://discuss.elastic.co/u/nico2)\
**Post date:** [October 29, 2018, 1:41pm UTC](https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210/2 "2018-10-29T13:41:11Z")

</div>

in pipelines.yml :

- pipeline.id: beats-server  
config.string: |  
input { beats { port =\> 5200 } }  
output {  
if [type] == syslog  
{  
pipeline { send\_to =\> syslogs }  
}  
}
- pipeline.id: syslogs  
path.config: "/etc/logstash/pipelines/syslogs/\*.conf"

in your .conf :  
input { pipeline { address =\> syslogs } }

---

<div class="post-metadata">

**Author:** ![Kamen\_MacKay](https://avatars.discourse-cdn.com/v4/letter/k/5f9b8f/32.png) [@Kamen\_MacKay](https://discuss.elastic.co/u/Kamen_MacKay)\
**Post date:** [October 30, 2018, 4:46pm UTC](https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210/3 "2018-10-30T16:46:25Z")

</div>

I've fiddled with this for an hour or so but no luck. When I test my syslog.conf in the proper pipeline directory, I get:

`16:34:06.336 [LogStash::Runner] FATAL logstash.runner - The given configuration is invalid. Reason: Couldn't find any input plugin named 'pipeline'. Are you sure this is correct? Trying to load the pipeline input plugin resulted in this error: Problems loading the requested plugin named pipeline of type input. Error: NameError NameError`

I used the logstash-plugin command and a 'logstash-input-pipeline' plugin doesn't exist.

Do you actually have this running on a live system or was this an educated guess?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 27, 2018, 4:46pm UTC](https://discuss.elastic.co/t/multiple-pipelines-with-distributor-pattern/152210/4 "2018-11-27T16:46:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.