# Using Centralized Pipeline Management and Multiple Pipelines

**URL:** <https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998>\
**Category:** Logstash\
**Created:** [March 19, 2019, 2:58pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998 "2019-03-19T14:58:22Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![jvsell](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jvsell/32/40631_2.png) [@jvsell](https://discuss.elastic.co/u/jvsell)\
**Post date:** [March 19, 2019, 2:58pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998/1 "2019-03-19T14:58:23Z")

</div>

Hi everyone,  
I am trying to use multiple pipelines using the centralized pipeline management from Kibana, but without successful, it possible to do what I'm trying to do? If yes, how?

I don't find any topic or documentation about this.

---

<div class="post-metadata">

**Author:** ![kharvey](https://avatars.discourse-cdn.com/v4/letter/k/d07c76/32.png) [@kharvey](https://discuss.elastic.co/u/kharvey)\
**Post date:** [March 19, 2019, 3:59pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998/2 "2019-03-19T15:59:21Z")

</div>

Do you have any examples of what you are trying to do?

Is this a problem with Kibana, or with Logstash?

You may want to take a look here if it is for Logstash:  
[https://www.elastic.co/guide/en/logstash/current/pipeline-to-pipeline.html](https://www.elastic.co/guide/en/logstash/current/pipeline-to-pipeline.html)

---

<div class="post-metadata">

**Author:** ![jvsell](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jvsell/32/40631_2.png) [@jvsell](https://discuss.elastic.co/u/jvsell)\
**Post date:** [March 20, 2019, 6:36pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998/3 "2019-03-20T18:36:11Z")

</div>

> [@kharvey](#):
>
> Do you have any examples of what you are trying to do?
> 
> Is this a problem with Kibana, or with Logstash?
> 
> You may want to take a look here if it is for Logstash:

Keen, thanks for your atention.

My problem is in Logstash, for example:

I have 1 Logstash running in docker, so I assign the environment variable "xpack.management.pipeline.id" with the following value ["output-internal-queue-1", "output-bdr"], this causes Logstash successfully recognizes both queues and tries to pick up both Elasticsearch queues since I use Centralized Pipelines, but it can not load the pipeline from the second queue, thus finalizing it at Logstash initialization and using only the first one.

Did I explain the scenario well?

---

<div class="post-metadata">

**Author:** ![kharvey](https://avatars.discourse-cdn.com/v4/letter/k/d07c76/32.png) [@kharvey](https://discuss.elastic.co/u/kharvey)\
**Post date:** [March 20, 2019, 6:39pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998/4 "2019-03-20T18:39:17Z")

</div>

Can you give an example of what you want to do? The entire flow of what you want.

It sounds like you want 2 logstashes to process the same file, which is totally doable.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 17, 2019, 6:39pm UTC](https://discuss.elastic.co/t/using-centralized-pipeline-management-and-multiple-pipelines/172998/5 "2019-04-17T18:39:17Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
