# Pipeline to pipeline communication - logstash data

**URL:** https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914
**Category:** Logstash
**Created:** [June 5, 2020, 8:45am UTC](https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914 "2020-06-05T08:45:58Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![Pankaj\_Jadhav](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pankaj_jadhav/32/65896_2.png) [@Pankaj\_Jadhav](https://discuss.elastic.co/u/Pankaj_Jadhav)
#### Post date: [June 5, 2020, 8:45am UTC](https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914/1 "2020-06-05T08:45:58Z")

</div>

Pipeline1 :- ds\_test.conf

```auto
input { generator { count => 1 lines => [''] } }

filter {
    mutate { add_field => { "[eventHeader][applicationId]" => "A" "[eventHeader][objectCode]" => 1 } }
    mutate { add_field => { "[@metadata][ObjectCode]" => "%{[eventHeader][applicationId]}_%{[eventHeader][objectCode]}"} }

   #prune { whitelist_names => ["itemId","IndexedOn","field","text","softDelete","normalizedText","type","appId","nounModifier","contactcode"] }
}

output { pipeline { send_to => [ds_test1] } }
=========================================
pipeline 2:- ds_test1.conf
input {
    pipeline { address => "ds_test1"}
}
filter {
     mutate { add_field => { "test" => "%{[@metadata][ObjectCode]}"} }
}

output{
    stdout { codec => rubydebug { metadata => true} }
}
=======================================================

am not able to see any debug output

command debug:- /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/ds_test.conf -f /etc/logstash/conf.d/ds_test1.conf --path.settings=/etc/logstash

please let me know how i can see event and metadata in pipeline 2
```

---

<div class="post-metadata">

### Author: ![ptamba](https://avatars.discourse-cdn.com/v4/letter/p/7feea3/32.png) [@ptamba](https://discuss.elastic.co/u/ptamba)
#### Post date: [June 5, 2020, 3:28pm UTC](https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914/2 "2020-06-05T15:28:19Z")

</div>

> [@Pankaj\_Jadhav](#):
>
> `usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/ds_test.conf -f /etc/logstash/conf.d/ds_test1.conf -`

you can’t use multiple -f in cli. only the last one will be used.

from the [docs](https://www.elastic.co/guide/en/logstash/current/running-logstash-command-line.html) :

**`-f, --path.config CONFIG_PATH`**

Load the Logstash config from a specific file or directory. If a directory is given, all files in that directory will be concatenated in lexicographical order and then parsed as a single config file. Specifying this flag multiple times is not supported. If you specify this flag multiple times, Logstash uses the last occurrence (for example, `-f foo -f bar` is the same as `-f bar` ).

---

<div class="post-metadata">

### Author: ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [June 5, 2020, 3:46pm UTC](https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914/3 "2020-06-05T15:46:59Z")

</div>

To run multiple pipelines you have to configure pipelines.yml, which is typically in /etc/logstash.

```
- pipeline.id: pipe1
  path.config: "/path/to/ds_test.conf"
- pipeline.id: pipe2
  path.config: "/path/to/ds_test1.conf"

```

Do not use -f since that will cause pipelines.yml to be ignored.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 3, 2020, 3:47pm UTC](https://discuss.elastic.co/t/pipeline-to-pipeline-communication-logstash-data/235914/4 "2020-07-03T15:47:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
