# Logstash multiple pipelines bug?
**URL:** https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582
**Category:** Logstash
**Created:** [January 31, 2019, 2:57pm UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582 "2019-01-31T14:57:10Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@sabdoul](https://discuss.elastic.co/u/sabdoul)
#### Post date: [January 31, 2019, 2:57pm UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582/1 "2019-01-31T14:57:10Z")
Hello,
I made a mutiple pipeline with version 6.6 of logstash. But, he has behavior that is unexpected.
Indeed I have my multiple pipeline that generates duplicates of the data as if making a loop before stopping the processing. For 3 lines of message in file it generates randomly 200 or 500 or 700 lines of the 3 lines of messages duplicated in outputs. Also my input exec doesn't generate anything for me. so if I run it alone it works fine. Below my code :
`File pipelines.yml`
```auto
- pipeline.id: main
queue.type: persisted
path.config: "/etc/logstash/conf.d/main.conf"
- pipeline.id: els
queue.type: persisted
path.config: "/etc/logstash/conf.d/els.conf"
- pipeline.id: file
queue.type: persisted
path.config: "/etc/logstash/conf.d/output_file.conf"
```
`file main.conf`
```auto
input {
file {
path => "/etc/logstash/test.txt"
start_position => "beginning"
sincedb_path => "/dev/null"
tags => "file_test"
}
exec {
codec => "json"
command => "bash /etc/logstash/curl.sh"
interval => 30
tags => "stats"
}
}
output {
if "stats" in [tags] {
elasticsearch {
hosts => ["localhost:9200"]
index => "index-test"
}
}
if "file_test" in [tags] {
pipeline {
send_to => [els, output_file]
}
}
stdout { codec => rubydebug }
}
```
`file els.conf`
```auto
input {
pipeline { address => els }
}
filter {
....
}
output {
if "old_date" in [tags] {
file {
path => "/opt/logstash/old/old_log.log"
codec => line { format => "%{message}"}
}
}
if "old_date" not in [tags] {
elasticsearch {
hosts => ["localhost:9200"]
index => "index-test2"
}
}
}
```
`output_file.conf`
```auto
input {
pipeline { address => output_file }
}
output {
file
{
path => "/opt/logstash/new/new.log"
codec => line { format => "%{message}"}
}
}
```
Is this behavior a bug? If not, how can this be resolved?
Thank you in advance
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [February 1, 2019, 7:34am UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582/2 "2019-02-01T07:34:52Z")
It looks like the pipelines are not being picked up, and the fact that you have stored your configs in the standard config directory to some extent hides this. I suspect the reason for this is that your config file is named `pipeline.yml` and not `pipelines.yml`, which [the documentation](https://www.elastic.co/guide/en/logstash/6.6/multiple-pipelines.html) indicates is the correct name.
---
### Author:  [@sabdoul](https://discuss.elastic.co/u/sabdoul)
#### Post date: [February 1, 2019, 8:16am UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582/3 "2019-02-01T08:16:23Z")
it's an entry error. it is pipelines.yml which is well in the configuration directory.
I just modified the contents of the pipelines.yml file in its default directory after installation.
---
### Author:  [@sabdoul](https://discuss.elastic.co/u/sabdoul)
#### Post date: [February 4, 2019, 10:31am UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582/4 "2019-02-04T10:31:05Z")
The pronleme has been resolved by removing the c`onf queue.type: persisted` in the pipeline configuration
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 4, 2019, 10:31am UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-bug/166582/5 "2019-03-04T10:31:07Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.