Multiple pipelines - logstash cannot start

Elastic Stack Logstash
1

Hello,

I have logstash 7.6.0 and I am trying to have multiple pipelines
the configuration is the below

[root@elastic1 logstash]# vi pipelines.yml            
# This file is where you define your pipelines. You can define multiple.
# For more information on multiple pipelines, see the documentation:
#   https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html

#- pipeline.id: main
#  path.config: "/etc/logstash/conf.d/*.conf"


  ece-logs
- pipeline.id: ecelogs
  path.config: "/etc/logstash/conf.d/01-ece1.conf"

# ip_syslogs
- pipeline.id: ipsyslogs
  path.config: "/etc/logstash/conf.d/02-syslogs.conf"

for the error while i am trying to start logstash check the attachments

I did try try a lot of idea from the forum but none of them is working

If i run only one pipeline (any of the two) is working properly.

Thank you

error1
error11873×771 619 KB
error2
error21871×541 424 KB

2

Hi,

What is the content of the pipelines? My guess is that the pipelines have a beats input with a port number which is the same in both pipelines. If you start a single pipeline it works, when starting both pipelines you get a port number conflict.

Best regards
Wolfram

3

Hi,

indeed, both listen at 9220

input {
    beats {
        port => "9220"
    }
}

so this is the problem? they have to listen at different ports?

Thank you

4

Yes, each pipeline has to have its separate port.

Alternatively, you can check if both pipelines can be merged together: If parsing is only slightly different you can use conditionals in Logstash filters and the output can contain variables to write to different indexes but this depends on the data and the usecase.

Best regards
Wolfram

5

No, there are completely different!

thanks!!!