Multiple pipelines - logstash cannot start

Hello,

I have logstash 7.6.0 and I am trying to have multiple pipelines
the configuration is the below

[root@elastic1 logstash]# vi pipelines.yml            
# This file is where you define your pipelines. You can define multiple.
# For more information on multiple pipelines, see the documentation:
#   https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html

#- pipeline.id: main
#  path.config: "/etc/logstash/conf.d/*.conf"


  ece-logs
- pipeline.id: ecelogs
  path.config: "/etc/logstash/conf.d/01-ece1.conf"

# ip_syslogs
- pipeline.id: ipsyslogs
  path.config: "/etc/logstash/conf.d/02-syslogs.conf"

for the error while i am trying to start logstash check the attachments

I did try try a lot of idea from the forum but none of them is working

If i run only one pipeline (any of the two) is working properly.

Thank you

Hi,

What is the content of the pipelines? My guess is that the pipelines have a beats input with a port number which is the same in both pipelines. If you start a single pipeline it works, when starting both pipelines you get a port number conflict.

Best regards
Wolfram

Hi,

indeed, both listen at 9220

input {
    beats {
        port => "9220"
    }
}

so this is the problem? they have to listen at different ports?

Thank you

Yes, each pipeline has to have its separate port.

Alternatively, you can check if both pipelines can be merged together: If parsing is only slightly different you can use conditionals in Logstash filters and the output can contain variables to write to different indexes but this depends on the data and the usecase.

Best regards
Wolfram

No, there are completely different!

thanks!!!

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.