I have logstash 7.6.0 and I am trying to have multiple pipelines
the configuration is the below
[root@elastic1 logstash]# vi pipelines.yml
# This file is where you define your pipelines. You can define multiple.
# For more information on multiple pipelines, see the documentation:
# https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html
#- pipeline.id: main
# path.config: "/etc/logstash/conf.d/*.conf"
ece-logs
- pipeline.id: ecelogs
path.config: "/etc/logstash/conf.d/01-ece1.conf"
# ip_syslogs
- pipeline.id: ipsyslogs
path.config: "/etc/logstash/conf.d/02-syslogs.conf"
for the error while i am trying to start logstash check the attachments
I did try try a lot of idea from the forum but none of them is working
If i run only one pipeline (any of the two) is working properly.
What is the content of the pipelines? My guess is that the pipelines have a beats input with a port number which is the same in both pipelines. If you start a single pipeline it works, when starting both pipelines you get a port number conflict.
Alternatively, you can check if both pipelines can be merged together: If parsing is only slightly different you can use conditionals in Logstash filters and the output can contain variables to write to different indexes but this depends on the data and the usecase.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.