Logstash centralized pipeline

Elastic Stack Logstash
1

Hi,
I use Logstash centralized pipeline in my new cluster.
I create pipeline for filebeat with: input/filter/output and it is work excellent.
Now I want to add another pipeline from different filebeat that use same port 5044 :
I create new pipeline without input segment (port is already up) only filter and output .
And got "Pipeline terminated" ...

In my old cluster i was use local conf files in /etc/logstash/conf.d and only first file was with input. other only with filter+output

2

Centralized pipelines are all independent so if you did not define an input that is probably the problem.

Centralized pipelines are not concatenated like your previous method.

So you're either going to have to make one pipeline with the logic in it or two separate pipelines with a different input port.

There is some cross pipeline communication. I'm not an expert at that.

3

I think the best way is to use as many pipelines as you need. All you have to do is create new pipeline configuration files in conf.d directory and restart logstash service. In my cluster I have separate pipelines for metricbeat and filebeat.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.