Pipeline multiple but no data coming in

Elastic Stack Logstash
1

Hi below are the description on the setup.

Under /usr/share/logstash/config, located pipelines.yml.

  5  - pipeline.id: logstash_main
  6    path.config: "/usr/share/logstash/logstash.conf"
  7
  8  - pipeline.id: Inputs
  9    path.config: "/etc/logstash/conf.d/01-wazuh.conf"
 10
 11  - pipeline.id: Beats
 12    path.config: "/etc/logstash/conf.d/02-beats-input.conf"
 13
 14  - pipeline.id: Filebeat_output
 15    path.config: "/etc/logstash/conf.d/03-filebeat-output.conf"
 16
 17  - pipeline.id: Nginx_filter
 18    path.config: "/etc/logstash/conf.d/09-filter-nginx.conf"
 19
 20  - pipeline.id: Syslog
 21    path.config: "/etc/logstash/conf.d/10-syslog-filter.conf"
 22
 23  - pipeline.id: Nginx_conf
 24    path.config: "/etc/logstash/conf.d/11-nginx-filter.conf"
 25
 26  - pipeline.id: Nginx_logstash
 27    path.config: "/etc/logstash/conf.d/logstash-nginx-es.conf"
 28
 29  - pipeline.id: Nginx_logstash2
 30    path.config: "/etc/logstash/conf.d/nginx_logstash.conf"

But when I go to Kibana, >> Logstash >> Pipeline, I can only see one "main" which is listed there ?

How can I ensure the data are passed correctly? Thanks

2

Which version of logstash. Could you be hitting this?

Also, are you saying that you have monitoring of a pipeline called "main" when you pipelines.yml does not define any such pipeline? That would suggest logstash is not using your pipelines.yml. The logstash logs should clarify that.

3

Hi Badger,

No mine is version 7.1.1. For the second part of question, I think I saw somewhere configured "main" before, or could be the pipeline I have changed from "main" to "logstash_main" and I have no idea how can I ensure those I specify in pipeline.yml are working.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.