Pipeline multiple but no data coming in

Hi below are the description on the setup.

Under /usr/share/logstash/config, located pipelines.yml.

  5  - pipeline.id: logstash_main
  6    path.config: "/usr/share/logstash/logstash.conf"
  8  - pipeline.id: Inputs
  9    path.config: "/etc/logstash/conf.d/01-wazuh.conf"
 11  - pipeline.id: Beats
 12    path.config: "/etc/logstash/conf.d/02-beats-input.conf"
 14  - pipeline.id: Filebeat_output
 15    path.config: "/etc/logstash/conf.d/03-filebeat-output.conf"
 17  - pipeline.id: Nginx_filter
 18    path.config: "/etc/logstash/conf.d/09-filter-nginx.conf"
 20  - pipeline.id: Syslog
 21    path.config: "/etc/logstash/conf.d/10-syslog-filter.conf"
 23  - pipeline.id: Nginx_conf
 24    path.config: "/etc/logstash/conf.d/11-nginx-filter.conf"
 26  - pipeline.id: Nginx_logstash
 27    path.config: "/etc/logstash/conf.d/logstash-nginx-es.conf"
 29  - pipeline.id: Nginx_logstash2
 30    path.config: "/etc/logstash/conf.d/nginx_logstash.conf"

But when I go to Kibana, >> Logstash >> Pipeline, I can only see one "main" which is listed there ?

How can I ensure the data are passed correctly? Thanks

Which version of logstash. Could you be hitting this?

Also, are you saying that you have monitoring of a pipeline called "main" when you pipelines.yml does not define any such pipeline? That would suggest logstash is not using your pipelines.yml. The logstash logs should clarify that.

Hi Badger,

No mine is version 7.1.1. For the second part of question, I think I saw somewhere configured "main" before, or could be the pipeline I have changed from "main" to "logstash_main" and I have no idea how can I ensure those I specify in pipeline.yml are working.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.