Pipelines are not loading

Elastic Stack Logstash
1

HI ,

logstash version 9.0.1

The logstash is running fine however the pipelines are not loading getting [ERROR][logstash.config.sourceloader] No configuration found in the configured sources.

List of pipelines to be loaded by Logstash

pipeline.yml

  • pipeline.id: primary
    path.config: "E:/config9/primary"
    pipeline.workers: 4
    #pipeline.batch.size: 1024
    #queue.type: persisted

  • pipeline.id: secondary
    path.config: "E:/config9/secondary"
    pipeline.workers: 2
    #pipeline.batch.size: 2048
    #queue.type: persisted

Logstash.yml
########################### Node Identity ###########################
node.name: logstash-test-node-1
path.data: E:\data\logstash9
path.logs: E:\logs\logstash9
config.reload.automatic: true
config.reload.interval: 60s
config.debug: true
api.enabled: true
api.http.host: "0.0.0.0"
api.http.port: 9600-9700
xpack.monitoring.enabled: false # Set to true if you want to use with Elasticsearch monitoring

log.level: trace

2

How are you starting logstash? Please start it again and share fresh logs from the beginning until it stops.

3

Welcome to the community!

Since you are using Windows, pipeline.yml should be:

pipeline.yml

- pipeline.id: primary
  path.config: "E:\\config9\\primary\\filename1.conf"
  pipeline.workers: 4
#pipeline.batch.size: 1024
#queue.type: persisted

- pipeline.id: secondary
  path.config: E:\config9\secondary\filename2.conf"
  pipeline.workers: 2
#pipeline.batch.size: 2048
#queue.type: persisted

Both option are possible, with the quotations and double backslashes, and single backslashes.

4

Using CMD to call the logstash.bat -path.settings /pathtothe logstash and pipeline.yml

5

Paths are not OK, change to backslashes

6

thank you so much, I think the paths were ok however was an issue with the pipeline.yml, i just copied from my elk 7 config and that seems to have worked

7

This is the notation how paths are specified in pipeline.yml-LS v9 on Windows, tested, checked, validated.

The most important, it's working, you can continue your work.