Multipipeline on Windows Server


(Walker) #1

Anybody have any luck getting this to work on Server 2012/2016? Below is my configuration and trace log

Pipelines.yml

 - pipeline.id: DMARC
   path.config: "C:/logstash/config/dmarcpipeline.cfg"
   config.reload.automatic: true
   config.reload.interval: 5s
   config.debug: true
   queue.type: persisted
   path.queue: C:/buffer
   queue.page_capacity: 64mb
   queue.max_bytes: 1024mb

Logstash.yml

 node.name: Logstash
 http.host: "192.168.1.101"
 http.port: 9600
 log.level: trace

Trace logs, removed default settings statements due to character limitation in post:

> [2018-02-19T19:16:53,939][DEBUG][logstash.runner          ] -------- Logstash Settings (* means modified) ---------
> [2018-02-19T19:16:53,939][DEBUG][logstash.runner          ] *log.level: "trace" (default: "info")
> [2018-02-19T19:16:53,939][DEBUG][logstash.runner          ] *http.host: "192.168.1.101" (default: "127.0.0.1")
> [2018-02-19T19:16:53,939][DEBUG][logstash.runner          ] *http.port: 9600..9600 (default: 9600..9700)
> [2018-02-19T19:16:53,954][DEBUG][logstash.runner          ] path.settings: "C:/logstash/config"
> [2018-02-19T19:16:53,954][DEBUG][logstash.runner          ] --------------- Logstash Settings -------------------
> [2018-02-19T19:16:54,017][DEBUG][logstash.config.source.multilocal] Reading pipeline configurations from YAML {:location=>"C:/logstash/config/pipelines.yml"}
> [2018-02-19T19:16:54,095][DEBUG][logstash.agent           ] Setting up metric collection
> [2018-02-19T19:16:54,189][DEBUG][logstash.instrument.periodicpoller.os] Starting {:polling_interval=>5, :polling_timeout=>120}
> [2018-02-19T19:16:54,376][DEBUG][logstash.instrument.periodicpoller.jvm] Starting {:polling_interval=>5, :polling_timeout=>120}
> [2018-02-19T19:16:54,517][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
> [2018-02-19T19:16:54,533][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
> [2018-02-19T19:16:54,548][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
> [2018-02-19T19:16:54,564][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
> [2018-02-19T19:16:54,626][INFO ][logstash.runner          ] Starting Logstash {"logstash.version"=>"6.2.1"}
> [2018-02-19T19:16:54,658][DEBUG][logstash.agent           ] Starting agent
> [2018-02-19T19:16:54,673][DEBUG][logstash.agent           ] Starting puma
> [2018-02-19T19:16:54,689][DEBUG][logstash.agent           ] Trying to start WebServer {:port=>9600}
> [2018-02-19T19:16:54,720][DEBUG][logstash.config.source.multilocal] Reading pipeline configurations from YAML {:location=>"C:/logstash/config/pipelines.yml"}
> [2018-02-19T19:16:54,986][DEBUG][logstash.api.service     ] [api-service] start
> [2018-02-19T19:16:55,017][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
> [2018-02-19T19:16:55,048][DEBUG][logstash.agent           ] Converging pipelines state {:actions_count=>0}
> [2018-02-19T19:16:55,079][TRACE][logstash.agent           ] Converge results {:success=>true, :failed_actions=>[], :successful_actions=>[]}
> [2018-02-19T19:16:55,126][DEBUG][logstash.instrument.periodicpoller.os] Stopping
> [2018-02-19T19:16:55,142][DEBUG][logstash.instrument.periodicpoller.jvm] Stopping
> [2018-02-19T19:16:55,142][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Stopping
> [2018-02-19T19:16:55,142][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Stopping
> [2018-02-19T19:16:55,236][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}
> [2018-02-19T19:17:00,408][DEBUG][logstash.agent           ] Shutting down all pipelines {:pipelines_count=>0}
> [2018-02-19T19:17:14,586][DEBUG][logstash.agent           ] Converging pipelines state {:actions_count=>0}
> [2018-02-19T19:17:14,586][TRACE][logstash.agent           ] Converge results {:success=>true, :failed_actions=>[], :successful_actions=>[]}

(Walker) #2

Figured it out after some trial and error, do not specify drive letter.

If your pipeline config file is here: C:\logstash\config\pipeline.config
Set config.path to /logstash/config/pipeline.config


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.