Logging for Logstash with pipelines.yml

Hello,

I have been trying to run Logstash (v6.5.4) with multiple pipelines by following guide here: https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html

My logstash pipeline.yml looks like this:

- pipeline.id: test-pipeline-1
  path.config: "/usr/local/logstash/logstash-6.5.4/pipeline-configs/test-pipeline-1.conf"  
  pipeline.workers: 1
  pipeline.batch.size: 125

- pipeline.id: test-pipeline-2
  path.config: "/usr/local/logstash/logstash-6.5.4/pipeline-configs/test-pipeline-2.conf"
  pipeline.workers: 1
  pipeline.batch.size: 125

I wanted to write the logs for each pipeline separately so i tried to pass the "path.logs" in pipeline.yml but it complains about the the configuration file, so I skipped it. But even then, I am not able to log the logstash output to log files. Instead everything winds up in system journal because logstash seems to output everything on the stdout. I didn't change anything in log4j2.properties.

I am running logstash as systemd service on centos7 and execution command in service looks like this:

ExecStart=/usr/local/logstash/logstash-6.5.4/bin/logstash --path.settings /usr/local/logstash/logstash-6.5.4/config --http.host localhost --http.port 9600 --path.logs /logs_home/logstash-6.5.4/logs

In the logs from journal, I am seeing following error:

2020-03-10T12:39:19.745411+00:00 my-host logstash: 2020-03-10 12:39:19,615 main ERROR Null object returned for RollingFile in Appenders.
2020-03-10T12:39:19.745598+00:00 my-host logstash: 2020-03-10 12:39:19,615 main ERROR Null object returned for RollingFile in Appenders.
2020-03-10T12:39:19.745784+00:00 my-host logstash: 2020-03-10 12:39:19,616 main ERROR Null object returned for RollingFile in Appenders.
2020-03-10T12:39:19.745970+00:00 my-host logstash: 2020-03-10 12:39:19,616 main ERROR Null object returned for RollingFile in Appenders.
2020-03-10T12:39:19.746171+00:00 my-host logstash: 2020-03-10 12:39:19,616 main ERROR Unable to locate appender "plain_rolling" for logger config "root"
2020-03-10T12:39:19.746361+00:00 my-host logstash: 2020-03-10 12:39:19,616 main ERROR Unable to locate appender "plain_rolling_slowlog" for logger config "slowlog"

Any pointers on what has gone wrong?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.