# How to run configured pipeline.yml in logstash **URL:** \ **Category:** Logstash\ **Created:** [June 16, 2021, 3:45am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072 "2021-06-16T03:45:41Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 16, 2021, 3:45am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/1 "2021-06-16T03:45:41Z")
I have configured 2 logstash.conf file in pipelines.yml file, pipeline.id: sys\_log\_1 pipeline.workers: 2 path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_1.conf" pipeline.id: sys\_log\_2 pipeline.workers: 2 path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_2.conf" can anyone please tell me how can I run the pipelines.yml file. I got struct in this. ---
**Author:** ![legoguy1000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/legoguy1000/32/54301_2.png) [@legoguy1000](https://discuss.elastic.co/u/legoguy1000)\ **Post date:** [June 16, 2021, 2:55pm UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/2 "2021-06-16T14:55:15Z")
Do you mean how to have logstash use your custom `pipeline.yml` file? See [Multiple Pipelines | Logstash Reference [7.13] | Elastic](https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html#multiple-pipelines) on where to put it and what to name it. ---
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 19, 2021, 1:54am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/3 "2021-06-19T01:54:24Z")
Can you please provide me the running command which I can use directly in terminal ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 19, 2021, 2:28am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/4 "2021-06-19T02:28:21Z")
How did you install logstash? tar.gz, deb, rpm, windows? What Version? What other configuration changes have you made? What commands have you tried? Any? Did you get errors? If so share them. Are you running from the command line or as a service? Perhaps Share your `logstash.yml` My point is ... if you want help, perhaps provide additional information then perhaps we can help. In general if you made no other changes than that, if you start filebeat [from the command line](https://www.elastic.co/guide/en/logstash/current/running-logstash-command-line.html) without the `-f` option it will read the `pipelines.yml` file and start those pipelines. If you installed as a package and it is running as a service and you made little other changes that will also pick up the `pipelines.yml` ---
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 19, 2021, 3:28am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/5 "2021-06-19T03:28:59Z")
Hi @stephenb I downloaded as ZIP file I'm using windows OS, I have configured 2 logstash.conf file in pipelines.yml file, pipeline.id: sys\_log\_1 pipeline.workers: 2 path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_1.conf" pipeline.id: sys\_log\_2 pipeline.workers: 2 path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_2.conf" Logstash version: Logstash/7.12.1 I haven't changed anything in logstash.yml file. I updated only on the pipeline.yml file ERROR LOGS: D:\Elastic\Logstash\7.12.1\>bin\logstash.bat "Using bundled JDK: "" OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. Sending Logstash logs to D:/Elastic/Logstash/7.12.1/logs which is now configured via log4j2.properties [2021-06-18T20:51:25,701][INFO][logstash.runner] Log4j configuration path used is: D:\Elastic\Logstash\7.12.1\config\log4j2.properties [2021-06-18T20:51:25,716][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.12.1", "jruby.version"=\>"jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 11.0.10+9 on 11.0.10+9 +indy +jit [mswin32-x86\_64]"} [2021-06-18T20:51:26,656][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600} [2021-06-18T20:51:26,796][ERROR][logstash.config.sourceloader] No configuration found in the configured sources. [2021-06-18T20:51:26,890][INFO][logstash.runner] Logstash shut down. [2021-06-18T20:51:26,906][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit org.jruby.exceptions.SystemExit: (SystemExit) exit at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:747) ~[jruby-complete-9.2.13.0.jar:?] at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:710) ~[jruby-complete-9.2.13.0.jar:?] at D\_3a\_.Elastic.Logstash.$7\_dot\_12\_dot\_1.lib.bootstrap.environment.(D:\Elastic\Logstash\7.12.1\lib\bootstrap\environment.rb:89) ~[?:?] ---
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 19, 2021, 3:42am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/6 "2021-06-19T03:42:56Z")
In logstash.yml file, this is the only line enabled pipeline.ordered: auto I think this is the default value ---
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 19, 2021, 3:53am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/7 "2021-06-19T03:53:56Z")
@stephenb I have provided answers for your questions in the above chat, Please take a look and let me know if you want any informations. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 19, 2021, 5:54am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/8 "2021-06-19T05:54:54Z")
This is the key error > [@sudo-ranjith](#): > > [2021-06-18T20:51:26,796][ERROR][logstash.config.sourceloader] No configuration found in the configured sources. It indicates those paths you defined in the `pipelines.yml` are not found.. also You did not move the pipelines file did you? Example, I'm sure you took a close look but could there be issues with upper or lower cases in the path. ```auto path.config: "D:/Elastic/Logstash/7.12.1/config/logstash_sys_1.conf" ``` You can run the command with `--debug` and it should show you the paths it's actually trying to load and or give you some more detail. Also If you try to run a a single conf file what happens ```auto D:\Elastic\Logstash\7.12.1>bin\logstash.bat -f D:\Elastic\Logstash\7.12.1\config\logstash_sys_1.conf ``` ---
**Author:** ![sudo-ranjith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sudo-ranjith/32/89146_2.png) [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Post date:** [June 28, 2021, 6:03am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/9 "2021-06-28T06:03:16Z")
Eventually I could be able to run pipeline.yml. 1. Configured logstash\_sys1.config 2. In pipeline.yml pipeline.id: sys\_log\_1 pipeline.workers: 2 _path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_1.conf"_ Instead I configured it, **path.config: "D:/Elastic/Logstash/7.12.1/config/logstash\_sys\_1.conf"** Then ran simply > bin\logstash Now the logstash pipeline is working fine. Thanks. 😇 ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 28, 2021, 6:27am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/10 "2021-06-28T06:27:41Z")
Glad it's working but I can't really tell what change was but I guess the path was not correct. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 26, 2021, 6:28am UTC](https://discuss.elastic.co/t/how-to-run-configured-pipeline-yml-in-logstash/276072/11 "2021-07-26T06:28:40Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.