# Possible to run modules and pipelines on one server? **URL:** \ **Category:** Logstash\ **Created:** [November 21, 2017, 3:20am UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496 "2017-11-21T03:20:06Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![dison4linux](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dison4linux/32/98141_2.png) [@dison4linux](https://discuss.elastic.co/u/dison4linux)\ **Post date:** [November 21, 2017, 3:20am UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/1 "2017-11-21T03:20:06Z")
I've seen several mentions to "..when 6.0 comes out you can do multiple pipelines" but can we use modules and pipelines? I successfully enabled the netflow module but now when Logstash starts up I see this message printed and everything in conf.d seems to be ignored. `[logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified` So is it possible to use the netflow module and also setup a pipeline for syslog data? If so can you provide the details on exactly how that should be setup. I've seen several mentions that it should work but no one has a link as to how. Thanks, Jon ---
**Author:** ![Diogo](https://avatars.discourse-cdn.com/v4/letter/d/ea666f/32.png) [@Diogo](https://discuss.elastic.co/u/Diogo)\ **Post date:** [December 14, 2017, 6:07pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/2 "2017-12-14T18:07:54Z")
Looks like this is not possible, but I couldn't find a definitive answer in the docs. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 14, 2017, 9:49pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/3 "2017-12-14T21:49:24Z")
You should definitely be able to do this, if you're having issues similar to the original poster, then providing the logs would be helpful 🙂 ---
**Author:** ![Diogo](https://avatars.discourse-cdn.com/v4/letter/d/ea666f/32.png) [@Diogo](https://discuss.elastic.co/u/Diogo)\ **Post date:** [December 15, 2017, 11:26am UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/4 "2017-12-15T11:26:03Z")
Hi @warkolm, thanks for getting on this! And here's my `logstash.yml`: ```auto config.debug: true log.level: debug modules: - name: netflow var.elasticsearche.hosts: "localhost:9200" var.input.udp.port: 2055 var.kibana.hosts.: "10.10.10.10:5601" path.data: /data/logstash path.logs: /data/log/logstash ``` my pipelines.yml: ```auto - pipeline.id: logs_and_traps path.config: "/etc/logstash/logs_and_traps/pipeline.config" ``` And my logs with debug and config debug are on [this gist](https://gist.github.com/DiogoAndre/7f7eb3671412f322a2887c365cdcb3a2) ---
**Author:** ![Diogo](https://avatars.discourse-cdn.com/v4/letter/d/ea666f/32.png) [@Diogo](https://discuss.elastic.co/u/Diogo)\ **Post date:** [December 27, 2017, 7:31pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/5 "2017-12-27T19:31:43Z")
I've updated to 6.1.1 and still can't get the two things working. Using the logstash.yml above I can get the module working, but pipelines.yml continue to be ignored with message: ```auto [2017-12-27T19:05:27,339][DEBUG][logstash.config.source.multilocal] Reading pipeline configurations from YAML {:location=>"/etc/logstash/pipelines.yml"} [2017-12-27T19:05:27,353][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified ``` any ideias? ---
**Author:** ![Diogo](https://avatars.discourse-cdn.com/v4/letter/d/ea666f/32.png) [@Diogo](https://discuss.elastic.co/u/Diogo)\ **Post date:** [January 22, 2018, 4:51pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/6 "2018-01-22T16:51:49Z")
I think this comment settles the issue: > guyboertje commented 13 days ago > I can confirm that the modules feature in Logstash is a stand alone pipeline. Using -e, -f or --modules will amount to pipelines.yaml being ignored. > The reason for this is Modules are a "getting started" quickly feature so that new Elastic Stack users can quickly build up an appreciation of the Stack without having to build Kibana objects and learn the LS config language. To do this we did not want a "toy" implementation that looks nice but has no real value. > > The netflow module code is open source, this means that you can find and extract the LS config after you have ran the --setup to get the ES and Kibana artefacts installed. The config is an ERB template so there are sections that are overwritten, in between \<%=, %\>, with real values - replace these and you will have a netflow config. > > > Hello, > > I am running Logstash v.6 on Centos 7.3.. I have tried to run it witho…ut specifying any modules or command line options but it ignores my pipeline.yml. > > When I run logstash, without any option, I get the following message: > sudo /usr/share/logstash/bin/logstash > \[WARN \]\[logstash.config.source.multilocal\] Ignoring the 'pipelines.yml' file because modules or command line options are specified > > No modules or command line options is specified. ---
**Author:** ![michaelm14](https://avatars.discourse-cdn.com/v4/letter/m/13edae/32.png) [@michaelm14](https://discuss.elastic.co/u/michaelm14)\ **Post date:** [January 22, 2018, 5:32pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/7 "2018-01-22T17:32:15Z")
So what I'm hearing is: Modules are quick and easy, and plug-ins/pipelines are slightly more involved. I cannot use a module for one process (Netflow) and build a pipeline for another (like JDBC). I would need to use a pipeline for the Netflow as well so that everything is up to the higher level. I'm a bit surprised, but is that correct? BTW - The Netflow dashboards that come with the Module are nice and I was worried using the open source mapping would cause a problem and break them. For me, the JDBC connection is more important so I'll just go with the latter option. ---
**Author:** ![jordansissel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jordansissel/32/44957_2.png) [@jordansissel](https://discuss.elastic.co/u/jordansissel)\ **Post date:** [January 22, 2018, 7:01pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/8 "2018-01-22T19:01:28Z")
It's currently a by-design limitation that modules and pipelines cannot be mixed. However, we will improve this in the future to allow you to mix modules and custom pipelines. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [February 19, 2018, 7:01pm UTC](https://discuss.elastic.co/t/possible-to-run-modules-and-pipelines-on-one-server/108496/9 "2018-02-19T19:01:42Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.