# Runninning two configs in parallel without conflict with schedule

**URL:** <https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575>\
**Category:** Logstash\
**Created:** [June 8, 2023, 9:40pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575 "2023-06-08T21:40:44Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![geothomas](https://avatars.discourse-cdn.com/v4/letter/g/50afbb/32.png) [@geothomas](https://discuss.elastic.co/u/geothomas)\
**Post date:** [June 8, 2023, 9:40pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575/1 "2023-06-08T21:40:44Z")

</div>

I am trying to create elasticsearch index from oracle table. I have two configs, one **delta.conf**

```auto
*input {*

* jdbc*
*{*

* jdbc_driver_library => "<path>/ojdbc10.jar"*

* jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"*

* jdbc_connection_string => "connection string"*

* jdbc_user => <username>*

* jdbc_password => <pwd>*

* statement => "SELECT * FROM my table name WHERE last_modified_date >= :sql_last_value"*

* schedule => "*/15 * * * *"*
*"*

*}*

*filter {*

* if !("$FULL_IMPORT_RUNNING" in [tags])*
* {*

* *
* }*
* else {*

* drop {}*

* }*

* }*

*}*
*output *
*{*

* if !("$FULL_IMPORT_RUNNING" in [tags]) *
* {*

* elasticsearch *
* {*
* hosts => ["http://localhost:9200"]*
* index => "index_with_id"*
* document_id => "%{col1}-%{col2}-%{col3}"*
* action => "update"*
* doc_as_upsert => true*
* document_id => "%{col1}-%{col2}-%{col3}"*
* }*
* }*

*}*

```

and **full.conf**

```auto
*input {*

* jdbc*
*{*

* jdbc_driver_library => "<path>/ojdbc10.jar"*

* jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"*

* jdbc_connection_string => "connection string"*

* jdbc_user => <username>*

* jdbc_password => <pwd>*

* statement => "SELECT * FROM my table name"*

* schedule => "0 0 * * *"*
*"*

*}*

*filter {*

* mutate {*

* add_tag => ["$FULL_IMPORT_RUNNING"]*

* }*

*}*

*}*
*output *
*{*

*elasticsearch *
*{*
* hosts => ["http://localhost:9200"]*
* index => "index_with_id"*
* document_id => "%{col1}-%{col2}-%{col3}"*
* action => "update"*
* doc_as_upsert => true*
* document_id => "%{col1}-%{col2}-%{col3}"*
*}*
* *

*}*

```

If I start logstash with either one of this configs, everything works fine. But when I try to start logstash like : _./logstash -f ../config/delta.conf -f ../config/full.conf_ I seet thats its started, but nothing happens after tht, no error as well. I am trying to run these flows with a schedule, one for fulltruth and one for delta and trying to avoid execution at the same time

---

<div class="post-metadata">

**Author:** ![Priscilla\_Parodi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/priscilla_parodi/32/43047_2.png) [@Priscilla\_Parodi](https://discuss.elastic.co/u/Priscilla_Parodi)\
**Post date:** [June 9, 2023, 12:54pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575/2 "2023-06-09T12:54:39Z")

</div>

Hello @geothomas,

Welcome to the community!

If you need to [run more than one pipeline](https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html) in the same process, Logstash provides a way to do this through a configuration file called `pipelines.yml`.

Hope it helps!

---

<div class="post-metadata">

**Author:** ![geothomas](https://avatars.discourse-cdn.com/v4/letter/g/50afbb/32.png) [@geothomas](https://discuss.elastic.co/u/geothomas)\
**Post date:** [June 9, 2023, 2:58pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575/3 "2023-06-09T14:58:34Z")

</div>

Thanks @Priscilla_Parodi , that triggered the execution in parallel. But what I need is to make sure my delta pipeline to stop execution when my full pipeline is runnining. So delta should run only if full is not executing

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [June 9, 2023, 3:19pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575/4 "2023-06-09T15:19:55Z")

</div>

logstash does not provide a way to do that. The pipelines run independently.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 7, 2023, 3:20pm UTC](https://discuss.elastic.co/t/runninning-two-configs-in-parallel-without-conflict-with-schedule/335575/5 "2023-07-07T15:20:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.