# Run pipeline based on condition in another pipeline
**URL:** https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025
**Category:** Logstash
**Created:** [October 17, 2019, 10:36am UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025 "2019-10-17T10:36:33Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@ansamHox](https://discuss.elastic.co/u/ansamHox)
#### Post date: [October 17, 2019, 10:36am UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025/1 "2019-10-17T10:36:34Z")
Need to import new data from Oracle (as soon as they start batch processing) couple of times a day.
E.g., my dba team are doing some batch processes 5 times a day (random time period and number of rows (up to 1 million)). They don't want me to run select on db (named TRANSACTIONS) every 5 minutes, but only when batch processing started. That's why they created another table in Oracle (named SIGNAL) with "notification" for me to start my logstash pipeline to start pulling data from TRANSACTIONS to ES.
When they start batch process (on table TRANSACTIONS), they add in table SIGNAL new row "`TIMESTAMP - BATCH STARTED`".
My plan is to run logstash pipeline on table **SIGNAL** every minute and check if new row contains "BATCH STARTED" string was created, if it is, then I should run new pipeline on table **TRANSACTIONS**. Is that possible in Logstash?
This is how my query for table TRANSACTIONS looks like:
```
input {
jdbc {
jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"
jdbc_connection_string => "jdbc:oracle:thin:@db12db:1543:db12"
jdbc_user => "XXXXX"
jdbc_password => "XXXXX"
use_column_value => true
tracking_column => "order_id"
#tracking_column_type => "numeric"
#clean_run => true
record_last_run => true
schedule => "* * * * *"
last_run_metadata_path => "/etc/logstash/lastrun_transactions"
statement => "select p.order_id,to_char(P.date_value, 'yyyy-mm-dd') datum_valute,to_char(P.date_booked, 'yyyy-mm-dd') date_booked......
WHERE order_id> :sql_last_value ORDER BY order_id"
}
} `# Can I add here another input on another table?`
output {
elasticsearch {
hosts => ["https://localhost:9200"]
user => "XXX"
password => "XXX"
index => "transactions__%{[@metadata][index_year]}"
document_id => "%{order_id}"
ssl => true
cacert => '/etc/logstash/XXXRootCAv4.cer.pem'
}
}
```
---
### Author:  [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [October 17, 2019, 3:18pm UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025/2 "2019-10-17T15:18:53Z")
You cannot trigger an input based on another input, but you could trigger an jdbc\_streaming filter based on the event generated by an input. It's not a great fit for the use case, but you might be able to get it to work.
P.S. Do you want to trigger on batch started or batch ended?
---
### Author:  [@ansamHox](https://discuss.elastic.co/u/ansamHox)
#### Post date: [October 28, 2019, 10:34am UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025/3 "2019-10-28T10:34:54Z")
I want to trigger when batch started
---
### Author:  [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [October 28, 2019, 12:11pm UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025/4 "2019-10-28T12:11:49Z")
OK, but that seems likely to lead to race conditions where you are trying to fetch rows before the batch processing has finished updating them, so you will not fetch them until the next day.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 25, 2019, 12:25pm UTC](https://discuss.elastic.co/t/run-pipeline-based-on-condition-in-another-pipeline/204025/5 "2019-11-25T12:25:21Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.