What @warkolm said is an excellent solution another way to do this is have the pipeline be a top level pipeline and call other pipelines based on a condition see here it can be very powerful and modularize your pipelines in fact this the way I build most my pipelines.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.