hello everybody,
i have not understand what is the best solution if you have many input files. Should you use one config file with the configuration of input files or create one config file per input file. (ex. 5-10 files)
Many input files for the same pipeline or are you talking about multiple pipelines?
You can have one big file with everything or point to a path with multiple config files, it really depends on what works best for you.
In my case I use multiple pipelines defined in the pipelines.yml and each one of those pipelines can point to a single config file or to a path with other config files, this depends on the complexity of the pipeline, breaking your pipeline into smaller files can help you when editing or adding new filters.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.