I'm wondering how other people deal with managing their ingest pipelines in terms of version control and deployment to the cluster.
I put pipeline definitions in Git so I can track the changes and, more importantly, the reason for the changes.
I still haven't found a nice way to automatically deploy new versions of pipelines. I cobbled a script together that will iterate over the definitions and push them to the cluster but it's rough and not very robust. I'd like to make some improvements to it but wanted to see if anyone is using an existing solution first.