I'm in the process of setting up ELK. Full X-Pack. Setting up pipelines using Kibana is really nice, but I now need Ansible/Chef/Puppet to propagate the pipeline id to the logstash.yml.
How about adding a
group field to the pipeline document, and allowing logstash.yml to specify a regexp for filtering which pipeline groups to deploy?
In my specific case, I'd specify
.* to begin with.
Is there another way to achieve this? I basically want Logstash to pick up any and all pipelines I add through Kibana.