I am working with ES/Logstash 6.1 with xpack. I am using the new pipeline capability within ES to store my pipelines in ES and view them in Kibana. Has there been any reported issues with the individual pipelines being slower than the original configs in the /conf.d/ directory.
My issue is I have 4 pipelines accepting TCP connections via logstash and outputting to kafka. Then I have 4 other pipelines on separated logstash nodes taking data from kafka and putting it in elastic. When I used one big config in the conf.d directory it worked great with next to no lag. Now with the pipelines stored in ES and managed in Kibana things seem to have slowed down considerably.
Is there anything that should be done to speed them up. No other infrastructure has changed, just switching from conf files to pipelines.
Thanks