Do ingest pipeline slow down the performance of a cluster?

Hi I am wondering if transformations (with ingest pipeline) affect the performance of a given cluster.
I had some transformations executed outside of ELK cluster, then decided to implement them with processors, the amount of transformations is quite interesting (around 30 processors used including for loops and if condition), can it slow down the performance of my cluster ?

Yes, it can slow down your cluster, specially if you use regex in your processors, depending on how are your for loops and conditionals or scripts, it can also impact.

For heavy ingest loads a dedicate ingest node is recommended.

2 Likes

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.