Intercept incoming data to logstash pipeline

Actually we are getting jenkins build logs result into elasticsearch through filebeats and logstash.
We are receiving the expected data in logstash but for an unknown reason is getting repeated constantly.
Seems that the pipeline is constantly receiving data and every time is processing the same data.
Filebeats has it once in its registry file, so does not seem a filebeat problem.
So, we need to intercept the data incoming into the logstash pipeline to verify what is happening in this step.
Thank you for your time and I hope you could help us.

Welcome to our community! :smiley:

What if you put a file output in the pipeline to see what's happening?

I did that and I have that information but I need the data is incoming in the pipeline because the problem is when reciving data.
Thank you for the reply anyway

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.