Hi Team,
in filebeat i have given the input section with filepath and outputsection with kafka.
while reading the data from file filebeat is reading in batchwise. I have not given any flush timeout, as a default it should take 1s, but it is reading different time intevels, I have attched the screenshot with record write time(Time) to the file and filebeat time (@timestamp). the latency is around 10 seconds
Can you please suggest, need any additional configuration to reduce the latency.
Regards,
Anji