I have a file which is rewritten daily with new data.
Everything was working fine till I missed to update the file with new data.
So, Logstash processed the old data itself again generating duplicate data.
Is there a way that i can correct that(remove duplicate data)?
Is there a way to avoid this issue in future?