Question on Elastic Search Filtering

Hi,

I have duplicates in my system but i intend to do some form of filtering on the logstash side to prevent any future duplicates from occurring (due to server restart incorrectly).

For reference, my current duplicates are the exact replica of each other with the exception of date/time.

How should I go about implementing duplicate filters.

Regards
Sam

See this thread.