Fingerprint processor allowing duplicates

Yes, it is really an issue, as it's skewing metrics, and duplicates will continue to happen each time the index rolls over.

It's a timing issue with the source data in SQL. The write interval is in some cases longer than the query interval. The SQL query intentionally returns the same records multiple times (with some additional each time), to ensure there's eventually a superset of the data. It's not ideal, but they're trying to take the weight of the query off the SQL database, so I've been relying on a "natural key" in the dataset to fingerprint in Elastic.