I would browse to both of those URL's or do a curl to get the results. Compare both of those and see if you are getting duplicates between those. If so the issue is with the source or query.
I can't think of any reasons this pipeline would create duplicate records so I would test that first.