Remove redundancy of data

Hi,

I am using python to import csv file, which has no unique ID and File size also big.. So can't re-indexing.