Delete the index for documents removed from the data source

We have indexed all documents from a data source. Some of the documents in the data source are removed after the index was created. Unfortunately the data source does not provide information on the deleted documents. What is the best way to remove the indices corresponding to the deleted document?

Probably to reindex everything into a new index.