I have an Oracle database with 80 million records. These have been migrated to elasticsearch and there is a continuous sync running that will keep the data updated in elasticsearch whenever data is added/changed in the Oracle database. I have two questions regarding this.
- How to verify if all 80 million records have been indexed in ES? This might be fairly easy running count
- How to verify the data consistency on a periodic basis, say each week to ensure that both data sources, Oracle and ES are in sync?