I have a Index setup with a MongoDB Connector that is pulling from a collection of ~1.4M records. The initial run was fine and took about 1.5 hours to complete. However, now I'm trying to re-run the sync every day so pull in new records, but when I try to run the sync it fails after about 3 minutes without pulling in any new records. The error I get in the ElasticCloud UI is:
Sync failure: The job has not seen any update for some time..
What does this error mean? I'm interpreting it as meaning the connector tried to find new records but didn't find any after 3 minutes. With such a large collection I'm wondering if the problem is that it's basically timing out after it reviews records in the collection for a few minutes and doesn't find any new ones to add to the index?
Elasticsearch version: 8.6.2