How to correctly calculate sync duration of connector run

Elastic Stack Elasticsearch
1

I need some help in calculating sync duration for a connector run. I am trying to measure performance of connector. Here is what I am observing:-

  1. My Google Drive connector is running for 5m and 20 seconds and has upserted around 5k documents. Then suddenly sync duration is shown as 25 seconds and upserted document count is shown as 40.
  2. Looks like these counter got reset in response of some error. Whenever, such behavior is observed, i see a notice that connector has observed an error.

I need help in knowing what is causing such behavior where counter like sync duration and upserted document count is reduced or reset. Moreover, how can I reliably calculate total sync duration.

2

Hi @Ankur_Mathur,

Are you using this connector? Elastic Google Drive connector reference | Enterprise Search documentation [8.15] | Elastic

3

Hi @Ankur_Mathur, based on your recent questions, it seems like you’re using the Google Drive connector that Artem mentioned. Does the connector end up in the Error state? Are the subsequent sync "full syncs" or "incremental syncs"?

Any errors during the sync should be surfaced to you in the UI, and the job should be marked as failed. If there are some errors during the sync, sharing some logs would be helpful to troubleshoot this further.