MSSQL Connector not syncing

[jjmcmullan (jj)]

Hi folks,

I've got a docker install of elastic that I built using the blog posts "getting-started-with-the-elastic-stack-and-docker-compose-part[1 and 2]" and that all went very well. I have since decided to add the connectors container to read data from a table on MSSQL. It all appears to be configured correctly. I can even see the "Select 1 +1" in SQL Profiler coming from the connector but every time I try to do a full sync the button just says "Waiting for sync". I have waited for over an hour to see if it's a scheduling thing. I then tried to schedule a full sync and the connector container even displayed the message " [Connector id: v2JxxxUBPxxxv5mxxx3b, index name: connector-xxsql01] Creating a scheduled 'full' sync..." but it didn't read any data back, again I've left it sitting for over an hour but no joy. I have a feeling I'm missing something very simple here but I just can't see it.

My stack version is 8.16.4 and all the components are using the same version.

Thanks in advance for any help.

J

[strawgate (William Easton)]

Can you try setting service.log_level: "DEBUG" in your connectors yml config? The key should go at the root level:

service.log_level: "DEBUG"

connectors:
-
 blah

elasticsearch:
 blah

And then can you share the full debug logs? Along with the connectors config.yml (with any sensitive information removed)?

[jjmcmullan (jj)]

Hi William,

Thanks for getting back to me, please find logs below:

2025-03-03T10:02:32.811825717Z [FMWK][10:02:32][INFO] Running connector service version 8.16.4
2025-03-03T10:02:32.811868373Z [FMWK][10:02:32][INFO] Loading config from /config/config.yml
2025-03-03T10:02:32.861223894Z [FMWK][10:02:32][DEBUG] ESManagementClient connecting to https://es01:9200
2025-03-03T10:02:32.861252181Z [FMWK][10:02:32][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:32.861257011Z [FMWK][10:02:32][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:32.861260187Z [FMWK][10:02:32][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:32.861263884Z [FMWK][10:02:32][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:32.861266095Z [FMWK][10:02:32][INFO] Running preflight checks
2025-03-03T10:02:32.861267970Z [FMWK][10:02:32][DEBUG] Wait for Elasticsearch (max: 120)
2025-03-03T10:02:32.861269935Z [FMWK][10:02:32][INFO] Waiting for Elasticsearch at https://es01:9200 (so far: 0 secs)
2025-03-03T10:02:32.861272039Z [FMWK][10:02:32][DEBUG] Seed node configuration: (NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={'user-agent': 'elasticsearch-py/8.16.0 (Python/3.11.11; elastic-transport/8.15.1)'}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs='/usr/share/connectors/config/certs/ca/ca.crt', client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={}),)
2025-03-03T10:02:33.595820976Z [FMWK][10:02:33][DEBUG] Connected to Elasticsearch server with version '8.16.4' and build flavor 'default'
2025-03-03T10:02:33.628116893Z [FMWK][10:02:33][INFO] Elasticsearch 8.16.4 and Connectors 8.16.4 are compatible
2025-03-03T10:02:33.628143341Z [FMWK][10:02:33][INFO] Extraction service is not configured, skipping its preflight check.
2025-03-03T10:02:33.628146622Z [FMWK][10:02:33][DEBUG] Checking index .elastic-connectors-v1
2025-03-03T10:02:34.345086734Z [FMWK][10:02:34][DEBUG] Checking index .elastic-connectors-sync-jobs-v1
2025-03-03T10:02:34.380809203Z [FMWK][10:02:34][DEBUG] Cancelling sleeps...
2025-03-03T10:02:34.380827070Z [FMWK][10:02:34][DEBUG] Cancelling sleeps...
2025-03-03T10:02:34.380829625Z [FMWK][10:02:34][DEBUG] Cancelling sleeps...
2025-03-03T10:02:34.380831701Z [FMWK][10:02:34][DEBUG] ConnectorIndex connecting to https://es01:9200
2025-03-03T10:02:34.380833743Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.380851023Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.380853286Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.380855210Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.457053622Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.457092434Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.457095845Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.457097837Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.523429129Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.523459986Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.523462674Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.523464684Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.582565713Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.582600649Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.582604490Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.582608296Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.674053561Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.674092476Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.674095050Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.674097081Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.763862361Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.763885537Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.763887813Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.763895252Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.763897619Z [FMWK][10:02:34][DEBUG] [job_scheduling_service] No native service types configured for job scheduling
2025-03-03T10:02:34.763899779Z [FMWK][10:02:34][INFO] [job_scheduling_service] Job Scheduling Service started, listening to events from https://es01:9200
2025-03-03T10:02:34.763901836Z [FMWK][10:02:34][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:02:34.763903699Z [FMWK][10:02:34][DEBUG] ConnectorIndex connecting to https://es01:9200
2025-03-03T10:02:34.763905619Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.763907999Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.763910018Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.763911905Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.882872684Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.882902822Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.882905460Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.882907748Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:34.914534769Z [FMWK][10:02:34][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:34.914552628Z [FMWK][10:02:34][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:34.914554875Z [FMWK][10:02:34][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:34.914556884Z [FMWK][10:02:34][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.049199054Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.049223661Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.049226029Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.049227996Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.049229955Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.049232426Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.049234495Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.049236341Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.082785569Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.082808645Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.082817343Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.082819465Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.115325229Z [FMWK][10:02:35][DEBUG] [content_sync_job_execution_service] No native service types configured for content sync job execution
2025-03-03T10:02:35.115345044Z [FMWK][10:02:35][INFO] [content_sync_job_execution_service] Content sync job execution service started, listening to events from https://es01:9200
2025-03-03T10:02:35.115347375Z [FMWK][10:02:35][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:02:35.115349442Z [FMWK][10:02:35][DEBUG] ConnectorIndex connecting to https://es01:9200
2025-03-03T10:02:35.115351476Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.115354095Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.115356721Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.115359498Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.245910947Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.245932643Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.245944581Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.245947041Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.370177077Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.370211187Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.370214239Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.370226264Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.396164930Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.418219828Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.418249182Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.418251542Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.418253790Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.418256710Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.418258543Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.418260391Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.509815995Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.509841253Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.509843651Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.509845709Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.509847701Z [FMWK][10:02:35][DEBUG] [access_control_sync_job_execution_service] No native service types configured for access control sync job execution
2025-03-03T10:02:35.521237846Z [FMWK][10:02:35][INFO] [access_control_sync_job_execution_service] Access control sync job execution service started, listening to events from https://es01:9200
2025-03-03T10:02:35.521258100Z [FMWK][10:02:35][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:02:35.521265434Z [FMWK][10:02:35][DEBUG] [job_cleanup_service] Successfully started Job cleanup task...
2025-03-03T10:02:35.521274388Z [FMWK][10:02:35][DEBUG] ConnectorIndex connecting to https://es01:9200
2025-03-03T10:02:35.521276572Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.521279417Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.521281280Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.521283187Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.531269635Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.531291867Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.531294252Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.531296550Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.552259743Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.552282232Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.552284815Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.552286752Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.611434333Z [FMWK][10:02:35][DEBUG] ESManagementClient connecting to https://es01:9200
2025-03-03T10:02:35.611456812Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.611461335Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.611464089Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.611474834Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.611477813Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.611481153Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.611483854Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.611486489Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.636920413Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.636949687Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.636953292Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.636956064Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.636958859Z [FMWK][10:02:35][DEBUG] Initial Elasticsearch node configuration is NodeConfig(scheme='https', host='es01', port=9200, path_prefix='', headers={}, connections_per_node=10, request_timeout=10.0, http_compress=False, verify_certs=True, ca_certs=None, client_cert=None, client_key=None, ssl_assert_hostname=None, ssl_assert_fingerprint=None, ssl_version=None, ssl_context=None, ssl_show_warn=True, _extras={})
2025-03-03T10:02:35.636962304Z [FMWK][10:02:35][DEBUG] Connecting with an API Key (d0dKV...)
2025-03-03T10:02:35.636964921Z [FMWK][10:02:35][DEBUG] configured API key will be used over configured basic auth
2025-03-03T10:02:35.636967548Z [FMWK][10:02:35][DEBUG] Verifying cert with /usr/share/connectors/config/certs/ca/ca.crt
2025-03-03T10:02:35.677264270Z [FMWK][10:02:35][DEBUG] [job_cleanup_service] Cleaning up orphaned idle jobs
2025-03-03T10:02:37.249247869Z [FMWK][10:02:37][DEBUG] Importing module connectors.sources.mssql
2025-03-03T10:02:37.834204524Z [FMWK][10:02:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Sending heartbeat
2025-03-03T10:02:40.304111844Z [FMWK][10:02:40][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:02:40.315160254Z [FMWK][10:02:40][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:02:40.315192070Z [FMWK][10:02:40][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:02:40.315194668Z [FMWK][10:02:40][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:02:40.315196734Z [FMWK][10:02:40][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:02:48.441226205Z [FMWK][10:02:48][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:02:48.441258539Z [FMWK][10:02:48][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:02:48.474191051Z [FMWK][10:02:48][DEBUG] [job_cleanup_service] No orphaned idle jobs found. Skipping...
2025-03-03T10:02:48.474210785Z [FMWK][10:02:48][DEBUG] [job_cleanup_service] Start cleaning up idle jobs...
2025-03-03T10:02:48.630631433Z [FMWK][10:02:48][DEBUG] [job_cleanup_service] No idle jobs found. Skipping...
2025-03-03T10:02:48.980121660Z [FMWK][10:02:48][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:02:48.924131+00:00. Previously woke up at 2025-03-03 10:02:34.369569+00:00.
2025-03-03T10:02:54.825196810Z [FMWK][10:02:54][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:02:54.825219174Z [FMWK][10:02:54][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:02:54.825222157Z [FMWK][10:02:54][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17585 seconds
2025-03-03T10:03:08.721295222Z [FMWK][10:03:08][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:03:09.976304180Z [FMWK][10:03:09][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:03:24.886214487Z [FMWK][10:03:24][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:03:25.519946720Z [FMWK][10:03:25][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:03:25.519964870Z [FMWK][10:03:25][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:03:25.519967250Z [FMWK][10:03:25][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:03:25.519969286Z [FMWK][10:03:25][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:03:25.519977020Z [FMWK][10:03:25][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:03:26.476496608Z [FMWK][10:03:26][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:03:26.476516174Z [FMWK][10:03:26][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:03:26.604032257Z [FMWK][10:03:26][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:03:26.560334+00:00. Previously woke up at 2025-03-03 10:02:54.818685+00:00.
2025-03-03T10:03:27.304303111Z [FMWK][10:03:27][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:03:27.304322833Z [FMWK][10:03:27][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:03:27.304325394Z [FMWK][10:03:27][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17552 seconds
2025-03-03T10:03:39.084599142Z [FMWK][10:03:39][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:03:41.246368991Z [FMWK][10:03:41][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:03:57.176178153Z [FMWK][10:03:57][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:03:57.520157250Z [FMWK][10:03:57][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:03:57.522139003Z [FMWK][10:03:57][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:03:57.522158411Z [FMWK][10:03:57][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:03:57.522179344Z [FMWK][10:03:57][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:03:57.522207828Z [FMWK][10:03:57][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:03:58.045335766Z [FMWK][10:03:58][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:03:58.045359753Z [FMWK][10:03:58][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:03:58.096170793Z [FMWK][10:03:58][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:03:58.068527+00:00. Previously woke up at 2025-03-03 10:03:27.137833+00:00.
2025-03-03T10:03:58.096201514Z [FMWK][10:03:58][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:03:58.096204062Z [FMWK][10:03:58][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:03:58.096218241Z [FMWK][10:03:58][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17521 seconds
2025-03-03T10:04:10.080103688Z [FMWK][10:04:10][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:04:13.752185900Z [FMWK][10:04:13][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:04:28.106301410Z [FMWK][10:04:28][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:04:28.782368168Z [FMWK][10:04:28][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:04:28.782393343Z [FMWK][10:04:28][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:04:28.782395896Z [FMWK][10:04:28][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:04:28.782398036Z [FMWK][10:04:28][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:04:28.782399977Z [FMWK][10:04:28][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:04:29.408215114Z [FMWK][10:04:29][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:04:29.408236082Z [FMWK][10:04:29][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:04:29.421169380Z [FMWK][10:04:29][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:04:29.415458+00:00. Previously woke up at 2025-03-03 10:03:58.086255+00:00.
2025-03-03T10:04:29.421185515Z [FMWK][10:04:29][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:04:29.421187956Z [FMWK][10:04:29][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:04:29.421190045Z [FMWK][10:04:29][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17490 seconds
2025-03-03T10:04:40.362437321Z [FMWK][10:04:40][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:04:44.052251614Z [FMWK][10:04:44][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:04:59.463580146Z [FMWK][10:04:59][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:04:59.817238007Z [FMWK][10:04:59][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:04:59.817276026Z [FMWK][10:04:59][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:04:59.817280051Z [FMWK][10:04:59][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:04:59.817283279Z [FMWK][10:04:59][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:04:59.817285516Z [FMWK][10:04:59][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:05:04.367516670Z [FMWK][10:05:04][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:05:04.367541106Z [FMWK][10:05:04][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:05:04.549136330Z [FMWK][10:05:04][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:05:04.530753+00:00. Previously woke up at 2025-03-03 10:04:29.420987+00:00.
2025-03-03T10:05:04.594651108Z [FMWK][10:05:04][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:05:04.594674847Z [FMWK][10:05:04][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:05:04.594677285Z [FMWK][10:05:04][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17455 seconds
2025-03-03T10:05:10.637336036Z [FMWK][10:05:10][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:05:14.355129569Z [FMWK][10:05:14][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:05:34.577837672Z [FMWK][10:05:34][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:05:34.819666950Z [FMWK][10:05:34][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:05:34.833538693Z [FMWK][10:05:34][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:05:34.833562444Z [FMWK][10:05:34][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:05:34.833564903Z [FMWK][10:05:34][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:05:34.833566973Z [FMWK][10:05:34][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:05:35.270402422Z [FMWK][10:05:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:05:35.270435721Z [FMWK][10:05:35][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:05:35.306833644Z [FMWK][10:05:35][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:05:35.272192+00:00. Previously woke up at 2025-03-03 10:05:04.560667+00:00.
2025-03-03T10:05:35.306855416Z [FMWK][10:05:35][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:05:35.306857764Z [FMWK][10:05:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:05:35.306859966Z [FMWK][10:05:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17424 seconds
2025-03-03T10:05:40.890725641Z [FMWK][10:05:40][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:05:45.054272695Z [FMWK][10:05:45][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:06:05.300407274Z [FMWK][10:06:05][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:06:05.477179589Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:06:05.477207190Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:06:05.477209708Z [FMWK][10:06:05][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:06:05.477216934Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:06:05.477219603Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:06:05.773242090Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:06:05.773270452Z [FMWK][10:06:05][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:06:05.802304391Z [FMWK][10:06:05][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:06:05.786975+00:00. Previously woke up at 2025-03-03 10:05:35.277095+00:00.
2025-03-03T10:06:05.810152903Z [FMWK][10:06:05][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:06:05.825196238Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:06:05.825217480Z [FMWK][10:06:05][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17394 seconds
2025-03-03T10:06:11.150219770Z [FMWK][10:06:11][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:06:15.507160398Z [FMWK][10:06:15][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:06:35.819083522Z [FMWK][10:06:35][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:06:35.865706609Z [FMWK][10:06:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:06:35.865740746Z [FMWK][10:06:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:06:35.865744550Z [FMWK][10:06:35][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:06:35.865747694Z [FMWK][10:06:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:06:35.865750845Z [FMWK][10:06:35][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:06:36.220584289Z [FMWK][10:06:36][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:06:36.220615995Z [FMWK][10:06:36][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:06:36.242174442Z [FMWK][10:06:36][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:06:36.231674+00:00. Previously woke up at 2025-03-03 10:06:05.810089+00:00.
2025-03-03T10:06:36.306767299Z [FMWK][10:06:36][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:06:36.306783417Z [FMWK][10:06:36][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:06:36.306785888Z [FMWK][10:06:36][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17363 seconds
2025-03-03T10:06:41.568147258Z [FMWK][10:06:41][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:06:45.640608663Z [FMWK][10:06:45][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:07:06.317259049Z [FMWK][10:07:06][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:07:06.408201625Z [FMWK][10:07:06][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:07:06.408230007Z [FMWK][10:07:06][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:07:06.408245193Z [FMWK][10:07:06][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:07:06.408247771Z [FMWK][10:07:06][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:07:06.408249930Z [FMWK][10:07:06][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:07:06.952891579Z [FMWK][10:07:06][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:07:06.952911340Z [FMWK][10:07:06][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:07:07.026170886Z [FMWK][10:07:07][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:07:07.015736+00:00. Previously woke up at 2025-03-03 10:06:36.295493+00:00.
2025-03-03T10:07:07.026195549Z [FMWK][10:07:07][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:07:07.026198329Z [FMWK][10:07:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:07:07.026200683Z [FMWK][10:07:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17332 seconds
2025-03-03T10:07:12.232208764Z [FMWK][10:07:12][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:07:15.740906205Z [FMWK][10:07:15][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:07:37.032594097Z [FMWK][10:07:37][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:07:37.159432450Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:07:37.159457772Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:07:37.159460154Z [FMWK][10:07:37][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:07:37.159462216Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:07:37.159464245Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:07:37.429682269Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:07:37.429710542Z [FMWK][10:07:37][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T10:07:37.476526837Z [FMWK][10:07:37][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 10:07:37.462261+00:00. Previously woke up at 2025-03-03 10:07:07.021827+00:00.
2025-03-03T10:07:37.513224143Z [FMWK][10:07:37][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T10:07:37.513600497Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:56:00+00:00
2025-03-03T10:07:37.513608442Z [FMWK][10:07:37][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 17302 seconds
2025-03-03T10:07:42.301534064Z [FMWK][10:07:42][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T10:07:45.828662181Z [FMWK][10:07:45][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T10:07:48.629130851Z [FMWK][10:07:48][DEBUG] [job_cleanup_service] Cleaning up orphaned idle jobs
2025-03-03T10:07:48.718180359Z [FMWK][10:07:48][DEBUG] [job_cleanup_service] No orphaned idle jobs found. Skipping...
2025-03-03T10:07:48.718213834Z [FMWK][10:07:48][DEBUG] [job_cleanup_service] Start cleaning up idle jobs...
2025-03-03T10:07:48.718216631Z [FMWK][10:07:48][DEBUG] [job_cleanup_service] No idle jobs found. Skipping...
2025-03-03T10:08:07.547990822Z [FMWK][10:08:07][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T10:08:07.636621402Z [FMWK][10:08:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Sending heartbeat
2025-03-03T10:08:07.844296302Z [FMWK][10:08:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T10:08:07.844319253Z [FMWK][10:08:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T10:08:07.844322499Z [FMWK][10:08:07][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T10:08:07.844324569Z [FMWK][10:08:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T10:08:07.844326562Z [FMWK][10:08:07][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T10:08:08.201900033Z [FMWK][10:08:08][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T10:08:08.201920914Z [FMWK][10:08:08][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source

[strawgate (William Easton)]

@jjmcmullan

Next 'full' sync due in 17302 seconds

Unfortunately that log doesn't seem to contain a sync job. Can you trigger the job and grab the debug log a little bit after you triggered the sync job?

[jjmcmullan (jj)]

Apologies William, see below:

2025-03-03T14:39:45.387516489Z [FMWK][14:39:45][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T14:39:45.403406115Z [FMWK][14:39:45][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 14:39:45.403183+00:00. Previously woke up at 2025-03-03 14:39:15.237993+00:00.
2025-03-03T14:39:45.405783014Z [FMWK][14:39:45][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T14:39:45.405920751Z [FMWK][14:39:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:40:00+00:00
2025-03-03T14:39:45.405950150Z [FMWK][14:39:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync due in 14 seconds
2025-03-03T14:40:02.394063877Z [FMWK][14:40:02][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T14:40:06.504543672Z [FMWK][14:40:06][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T14:40:15.417807613Z [FMWK][14:40:15][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T14:40:15.427988307Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T14:40:15.428023563Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T14:40:15.428026322Z [FMWK][14:40:15][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T14:40:15.428028339Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T14:40:15.428030380Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T14:40:15.512184667Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping...
2025-03-03T14:40:15.512212351Z [FMWK][14:40:15][INFO] [job_scheduling_service] Connector is configured correctly and can reach the data source
2025-03-03T14:40:15.518023229Z [FMWK][14:40:15][DEBUG] [job_scheduling_service] Scheduler woke up at 2025-03-03 14:40:15.516265+00:00. Previously woke up at 2025-03-03 14:39:45.405974+00:00.
2025-03-03T14:40:15.521342796Z [FMWK][14:40:15][DEBUG] [job_scheduling_service] Last sync was scheduled at 2025-03-02 14:56:00+00:00
2025-03-03T14:40:15.521358692Z [FMWK][14:40:15][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Next 'full' sync is at 2025-03-03 14:40:00+00:00
2025-03-03T14:40:15.526530341Z [FMWK][14:40:15][INFO] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Creating a scheduled 'full' sync...
2025-03-03T14:40:32.417492507Z [FMWK][14:40:32][DEBUG] [access_control_sync_job_execution_service] Polling every 30 seconds for access control sync job execution
2025-03-03T14:40:36.518448380Z [FMWK][14:40:36][DEBUG] [content_sync_job_execution_service] Polling every 30 seconds for content sync job execution
2025-03-03T14:40:45.562124068Z [FMWK][14:40:45][DEBUG] [job_scheduling_service] Polling every 30 seconds for Job Scheduling
2025-03-03T14:40:45.575044753Z [FMWK][14:40:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Status is Status.CONNECTED
2025-03-03T14:40:45.577149788Z [FMWK][14:40:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating configuration
2025-03-03T14:40:45.577197023Z [FMWK][14:40:45][DEBUG] 'SSL certificate' was not validated because its dependencies were not met.
2025-03-03T14:40:45.577227585Z [FMWK][14:40:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Pinging the backend
2025-03-03T14:40:45.577276025Z [FMWK][14:40:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Validating the Connector Configuration...
2025-03-03T14:40:45.612165724Z [FMWK][14:40:45][DEBUG] [Connector id: v2JVP5UBPmayv5mKSd3b, index name: connector-dvsql01] Filtering is in state valid, skipping..

[jjmcmullan (jj)]

Folks,
If anyone else has this issue. I finally got it working by destroying the connector and associated index. I also deleted the the ".elastic-connectors-sync-jobs-v1" index and reconfigured everything from scratch and it all started working