Kibana server is not ready

{"type":"log","@timestamp":"2023-06-30T16:56:33+08:00","tags":["error","savedobjects-service"],"pid":21133,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 5 in 32 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:33+08:00","tags":["info","savedobjects-service"],"pid":21133,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 16107ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:33+08:00","tags":["error","savedobjects-service"],"pid":21133,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 5 in 32 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:33+08:00","tags":["info","savedobjects-service"],"pid":21133,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 16104ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:42+08:00","tags":["warning","plugins-system"],"pid":21133,"message":""eventLog" plugin didn't stop in 30sec., move on to the next."}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["info","plugins-service"],"pid":24343,"message":"Plugin "timelion" is disabled."}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""logging.timezone" has been deprecated and will be removed in 8.0. To set the timezone moving forward, please add a timezone date modifier to the log pattern in your logging configuration. For more details, see https://github.com/elastic/kibana/blob/master/src/core/server/logging/README.mdx"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["info","plugins-service"],"pid":24343,"message":"Plugin "visTypeTimelion" is disabled."}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["info","plugins-service"],"pid":24343,"message":"Plugin "timelines" is disabled."}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""logging.dest" has been deprecated and will be removed in 8.0. To set the destination moving forward, you can use the "console" appender in your logging configuration or define a custom one. For more details, see https://github.com/elastic/kibana/blob/master/src/core/server/logging/README.mdx"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""logging.quiet" has been deprecated and will be removed in 8.0. Moving forward, you can use "logging.root.level:error" in your logging configuration. "}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""logging.json" has been deprecated and will be removed in 8.0. To specify log message format moving forward, you can configure the "appender.layout" property for every custom appender in your logging configuration. There is currently no default layout for custom appenders and each one must be declared explicitly. For more details, see https://github.com/elastic/kibana/blob/master/src/core/server/logging/README.mdx"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""server.maxPayloadBytes" is deprecated and has been replaced by "server.maxPayload""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":"plugins.scanDirs is deprecated and is no longer used"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""kibana.index" is deprecated. Multitenancy by changing "kibana.index" will not be supported starting in 8.0. See Kibana 8.0.0-beta1 | Kibana Guide [8.0] | Elastic for more details"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""timelion.enabled" is deprecated and has been replaced by "vis_type_timelion.enabled""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""xpack.monitoring.ui.container.elasticsearch.enabled" is deprecated and has been replaced by "monitoring.ui.container.elasticsearch.enabled""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""xpack.monitoring" is deprecated and has been replaced by "monitoring". However both key are present, ignoring "xpack.monitoring""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":"Config key [monitoring.cluster_alerts.email_notifications.email_address] will be required for email notifications to work in 8.0.""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["warning","config","deprecation"],"pid":24343,"message":""xpack.security.sessionTimeout" is deprecated and has been replaced by "xpack.security.session.idleTimeout""}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["info","plugins-system"],"pid":24343,"message":"Setting up [104] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,banners,features,code,usageCollection,xpackLegacy,telemetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,securityOss,share,newsfeed,mapsEms,mapsLegacy,kibanaLegacy,translations,licenseApiGuard,legacyExport,embeddable,uiActionsEnhanced,expressions,charts,esUiShared,bfetch,data,home,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,licenseManagement,watcher,advancedSettings,savedObjects,visualizations,visTypeMetric,visTypeVislib,visTypeVega,visTypeTable,visTypeMarkdown,visTypeTagcloud,visTypeXy,tileMap,regionMap,presentationUtil,canvas,graph,dashboard,dashboardEnhanced,visualize,visTypeTimeseries,inputControlVis,indexPatternManagement,discover,discoverEnhanced,savedObjectsManagement,spaces,security,savedObjectsTagging,lens,reporting,lists,dataEnhanced,encryptedSavedObjects,dashboardMode,cloud,upgradeAssistant,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,beatsManagement,transform,ingestPipelines,fileUpload,maps,fileDataVisualizer,eventLog,actions,alerting,triggersActionsUi,stackAlerts,ruleRegistry,observability,osquery,ml,securitySolution,cases,infra,monitoring,logstash,apm,uptime]"}
{"type":"log","@timestamp":"2023-06-30T16:56:48+08:00","tags":["info","plugins","taskManager"],"pid":24343,"message":"TaskManager is identified by the Kibana UUID: 81108e03-70eb-4c47-9ee1-1d016d489791"}
{"type":"log","@timestamp":"2023-06-30T16:56:49+08:00","tags":["info","plugins","monitoring","monitoring"],"pid":24343,"message":"config sourced from: production cluster"}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations..."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"Starting saved objects migrations"}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] INIT -> OUTDATED_DOCUMENTS_SEARCH. took: 36ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] INIT -> OUTDATED_DOCUMENTS_SEARCH. took: 39ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 1 in 2 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 122ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 1 in 2 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:50+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 119ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:52+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 2 in 4 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:52+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 2103ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:52+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 2 in 4 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:52+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 2121ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:56+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 3 in 8 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:56+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 4113ms."}
{"type":"log","@timestamp":"2023-06-30T16:56:56+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 3 in 8 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:56:56+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 4118ms."}
{"type":"log","@timestamp":"2023-06-30T16:57:04+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 4 in 16 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:04+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 8105ms."}
{"type":"log","@timestamp":"2023-06-30T16:57:04+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 4 in 16 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:04+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 8124ms."}
{"type":"log","@timestamp":"2023-06-30T16:57:20+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 5 in 32 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:20+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 16121ms."}
{"type":"log","@timestamp":"2023-06-30T16:57:20+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 5 in 32 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:20+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 16104ms."}

{"type":"log","@timestamp":"2023-06-30T16:57:53+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] Action failed with 'search_phase_execution_exception'. Retrying attempt 6 in 64 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:53+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana-147-105] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 32116ms."}
{"type":"log","@timestamp":"2023-06-30T16:57:53+08:00","tags":["error","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] Action failed with 'search_phase_execution_exception'. Retrying attempt 6 in 64 seconds."}
{"type":"log","@timestamp":"2023-06-30T16:57:53+08:00","tags":["info","savedobjects-service"],"pid":24343,"message":"[.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH -> OUTDATED_DOCUMENTS_SEARCH. took: 32090ms."}

Hi @Alwyn_Tiu. I don't think we have enough information to help. I suggest looking also at your Elasticsearch logs for any errors. Also, have you made any changes to your cluster before this problem started?

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.