Kibana not responding following 8.11.0 upgrade

jdswifty · November 10, 2023, 5:24pm

Just completed upgrading both ES & Kibana from 8.9.0 to 8.11.0 & the kibana web front end is not responding at all

seeing no obvious errors in the logs

[2023-11-10T16:07:48.509+00:00][INFO ][http.server.Preboot] http server running at https://wpxxxxx2.xxxxx.com:443
[2023-11-10T16:08:00.787+00:00][INFO ][plugins.observability] SLO summary transforms already installed - skipping
[2023-11-10T16:08:00.986+00:00][INFO ][plugins.observabilityAIAssistant.service] Successfully set up index assets
[2023-11-10T16:08:02.140+00:00][INFO ][plugins.fleet] Fleet setup completed
[2023-11-10T16:08:02.143+00:00][INFO ][plugins.securitySolution] Dependent plugin setup complete - Starting ManifestTask
[2023-11-10T16:08:02.145+00:00][INFO ][plugins.securitySolution.endpoint.policyProtections] App feature [endpoint_policy_protections] is enabled. Nothing to do!
[2023-11-10T16:08:02.683+00:00][INFO ][plugins.synthetics] Installed synthetics index templates
[2023-11-10T16:08:05.797+00:00][INFO ][status] Kibana is now available (was degraded)
[2023-11-10T16:15:57.762+00:00][ERROR][plugins.taskManager] Task Fleet-Usage-Sender "Fleet-Usage-Sender-1.1.0" failed: Error: Outdated task version for task: Fleet-Usage-Sender-1.1.0

but getting ERR_CONNECTION_TIMED_OUT in the browser (tired various browsers, running locally on the host, incogneto mode etc...)

kibana config

server.port: 443
server.host: "wpxxxxxx.xxxxx.com"
server.name: "WPxxxxxx-xxxx-NODE-1"
server.publicBaseUrl: "https://cxxxxxxa.xxxxx.com/"
elasticsearch.hosts: ["https://wpxxxxxx.bskyb.com:9200","https://wpxxxxxx.bskyb.com:9200"]
data.autocomplete.valueSuggestions.timeout: 30000
data.autocomplete.valueSuggestions.terminateAfter: 60000
elasticsearch.serviceAccountToken: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
xpack.security.encryptionKey: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
xpack.encryptedSavedObjects.encryptionKey: "xxxxxxxxxxxxxxxxxxxxy"
xpack.security.session.idleTimeout: "120m"
xpack.security.session.lifespan: "8h"
xpack.reporting.roles.enabled : false
elasticsearch.ssl.certificateAuthorities: D:\Config\certs\ct-cacerts.pem
server.ssl.enabled: true
server.ssl.certificate: D:\Config\certs\xxxx.xxxxxx.com.pem
server.ssl.key: D:\Config\certs\xxxxx.xxxxx.com.key
logging:
  appenders:
    file:
      type: file
      fileName: L:\Kibana\kibana-log.log
      layout:
        type: pattern
  root:
    appenders: [default,file]
    level: info

jdswifty · November 10, 2023, 5:51pm

ES Cluster health is green
{
"cluster_name": "CT-ES-PROD",
"status": "green",
"timed_out": false,
"number_of_nodes": 17,
"number_of_data_nodes": 12,
"active_primary_shards": 5247,
"active_shards": 6689,
"relocating_shards": 10,
"initializing_shards": 0,
"unassigned_shards": 0,
"delayed_unassigned_shards": 0,
"number_of_pending_tasks": 0,
"number_of_in_flight_fetch": 0,
"task_max_waiting_in_queue_millis": 0,
"active_shards_percent_as_number": 100.0
}

jdswifty · November 10, 2023, 5:59pm

not sure if this is related or not but i cant see an index for kibana 8.11.0

jdswifty · November 11, 2023, 9:27am

full start up log

[2023-11-11T09:21:09.323+00:00][INFO ][root] Kibana is starting
[2023-11-11T09:21:09.386+00:00][INFO ][node] Kibana process configured with roles: [background_tasks, ui]
[2023-11-11T09:21:47.705+00:00][INFO ][plugins-service] Plugin "cloudChat" is disabled.
[2023-11-11T09:21:47.713+00:00][INFO ][plugins-service] Plugin "cloudExperiments" is disabled.
[2023-11-11T09:21:47.713+00:00][INFO ][plugins-service] Plugin "cloudFullStory" is disabled.
[2023-11-11T09:21:47.713+00:00][INFO ][plugins-service] Plugin "cloudGainsight" is disabled.
[2023-11-11T09:21:47.933+00:00][INFO ][plugins-service] Plugin "profilingDataAccess" is disabled.
[2023-11-11T09:21:47.933+00:00][INFO ][plugins-service] Plugin "profiling" is disabled.
[2023-11-11T09:21:48.008+00:00][INFO ][plugins-service] Plugin "securitySolutionServerless" is disabled.
[2023-11-11T09:21:48.008+00:00][INFO ][plugins-service] Plugin "serverless" is disabled.
[2023-11-11T09:21:48.008+00:00][INFO ][plugins-service] Plugin "serverlessObservability" is disabled.
[2023-11-11T09:21:48.008+00:00][INFO ][plugins-service] Plugin "serverlessSearch" is disabled.
[2023-11-11T09:21:48.385+00:00][INFO ][http.server.Preboot] http server running at https://wpxxxxxx.xxxxxxx.com:443
[2023-11-11T09:21:48.649+00:00][INFO ][plugins-system.preboot] Setting up [1] plugins: [interactiveSetup]
[2023-11-11T09:21:48.711+00:00][WARN ][config.deprecation] Setting "data.autocomplete.valueSuggestions.terminateAfter" has been replaced by "unifiedSearch.autocomplete.valueSuggestions.terminateAfter"
[2023-11-11T09:21:48.713+00:00][WARN ][config.deprecation] Setting "data.autocomplete.valueSuggestions.timeout" has been replaced by "unifiedSearch.autocomplete.valueSuggestions.timeout"
[2023-11-11T09:21:50.892+00:00][INFO ][plugins-system.standard] Setting up [147] plugins: [devTools,translations,share,screenshotMode,usageCollection,telemetryCollectionManager,telemetryCollectionXpack,taskManager,kibanaUsageCollection,cloud,newsfeed,savedObjectsFinder,noDataPage,monitoringCollection,metricsDataAccess,licensing,mapsEms,globalSearch,globalSearchProviders,features,guidedOnboarding,banners,licenseApiGuard,customBranding,ftrApis,fieldFormats,expressions,screenshotting,esUiShared,customIntegrations,contentManagement,dataViews,home,searchprofiler,painlessLab,management,spaces,security,telemetry,licenseManagement,snapshotRestore,lists,files,encryptedSavedObjects,eventLog,actions,notifications,cloudDataMigration,advancedSettings,grokdebugger,console,bfetch,data,savedObjectsTagging,savedObjectsManagement,unifiedSearch,graph,alerting,embeddable,uiActionsEnhanced,savedSearch,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,controls,fileUpload,ingestPipelines,ecsDataQualityDashboard,dataViewFieldEditor,dataViewManagement,charts,watcher,visualizations,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,visTypeHeatmap,inputControlVis,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionLegacyMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,eventAnnotation,expressionXY,dashboard,triggersActionsUi,transform,stackConnectors,stackAlerts,ruleRegistry,links,lens,maps,discover,reporting,canvas,fleet,logExplorer,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,cloudSecurityPosture,discoverEnhanced,dataVisualizer,cases,timelines,sessionView,kubernetesSecurity,cloudDefend,threatIntelligence,osquery,observabilityLogExplorer,observabilityAIAssistant,logsShared,aiops,observability,observabilityOnboarding,ml,uptime,synthetics,infra,upgradeAssistant,monitoring,logstash,enterpriseSearch,elasticAssistant,securitySolution,securitySolutionEss,dashboardEnhanced,apmDataAccess,assetManager,apm]
[2023-11-11T09:21:50.907+00:00][INFO ][plugins.taskManager] TaskManager is identified by the Kibana UUID: f4b24a96-5c13-4a9c-8bd1-bf0d746f6b87
[2023-11-11T09:21:50.949+00:00][INFO ][custom-branding-service] CustomBrandingService registering plugin: customBranding
[2023-11-11T09:21:51.124+00:00][INFO ][plugins.encryptedSavedObjects] Hashed 'xpack.encryptedSavedObjects.encryptionKey' for this instance: BDxARD5NuQG2mRuSg8IWx0Idt6gbiAQs6gmvvPyIj88=
[2023-11-11T09:21:51.138+00:00][INFO ][plugins.notifications] Email Service Error: Email connector not specified.
[2023-11-11T09:21:51.264+00:00][INFO ][plugins.alerting] using indexes and aliases for persisting alerts
[2023-11-11T09:21:51.721+00:00][INFO ][plugins.alerting] Registering resources for context "stack".
[2023-11-11T09:21:51.769+00:00][WARN ][plugins.reporting.config] Generating a random key for xpack.reporting.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.reporting.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
[2023-11-11T09:21:51.870+00:00][INFO ][plugins.cloudSecurityPosture] Registered task successfully [Task: cloud_security_posture-stats_task]
[2023-11-11T09:21:51.936+00:00][INFO ][plugins.alerting] Registering resources for context "observability.slo".
[2023-11-11T09:21:51.942+00:00][INFO ][plugins.alerting] Registering resources for context "observability.threshold".
[2023-11-11T09:21:51.985+00:00][INFO ][plugins.alerting] Registering resources for context "ml.anomaly-detection".
[2023-11-11T09:21:52.016+00:00][INFO ][plugins.alerting] Registering resources for context "observability.uptime".
[2023-11-11T09:21:52.075+00:00][INFO ][plugins.alerting] Registering resources for context "observability.logs".
[2023-11-11T09:21:52.079+00:00][INFO ][plugins.alerting] Registering resources for context "observability.metrics".
[2023-11-11T09:21:52.358+00:00][INFO ][plugins.alerting] Registering resources for context "security".
[2023-11-11T09:21:52.419+00:00][INFO ][plugins.assetManager] Server is NOT enabled
[2023-11-11T09:21:52.435+00:00][INFO ][plugins.alerting] Registering resources for context "observability.apm".
[2023-11-11T09:21:52.576+00:00][INFO ][plugins.screenshotting.config] Chromium sandbox provides an additional layer of protection, and is supported for Win32 OS. Automatically enabling Chromium sandbox.
[2023-11-11T09:21:52.723+00:00][INFO ][plugins.screenshotting.chromium] Browser executable: C:\Program Files\Elastic\kibana\node_modules\@kbn\screenshotting-plugin\chromium\chrome-win\chrome.exe
[2023-11-11T09:21:52.840+00:00][INFO ][savedobjects-service] Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
[2023-11-11T09:21:52.841+00:00][INFO ][savedobjects-service] Starting saved objects migrations
[2023-11-11T09:21:53.146+00:00][INFO ][savedobjects-service] [.kibana] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 285ms.
[2023-11-11T09:21:53.305+00:00][INFO ][savedobjects-service] [.kibana] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 159ms.
[2023-11-11T09:21:53.307+00:00][INFO ][savedobjects-service] [.kibana] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 2ms.
[2023-11-11T09:21:53.408+00:00][INFO ][savedobjects-service] [.kibana_task_manager] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 544ms.
[2023-11-11T09:21:53.414+00:00][INFO ][savedobjects-service] [.kibana_task_manager] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 6ms.
[2023-11-11T09:21:53.415+00:00][INFO ][savedobjects-service] [.kibana_task_manager] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 1ms.
[2023-11-11T09:21:53.422+00:00][INFO ][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 7ms.
[2023-11-11T09:21:53.427+00:00][INFO ][savedobjects-service] [.kibana_analytics] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 512ms.
[2023-11-11T09:21:53.431+00:00][INFO ][savedobjects-service] [.kibana_security_solution] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 464ms.
[2023-11-11T09:21:53.435+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 416ms.
[2023-11-11T09:21:53.438+00:00][INFO ][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 131ms.
[2023-11-11T09:21:53.442+00:00][INFO ][savedobjects-service] [.kibana_ingest] INIT -> WAIT_FOR_YELLOW_SOURCE. took: 367ms.
[2023-11-11T09:21:53.444+00:00][INFO ][savedobjects-service] [.kibana_analytics] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 17ms.
[2023-11-11T09:21:53.445+00:00][INFO ][savedobjects-service] [.kibana_analytics] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 1ms.
[2023-11-11T09:21:53.447+00:00][INFO ][savedobjects-service] [.kibana_security_solution] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 16ms.
[2023-11-11T09:21:53.448+00:00][INFO ][savedobjects-service] [.kibana_security_solution] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 1ms.
[2023-11-11T09:21:53.450+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 15ms.
[2023-11-11T09:21:53.451+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 1ms.
[2023-11-11T09:21:53.453+00:00][INFO ][savedobjects-service] [.kibana_ingest] WAIT_FOR_YELLOW_SOURCE -> UPDATE_SOURCE_MAPPINGS_PROPERTIES. took: 11ms.
[2023-11-11T09:21:53.454+00:00][INFO ][savedobjects-service] [.kibana_ingest] UPDATE_SOURCE_MAPPINGS_PROPERTIES -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 1ms.
[2023-11-11T09:21:53.456+00:00][INFO ][savedobjects-service] [.kibana_analytics] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 11ms.
[2023-11-11T09:21:53.459+00:00][INFO ][savedobjects-service] [.kibana_security_solution] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 11ms.
[2023-11-11T09:21:53.462+00:00][INFO ][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 40ms.
[2023-11-11T09:21:53.465+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 14ms.
[2023-11-11T09:21:53.468+00:00][INFO ][savedobjects-service] [.kibana_ingest] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 14ms.
[2023-11-11T09:21:53.471+00:00][INFO ][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 33ms.
[2023-11-11T09:21:53.473+00:00][INFO ][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 11ms.
[2023-11-11T09:21:53.474+00:00][INFO ][savedobjects-service] [.kibana_task_manager] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 1ms.
[2023-11-11T09:21:53.475+00:00][INFO ][savedobjects-service] [.kibana_task_manager] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 1ms.
[2023-11-11T09:21:53.475+00:00][INFO ][savedobjects-service] [.kibana_task_manager] Migration completed after 611ms
[2023-11-11T09:21:53.477+00:00][INFO ][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 6ms.
[2023-11-11T09:21:53.478+00:00][INFO ][savedobjects-service] [.kibana] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 1ms.
[2023-11-11T09:21:53.480+00:00][INFO ][savedobjects-service] [.kibana] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 2ms.
[2023-11-11T09:21:53.480+00:00][INFO ][savedobjects-service] [.kibana] Migration completed after 619ms
[2023-11-11T09:21:53.481+00:00][INFO ][savedobjects-service] [.kibana_security_solution] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 22ms.
[2023-11-11T09:21:53.484+00:00][INFO ][savedobjects-service] [.kibana_analytics] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 27ms.
[2023-11-11T09:21:53.486+00:00][INFO ][savedobjects-service] [.kibana_security_solution] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 5ms.
[2023-11-11T09:21:53.486+00:00][INFO ][savedobjects-service] [.kibana_security_solution] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 0ms.
[2023-11-11T09:21:53.487+00:00][INFO ][savedobjects-service] [.kibana_security_solution] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 1ms.
[2023-11-11T09:21:53.487+00:00][INFO ][savedobjects-service] [.kibana_security_solution] Migration completed after 520ms
[2023-11-11T09:21:53.489+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 24ms.
[2023-11-11T09:21:53.491+00:00][INFO ][savedobjects-service] [.kibana_analytics] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 8ms.
[2023-11-11T09:21:53.491+00:00][INFO ][savedobjects-service] [.kibana_analytics] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 0ms.
[2023-11-11T09:21:53.492+00:00][INFO ][savedobjects-service] [.kibana_analytics] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 1ms.
[2023-11-11T09:21:53.492+00:00][INFO ][savedobjects-service] [.kibana_analytics] Migration completed after 577ms
[2023-11-11T09:21:53.494+00:00][INFO ][savedobjects-service] [.kibana_ingest] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 26ms.
[2023-11-11T09:21:53.496+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 7ms.
[2023-11-11T09:21:53.497+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 1ms.
[2023-11-11T09:21:53.498+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 1ms.
[2023-11-11T09:21:53.498+00:00][INFO ][savedobjects-service] [.kibana_alerting_cases] Migration completed after 479ms
[2023-11-11T09:21:53.500+00:00][INFO ][savedobjects-service] [.kibana_ingest] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> CHECK_TARGET_MAPPINGS. took: 6ms.
[2023-11-11T09:21:53.501+00:00][INFO ][savedobjects-service] [.kibana_ingest] CHECK_TARGET_MAPPINGS -> CHECK_VERSION_INDEX_READY_ACTIONS. took: 0ms.
[2023-11-11T09:21:53.501+00:00][INFO ][savedobjects-service] [.kibana_ingest] CHECK_VERSION_INDEX_READY_ACTIONS -> DONE. took: 1ms.
[2023-11-11T09:21:53.502+00:00][INFO ][savedobjects-service] [.kibana_ingest] Migration completed after 426ms
[2023-11-11T09:21:53.511+00:00][INFO ][plugins-system.preboot] Stopping all plugins.
[2023-11-11T09:21:53.512+00:00][INFO ][plugins-system.preboot] All plugins stopped.
[2023-11-11T09:21:53.513+00:00][INFO ][plugins-system.standard] Starting [147] plugins: [devTools,translations,share,screenshotMode,usageCollection,telemetryCollectionManager,telemetryCollectionXpack,taskManager,kibanaUsageCollection,cloud,newsfeed,savedObjectsFinder,noDataPage,monitoringCollection,metricsDataAccess,licensing,mapsEms,globalSearch,globalSearchProviders,features,guidedOnboarding,banners,licenseApiGuard,customBranding,ftrApis,fieldFormats,expressions,screenshotting,esUiShared,customIntegrations,contentManagement,dataViews,home,searchprofiler,painlessLab,management,spaces,security,telemetry,licenseManagement,snapshotRestore,lists,files,encryptedSavedObjects,eventLog,actions,notifications,cloudDataMigration,advancedSettings,grokdebugger,console,bfetch,data,savedObjectsTagging,savedObjectsManagement,unifiedSearch,graph,alerting,embeddable,uiActionsEnhanced,savedSearch,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,controls,fileUpload,ingestPipelines,ecsDataQualityDashboard,dataViewFieldEditor,dataViewManagement,charts,watcher,visualizations,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,visTypeHeatmap,inputControlVis,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionLegacyMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,eventAnnotation,expressionXY,dashboard,triggersActionsUi,transform,stackConnectors,stackAlerts,ruleRegistry,links,lens,maps,discover,reporting,canvas,fleet,logExplorer,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,cloudSecurityPosture,discoverEnhanced,dataVisualizer,cases,timelines,sessionView,kubernetesSecurity,cloudDefend,threatIntelligence,osquery,observabilityLogExplorer,observabilityAIAssistant,logsShared,aiops,observability,observabilityOnboarding,ml,uptime,synthetics,infra,upgradeAssistant,monitoring,logstash,enterpriseSearch,elasticAssistant,securitySolution,securitySolutionEss,dashboardEnhanced,apmDataAccess,assetManager,apm]
[2023-11-11T09:21:54.433+00:00][INFO ][plugins.fleet] Task Fleet-Usage-Sender-1.1.3 scheduled with interval 1h
[2023-11-11T09:21:54.434+00:00][INFO ][plugins.fleet.fleet:check-deleted-files-task:1.0.1] Started with interval of [1d] and timeout of [2m]
[2023-11-11T09:21:54.459+00:00][INFO ][plugins.monitoring.monitoring] config sourced from: production cluster
[2023-11-11T09:21:54.661+00:00][INFO ][plugins.observability] Installing SLO shared resources
[2023-11-11T09:21:54.662+00:00][INFO ][plugins.observability] Installing SLO component template [.slo-observability.sli-mappings]
[2023-11-11T09:21:54.708+00:00][INFO ][plugins.observability] Installing SLO component template [.slo-observability.sli-settings]
[2023-11-11T09:21:54.755+00:00][INFO ][plugins.observability] Installing SLO component template [.slo-observability.summary-mappings]
[2023-11-11T09:21:54.801+00:00][INFO ][plugins.observability] Installing SLO component template [.slo-observability.summary-settings]
[2023-11-11T09:21:54.903+00:00][INFO ][plugins.alerting] Installing ILM policy .alerts-ilm-policy
[2023-11-11T09:21:54.954+00:00][INFO ][plugins.alerting] Installing component template .alerts-framework-mappings
[2023-11-11T09:21:55.001+00:00][INFO ][plugins.alerting] Installing component template .alerts-legacy-alert-mappings
[2023-11-11T09:21:55.141+00:00][INFO ][plugins.alerting] Installing component template .alerts-ecs-mappings
[2023-11-11T09:21:55.377+00:00][INFO ][plugins.ruleRegistry] Installing component template .alerts-technical-mappings
[2023-11-11T09:21:58.295+00:00][INFO ][status] Kibana is now degraded
[2023-11-11T09:21:58.367+00:00][INFO ][http.server.Kibana] http server running at https://wpxxxxxxx.xxxxxx.com:443
[2023-11-11T09:21:58.382+00:00][INFO ][plugins.fleet] Task Fleet-Usage-Logger-Task scheduled with interval 15m
[2023-11-11T09:21:58.582+00:00][INFO ][plugins.monitoring.monitoring.kibana-monitoring] Starting monitoring stats collection
[2023-11-11T09:21:58.590+00:00][INFO ][plugins.fleet] Beginning fleet setup
[2023-11-11T09:21:58.600+00:00][INFO ][plugins.observability] Installing SLO index template [.slo-observability.sli]
[2023-11-11T09:21:58.618+00:00][INFO ][plugins.ruleRegistry] Installing ILM policy .preview.alerts-security.alerts-policy
[2023-11-11T09:21:58.695+00:00][INFO ][plugins.alerting] Installing component template .alerts-stack.alerts-mappings
[2023-11-11T09:21:58.697+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.slo.alerts-mappings
[2023-11-11T09:21:58.698+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.threshold.alerts-mappings
[2023-11-11T09:21:58.700+00:00][INFO ][plugins.alerting] Installing component template .alerts-ml.anomaly-detection.alerts-mappings
[2023-11-11T09:21:58.701+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.uptime.alerts-mappings
[2023-11-11T09:21:58.702+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.logs.alerts-mappings
[2023-11-11T09:21:58.703+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.metrics.alerts-mappings
[2023-11-11T09:21:58.709+00:00][INFO ][plugins.alerting] Installing component template .alerts-security.alerts-mappings
[2023-11-11T09:21:58.711+00:00][INFO ][plugins.alerting] Installing component template .alerts-observability.apm.alerts-mappings
[2023-11-11T09:21:58.715+00:00][INFO ][plugins.observabilityAIAssistant.service] Creating concrete write index - .kibana-observability-ai-assistant-conversations-000001
[2023-11-11T09:21:58.758+00:00][INFO ][plugins.observability] Installing SLO index template [.slo-observability.summary]
[2023-11-11T09:21:58.811+00:00][INFO ][plugins.ruleRegistry] Installing component template .preview.alerts-security.alerts-mappings
[2023-11-11T09:21:58.816+00:00][INFO ][plugins.fleet] Agent policies updated by license change: []
[2023-11-11T09:21:58.832+00:00][INFO ][plugins.alerting] Installing index template .alerts-stack.alerts-default-index-template
[2023-11-11T09:21:58.834+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.threshold.alerts-default-index-template
[2023-11-11T09:21:58.835+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.metrics.alerts-default-index-template
[2023-11-11T09:21:58.837+00:00][INFO ][plugins.alerting] Installing index template .alerts-ml.anomaly-detection.alerts-default-index-template
[2023-11-11T09:21:58.839+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.apm.alerts-default-index-template
[2023-11-11T09:21:58.841+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.slo.alerts-default-index-template
[2023-11-11T09:21:58.843+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.uptime.alerts-default-index-template
[2023-11-11T09:21:58.845+00:00][INFO ][plugins.alerting] Installing index template .alerts-observability.logs.alerts-default-index-template
[2023-11-11T09:21:58.848+00:00][INFO ][plugins.alerting] Installing index template .alerts-security.alerts-default-index-template
[2023-11-11T09:21:59.378+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-stack.alerts-default-000001
[2023-11-11T09:21:59.382+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-ml.anomaly-detection.alerts-default-000001
[2023-11-11T09:21:59.385+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.metrics.alerts-default-000001
[2023-11-11T09:21:59.388+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.threshold.alerts-default-000001
[2023-11-11T09:21:59.431+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.logs.alerts-default-000001
[2023-11-11T09:21:59.433+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.apm.alerts-default-000001
[2023-11-11T09:21:59.434+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.slo.alerts-default-000001
[2023-11-11T09:21:59.439+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-observability.uptime.alerts-default-000001
[2023-11-11T09:21:59.440+00:00][INFO ][plugins.alerting] Creating concrete write index - .internal.alerts-security.alerts-default-000001
[2023-11-11T09:21:59.803+00:00][INFO ][plugins.observability] Installing SLO ingest pipeline [.slo-observability.sli.pipeline]
[2023-11-11T09:21:59.846+00:00][INFO ][plugins.observability] Installing SLO ingest pipeline [.slo-observability.summary.pipeline]
[2023-11-11T09:21:59.914+00:00][INFO ][plugins.observabilityAIAssistant.service] Creating concrete write index - .kibana-observability-ai-assistant-kb-000001
[2023-11-11T09:21:59.952+00:00][INFO ][plugins.observability] SLO summary transforms already installed - skipping
[2023-11-11T09:22:00.219+00:00][INFO ][plugins.observabilityAIAssistant.service] Successfully set up index assets
[2023-11-11T09:22:01.211+00:00][INFO ][plugins.fleet] Fleet setup completed
[2023-11-11T09:22:01.214+00:00][INFO ][plugins.securitySolution] Dependent plugin setup complete - Starting ManifestTask
[2023-11-11T09:22:01.216+00:00][INFO ][plugins.securitySolution.endpoint.policyProtections] App feature [endpoint_policy_protections] is enabled. Nothing to do!
[2023-11-11T09:22:01.671+00:00][INFO ][plugins.synthetics] Installed synthetics index templates
[2023-11-11T09:22:03.194+00:00][INFO ][status] Kibana is now available (was degraded)
[2023-11-11T09:22:05.337+00:00][INFO ][plugins.fleet] Fleet Usage: {"agents_enabled":true,"agents":{"total_enrolled":4,"healthy":2,"unhealthy":0,"offline":2,"inactive":0,"unenrolled":3,"total_all_statuses":7,"updating":0},"fleet_server":{"total_enrolled":2,"healthy":1,"unhealthy":0,"offline":1,"updating":0,"total_all_statuses":2,"num_host_urls":5}}

jdswifty · November 11, 2023, 11:01am

Resolved...
removed all the SSL & set the hostname back to localhost & port back to the default port, could then see was getting this error browsing locally on the host

Version: 8.11.0
Build: 68160
TypeError: Failed to fetch
    at Module.B (http://localhost:5601/68160/bundles/kbn-ui-shared-deps-src/kbn-ui-shared-deps-src.js:1:158208)
    at Module.an (http://localhost:5601/68160/bundles/core/core.entry.js:1:377041)
    at http://localhost:5601/bootstrap.js:111:47
    at HTMLScriptElement.innerCb (http://localhost:5601/bootstrap.js:90:13)

so re deployed the install files & tried again & its working now, either the deploy job to stage the new version dir missed something or I'm blaming crowdstrike for nuking some files as its done in the past.
Anyhow all working now

system · December 9, 2023, 11:01am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.