Hello,
i just can't get my Kibana WebUI to load. After 5 seconds I get the following error message in the web browser:
Kibana server is not ready yet.
System Information:
root@dsme01:~# lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description: Debian GNU/Linux 12 (bookworm)
Release: 12
Codename: bookworm
root@dsme01:~# dpkg -l elasticsearch
Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten
| Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/
Halb installiert/Trigger erWartet/Trigger anhängig
|/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler: GROSS=schlecht)
||/ Name Version Architektur Beschreibung
+++-==============-============-============-=====================================================
ii elasticsearch 8.15.3 amd64 Distributed RESTful search engine built for the cloud
root@dsme01:~# dpkg -l logstash
Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten
| Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/
Halb installiert/Trigger erWartet/Trigger anhängig
|/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler: GROSS=schlecht)
||/ Name Version Architektur Beschreibung
+++-==============-============-============-=================================
ii logstash 1:8.15.3-1 amd64 An extensible logging pipeline
root@dsme01:~# dpkg -l filebeat
Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten
| Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/
Halb installiert/Trigger erWartet/Trigger anhängig
|/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler: GROSS=schlecht)
||/ Name Version Architektur Beschreibung
+++-==============-============-============-==================================================================
ii filebeat 8.15.3 amd64 Filebeat sends log files to Logstash or directly to Elasticsearch.
root@dsme01:~# dpkg -l kibana
Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten
| Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/
Halb installiert/Trigger erWartet/Trigger anhängig
|/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler: GROSS=schlecht)
||/ Name Version Architektur Beschreibung
+++-==============-============-============-=============================================
ii kibana 8.15.3 amd64 Explore and visualize your Elasticsearch data
My Configuration
nginx:
server {
listen kibana.intern.harnet.de:443 ssl http2;
server_name kibana.intern.harnet.de;
ssl_certificate /etc/ssl/certs/kibana.intern.harnet.de.crt;
ssl_certificate_key /etc/ssl/private/kibana.intern.harnet.de.key;
ssl_dhparam /etc/ssl/certs/dhparams.pem;
location / {
proxy_read_timeout 300s;
proxy_connect_timeout 75s;
proxy_pass https://kibana.intern.harnet.de:5601;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection 'upgrade';
proxy_set_header Host $http_host;
proxy_cache_bypass $http_upgrade;
}
access_log /var/log/nginx/kibana.log;
error_log /var/log/nginx/kibana.log;
}
kibana.yml
root@dsme01:~# cat /etc/kibana/kibana.yml
server.host: "kibana.intern.harnet.de"
server.name: "kibana.intern.harnet.de"
server.ssl.enabled: true
server.ssl.certificate: /etc/kibana/config/certs/kibana.intern.harnet.de.crt
server.ssl.key: /etc/kibana/config/certs/kibana.intern.harnet.de.key
elasticsearch.hosts: ["https://elasticsearch.intern.harnet.de:9200"]
elasticsearch.serviceAccountToken: "AAEAAWVsYXN0aWMvZmxlZXQtc2VydmVyL21....va2VuOmxEU1l0c3k1U1NTSU9zWnFncDZ3REE"
elasticsearch.ssl.certificateAuthorities: [ "/etc/kibana/config/certs/HarbichCA.crt" ]
logging:
appenders:
file:
type: file
fileName: /var/log/kibana/kibana.log
layout:
type: json
root:
appenders:
- default
- file
pid.file: /run/kibana/kibana.pid
xpack.encryptedSavedObjects.encryptionKey: a22494aa8710....9d8a7c03b94df105
xpack.reporting.encryptionKey: 1642d183816aa3....87e27370928c6a
xpack.security.encryptionKey: 03082e82c33e265....96b466af69e80
xpack.screenshotting.browser.chromium.disableSandbox: true
Here my Logging Informationen
Kibana Service
root@dsme01:~# systemctl status kibana.service
● kibana.service - Kibana
Loaded: loaded (/lib/systemd/system/kibana.service; disabled; vendor preset: enabled)
Active: active (running) since Mon 2024-11-04 09:06:53 CET; 1min 3s ago
Docs: https://www.elastic.co
Main PID: 309354 (node)
Tasks: 11 (limit: 38438)
Memory: 1.0G
CGroup: /system.slice/kibana.service
└─309354 /usr/share/kibana/bin/../node/glibc-217/bin/node /usr/share/kibana/bin/../src/cli/dist
Nov 04 09:07:38 dsme01 kibana[309354]: [2024-11-04T09:07:38.034+01:00][INFO ][plugins.encryptedSavedObjects] Hashed 'xpack.encryptedSavedObjects.encryptionKey' for this instance: SycWVrlikMOHTE0WTKXX/Rjs1zsbUI/>
Nov 04 09:07:38 dsme01 kibana[309354]: [2024-11-04T09:07:38.661+01:00][INFO ][plugins.notifications] Email Service Error: Email connector not specified.
Nov 04 09:07:39 dsme01 kibana[309354]: [2024-11-04T09:07:39.397+01:00][INFO ][plugins.alerting] using indexes and aliases for persisting alerts
Nov 04 09:07:47 dsme01 kibana[309354]: [2024-11-04T09:07:47.150+01:00][INFO ][plugins.cloudSecurityPosture] Registered task successfully [Task: cloud_security_posture-stats_task]
Nov 04 09:07:49 dsme01 kibana[309354]: [2024-11-04T09:07:49.608+01:00][INFO ][plugins.securitySolution.endpoint:user-artifact-packager:1.0.0] Registering endpoint:user-artifact-packager task with timeout of [20>
Nov 04 09:07:49 dsme01 kibana[309354]: [2024-11-04T09:07:49.609+01:00][INFO ][plugins.securitySolution.endpoint:complete-external-response-actions] Registering task [endpoint:complete-external-response-actions]>
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.503+01:00][INFO ][elasticsearch-service] Successfully connected to Elasticsearch after waiting for 38 milliseconds
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.572+01:00][INFO ][savedobjects-service] Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.572+01:00][INFO ][savedobjects-service] Starting saved objects migrations
Nov 04 09:07:54 dsme01 kibana[309354]: [2024-11-04T09:07:54.009+01:00][INFO ][plugins.screenshotting.chromium] Browser executable: /usr/share/kibana/node_modules/@kbn/screenshotting-plugin/chromium/headless_she>
kibana.log
{"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:09.996+01:00","message":"Kibana is starting","log":{"level":"INFO","logger":"root"},"process":{"pid":309354,"uptime":16.012911998}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:10.119+01:00","message":"Kibana process configured with roles: [background_tasks, ui]","log":{"level":"INFO","logger":"node"},"process":{"pid":309354,"uptime":16.057061839},"trace":{"id":"94bf027682fe9365ea0fed02733239cd"},"transaction":{"id":"64f1973cbf9a9936"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:31.271+01:00","message":"The following plugins are disabled: \"cloudChat,cloudExperiments,cloudFullStory,profilingDataAccess,profiling,securitySolutionServerless,serverless,serverlessObservability,serverlessSearch\".","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":309354,"uptime":37.550896043},"trace":{"id":"94bf027682fe9365ea0fed02733239cd"},"transaction":{"id":"64f1973cbf9a9936"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:31.622+01:00","message":"http server running at https://kibana.intern.harnet.de:5601","log":{"level":"INFO","logger":"http.server.Preboot"},"process":{"pid":309354,"uptime":37.57902269},"trace":{"id":"94bf027682fe9365ea0fed02733239cd"},"transaction":{"id":"64f1973cbf9a9936"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:31.792+01:00","message":"Setting up [1] plugins: [interactiveSetup]","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":309354,"uptime":37.723767457},"trace":{"id":"94bf027682fe9365ea0fed02733239cd"},"transaction":{"id":"64f1973cbf9a9936"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:31.860+01:00","message":"The default mechanism for Reporting privileges will work differently in future versions, which will affect the behavior of this cluster. Set \"xpack.reporting.roles.enabled\" to \"false\" to adopt the future behavior before upgrading.","log":{"level":"WARN","logger":"config.deprecation"},"process":{"pid":309354,"uptime":37.792458327},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:32.288+01:00","message":"Setting up [166] plugins: [devTools,translations,share,searchConnectors,screenshotMode,usageCollection,telemetryCollectionManager,telemetryCollectionXpack,taskManager,kibanaUsageCollection,cloud,newsfeed,savedObjectsFinder,noDataPage,monitoringCollection,licensing,mapsEms,globalSearch,globalSearchProviders,features,guidedOnboarding,banners,licenseApiGuard,customBranding,ftrApis,fieldsMetadata,fieldFormats,expressions,screenshotting,esUiShared,customIntegrations,contentManagement,dataViews,home,searchprofiler,painlessLab,management,spaces,security,telemetry,licenseManagement,snapshotRestore,lists,files,encryptedSavedObjects,entityManager,eventLog,actions,observabilityAIAssistant,investigate,notifications,cloudDataMigration,aiAssistantManagementSelection,advancedSettings,grokdebugger,console,searchNotebooks,searchHomepage,bfetch,data,savedObjectsTagging,savedObjectsManagement,unifiedSearch,navigation,graph,embeddable,uiActionsEnhanced,savedSearch,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,controls,alerting,logsDataAccess,fileUpload,ingestPipelines,ecsDataQualityDashboard,dataViewFieldEditor,dataViewManagement,charts,watcher,visualizations,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,visTypeHeatmap,inputControlVis,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionLegacyMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,eventAnnotation,expressionXY,lens,maps,dataVisualizer,dashboard,triggersActionsUi,transform,stackConnectors,searchPlayground,integrationAssistant,stackAlerts,ruleRegistry,cases,timelines,sessionView,kubernetesSecurity,threatIntelligence,metricsDataAccess,logsShared,aiops,discover,reporting,canvas,ml,searchInferenceEndpoints,elasticAssistant,logsExplorer,fleet,osquery,indexManagement,textBasedLanguages,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,observabilityAiAssistantManagement,datasetQuality,dataQuality,cloudSecurityPosture,cloudDefend,securitySolution,securitySolutionEss,observability,uptime,synthetics,slo,observabilityLogsExplorer,observabilityOnboarding,observabilityAIAssistantApp,discoverEnhanced,links,dashboardEnhanced,apmDataAccess,infra,upgradeAssistant,monitoring,logstash,apm,ux,assetsDataAccess]","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":309354,"uptime":38.220078292},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:33.113+01:00","message":"TaskManager is identified by the Kibana UUID: c75e423a-1a9b-455c-b3f5-bab9923fa7e4","log":{"level":"INFO","logger":"plugins.taskManager"},"process":{"pid":309354,"uptime":39.044832773},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:34.174+01:00","message":"CustomBrandingService registering plugin: customBranding","log":{"level":"INFO","logger":"custom-branding-service"},"process":{"pid":309354,"uptime":40.106254384},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:38.034+01:00","message":"Hashed 'xpack.encryptedSavedObjects.encryptionKey' for this instance: SycWVrlikMOHTE0WTKXX/Rjs1zsbUI/3vIrYgyPkbJo=","log":{"level":"INFO","logger":"plugins.encryptedSavedObjects"},"process":{"pid":309354,"uptime":43.966389579},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:38.661+01:00","message":"Email Service Error: Email connector not specified.","log":{"level":"INFO","logger":"plugins.notifications"},"process":{"pid":309354,"uptime":44.592764526},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:39.397+01:00","message":"using indexes and aliases for persisting alerts","log":{"level":"INFO","logger":"plugins.alerting"},"process":{"pid":309354,"uptime":45.328527891},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:47.150+01:00","message":"Registered task successfully [Task: cloud_security_posture-stats_task]","log":{"level":"INFO","logger":"plugins.cloudSecurityPosture"},"process":{"pid":309354,"uptime":53.08191627},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:49.608+01:00","message":"Registering endpoint:user-artifact-packager task with timeout of [20m], interval of [60s] and policy update batch size of [25]","log":{"level":"INFO","logger":"plugins.securitySolution.endpoint:user-artifact-packager:1.0.0"},"process":{"pid":309354,"uptime":55.540324407},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:49.609+01:00","message":"Registering task [endpoint:complete-external-response-actions] with timeout of [5m] and run interval of [60s]","log":{"level":"INFO","logger":"plugins.securitySolution.endpoint:complete-external-response-actions"},"process":{"pid":309354,"uptime":55.540880302},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"event":{"type":"kibana_started.elasticsearch.waitTime","duration":38},"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:51.503+01:00","message":"Successfully connected to Elasticsearch after waiting for 38 milliseconds","log":{"level":"INFO","logger":"elasticsearch-service"},"process":{"pid":309354,"uptime":57.435226447},"trace":{"id":"17685ff4473d36fb601f4317b5458e64"},"transaction":{"id":"c115e12e6c600683"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:51.572+01:00","message":"Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...","log":{"level":"INFO","logger":"savedobjects-service"},"process":{"pid":309354,"uptime":57.503685697},"trace":{"id":"17685ff4473d36fb601f4317b5458e64"},"transaction":{"id":"c115e12e6c600683"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:51.572+01:00","message":"Starting saved objects migrations","log":{"level":"INFO","logger":"savedobjects-service"},"process":{"pid":309354,"uptime":57.504229571},"trace":{"id":"17685ff4473d36fb601f4317b5458e64"},"transaction":{"id":"c115e12e6c600683"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:07:54.009+01:00","message":"Browser executable: /usr/share/kibana/node_modules/@kbn/screenshotting-plugin/chromium/headless_shell-linux_x64/headless_shell","log":{"level":"INFO","logger":"plugins.screenshotting.chromium"},"process":{"pid":309354,"uptime":59.94093813},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:27:43.275+01:00","message":"Timeout: it took more than 1200000ms","error":{"message":"Timeout: it took more than 1200000ms","type":"Error","stack_trace":"Error: Timeout: it took more than 1200000ms\n at Timeout._onTimeout (/usr/share/kibana/node_modules/@kbn/alerting-plugin/server/alerts_service/lib/install_with_timeout.js:43:18)\n at listOnTimeout (node:internal/timers:573:17)\n at processTimers (node:internal/timers:514:7)"},"log":{"level":"ERROR","logger":"plugins.ruleRegistry"},"process":{"pid":309354,"uptime":1249.229004923},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.11.0"},"@timestamp":"2024-11-04T09:27:43.298+01:00","message":"Failure during installation of common resources shared between all indices. Timeout: it took more than 1200000ms","error":{"message":"Failure during installation of common resources shared between all indices. Timeout: it took more than 1200000ms","type":"Error","stack_trace":"Error: Failure during installation of common resources shared between all indices. Timeout: it took more than 1200000ms\n at installWithTimeout (/usr/share/kibana/node_modules/@kbn/alerting-plugin/server/alerts_service/lib/install_with_timeout.js:59:13)\n at ResourceInstaller.installCommonResources (/usr/share/kibana/node_modules/@kbn/rule-registry-plugin/server/rule_data_plugin_service/resource_installer.js:42:5)"},"log":{"level":"ERROR","logger":"plugins.ruleRegistry"},"process":{"pid":309354,"uptime":1249.230465497},"trace":{"id":"0e992f91d3f83905c1db0bbb62843e16"},"transaction":{"id":"f6478842f480f5fe"}}
Nginx Log
92.168.30.71 - - [04/Nov/2024:09:13:20 +0100] "GET / HTTP/2.0" 200 23610 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /bootstrap.js HTTP/2.0" 200 1710 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-src/kbn-ui-shared-deps-src.css HTTP/2.0" 200 15242 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/ui/legacy_styles.css HTTP/2.0" 200 796 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/ui/favicons/favicon.svg HTTP/2.0" 200 1008 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/bundles/plugin/interactiveSetup/1.0.0/interactiveSetup.plugin.js HTTP/2.0" 200 15670 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/bundles/core/core.entry.js HTTP/2.0" 200 102658 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/ui/favicons/favicon.png HTTP/2.0" 200 5234 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-src/kbn-ui-shared-deps-src.js HTTP/2.0" 200 642132 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:21 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.dll.js HTTP/2.0" 200 1249953 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /translations/a399c2baef20/en.json HTTP/2.0" 200 878 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.v8.light.css HTTP/2.0" 200 12756 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "POST /api/core/capabilities HTTP/2.0" 200 46 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/ui/legacy_light_theme.min.css HTTP/2.0" 200 11792 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.chunk.193.js HTTP/2.0" 200 643 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.chunk.249.js HTTP/2.0" 200 1160 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.chunk.105.js HTTP/2.0" 200 364 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /internal/interactive_setup/status HTTP/2.0" 503 30 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/bundles/kbn-ui-shared-deps-npm/kbn-ui-shared-deps-npm.chunk.492.js HTTP/2.0" 200 415 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/ui/fonts/inter/Inter-Bold.woff2 HTTP/2.0" 200 105912 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/ui/fonts/inter/Inter-Regular.woff2 HTTP/2.0" 200 98844 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/ui/fonts/roboto_mono/RobotoMono-Regular.ttf HTTP/2.0" 200 67409 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
192.168.30.71 - - [04/Nov/2024:09:13:22 +0100] "GET /3933429968aa/ui/fonts/inter/Inter-Medium.woff2 HTTP/2.0" 200 105616 "https://kibana.intern.harnet.de/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36"
Journalctl
Nov 04 09:06:53 dsme01 systemd[1]: Started Kibana.
Nov 04 09:06:56 dsme01 kibana[309354]: Kibana is currently running with legacy OpenSSL providers enabled! For details and instructions on how to disable see https://www.elastic.co/guide/en/kibana/8.15/production.html#openssl-legacy-provider
Nov 04 09:07:00 dsme01 kibana[309354]: {"log.level":"info","@timestamp":"2024-11-04T08:07:00.115Z","log.logger":"elastic-apm-node","ecs.version":"8.10.0","agentVersion":"4.7.0","env":{"pid":309354,"proctitle":"/usr/share/kibana/bin/../node/glibc-217/bin/node","os":"linux 6.1.0-26-amd64","arch":"x64","host":"dsme01","timezone":"UTC+0100","runtime":"Node.js v20.15.1"},"config":{"active":{"source":"start","value":true},"breakdownMetrics":{"source":"start","value":false},"captureBody":{"source":"start","value":"off","commonName":"capture_body"},"captureHeaders":{"source":"start","value":false},"centralConfig":{"source":"start","value":false},"contextPropagationOnly":{"source":"start","value":true},"environment":{"source":"start","value":"production"},"globalLabels":{"source":"start","value":[["kibana_uuid","c75e423a-1a9b-455c-b3f5-bab9923fa7e4"],["git_rev","3933429968aafb1ba31319fc38649d0f974044bf"]],"sourceValue":{"kibana_uuid":"c75e423a-1a9b-455c-b3f5-bab9923fa7e4","git_rev":"3933429968aafb1ba31319fc38649d0f974044bf"}},"logLevel":{"source":"default","value":"info","commonName":"log_level"},"metricsInterval":{"source":"start","value":120,"sourceValue":"120s"},"serverUrl":{"source":"start","value":"https://kibana-cloud-apm.apm.us-east-1.aws.found.io/","commonName":"server_url"},"transactionSampleRate":{"source":"start","value":0.1,"commonName":"transaction_sample_rate"},"captureSpanStackTraces":{"source":"start","sourceValue":false},"secretToken":{"source":"start","value":"[REDACTED]","commonName":"secret_token"},"serviceName":{"source":"start","value":"kibana","commonName":"service_name"},"serviceVersion":{"source":"start","value":"8.15.3","commonName":"service_version"}},"activationMethod":"require","message":"Elastic APM Node.js Agent v4.7.0"}
Nov 04 09:07:01 dsme01 kibana[309354]: Native global console methods have been overridden in production environment.
Nov 04 09:07:10 dsme01 kibana[309354]: [2024-11-04T09:07:09.996+01:00][INFO ][root] Kibana is starting
Nov 04 09:07:10 dsme01 kibana[309354]: [2024-11-04T09:07:10.119+01:00][INFO ][node] Kibana process configured with roles: [background_tasks, ui]
Nov 04 09:07:31 dsme01 kibana[309354]: [2024-11-04T09:07:31.271+01:00][INFO ][plugins-service] The following plugins are disabled: "cloudChat,cloudExperiments,cloudFullStory,profilingDataAccess,profiling,securitySolutionServerless,serverless,serverlessObservability,serverlessSearch".
Nov 04 09:07:31 dsme01 kibana[309354]: [2024-11-04T09:07:31.622+01:00][INFO ][http.server.Preboot] http server running at https://kibana.intern.harnet.de:5601
Nov 04 09:07:31 dsme01 kibana[309354]: [2024-11-04T09:07:31.792+01:00][INFO ][plugins-system.preboot] Setting up [1] plugins: [interactiveSetup]
Nov 04 09:07:31 dsme01 kibana[309354]: [2024-11-04T09:07:31.860+01:00][WARN ][config.deprecation] The default mechanism for Reporting privileges will work differently in future versions, which will affect the behavior of this cluster. Set "xpack.reporting.roles.enabled" to "false" to adopt the future behavior before upgrading.
Nov 04 09:07:32 dsme01 kibana[309354]: [2024-11-04T09:07:32.288+01:00][INFO ][plugins-system.standard] Setting up [166] plugins: [devTools,translations,share,searchConnectors,screenshotMode,usageCollection,telemetryCollectionManager,telemetryCollectionXpack,taskManager,kibanaUsageCollection,cloud,newsfeed,savedObjectsFinder,noDataPage,monitoringCollection,licensing,mapsEms,globalSearch,globalSearchProviders,features,guidedOnboarding,banners,licenseApiGuard,customBranding,ftrApis,fieldsMetadata,fieldFormats,expressions,screenshotting,esUiShared,customIntegrations,contentManagement,dataViews,home,searchprofiler,painlessLab,management,spaces,security,telemetry,licenseManagement,snapshotRestore,lists,files,encryptedSavedObjects,entityManager,eventLog,actions,observabilityAIAssistant,investigate,notifications,cloudDataMigration,aiAssistantManagementSelection,advancedSettings,grokdebugger,console,searchNotebooks,searchHomepage,bfetch,data,savedObjectsTagging,savedObjectsManagement,unifiedSearch,navigation,graph,embeddable,uiActionsEnhanced,savedSearch,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,controls,alerting,logsDataAccess,fileUpload,ingestPipelines,ecsDataQualityDashboard,dataViewFieldEditor,dataViewManagement,charts,watcher,visualizations,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,visTypeHeatmap,inputControlVis,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionLegacyMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,eventAnnotation,expressionXY,lens,maps,dataVisualizer,dashboard,triggersActionsUi,transform,stackConnectors,searchPlayground,integrationAssistant,stackAlerts,ruleRegistry,cases,timelines,sessionView,kubernetesSecurity,threatIntelligence,metricsDataAccess,logsShared,aiops,discover,reporting,canvas,ml,searchInferenceEndpoints,elasticAssistant,logsExplorer,fleet,osquery,indexManagement,textBasedLanguages,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,observabilityAiAssistantManagement,datasetQuality,dataQuality,cloudSecurityPosture,cloudDefend,securitySolution,securitySolutionEss,observability,uptime,synthetics,slo,observabilityLogsExplorer,observabilityOnboarding,observabilityAIAssistantApp,discoverEnhanced,links,dashboardEnhanced,apmDataAccess,infra,upgradeAssistant,monitoring,logstash,apm,ux,assetsDataAccess]
Nov 04 09:07:33 dsme01 kibana[309354]: [2024-11-04T09:07:33.113+01:00][INFO ][plugins.taskManager] TaskManager is identified by the Kibana UUID: c75e423a-1a9b-455c-b3f5-bab9923fa7e4
Nov 04 09:07:34 dsme01 kibana[309354]: [2024-11-04T09:07:34.174+01:00][INFO ][custom-branding-service] CustomBrandingService registering plugin: customBranding
Nov 04 09:07:38 dsme01 kibana[309354]: [2024-11-04T09:07:38.034+01:00][INFO ][plugins.encryptedSavedObjects] Hashed 'xpack.encryptedSavedObjects.encryptionKey' for this instance: SycWVrlikMOHTE0WTKXX/Rjs1zsbUI/3vIrYgyPkbJo=
Nov 04 09:07:38 dsme01 kibana[309354]: [2024-11-04T09:07:38.661+01:00][INFO ][plugins.notifications] Email Service Error: Email connector not specified.
Nov 04 09:07:39 dsme01 kibana[309354]: [2024-11-04T09:07:39.397+01:00][INFO ][plugins.alerting] using indexes and aliases for persisting alerts
Nov 04 09:07:47 dsme01 kibana[309354]: [2024-11-04T09:07:47.150+01:00][INFO ][plugins.cloudSecurityPosture] Registered task successfully [Task: cloud_security_posture-stats_task]
Nov 04 09:07:49 dsme01 kibana[309354]: [2024-11-04T09:07:49.608+01:00][INFO ][plugins.securitySolution.endpoint:user-artifact-packager:1.0.0] Registering endpoint:user-artifact-packager task with timeout of [20m], interval of [60s] and policy update batch size of [25]
Nov 04 09:07:49 dsme01 kibana[309354]: [2024-11-04T09:07:49.609+01:00][INFO ][plugins.securitySolution.endpoint:complete-external-response-actions] Registering task [endpoint:complete-external-response-actions] with timeout of [5m] and run interval of [60s]
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.503+01:00][INFO ][elasticsearch-service] Successfully connected to Elasticsearch after waiting for 38 milliseconds
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.572+01:00][INFO ][savedobjects-service] Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
Nov 04 09:07:51 dsme01 kibana[309354]: [2024-11-04T09:07:51.572+01:00][INFO ][savedobjects-service] Starting saved objects migrations
Nov 04 09:07:54 dsme01 kibana[309354]: [2024-11-04T09:07:54.009+01:00][INFO ][plugins.screenshotting.chromium] Browser executable: /usr/share/kibana/node_modules/@kbn/screenshotting-plugin/chromium/headless_shell-linux_x64/headless_shell
Nov 04 09:27:43 dsme01 kibana[309354]: [2024-11-04T09:27:43.275+01:00][ERROR][plugins.ruleRegistry] Error: Timeout: it took more than 1200000ms
Nov 04 09:27:43 dsme01 kibana[309354]: at Timeout._onTimeout (/usr/share/kibana/node_modules/@kbn/alerting-plugin/server/alerts_service/lib/install_with_timeout.js:43:18)
Nov 04 09:27:43 dsme01 kibana[309354]: at listOnTimeout (node:internal/timers:573:17)
Nov 04 09:27:43 dsme01 kibana[309354]: at processTimers (node:internal/timers:514:7)
Nov 04 09:27:43 dsme01 kibana[309354]: [2024-11-04T09:27:43.298+01:00][ERROR][plugins.ruleRegistry] Error: Failure during installation of common resources shared between all indices. Timeout: it took more than 1200000ms
Nov 04 09:27:43 dsme01 kibana[309354]: at installWithTimeout (/usr/share/kibana/node_modules/@kbn/alerting-plugin/server/alerts_service/lib/install_with_timeout.js:59:13)
Nov 04 09:27:43 dsme01 kibana[309354]: at ResourceInstaller.installCommonResources (/usr/share/kibana/node_modules/@kbn/rule-registry-plugin/server/rule_data_plugin_service/resource_installer.js:42:5)
I hope you find the error? Greetings from Stefan Harbich
