Hello Team,
We used the CA to create a http.p12 file for elasticsearch secured configuration.
If we use the own CA, the kibana error.
Please help me to fix the issue.
Server not yet ready.
[ERROR][elasticsearch-service] Unable to retrieve version information from Elasticsearch nodes. unable to get issuer certificate.
ERROR: Failed to determine the health of the cluster.
Please share your logs from Elasticsearch and Kibana.
Please format your code/logs/config using the </> button, or markdown style back ticks. It helps to make things easy to read which helps us help you 
Hi Warklom,
Please find the attached elasticsearch and kibana logs for your reference.
[root@l04elkche002 ~]# tail -100 /var/log/elasticsearch/elasticsearch.log
[2022-08-29T01:30:00,012][INFO ][o.e.x.m.MlDailyMaintenanceService] [l04elkche002] triggering scheduled [ML] maintenance tasks
[2022-08-29T01:30:00,073][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] [l04elkche002] Deleting expired data
[2022-08-29T01:30:00,078][INFO ][o.e.x.m.j.r.UnusedStatsRemover] [l04elkche002] Successfully deleted [0] unused stats documents
[2022-08-29T01:30:00,079][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] [l04elkche002] Completed deletion of expired ML data
[2022-08-29T01:30:00,079][INFO ][o.e.x.m.MlDailyMaintenanceService] [l04elkche002] Successfully completed [ML] maintenance task: triggerDeleteExpiredDataTask
[2022-08-29T07:00:00,012][INFO ][o.e.x.s.SnapshotRetentionTask] [l04elkche002] starting SLM retention snapshot cleanup task
[2022-08-29T07:00:00,017][INFO ][o.e.x.s.SnapshotRetentionTask] [l04elkche002] there are no repositories to fetch, SLM retention snapshot cleanup task complete
[2022-08-29T08:55:13,263][WARN ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [l04elkche002] http client did not trust this server's certificate, closing connection Netty4HttpChannel{localAddress=/x.x.x.x:9200, remoteAddress=/x.x.x.x:52800}
[root@l04elkche002 ~]# tail -100 /var/log/kibana/kibana.log
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.256+05:30","message":"Plugin \"cloudSecurityPosture\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.297+05:30","message":"Plugin \"metricsEntities\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.398+05:30","message":"http server running at https://dev.elastic.test.com:5601","log":{"level":"INFO","logger":"http.server.Preboot"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.435+05:30","message":"Setting up [1] plugins: [interactiveSetup]","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.488+05:30","message":"The default mechanism for Reporting privileges will work differently in future versions, which will affect the behavior of this cluster. Set \"xpack.reporting.roles.enabled\" to \"false\" to adopt the future behavior before upgrading.","log":{"level":"WARN","logger":"config.deprecation"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.709+05:30","message":"Setting up [117] plugins: [translations,monitoringCollection,licensing,globalSearch,globalSearchProviders,features,mapsEms,licenseApiGuard,usageCollection,taskManager,telemetryCollectionManager,telemetryCollectionXpack,kibanaUsageCollection,share,embeddable,uiActionsEnhanced,screenshotMode,screenshotting,banners,newsfeed,fieldFormats,expressions,eventAnnotation,dataViews,charts,esUiShared,bfetch,data,savedObjects,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,customIntegrations,home,searchprofiler,painlessLab,grokdebugger,management,watcher,advancedSettings,spaces,security,savedObjectsTagging,reporting,lists,fileUpload,ingestPipelines,encryptedSavedObjects,dataEnhanced,cloud,snapshotRestore,telemetry,licenseManagement,eventLog,actions,alerting,triggersActionsUi,transform,stackAlerts,ruleRegistry,savedObjectsManagement,console,controls,graph,fleet,indexManagement,remoteClusters,crossClusterReplication,indexLifecycleManagement,visualizations,canvas,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,rollup,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeHeatmap,visTypeMarkdown,dashboard,dashboardEnhanced,expressionXY,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,dataViewFieldEditor,sharedUX,discover,lens,osquery,maps,dataVisualizer,ml,cases,timelines,sessionView,securitySolution,observability,uptime,infra,upgradeAssistant,monitoring,logstash,enterpriseSearch,apm,discoverEnhanced,dataViewManagement]","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.724+05:30","message":"TaskManager is identified by the Kibana UUID: f987bbf6-98e1-4b53-8f52-0c0bd6ef3b98","log":{"level":"INFO","logger":"plugins.taskManager"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.994+05:30","message":"Installing common resources shared between all indices","log":{"level":"INFO","logger":"plugins.ruleRegistry"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.113+05:30","message":"Chromium sandbox provides an additional layer of protection, but is not supported for Linux Red Hat Linux 8.2 OS. Automatically setting 'xpack.screenshotting.capture.browser.chromium.disableSandbox: true'.","log":{"level":"WARN","logger":"plugins.screenshotting.config"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.290+05:30","message":"Unable to retrieve version information from Elasticsearch nodes. unable to get issuer certificate","log":{"level":"ERROR","logger":"elasticsearch-service"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.814+05:30","message":"Browser executable: /usr/share/kibana/x-pack/plugins/screenshotting/chromium/headless_shell-linux_x64/headless_shell","log":{"level":"INFO","logger":"plugins.screenshotting.chromium"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.815+05:30","message":"Enabling the Chromium sandbox provides an additional layer of protection.","log":{"level":"WARN","logger":"plugins.screenshotting.chromium"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.297+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.299+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.300+05:30","message":"Monitoring stats collection is stopped","log":{"level":"INFO","logger":"plugins.monitoring.monitoring.kibana-monitoring"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:55:05.268+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678}}
8.0.0"},"@timestamp":"2022-08-27T18:17:18.138+05:30","message":"Setting up [1] plugins: [interactiveSetup]","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":2351153},"trace":{"id":"793bafcc74e20ea6d0dd287f5a60fea5"},"transaction":{"id":"657f6c3c5e827c91"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:17:18.140+05:30","message":"\"interactiveSetup\" plugin is holding setup: Validating Elasticsearch connection configuration…","log":{"level":"INFO","logger":"preboot"},"process":{"pid":2351153},"trace":{"id":"793bafcc74e20ea6d0dd287f5a60fea5"},"transaction":{"id":"657f6c3c5e827c91"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:17:18.175+05:30","message":"Holding setup until preboot stage is completed.","log":{"level":"INFO","logger":"root"},"process":{"pid":2351153}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:24:21.147+05:30","message":"Invalid verification code '365818\\' provided. 4 attempts left.","log":{"level":"ERROR","logger":"plugins.interactiveSetup.verification"},"process":{"pid":2351153},"trace":{"id":"b437286834899869a07b846b7d97b785"},"transaction":{"id":"80bedce7b0d5bc4c"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:24:39.201+05:30","message":"Failed to authenticate with host \"https://dev.elastic.test.com:9200\": unable to verify the first certificate","log":{"level":"ERROR","logger":"plugins.interactiveSetup.elasticsearch"},"process":{"pid":2351153},"trace":{"id":"de5d3f9037e374f7da86340b9d8e2299"},"transaction":{"id":"2e7602cd7f45d1de"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:24:49.164+05:30","message":"Failed to authenticate with host \"https://dev.elastic.test.com:9200\": unable to verify the first certificate","log":{"level":"ERROR","logger":"plugins.interactiveSetup.elasticsearch"},"process":{"pid":2351153},"trace":{"id":"fcc60bce042c5b39a7d49d000c812ee7"},"transaction":{"id":"49dc67373f63c5a3"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T18:24:50.574+05:30","message":"Failed to authenticate with host \"https://dev.elastic.test.com:9200\": unable to verify the first certificate","log":{"level":"ERROR","logger":"plugins.interactiveSetup.elasticsearch"},"process":{"pid":2351153},"trace":{"id":"d25b989aa86f356a7fda408abb5144fa"},"transaction":{"id":"425f50b42eef0c03"}}
{"tags":["config"],"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-27T19:09:19.044+05:30","message":"Reloading Kibana configuration (reason: SIGHUP signal received).","log":{"level":"INFO","logger":"cli"},"process":{"pid":2351153}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.256+05:30","message":"Plugin \"cloudSecurityPosture\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.297+05:30","message":"Plugin \"metricsEntities\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.398+05:30","message":"http server running at https://dev.elastic.test.com:5601","log":{"level":"INFO","logger":"http.server.Preboot"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.435+05:30","message":"Setting up [1] plugins: [interactiveSetup]","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":2383678},"trace":{"id":"76e19970f6c7062b294fd870e582151b"},"transaction":{"id":"58a27362cd306dcd"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.488+05:30","message":"The default mechanism for Reporting privileges will work differently in future versions, which will affect the behavior of this cluster. Set \"xpack.reporting.roles.enabled\" to \"false\" to adopt the future behavior before upgrading.","log":{"level":"WARN","logger":"config.deprecation"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.709+05:30","message":"Setting up [117] plugins: [translations,monitoringCollection,licensing,globalSearch,globalSearchProviders,features,mapsEms,licenseApiGuard,usageCollection,taskManager,telemetryCollectionManager,telemetryCollectionXpack,kibanaUsageCollection,share,embeddable,uiActionsEnhanced,screenshotMode,screenshotting,banners,newsfeed,fieldFormats,expressions,eventAnnotation,dataViews,charts,esUiShared,bfetch,data,savedObjects,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,customIntegrations,home,searchprofiler,painlessLab,grokdebugger,management,watcher,advancedSettings,spaces,security,savedObjectsTagging,reporting,lists,fileUpload,ingestPipelines,encryptedSavedObjects,dataEnhanced,cloud,snapshotRestore,telemetry,licenseManagement,eventLog,actions,alerting,triggersActionsUi,transform,stackAlerts,ruleRegistry,savedObjectsManagement,console,controls,graph,fleet,indexManagement,remoteClusters,crossClusterReplication,indexLifecycleManagement,visualizations,canvas,visTypeXy,visTypeVislib,visTypeVega,visTypeTimeseries,rollup,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeHeatmap,visTypeMarkdown,dashboard,dashboardEnhanced,expressionXY,expressionTagcloud,expressionPartitionVis,visTypePie,expressionMetricVis,expressionHeatmap,expressionGauge,visTypeGauge,dataViewFieldEditor,sharedUX,discover,lens,osquery,maps,dataVisualizer,ml,cases,timelines,sessionView,securitySolution,observability,uptime,infra,upgradeAssistant,monitoring,logstash,enterpriseSearch,apm,discoverEnhanced,dataViewManagement]","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.724+05:30","message":"TaskManager is identified by the Kibana UUID: f987bbf6-98e1-4b53-8f52-0c0bd6ef3b98","log":{"level":"INFO","logger":"plugins.taskManager"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:25.994+05:30","message":"Installing common resources shared between all indices","log":{"level":"INFO","logger":"plugins.ruleRegistry"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.113+05:30","message":"Chromium sandbox provides an additional layer of protection, but is not supported for Linux Red Hat Linux 8.2 OS. Automatically setting 'xpack.screenshotting.capture.browser.chromium.disableSandbox: true'.","log":{"level":"WARN","logger":"plugins.screenshotting.config"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.290+05:30","message":"Unable to retrieve version information from Elasticsearch nodes. unable to get issuer certificate","log":{"level":"ERROR","logger":"elasticsearch-service"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.814+05:30","message":"Browser executable: /usr/share/kibana/x-pack/plugins/screenshotting/chromium/headless_shell-linux_x64/headless_shell","log":{"level":"INFO","logger":"plugins.screenshotting.chromium"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:52:27.815+05:30","message":"Enabling the Chromium sandbox provides an additional layer of protection.","log":{"level":"WARN","logger":"plugins.screenshotting.chromium"},"process":{"pid":2383678},"trace":{"id":"9c38bbea58e2504d256ee04f7a0c41b6"},"transaction":{"id":"8601b64800c68a07"}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.297+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.preboot"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.299+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:54:51.300+05:30","message":"Monitoring stats collection is stopped","log":{"level":"INFO","logger":"plugins.monitoring.monitoring.kibana-monitoring"},"process":{"pid":2383678}}
{"ecs":{"version":"8.0.0"},"@timestamp":"2022-08-29T08:55:05.268+05:30","message":"Stopping all plugins.","log":{"level":"INFO","logger":"plugins-system.standard"},"process":{"pid":2383678}}
Looks like there is a certificate trust issue? Did you copy the root trust over to Kibana to be able to reference?
Kibana.yml configuration
# =================== System: Kibana Server (Optional) ===================
# Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
# These settings enable SSL for outgoing requests from the Kibana server to the browser.
server.ssl.enabled: true
server.ssl.certificate: /etc/pki/tls/certs/dev.elastic.test.cer
server.ssl.key: /etc/pki/tls/certs/dev.elastic.test.com.key
server.ssl.certificateAuthorities: ["/etc/elasticsearch/certs/GH-serverca.crt"]
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.