Monitoring tab blank

bevano · August 19, 2020, 6:00am

Updated from 7.8.1 to 7.9 today on my monitoring cluster and after clicking on the monitoring tab, i am presented with a blank page. No error with regards to Kibana but from the web console i can see this.

I assume it is a bug related to 7.9? If not any ideas on how i can resolve this problem or find more logs that point me to the problem?

:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:422 TypeError: Cannot read property 'list' of undefined
at render (:5601/33813/bundles/plugin/monitoring/1.plugin.js:3)
at t.value (:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393)
at :5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393
at Array.forEach ()
at t.value (:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393)
at :5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393
at Array.map ()
at t.value (:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393)
at t.value (:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393)
at t.value (:5601/33813/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.@elastic.js:393)

This is the blank page

warkolm · August 19, 2020, 6:06am

Is there anything in the Kibana or Elasticsearch logs?

bevano · August 19, 2020, 6:10am

Theres nothing in the Elasticsearch logs, this is the request i see from the Kibana logs

Aug 19 16:11:41 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:41Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/app/monitoring","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","cache-control":"max-age=0","upgrade-insecure-requests":"1","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64;>
Aug 19 16:11:42 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:41Z","tags":["api"],"pid":12596,"method":"get","statusCode":304,"req":{"url":"/bundles/app/core/bootstrap.js","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Ge>
Aug 19 16:11:42 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:42Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/ui/favicons/favicon.ico","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","pragma":"no-cache","cache-control":"no-cache","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64>
Aug 19 16:11:43 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:43Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/node_modules/@kbn/ui-framework/dist/kui_dark.css","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (>
Aug 19 16:11:43 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:43Z","tags":[],"pid":12596,"method":"get","statusCode":304,"req":{"url":"/translations/en.json","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84>
Aug 19 16:11:43 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:43Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/ui/fonts/inter_ui/Inter-UI-Regular.woff2","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","origin":"http://192.168.0.120:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win>
Aug 19 16:11:43 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:43Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/internal/security/me","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML,>
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/internal/spaces/_active_space","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.3>
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/core/capabilities","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"687","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) >
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/internal/security/session","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (K>
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/internal/security/me","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML,>
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/saved_objects/_bulk_get","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"39","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; >
Aug 19 16:11:44 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/ui/fonts/inter_ui/Inter-UI-Medium.woff2","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","origin":"http://192.168.0.120:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win6>
Aug 19 16:11:45 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:45Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/api/licensing/info","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","kbn-version":"7.9.0","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, l>
Aug 19 16:11:48 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:44Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/monitoring/v1/clusters","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"101","accept":"application/json, text/plain, */*","kbn-version":"7.9.0","user->
Aug 19 16:11:48 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:48Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/monitoring/v1/alerts/enable","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"2","accept":"application/json, text/plain, */*","kbn-version":"7.9.0","us>
Aug 19 16:11:48 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:48Z","tags":[],"pid":12596,"method":"get","statusCode":200,"req":{"url":"/ui/fonts/inter_ui/Inter-UI-Light-BETA.woff2","method":"get","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","origin":"http://192.168.0.120:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; >
Aug 19 16:11:49 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:48Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/monitoring/v1/clusters","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"101","accept":"application/json, text/plain, */*","kbn-version":"7.9.0","user->
Aug 19 16:11:49 ELKMONITOR kibana[12596]: {"type":"response","@timestamp":"2020-08-19T06:11:48Z","tags":[],"pid":12596,"method":"post","statusCode":200,"req":{"url":"/api/monitoring/v1/clusters","method":"post","headers":{"host":"192.168.0.120:5601","connection":"keep-alive","content-length":"101","accept":"application/json, text/plain, */*","kbn-version":"7.9.0","user->

bevano · August 19, 2020, 7:46am

Ok looks like I had to add this field even though this has previously been optional.

xpack.security.encryptionKey

On my test cluster this was not enabled, yet the monitoring tab worked. I am thinking maybe its a combination for having either one of these fields set to true

xpack.transform.enabled: true
xpack.security.enabled: true
xpack.security.transport.ssl.enabled: true

chrisronline · August 19, 2020, 1:50pm

Can you capture a HAR for that page load?

See https://gist.github.com/legrego/7154b71096a09876423e2bd61d6a3e0f

Alex_Howle · August 20, 2020, 12:00pm

Getting a similar issue here, too. Can't send details from my phone but I'm seeing "TypeError: cluster.alerts is undefined"

chrisronline · August 20, 2020, 1:33pm

Thanks @Alex_Howle

If you can provide a HAR as well, that'd be very helpful to understand what's going on. Also, any warning/errors in the Kibana server log?

Vertigo · September 16, 2020, 9:10pm

We just upgraded for 7.8.1 to 7.9.1 and are experiencing the same issue. Adding the xpack.security.encryptionKey did not fix the issue

chrisronline · September 16, 2020, 9:31pm

Can you check the Kibana server log and browser dev tools for any errors and post them here?

adrian-arapiles · October 2, 2020, 12:43pm

Hi all,
I faced same issue, and I'm not sure why, but if you remove from localStorage the key xpack.monitoring.data and refresh the page, it works. At least it works for me.

I hope also it works for you until they found the bug.

adrian-arapiles · October 5, 2020, 7:57am

Hello,

In my case, inspecting the network tab, I see that this issue happens when /api/monitoring/v1/clusters request return more than one element.

Investigating on that, I see too that this happens (on my case) because any events of my stack (apm, beats) send events with cluster_uuid: null. I haven't configured in yml the cluster_uuid, and it must inferred from elasticsearch output cluster.
From documentation

# Sets the UUID of the Elasticsearch cluster under which monitoring data for this
# Filebeat instance will appear in the Stack Monitoring UI. If output.elasticsearch
# is enabled, the UUID is derived from the Elasticsearch cluster referenced by output.elasticsearch.
#monitoring.cluster_uuid:

EDIT: I have basic license, so multi-cluster monitoring is not available.

I hope this information could help to resolve the issue. I'm continue investigating that. I'll share any information about that.

Thanks.

bevano · October 5, 2020, 9:06am

Did you also upgrade from 7.8.X to 7.9.X Adrian?
I hope this doesn’t occur from 7.9.X to 7.10.X

adrian-arapiles · October 5, 2020, 9:31am

Yes, I upgraded from 7.8.1 to 7.9.1.

chrisronline · October 5, 2020, 7:49pm

Can you paste the response of /api/monitoring/v1/clusters?

adrian-arapiles · October 7, 2020, 8:52am

Now, I haven't the issue. I resolved it with explained above.
Anyways, when it happens again I share the response of request.

chrisronline · October 7, 2020, 4:27pm

Ah, my mistake. Glad to hear it's been resolved

adrian-arapiles · October 8, 2020, 6:48am

Although I found a workaround to the issue, I'm pretty sure how to reproduce.

Have basic license, so multi-clustering monitoring not available.
Beats send any event with cluster_uuid: null (for external reasons, I think bug in beats).
You must have events from more than one cluster, in my case with cluster_uuid setted and with cluster_uuid null.
When navigate to monitoring and request to /api/monitoring/v1/clusters return array with more than one cluster (on my case some event haven't cluster uuid setted) the monitoring app doesn't show all cluster to select one, monitoring show blank page.

My suspicion is that some information that is saved in local storage with key xpack.monitoring.data breaks something. Because when this happens and delete this key from local storage and you refresh page, all works fine as expected.

In previous versions, monitoring tab shows a selector table with clusters when this issue happens (events from different clusters). And if I'm not wrong, shows a warning that basic license doesn't allow have multi cluster monitoring.

I hope this can help you to find and solve the issue.

If any more information needed, say me.

Thanks,
Adrián,

chrisronline · October 8, 2020, 3:15pm

Do you have SSL enabled?

If not, it might be this issue: https://github.com/elastic/kibana/pull/77179

adrian-arapiles · October 8, 2020, 3:47pm

In fact, could he the same issue. I haven't SSL enabled and I haven't encryption key set. Kibana shows a warning about that one.

system · November 5, 2020, 3:47pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.