Monitoring UI can't find cluster data - 2h delay

Elastic Stack Elasticsearch
,
1

Hello guys,

I am using ELK v6.8.5 and I recently came upon a problem with the Monitoring UI.
It work just fine when I set the time to Today as seen in the image below.

3elk
3elk1920×870 79.6 KB

However, when I change the time to a smaller period such as 1h I get the error described in the following image.

2elk
2elk1920×861 106 KB

Upon a closer inspection of the monitoring data in Elasticsearch I found this delay of 2h and I can't seem to figure out a way to solve this.

1elk
1elk1920×863 94.4 KB

Would you be so kind to help me out?
Thank you!

2

Hi @rsustic,

Is this a consistent problem? Or a one time thing?

3

Hi,
Sorry for the late reply. Yes, this is a consistent problem. I tried again today and now it can't find any monitoring data, although I have logs in my cluster.

aa
aa1920×868 99.6 KB

As you can see, I applied the same time filter.

4

Update: monitoring data appeared just now but still in a very weird fashion. My browser date and time is June 22nd, 00:05 and the monitoring data comes June 22nd at 3:00.

bb
bb1920×870 96.4 KB

5

If you go to Kibana -> Advanced Settings, do you have a custom timezone set?

6

No, just the browser time.

kibana
kibana1028×761 54.3 KB

7

Are there potential timezone differences between the servers running any of your ES nodes that might explain this?