All beats have missing documents or timestamp not accurate

cctk · January 21, 2022, 2:27pm

I am experiencing several documents missing after the upgrade to 7.0. Metricbeat dashboard used to show a regular update of the cpu and memory , however now it now shows a dash (-) for 1m before showing update. this makes it very difficult to track the health of the servers.

is there any way to go back to how it was before to prevent showing no units. (picture below shows explanation )

I can't create proper watchers and keep track of when the cpu is high or in danger like this.

lucasfcosta · January 24, 2022, 9:07am

Hi @cctk, thanks for contacting us.

Just to be sure, I assume these dashboards were created using the metricbeat setup command, is that correct?

Could you also double check the logs for your beats to see if they're facing any errors and double check the clock on your servers?

One more thing to try would be to run a query using the Kibana console under the Dev Tools to see the raw documents themselves, so that you can see the field's names and values and compare that to the queries used by your dashboard.

Andrew_Cholakian1 · January 24, 2022, 2:52pm

Which version are you on? Are you on 7.0 or 7.16?

cctk · January 25, 2022, 9:27am

7.15.1

cctk · January 25, 2022, 10:10am

Yes I used metricbeat setup command.
I get this part but no error

fetching V2 controller: []string{"*****"} for pid 5465

I get the above command for awhile before I get normal logs again. where its collecting the metrics.

no errors in log file.
the clock on my server is in UTC

Andrew_Cholakian1 · January 25, 2022, 2:30pm

The issue here is probably one of the following:

Some incompatibility between a 6.x and a 7.x dashboard
Some issue where not all documents are indexed

If you're certain that docs are missing from all beats that points to 2, esp. since heartbeat doesn't have a dashboard.

Can you verify which beats you're actively using? @lucasfcosta and I are heartbeat experts, but if this is mostly a metricbeat issue you'll want to speak to a metricbeat expert.

cctk · January 26, 2022, 1:38pm

I have fixed the issue with the metricbeat dashboard thank you.

system · February 23, 2022, 3:39pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.