I am getting constantly the following errormessage in my metricbeat logs:
[elastic_agent.metricbeat][error] error getting cgroup stats for V2: error fetching stats for controller io: error fetching IO stats: error getting io.stats for path /hostfs/sys/fs/cgroup: error scanning file: /hostfs/sys/fs/cgroup/io.stat: input does not match format
Additionally I have trouble to get detailed io metrics from my docker containers using the docker integration.
As this is the only errormessage I see in the logs, I believe that this is thightly connected to each other.
However - when I run "docker stats" I do see all the stats for each container, but elastic agent / metricbeats is not able to pick these up and deliver themt to ES.
The host system is a raspberry pi 4:
$ uname -a Linux 5.15.76-v8+ #1597 SMP PREEMPT Fri Nov 4 12:16:41 GMT 2022 aarch64 GNU/Linux $ cat /etc/os-release PRETTY_NAME="Debian GNU/Linux 11 (bullseye)" NAME="Debian GNU/Linux" VERSION_ID="11" VERSION="11 (bullseye)" VERSION_CODENAME=bullseye ID=debian
I also doublechecked that the required cgroup controllers mapped and enabled:
$ cat /sys/fs/cgroup/cgroup.controllers cpuset cpu io memory pids
Additionally i verified that tie io.stat delivers informations:
$ cat /sys/fs/cgroup/io.stat 179:0 rbytes=1715794944 wbytes=2942546944 rios=36193 wios=353651 dbytes=0 dios=0 7:7 7:6 7:5 7:4 7:3 7:2 7:1 7:0 1:15 1:14 1:13 1:12 1:11 1:10 1:9 1:8 1:7 1:6 1:5 1:4 1:3 1:2 1:1 1:0
At this point I am running out of ideas what else could be wrong or missing.
Any ideas in the community?