# Metricbeat not getting diskio

**URL:** <https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606>\
**Category:** Beats\
**Tags:** metricbeat\
**Created:** [October 9, 2020, 6:25pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606 "2020-10-09T18:25:51Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 6:25pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/1 "2020-10-09T18:25:51Z")

</div>

where can I see diskio for process and network traffic use by process?

I did load default template, running 7.9.1  
here is config file

```
- module: system
  period: 1m
  metricsets:
    - cpu
    - load
    - memory
    - network
    - process
    - process_summary
    - socket_summary
    - entropy
    - core
    - diskio
    #- socket
    - service
    - users
  process.include_top_n:
    by_cpu: 10 # include top 5 processes by CPU
    by_memory: 10 # include top 5 processes by memory

- module: system
  period: 5m
  metricsets:
    - filesystem
    - fsstat
  processors:
  - drop_event.when.regexp:
      system.filesystem.mount_point: '^/(sys|cgroup|proc|dev|etc|host|lib|snap)($|/)'

- module: system
  period: 15m
  metricsets:
    - uptime

```

Here is output of dd command that ran.

```
"_source": {
    "@timestamp": "2020-10-09T18:21:54.276Z",
    "service": {
      "type": "system"
    },
    "process": {
      "executable": "/usr/bin/dd",
      "args": [
        "dd",
        "if=/dev/sdb1",
        "of=/dev/null"
      ],
      "name": "dd",
      "pid": 36666,
      "ppid": 33543,
      "pgid": 36666,
      "working_directory": "/etc/metricbeat"
    },
    "event": {
      "duration": 310303583,
      "dataset": "system.process",
      "module": "system"
    },
    "metricset": {
      "name": "process",
      "period": 10000
    },
    "ecs": {
      "version": "1.5.0"
    },
    "system": {
      "process": {
        "fd": {
          "open": 3,
          "limit": {
            "soft": 1024,
            "hard": 4096
          }
        },
        "state": "running",
        "memory": {
          "size": 110604288,
          "rss": {
            "bytes": 753664,
            "pct": 0
          },
          "share": 675840
        },
        "cmdline": "dd if=/dev/sdb1 of=/dev/null",
        "cpu": {
          "start_time": "2020-10-09T18:21:48.000Z",
          "total": {
            "pct": 0,
            "norm": {
              "pct": 0
            },
            "value": 0
          }
        }
      }
    },
    "user": {
      "name": "root"
    },
    "agent": {
      "version": "7.9.1",
      "hostname": "elktst02",
      "ephemeral_id": "9c14dd0c-a5de-4627-8514-a0d68220dc3b",
      "id": "17eb491f-8a11-4e66-96e4-47cc8a86203c",
      "name": "houelktst02",
      "type": "metricbeat"
    },
    "host": {
      "name": "elktst02"
    }
  },
  "fields": {
    "system.process.cpu.start_time": [
      "2020-10-09T18:21:48.000Z"
    ],
    "@timestamp": [
      "2020-10-09T18:21:54.276Z"
    ]
  },
```

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [October 9, 2020, 7:08pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/2 "2020-10-09T19:08:30Z")

</div>

Hey @elasticforme,

I think there are currently no diskio metrics per process available. Only per disk. Imho it would be a nice addition.

Grtz

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 7:12pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/3 "2020-10-09T19:12:53Z")

</div>

> [@willemdh](#):
>
> disk

you mean currently metricbeat can only collect cpu,memory,fd for each process. nothing else?

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 7:17pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/4 "2020-10-09T19:17:03Z")

</div>

but this document says it should be there  
system.process.cgroup.blkio.total.bytes

[https://www.elastic.co/guide/en/beats/metricbeat/7.9/metricbeat-metricset-system-process.html](https://www.elastic.co/guide/en/beats/metricbeat/7.9/metricbeat-metricset-system-process.html)

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [October 9, 2020, 7:18pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/5 "2020-10-09T19:18:38Z")

</div>

Well I'd be suprised it's currently possible. Never seen those metrics in my data anyway. Also checking [https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-system-process.html](https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-system-process.html) I can't seem to find any info about it.

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 7:20pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/6 "2020-10-09T19:20:12Z")

</div>

same link it is there

```
"system": {
        "process": {
            "cgroup": {
                "blkio": {
                    "id": "docker.service",
                    "path": "/system.slice/docker.service",
                    "total": {
                        "bytes": 844576104448,
                        "ios": 54869430
                    }
                },
```

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [October 9, 2020, 7:22pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/7 "2020-10-09T19:22:43Z")

</div>

Did you try set:

`process.cgroups.enabled: true`

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 7:29pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/8 "2020-10-09T19:29:05Z")

</div>

> [@willemdh](#):
>
> process.cgroups.enabled: true

ok just added that restarted metricbeat. restarted same process. but no I still didn't got that cgroup. infact all the cgroup are empty.

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [October 9, 2020, 7:36pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/9 "2020-10-09T19:36:44Z")

</div>

Im not sure, but these cgroup metrics might be related to container metrics, I suggest we wait for someone from Elastic to confirm. Sry I cant help you further.

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [October 9, 2020, 7:38pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/10 "2020-10-09T19:38:31Z")

</div>

you might be right. just found this and it is close as well without any fix

[https://github.com/elastic/beats/issues/7461](https://github.com/elastic/beats/issues/7461)

Hopefully someone from ELK can confirm this.

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [October 9, 2020, 7:40pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/11 "2020-10-09T19:40:22Z")

</div>

+1'ed it, maybe the enhancement request can get reopened.

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [November 2, 2020, 1:49pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/12 "2020-11-02T13:49:25Z")

</div>

Added a comment in the GH issue to question the closure, hopefully someone of Elastic sees the added value.

---

<div class="post-metadata">

**Author:** ![elasticforme](https://avatars.discourse-cdn.com/v4/letter/e/f05b48/32.png) [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Post date:** [November 2, 2020, 6:24pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/13 "2020-11-02T18:24:20Z")

</div>

I also did +1 on that issue

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 30, 2020, 8:24pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-diskio/251606/14 "2020-11-30T20:24:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
