How to collect performance data related to disk

Elastic Stack Beats
1

Hi,
I want to collect performance data related to disk into ELK,especially physical disk read/write,IOPs,Does anybody know which software or beat could work?
thanks so much.

2

I assume that is what you are looking for: https://github.com/elastic/beats/issues/422

3

I found a tools called collectl,which could collect a lot of performance counter,and work with filebeat to ELK.
but still a little bit inconvenient, expect that elastic would release a beat that could transfer to ELK directly.:relaxed:

4

@tuankun, Disk IO stats will go into Metricbeat. Here's a sample of what I'm thinking at the moment. I'm interested to know if these are all the fields that you need or is there something missing.


{
  "@timestamp": "2016-05-03T03:46:35.437Z",
  "beat": {
    "hostname": "b2bf7b803e9d",
    "name": "b2bf7b803e9d"
  },
  "metricset": "disk_io",
  "module": "system",
  "rtt": 38634,
  "system-disk_io": {
    "io_time": 2850,
    "name": "sda2",
    "read_bytes": 9211904,
    "read_count": 1639,
    "read_time": 1770,
    "write_bytes": 401596416,
    "write_count": 919,
    "write_time": 36900
  },
  "type": "metricsets"
}
5

@andrewkroh
Sorry,too late to reply you.
the above metrics are all I need.
In our production env,we pay more attention to the following performance metrics:

1.CPU overall:

  • CPU run queue
  • load average
  • CPU utilization
  • CPU user utilization
  • CPU system utilization
    (Total CPU utilization = CPU user utilization + CPU system utilization)

2.Memory overall:

  • Memory Utilization
  • swap utilization
  • swap in
  • swap out

3.by process:

  • CPU utilization
  • memory utilization

4.each pyscial disk and overall:

  • Disk utilization
  • phyiscal disk read request/second
  • phyiscal disk write request/second
  • total IO/s
    (total IO/s = phyiscal disk read request/second + phyiscal disk write request/second)

5.each Network interface :

  • KB in
  • KB out
  • network utilization.

English is not my native language,hope you could get the meaning.:grin:
if any doubt, let me know.

really appreciate you!~

6

if the tool you've been developing could collect above performnace metrics on windows 2003/2008/2012 and linux,that would be perfect!~:grin: