Loading iostat.disk, iostat.cpu, sar.disk, sar.cpu, etc file to Elasticsearch


#1

I got iostat.disk, iostat.cpu, sar.disk, sar.cpu, etc files captured from testing/production servers and I would like to analyze these data offline by loading into elasticsearch.
But I don't find option to load these files data directly into elasticsearch engine by using beats. Any suggestions please?

Sample iostat.disk file content:

06/24/2016 11:00:44 PM

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda
                  0.00     1.85    0.04    2.65     2.01   215.93   161.56     0.00    1.74    5.88    1.68   0.05   0.01
dm-0
                  0.00     0.00    0.01    0.04     0.13     0.63    32.47     0.00    0.47    2.19    0.26   0.10   0.00
dm-1
                  0.00     0.00    0.00    0.00     0.00     0.00     8.00     0.00    5.54    1.94    5.80   1.13   0.00
dm-2
                  0.00     0.00    0.00    0.10     0.01     1.81    34.66     0.00    1.27   13.06    1.21   0.03   0.00
dm-3
                  0.00     0.00    0.00    0.12     0.06     3.52    60.29     0.00    0.51    4.29    0.49   0.02   0.00
dm-4
                  0.00     0.00    0.00    0.86     0.00     4.90    11.46     0.00    0.02    6.63    0.02   0.01   0.00
dm-5
                  0.00     0.00    0.00    2.34     0.04    91.78    78.31     0.00    0.57    2.50    0.57   0.02   0.00
dm-6
                  0.00     0.00    0.04    1.04     1.76   113.28   212.86     0.00    3.46    6.43    3.36   0.07   0.01

06/24/2016 11:00:54 PM
Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda
                  0.00    33.20    0.00   32.20     0.00   898.80    55.83     0.00    0.14    0.00    0.14   0.02   0.08
dm-0
                  0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-1
                  0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2
                  0.00     0.00    0.00   17.80     0.00    82.40     9.26     0.00    0.07    0.00    0.07   0.01   0.02
dm-3
                  0.00     0.00    0.00    7.00     0.00   116.80    33.37     0.00    0.04    0.00    0.04   0.04   0.03
dm-4
                  0.00     0.00    0.00    4.20     0.00    34.00    16.19     0.00    0.02    0.00    0.02   0.02   0.01
dm-5
                  0.00     0.00    0.00    1.80     0.00     7.60     8.44     0.00    0.00    0.00    0.00   0.00   0.00
dm-6
                  0.00     0.00    0.00   34.60     0.00   658.00    38.03     0.01    0.17    0.00    0.17   0.01   0.04

06/24/2016 11:01:04 PM
Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda
                  0.00    10.10    0.00   11.70     0.00   761.60   130.19     0.00    0.11    0.00    0.11   0.02   0.02
dm-0
                  0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00

(ruflin) #2

It seems you are more looking for something like csv plugin in Logstash or CSV import in Kibana: https://www.elastic.co/guide/en/logstash/2.4/plugins-filters-csv.html

Metricbeat itself is directly shipping all these metrics to elasticsearch. It can't import manually exported data.


(system) #3

This topic was automatically closed after 21 days. New replies are no longer allowed.