Metricbeat not pulling logs from AWS CWAgent namespace

[sumeshms (Sumesh)]

Hello

I am trying to pull logs from AWS Cloudwatch metricset with the below configuration. Unfortunately no logs received at the metricbeat end.

- module: aws
  period: 300s
  access_key_id: 'xxxxxxx'
  secret_access_key: 'xxxxxxxxxx'
  default_region: 'me-south-1'
  metricsets:
    - cloudwatch
  metrics:
    - namespace: CWAgent
      statistic: "Average"
      name: "LogicalDisk % Free Space"
      dimensions:
      - name: instance
        value: C:
      - name: InstanceId
        value: i-xxxxxxxxxxx
      - name: ImageId
        value: ami-xxxxxxxxx
      - name: objectname
        value: LogicalDisk
      - name: InstanceType
        value: m5.large

Interesting fact is that the same parameters pull data from the the aws cli with same credentials!
Any thoughts ?

aws cloudwatch get-metric-statistics --namespace CWAgent  --metric-name  "LogicalDisk % Free Space"   --dimensions Name=instance,Value=C: Name=InstanceId,Value=i-xxxxxxx Name=ImageId,Value=ami-xxxxxxx Name=objectname,Value=LogicalDisk Name=InstanceType,Value=m5.large --start-time 2021-06-25T00:00:00Z   --end-time 2021-06-25T00:10:00Z  --period 300  --statistics Average

{
    "Label": "LogicalDisk % Free Space",
    "Datapoints": [
        {
            "Timestamp": "2021-06-25T00:00:00+00:00",
            "Average": 20.8502197265625,
            "Unit": "None"
        },
        {
            "Timestamp": "2021-06-25T00:05:00+00:00",
            "Average": 20.8502197265625,
            "Unit": "None"
        }
    ]
}

Any thoughts on this please? Thanks in advance.

Sumesh

[sumeshms (Sumesh)]

Finally it worked - the correct format of yml file is expained here - thanks

Metricbeat AWS Cloudwatch Agent Log-shipping (cloudcybersafe.com)